Details
Description
With TCOMP-253, the component framework can add business objects with common logic.
Component families can provide a FileFormatDefinition that represent how a record should be serialized to a filesystem.
This mechanism should be reused where it makes sense for serializing and sending individual records as a message:
- JSON and Avro are both formats that can be reused to send a record to a Kafka messaging system.
- Avro serializes differently depending on whether it's creating a file or an individual message.
- It doesn't make any sense to serialize a record in Parquet format, only files.
Attachments
Issue Links
- depends on
-
TCOMP-253
Add "extended" definitions to components-api, commons and service.
-
- Closed
-
- is related to
-
TCOMP-267
A component family can provide a new file system definition.
-
- Closed
-
- prerequisite of
-
TCOMP-1119
Unified FileSystem Datastore/Dataset definition to centralize all FS providers
-
- Rejected
-