Uploaded image for project: 'Talend Component Kit'
  1. Talend Component Kit
  2. TCOMP-1119

Unified FileSystem Datastore/Dataset definition to centralize all FS providers

Apply templateInsert Lucidchart Diagram
    XMLWordPrintable

Details

    • New Feature
    • Resolution: Canceled
    • Major
    • 0.1.0
    • None
    • None
    • All
    • 0.18.0
    • GreenHopper Ranking:
      0|i0we2r:
    • 9223372036854775807
    • Small
    • 8
    • Waiting on Internal Information

    Description

      Beam is moving to an unified Filesystem runtime definition allowing all input/output connectors to transparently read/write to CloudFS providers (S3, Google Storage, Azure BlobStorage) or local and HDFS-compliant filesystems
      Idea is to support the same pattern for the Datastore / Dataset definitions in TCOMP

      DatastoreDefinition will let the user choose the FS provider
      DatasetDefinition will be relative common to all of them with a path (potentially within a bucket)

      Attachments

        Issue Links

          depends on

          New Feature - TCOMP-267 A component family can provide a new file system definition.

          • Major - There are major errors in a system function. However, the error situation is not critical. The customer's business may be impaired by it.
          • Closed

          New Feature - TCOMP-268 A component family can provide a new file/record format definition.

          • Major - There are major errors in a system function. However, the error situation is not critical. The customer's business may be impaired by it.
          • Closed
          is duplicated by

          New Feature - TCOMP-459 Rest API : Add missing endpoint for export wizard

          • Critical - The customer's production system is in a critical error situation. Basic functions of the supported software are not usable. The consequences can have a serious impact on the customer's business. This is the highest error category for issues arising outside of production systems.
          • Closed
          prerequisite of

          New Feature - TCOMP-458 Add some semantic to have the filesystem/format notion for IO components and web service

          • Critical - The customer's production system is in a critical error situation. Basic functions of the supported software are not usable. The consequences can have a serious impact on the customer's business. This is the highest error category for issues arising outside of production systems.
          • Closed

          Activity

            People

              sgandon sebastien gandon
              tfion Thomas Fion
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: