Uploaded image for project: 'Talend Component Kit'
  1. Talend Component Kit
  2. TCOMP-2005

Non defined columns appear in schema

Apply templateInsert Lucidchart Diagram
    XMLWordPrintable

Details

    • Hide

      The column should be defined as the primary key.

      Show
      The column should be defined as the primary key.
    • All
    • Small

    Description

      TCK connectors are received non-defined columns in the schema when the primary key was declared on the Studio side. Component runtime doesn't filter them out.


      It happens during the "inferSchema"
      https://github.com/Talend/component-runtime/blob/42034d4757009efd1957e228ff2e4fd66e09014b/component-studio/component-runtime-di/src/main/java/org/talend/sdk/component/runtime/di/record/DiRowStructVisitor.java#L211-L213

      ============================================

      Suggestion:
      We can mark generated fields in rowStruct classes with "special" annotation to be able to filter out those kinds of fields.
      @AuxilaryField - or smth like that.
      The annotation should be reachable for studio and components runtime.

      Attachments

        1. NotDefinedColumnsInSchema_inferSchema.PNG
          107 kB
          Oleksandr Zhelezniak
        2. NotDefinedColumnsInSchema_rowStruct.PNG
          86 kB
          Oleksandr Zhelezniak
        3. NotDefinedColumnsInSchema.png
          93 kB
          Oleksandr Zhelezniak

        Issue Links

          Activity

            People

              emmanuel_g emmanuel gallois
              ozhelezniak Oleksandr Zhelezniak
              emmanuel gallois
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: