Uploaded image for project: 'Talend Component Kit'
  1. Talend Component Kit
  2. TCOMP-407

SimpleFileIo components should parse/write CSV files according to the CSV standard

Apply templateInsert Lucidchart Diagram
    XMLWordPrintable

Details

    • New Feature
    • Resolution: Fixed
    • Minor
    • 0.17.0
    • None
    • None
    • None
    • All
    • GreenHopper Ranking:
      0|i0yb77:
    • 9223372036854775807
    • Small

    Description

      When SimpleFileIoInput is configured to use the CSV format, only a split with the given separator is done. If values were actually escaped with double quotes, then SimpleFileIoInput outputs them as they are with their surronding double quotes.

      That causes functional issues with DataPrep (through the DataPrepRun component) since actions involving the dictionary almost all actions cannot work correctly because of those double quotes.

      The SimpleFileIoInput should handle the CSV parsing according to the CSV standard and un-escape values if necessary (or if the component is configured to do so).
      Same applies to the SimpleFileIoOutput that could be able to escape values according to the CSV standard if needed, or requested through the component configuration.

      Attachments

        Activity

          People

            rskraba Ryan Skraba
            psouvanlasy Prada Souvanlasy
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: