Details
-
New Feature
-
Resolution: Fixed
-
Minor
-
None
-
None
-
None
-
All
-
GreenHopper Ranking:0|i0yb77:
-
9223372036854775807
-
Small
Description
When SimpleFileIoInput is configured to use the CSV format, only a split with the given separator is done. If values were actually escaped with double quotes, then SimpleFileIoInput outputs them as they are with their surronding double quotes.
That causes functional issues with DataPrep (through the DataPrepRun component) since actions involving the dictionary almost all actions cannot work correctly because of those double quotes.
The SimpleFileIoInput should handle the CSV parsing according to the CSV standard and un-escape values if necessary (or if the component is configured to do so).
Same applies to the SimpleFileIoOutput that could be able to escape values according to the CSV standard if needed, or requested through the component configuration.