Uploaded image for project: 'Talend DI components'
  1. Talend DI components
  2. TDI-44874

Performance degradation after applying latest patch

Apply templateInsert Lucidchart Diagram
    XMLWordPrintable

Details

    • Bug
    • Status: Done
    • Critical
    • Resolution: Fixed
    • None
    • 7.3.1-R2020-09, 8.0.1
    • None
    • None

    Description

      Studio on Windows machines has a huge performance degradation in output components after applying latest patches. With component-runtime 1.1.23 performance of neo4jv4 output component was about 5-6k records per second for a million records. After applying patch with component-runtime 1.1.24 the performance has dropped down to 500-700 records per second. 

      After some investigation I've discovered that the problem is in records conversion. For 100k records it took about 146 seconds out of total 174 seconds the job has worked.

      Attachments

        1. 100kRecords1_1_24.PNG
          100kRecords1_1_24.PNG
          12 kB
        2. 1mlnRecordsOutput.PNG
          1mlnRecordsOutput.PNG
          23 kB
        3. screenshot-1.png
          screenshot-1.png
          121 kB

        Issue Links

          Activity

            People

              pteyssier pierre teyssier
              dchmyga Dmytro Chmyga (Inactive)
              emmanuel gallois, Liang Xia, Wei Yuan
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: