Uploaded image for project: 'Talend Component Kit'
  1. Talend Component Kit
  2. TCOMP-2568

[internal] memory leak for component server

Apply templateInsert Lucidchart Diagram
    XMLWordPrintable

Details

    • Work Item
    • Resolution: Done
    • Major
    • 1.63.0
    • None
    • component-server
    • None
    • All
    • Hide

      Research led to some new ticket to improve performance and monitor it. 
      As it is the research is done, the ticket can be closed.

      Show
      Research led to some new ticket to improve performance and monitor it.  As it is the research is done, the ticket can be closed.
    • GreenHopper Ranking:
      0|i2udkz:
    • 9223372036854775807
    • Small

    Description

      Since few weeks, we remove component server from Cloud engine deployment and we are using only two instances for the all cluster (deployed in the multi-tenant namespace).

      With the default ressources configuration, 1G of memory, the number of restart of this service due to OOMKilled is big - like almost 100 restart for a couple of days.

      I bump to 2g for the request memory but we still have the same pattern, even if we have less restart.

      You can see in the screenshot the behavior of the service in terms of memory consumption.

      I guess a Thread dump could be a first option to analyze the memory usage before the restart of the service.

      Attachments

        1. .env
          2 kB
          Axel Catoire
        2. Capture d’écran 2023-11-14 à 14.17.07.png
          124 kB
          Aurélien Leboulanger
        3. Capture d’écran 2023-11-14 à 15.19.41.png
          142 kB
          Aurélien Leboulanger
        4. docker-compose.yml
          14 kB
          Axel Catoire
        5. hikari-pool-threads-2023-11-21_16-39.png
          402 kB
          emmanuel gallois
        6. image (2).png
          113 kB
          Axel Catoire
        7. image (3).png
          35 kB
          Axel Catoire
        8. postman_collection.DataGenerator.json
          3 kB
          Axel Catoire
        9. postman_collection.MySql.json
          7 kB
          Axel Catoire
        10. postman_collection.SFTP.json
          3 kB
          Axel Catoire
        11. postman_collection.Snowflake.json
          8 kB
          Axel Catoire
        12. postman_collection.Tacokit.json
          6 kB
          Axel Catoire
        13. workspace.postman_globals_nopass.json
          2 kB
          Axel Catoire

        Issue Links

          Activity

            People

              Unassigned Unassigned
              aleboulanger Aurélien Leboulanger
              Axel Catoire, emmanuel gallois, Fabien Desiles
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: