Uploaded image for project: 'Talend Component Kit'
  1. Talend Component Kit
  2. TCOMP-2568

[internal] memory leak for component server

Apply templateInsert Lucidchart DiagramXMLWordPrintable

    • Icon: Work Item Work Item
    • Resolution: Done
    • Icon: Major Major
    • 1.63.0
    • None
    • component-server
    • None
    • All
    • Hide

      Research led to some new ticket to improve performance and monitor it. 
      As it is the research is done, the ticket can be closed.

      Show
      Research led to some new ticket to improve performance and monitor it.  As it is the research is done, the ticket can be closed.
    • GreenHopper Ranking:
      0|i2udkz:
    • 9223372036854775807
    • Small

      Since few weeks, we remove component server from Cloud engine deployment and we are using only two instances for the all cluster (deployed in the multi-tenant namespace).

      With the default ressources configuration, 1G of memory, the number of restart of this service due to OOMKilled is big - like almost 100 restart for a couple of days.

      I bump to 2g for the request memory but we still have the same pattern, even if we have less restart.

      You can see in the screenshot the behavior of the service in terms of memory consumption.

      I guess a Thread dump could be a first option to analyze the memory usage before the restart of the service.

        1. .env
          2 kB
        2. Capture d’écran 2023-11-14 à 14.17.07.png
          Capture d’écran 2023-11-14 à 14.17.07.png
          124 kB
        3. Capture d’écran 2023-11-14 à 15.19.41.png
          Capture d’écran 2023-11-14 à 15.19.41.png
          142 kB
        4. docker-compose.yml
          14 kB
        5. hikari-pool-threads-2023-11-21_16-39.png
          hikari-pool-threads-2023-11-21_16-39.png
          402 kB
        6. image (2).png
          image (2).png
          113 kB
        7. image (3).png
          image (3).png
          35 kB
        8. postman_collection.DataGenerator.json
          3 kB
        9. postman_collection.MySql.json
          7 kB
        10. postman_collection.SFTP.json
          3 kB
        11. postman_collection.Snowflake.json
          8 kB
        12. postman_collection.Tacokit.json
          6 kB
        13. workspace.postman_globals_nopass.json
          2 kB

            Unassigned Unassigned
            aleboulanger Aurélien Leboulanger
            Axel Catoire, emmanuel gallois, Fabien Desiles
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

              Created:
              Updated:
              Resolved: