Uploaded image for project: 'Talend Component Kit'
  1. Talend Component Kit
  2. TCOMP-2568

[internal] memory leak for component server

Apply templateInsert Lucidchart Diagram
    XMLWordPrintable

Details

    • Work Item
    • Resolution: Done
    • Major
    • 1.63.0
    • None
    • component-server
    • None
    • All
    • Hide

      Research led to some new ticket to improve performance and monitor it. 
      As it is the research is done, the ticket can be closed.

      Show
      Research led to some new ticket to improve performance and monitor it.  As it is the research is done, the ticket can be closed.
    • GreenHopper Ranking:
      0|i2udkz:
    • 9223372036854775807
    • Small

    Description

      Since few weeks, we remove component server from Cloud engine deployment and we are using only two instances for the all cluster (deployed in the multi-tenant namespace).

      With the default ressources configuration, 1G of memory, the number of restart of this service due to OOMKilled is big - like almost 100 restart for a couple of days.

      I bump to 2g for the request memory but we still have the same pattern, even if we have less restart.

      You can see in the screenshot the behavior of the service in terms of memory consumption.

      I guess a Thread dump could be a first option to analyze the memory usage before the restart of the service.

      Attachments

        1. .env
          2 kB
        2. Capture d’écran 2023-11-14 à 14.17.07.png
          Capture d’écran 2023-11-14 à 14.17.07.png
          124 kB
        3. Capture d’écran 2023-11-14 à 15.19.41.png
          Capture d’écran 2023-11-14 à 15.19.41.png
          142 kB
        4. docker-compose.yml
          14 kB
        5. hikari-pool-threads-2023-11-21_16-39.png
          hikari-pool-threads-2023-11-21_16-39.png
          402 kB
        6. image (2).png
          image (2).png
          113 kB
        7. image (3).png
          image (3).png
          35 kB
        8. postman_collection.DataGenerator.json
          3 kB
        9. postman_collection.MySql.json
          7 kB
        10. postman_collection.SFTP.json
          3 kB
        11. postman_collection.Snowflake.json
          8 kB
        12. postman_collection.Tacokit.json
          6 kB
        13. workspace.postman_globals_nopass.json
          2 kB

        Issue Links

          Activity

            People

              Unassigned Unassigned
              aleboulanger Aurélien Leboulanger
              Axel Catoire, emmanuel gallois, Fabien Desiles
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: