Uploaded image for project: 'Talend Component Kit'
  1. Talend Component Kit
  2. TCOMP-2831

Provide a checkpointing API/solution for sources

Apply templateInsert Lucidchart Diagram
    XMLWordPrintable

Details

    • All
    • GreenHopper Ranking:
      0|i2z90j:
    • 9223372036854775807
    • Small
    • To be defined

    Description

      Goal of this task is to enable Talend Component Kit components to use checkpointing.
      The idea is to be able to snapshot the current iteration state from time to time (each N records for instance) and if the job fails and is relaunched to start back from that state.

      It must provide a "give state for component X" and "store state for component X" API in jobs (usable in Talend Component Kit javajet).

      Side note: solution can use the file system but must work for standalone and TIPAAS jobs - relaunch being likely the challenge.

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            emmanuel_g emmanuel gallois
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: