Uploaded image for project: 'Talend Data Prep'
  1. Talend Data Prep
  2. TDP-9985

[RunConv][Backend] Provide download link for run history (direct export to file)

Apply templateInsert Lucidchart Diagram
    XMLWordPrintable

Details

    • 2

    Description

      As a Data Preparation user,
      I want to download the result file of a preparation full run from the history page (when exporting directly to a file),
      in order to retrieve the result of my preparation for further usage without creating a dataset (similar usage as in current legacy mode).

      [backend API part]

      Scope: Runs in Runtime Convergence mode

      • For direct export to a file without selecting a dataset as destination
      • For datasets => implemented in TDP-9974
      • For legacy runs => implemented in TDP-9964

      Why?

      A new run history API in Preparation V2 now provides the list of runs for a preparation both in legacy mode and runtime convergence mode.

      Data Preparation backend needs to provide a download link to access it from the frontend (Run history page).

      How ?

      Implement /transform/preparations/{preparationId}/runs/{runId}/content endpoint (see API Designer spec) on runtime convergence mode

      • For direct export to a file without selecting a dataset as destination => store file on MinIO and return a presigned URL
      • See how to generate presigned URL (use AmazonS3.generatePresignedURL(...))
      • Set expiration time to 1H (odubois See dataset policy?)

      Inputs

      Attachments

        Issue Links

          Activity

            People

              eguillossou Erwan Guillossou
              odubois Olivier Dubois
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: