Uploaded image for project: 'Talend Data Prep'
  1. Talend Data Prep
  2. TDP-4069

FullRun Streams Failure brings to inconsistent state

Apply templateInsert Lucidchart Diagram
    XMLWordPrintable

Details

    • Bug
    • Status: Rejected
    • Major
    • Resolution: Cannot Reproduce
    • None
    • None
    • None
    • All
    • EE
    • Small

    Description

      Using Galting on a simple scenario, a preparation comes to a broken state, that there's no ExportHistory at all, and any further FullRun fails. What is interesting here is not that Gatling is used, but rather that a preparation comes to an inconsistent state.
      The scenario is:

      • Create a hdfs dataset
      • Create a preparation on it
      • Apply an UpperCase action
      • Export the full dataset to hdfs

      Then, on the 2 first GET

      /gateway/api/export/async/${prepId}/history

      , the result is:
      1- NEW
      2- FAILED

      Here is the second request and response as it fails:

      =========================
      HTTP request:
      GET http://10.42.150.110:9999/gateway/api/export/async/23c6e65a-5d6b-490d-b986-b2f9fedb4654/history
      headers=
      Origin: http://10.42.150.110
      Accept: text/html,application/xhtml+xml,application/xml;q=0.9,image/webp,*/*;q=0.8
      Content-Type: application/json
      DNT: 1
      Referer: http://10.42.150.110:9999/
      Cookie: TDPSESSION=node0hpd26n8yaft1g3nkq6t8fuk75.node0
      Connection: keep-alive
      Host: 10.42.150.110:9999
      =========================
      HTTP response:
      status=
      200 OK
      headers= 
      Date: [Thu, 22 Jun 2017 13:27:50 GMT, Thu, 22 Jun 2017 13:27:50 GMT]
      X-Content-Type-Options: [nosniff]
      X-XSS-Protection: [1; mode=block]
      Cache-Control: [no-cache, no-store, must-revalidate]
      Pragma: [no-cache]
      Expires: [0]
      X-Frame-Options: [DENY]
      X-Application-Context: [application:server-standalone:9999]
      Access-Control-Allow-Origin: [http://10.42.150.110]
      Vary: [Origin]
      Access-Control-Expose-Headers: [Authorization]
      Access-Control-Allow-Credentials: [true]
      Content-Type: [application/json;charset=utf-8]
      Transfer-Encoding: [chunked]
      
      body=
      [{"group":"23c6e65a-5d6b-490d-b986-b2f9fedb4654","id":"23c6e65a-5d6b-490d-b986-b2f9fedb4654-6599a968-afa3-4451-9ed5-00258713e290","time":{"creation":1498138067426,"start":1498138067428,"end":1498138067651},"status":"FAILED","error":["org.talend.dataprep.exception.error.CommonErrorCodes","UNEXPECTED_EXCEPTION"],"userId":"40","tenantId":"none","user":"Nicolas2 Talend"}]
      

      Attached, the associated logs on TDP side TDP_logs.log.

      Then, once this occured, opening the preparation in the GUI, there's no export history at all, and it's impossible to run any new export https://screencast.com/t/3rPAgbu8JiW

      Attachments

        1. 2017-06-22_1616.png
          2017-06-22_1616.png
          295 kB
        2. dumpMongo_TDP-4069.zip
          63 kB
        3. TDP_logs.log
          97 kB

        Issue Links

          Activity

            People

              Unassigned Unassigned
              nlegeay Nicolas Legeay
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: