Uploaded image for project: 'Talend Data Prep'
  1. Talend Data Prep
  2. TDP-5232

[tDataprepRun spark] DQ libs are not compatible between 2.4 winter and studio 651

Apply templateInsert Lucidchart Diagram
    XMLWordPrintable

Details

    • Bug
    • Status: closed
    • Critical
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      Using the stack integ (2.4 winter) and studio 651
      When the preparation contained a step like "delete invalid values", the job crashed

      org.talend.dataprep.actions.RemoteResourceGetter$RemoteConnectionException: Unable to retrieve dictionaries.
      	at org.talend.dataprep.actions.RemoteResourceGetter.retrieveDictionaries(RemoteResourceGetter.java:138)
      	at org.talend.dataprep.actions.resources.DictionaryFunctionResourceProvider.retrieveDictionaries(DictionaryFunctionResourceProvider.java:61)
      	at org.talend.dataprep.actions.resources.DictionaryFunctionResourceProvider.get(DictionaryFunctionResourceProvider.java:71)
      	at org.talend.dataprep.actions.StandalonePreparationFactory.lambda$create$1(StandalonePreparationFactory.java:90)
      	at java.util.stream.ReferencePipeline$3$1.accept(Unknown Source)
      	at java.util.Spliterators$ArraySpliterator.forEachRemaining(Unknown Source)
      	at java.util.stream.AbstractPipeline.copyInto(Unknown Source)
      	at java.util.stream.AbstractPipeline.wrapAndCopyInto(Unknown Source)
      	at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(Unknown Source)
      	at java.util.stream.AbstractPipeline.evaluate(Unknown Source)
      	at java.util.stream.ReferencePipeline.collect(Unknown Source)
      	at org.talend.dataprep.actions.StandalonePreparationFactory.create(StandalonePreparationFactory.java:91)
      	at org.talend.dataprep.actions.StandalonePreparationFactory.create(StandalonePreparationFactory.java:75)
      	at org.talend.dataprep.actions.DefaultActionParser.internalParse(DefaultActionParser.java:82)
      	at org.talend.dataprep.actions.DefaultActionParser.parse(DefaultActionParser.java:94)
      	at local_project.dataprep_customregex_0_1.dataprep_customRegex.tFixedFlowInput_1Process(dataprep_customRegex.java:1405)
      	at local_project.dataprep_customregex_0_1.dataprep_customRegex.run(dataprep_customRegex.java:1753)
      	at local_project.dataprep_customregex_0_1.dataprep_customRegex.runJobInTOS(dataprep_customRegex.java:1676)
      	at local_project.dataprep_customregex_0_1.dataprep_customRegex.main(dataprep_customRegex.java:1564)
      Caused by: java.lang.ClassNotFoundException: org.talend.dataquality.semantic.broadcast.DQCategoryForValidation
      	at java.net.URLClassLoader.findClass(Unknown Source)
      

      Currently, data prep 2.4 winter used dq libs 5.0.0, but studio 651 used dq libs 4.0.1

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              jidu Jixiao Du
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: