Uploaded image for project: 'Talend Component Kit'
  1. Talend Component Kit
  2. TCOMP-2111

[Runtime convergence] : Join connector fails in cloud environment with hybrid tck/beam connectors

Apply templateInsert Lucidchart Diagram
    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Critical
    • 1.45.0
    • None
    • api, beam

    Description

      When tryiing to execute a pipeline with join connector on fileio the execution fails with

      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: Caused by: java.lang.IllegalStateException: Native beam components don't support Talend Component Kit API
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.sdk.component.runtime.beam.spi.BeamComponentExtension$LazyComponentHandler.invoke(BeamComponentExtension.java:173) ~[component-runtime-beam-1.40.0.jar:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at com.sun.proxy.$Proxy128.create(Unknown Source) ~[?:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.sdk.component.runtime.manager.service.ProducerFinderImpl.find(ProducerFinderImpl.java:51) ~[component-runtime-manager-1.40.0.jar:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.components.processing.functions.join.LookupDatasetConfiguration.buildIterator(LookupDatasetConfiguration.java:41) ~[?:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.components.processing.functions.join.JoinBuilder.lambda$recordFinderFunction$0(JoinBuilder.java:47) ~[?:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.components.processing.functions.join.finder.IteratorFinder.init(IteratorFinder.java:35) ~[?:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.components.processing.functions.join.finder.IteratorFinder.search(IteratorFinder.java:42) ~[?:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.components.processing.functions.join.JoinBuilder.lambda$recordFinderFunction$1(JoinBuilder.java:50) ~[?:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.components.processing.functions.join.Join.transform(Join.java:48) ~[?:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.components.processing.functions.FunctionProcessor.onElement(FunctionProcessor.java:76) ~[?:?]
      [2022-02-01 14:51:43,616] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_292]
      [2022-02-01 14:51:43,616] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_292]
      [2022-02-01 14:51:43,616] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_292]
      [2022-02-01 14:51:43,616] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_292]
      [2022-02-01 14:51:43,616] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.sdk.component.runtime.base.LifecycleImpl.doInvoke(LifecycleImpl.java:83) ~[component-runtime-impl-1.40.0.jar:?]
      [2022-02-01 14:51:43,616] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.sdk.component.runtime.output.ProcessorImpl.onNext(ProcessorImpl.java:266) ~[component-runtime-impl-1.40.0.jar:?]
      [2022-02-01 14:51:43,616] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.sdk.component.runtime.beam.BaseProcessorFn.processElement(BaseProcessorFn.java:103) ~[component-runtime-beam-1.40.0.jar:?]
      

      also

      [2022-02-01 14:51:36,031] [INFO ] o.a.l.u.LineBufferedStream - stdout: [2022-02-01T14:51:36,031] [WARN ] o.t.s.c.r.b.s.BeamComponentExtension - Creating a 'interface org.talend.sdk.component.runtime.input.Mapper' instance for 'LocalStorage#LocalStorageInput', this must be unwrapped before being used
      [2022-02-01 14:51:36,037] [INFO ] o.a.l.u.LineBufferedStream - stdout: [2022-02-01T14:51:36,036] [INFO ] o.t.d.b.c.BeamCompiler - Tacokit component runtime: WrapperInputPTransform
      

      Attachments

        Issue Links

          Activity

            People

              emmanuel_g emmanuel gallois
              emmanuel_g emmanuel gallois
              emmanuel gallois
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: