Uploaded image for project: 'Talend Component Kit'
  1. Talend Component Kit
  2. TCOMP-2111

[Runtime convergence] : Join connector fails in cloud environment with hybrid tck/beam connectors

Apply templateInsert Lucidchart DiagramXMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Critical Critical
    • 1.45.0
    • None
    • api, beam
    • All
    • Hide

      Base work is here but may need to be refined.
      Shouldn't influence or have regression on it... 

      Show
      Base work is here but may need to be refined. Shouldn't influence or have regression on it... 
    • Small

      When tryiing to execute a pipeline with join connector on fileio the execution fails with

      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: Caused by: java.lang.IllegalStateException: Native beam components don't support Talend Component Kit API
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.sdk.component.runtime.beam.spi.BeamComponentExtension$LazyComponentHandler.invoke(BeamComponentExtension.java:173) ~[component-runtime-beam-1.40.0.jar:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at com.sun.proxy.$Proxy128.create(Unknown Source) ~[?:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.sdk.component.runtime.manager.service.ProducerFinderImpl.find(ProducerFinderImpl.java:51) ~[component-runtime-manager-1.40.0.jar:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.components.processing.functions.join.LookupDatasetConfiguration.buildIterator(LookupDatasetConfiguration.java:41) ~[?:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.components.processing.functions.join.JoinBuilder.lambda$recordFinderFunction$0(JoinBuilder.java:47) ~[?:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.components.processing.functions.join.finder.IteratorFinder.init(IteratorFinder.java:35) ~[?:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.components.processing.functions.join.finder.IteratorFinder.search(IteratorFinder.java:42) ~[?:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.components.processing.functions.join.JoinBuilder.lambda$recordFinderFunction$1(JoinBuilder.java:50) ~[?:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.components.processing.functions.join.Join.transform(Join.java:48) ~[?:?]
      [2022-02-01 14:51:43,615] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.components.processing.functions.FunctionProcessor.onElement(FunctionProcessor.java:76) ~[?:?]
      [2022-02-01 14:51:43,616] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_292]
      [2022-02-01 14:51:43,616] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_292]
      [2022-02-01 14:51:43,616] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_292]
      [2022-02-01 14:51:43,616] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_292]
      [2022-02-01 14:51:43,616] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.sdk.component.runtime.base.LifecycleImpl.doInvoke(LifecycleImpl.java:83) ~[component-runtime-impl-1.40.0.jar:?]
      [2022-02-01 14:51:43,616] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.sdk.component.runtime.output.ProcessorImpl.onNext(ProcessorImpl.java:266) ~[component-runtime-impl-1.40.0.jar:?]
      [2022-02-01 14:51:43,616] [INFO ] o.a.l.u.LineBufferedStream - stdout: 	at org.talend.sdk.component.runtime.beam.BaseProcessorFn.processElement(BaseProcessorFn.java:103) ~[component-runtime-beam-1.40.0.jar:?]
      

      also

      [2022-02-01 14:51:36,031] [INFO ] o.a.l.u.LineBufferedStream - stdout: [2022-02-01T14:51:36,031] [WARN ] o.t.s.c.r.b.s.BeamComponentExtension - Creating a 'interface org.talend.sdk.component.runtime.input.Mapper' instance for 'LocalStorage#LocalStorageInput', this must be unwrapped before being used
      [2022-02-01 14:51:36,037] [INFO ] o.a.l.u.LineBufferedStream - stdout: [2022-02-01T14:51:36,036] [INFO ] o.t.d.b.c.BeamCompiler - Tacokit component runtime: WrapperInputPTransform
      

            emmanuel_g emmanuel gallois
            emmanuel_g emmanuel gallois
            emmanuel gallois
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

              Created:
              Updated:
              Resolved: