tBigQueryOutput Exception in thread "Thread-1" java.lang.OutOfMemoryError: Required array size too large

Hi all,

I develop an ETL pipeline with TOS 8. Pipeline read from SQL Server and write to Google BigQuery with tBigQueryOutput but I received this error:

Exception in thread "Thread-1" java.lang.OutOfMemoryError: Required array size too large

at java.base/java.nio.file.Files.readAllBytes(Files.java:3212)

at lov_poc.job_skuitemtag_1_1.Job_SkuItemTag.tDBInput_1Process(Job_SkuItemTag.java:11010)

at lov_poc.job_skuitemtag_1_1.Job_SkuItemTag.tDBConnection_1Process(Job_SkuItemTag.java:1005)

at lov_poc.job_skuitemtag_1_1.Job_SkuItemTag$2.run(Job_SkuItemTag.java:21841)

Here the flow details:

The CSV is correctly written on the local file system (5GB) but is not copied to Google Cloud Storage.

The same process is correctly execute by TOS 7.3.

My JVM:

has anyone had the same problem?

Here my post in Talend Community with all attempts to resolve the problem.

Thank you,

Federico