Details
-
Bug
-
Status: closed
-
Critical
-
Resolution: Fixed
-
None
-
All
-
Sprint 21 TDP, Sprint 22 TDP, Sprint 23 TDP (feb 26), Sprint 24 TDP (mar 19)
-
-
Small
Description
When running performance on master version with 10 users making different actions during around 1 hour, I got many errors 500 in middle/end of the run.
Looking into logs I've found errors about Service unavailable on 3 kind of actions : lookup, fetchMore and Fullrun.
Here are the extracts of the logs for the lookup :
2017-11-20 10:01:18.560 ERROR [user a4178003-1b51-4da9-bc62-511c228f4717] 2612 --- [managedTaskEngine-1] o.t.d.t.a.c.CompileDataSetRowAction : Unable to use action 'lookup' due to unexpected error. ... org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'dataSetLookupRowMatcher': Invocation of init method failed; nested exception is org.talend.dataprep.exception.TDPException: Unable to retrieve dataset content at org.springframework.beans.factory.annotation.InitDestroyAnnotationBeanPostProcessor.postProcessBeforeInitialization(InitDestroyAnnotationBeanPostProcessor.java:137) ~[spring-beans-4.3.7.RELEASE.jar:4.3.7.RELEASE] ... Caused by: org.talend.dataprep.exception.TDPException: Unable to retrieve dataset content at org.talend.dataprep.command.dataset.DataSetGet.lambda$new$116(DataSetGet.java:65) ~[dataprep-backend-service-2.3.0-SNAPSHOT.jar:na] ... Caused by: org.talend.dataprep.exception.TDPException: Service Unavailable at org.talend.dataprep.exception.ExceptionsConfiguration$ExceptionsConversions.lambda$doWith$137(ExceptionsConfiguration.java:86) ~[dataprep-backend-service-2.3.0-SNAPSHOT.jar:na] ...
For a fullrun :
2017-11-20 09:42:38.792 INFO [user a4178003-1b51-4da9-bc62-511c228f4717] 2612 --- [managedTaskEngine-5] t.d.f.e.PreparationFullRunExportStrategy : Asynchronous export for ExportParameters{exportType='CSV', preparationId='8cfd039b-9fcf-4a4b-b7b7-c5815d3406b8', stepId='$lastStepId', datasetId='912248fc-dcad-4e1e-947d-ee3eaa092821', from='null', exportName='Test_user7@dataprep.com-37 PREPARATION', arguments={exportParameters.fileName=Test_user7@dataprep.com-37 PREPARATION, exportParameters.csvSeparator=;}, filter=null} ended. 2017-11-20 09:42:38.796 ERROR [user a4178003-1b51-4da9-bc62-511c228f4717] 2612 --- [managedTaskEngine-5] o.t.d.async.SimpleManagedTaskExecutor : Execution 8cfd039b-9fcf-4a4b-b7b7-c5815d3406b8-b40dd27b-264f-4fc5-becb-852880de7cd9 finished with error. ... org.talend.dataprep.exception.TDPException: Sorry an unexpected error occurred and we could not complete your last operation, but you can keep using Data Preparation ... Caused by: org.talend.dataprep.exception.TDPException: Unable to retrieve dataset content ... Caused by: org.talend.dataprep.exception.TDPException: Service Unavailable ...
For a fetch more :
2017-11-20 09:37:19.454 INFO [user 61478569-7d2c-4934-9fbb-8e5ec39ce977] 2612 --- [managedTaskEngine-1] o.t.d.t.s.sample.FilterSamplingStrategy : Sampling for preparation ... 2017-11-20 09:37:19.457 ERROR [user 61478569-7d2c-4934-9fbb-8e5ec39ce977] 2612 --- [managedTaskEngine-1] o.t.d.async.SimpleManagedTaskExecutor : Execution 61478569-7d2c-4934-9fbb-8e5ec39ce977-ed7340f7-74a8-435f-af7c-0f1cbef6000d-61f48a4d-f5de-4719-9238-e6b8d200cf8e finished with error. ... org.talend.dataprep.exception.TDPException: Sorry an unexpected error occurred and we could not complete your last operation, but you can keep using Data Preparation at org.talend.dataprep.transformation.service.sample.FilterSamplingStrategy.sample(FilterSamplingStrategy.java:117) ~[dataprep-ee-transformation-2.3.0-SNAPSHOT-lib.jar:na] ... Caused by: org.talend.dataprep.exception.TDPException: Unable to retrieve dataset content at org.talend.dataprep.command.dataset.DataSetGet.lambda$new$116(DataSetGet.java:65) ~[dataprep-backend-service-2.3.0-SNAPSHOT.jar:na] ... Caused by: org.talend.dataprep.exception.TDPException: Service Unavailable at org.talend.dataprep.exception.ExceptionsConfiguration$ExceptionsConversions.lambda$doWith$137(ExceptionsConfiguration.java:86) ~[dataprep-backend-service-2.3.0-SNAPSHOT.jar:na]
Don't know if it's linked but I also had 59 errors of type
Here is the log of the error and it seems to happen after dataset creation, preparation creation, data sampling, async export... a little bit everywhere in the logs in fact :
2017-11-20 09:42:53.142 WARN [user ] 2612 --- [SimpleAsyncTaskExecutor-382] o.t.dataprep.security.RunAsTaskExecutor : Error when running java.lang.IllegalArgumentException: Cannot dispatch without an AsyncContext at org.springframework.util.Assert.notNull(Assert.java:134) ~[spring-core-4.3.7.RELEASE.jar:4.3.7.RELEASE] at org.springframework.web.context.request.async.StandardServletAsyncWebRequest.dispatch(StandardServletAsyncWebRequest.java:122) ~[spring-web-4.3.7.RELEASE.jar:4.3.7.RELEASE] at org.springframework.web.context.request.async.WebAsyncManager.setConcurrentResultAndDispatch(WebAsyncManager.java:353) ~[spring-web-4.3.7.RELEASE.jar:4.3.7.RELEASE] at org.springframework.web.context.request.async.WebAsyncManager.access$200(WebAsyncManager.java:58) ~[spring-web-4.3.7.RELEASE.jar:4.3.7.RELEASE] at org.springframework.web.context.request.async.WebAsyncManager$4.run(WebAsyncManager.java:324) ~[spring-web-4.3.7.RELEASE.jar:4.3.7.RELEASE] at org.talend.dataprep.security.RunAsTaskExecutor.lambda$toRunnable$4(RunAsTaskExecutor.java:139) ~[dataprep-ee-backend-service-2.3.0-SNAPSHOT.jar:na] at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.8.0_141] at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.8.0_141] at java.lang.Thread.run(Unknown Source) ~[na:1.8.0_141]
Attachments
Issue Links
- prerequisite of
-
TDP-4563 Check performances
-
- closed
-