How to avoid pipeline to shutdown when an exception is raised

asked 2020-11-11 14:47:19 -0600

ReneMendes gravatar image

updated 2020-11-12 12:18:40 -0600

Hi,

I have a microservice pipeline that uses a JDBC Lookup stage that submits a SQL dynamically built. However, when a column is not found in the table, an exception is raised and the pipeline shuts down.

StreamSets Data Collector 3.12.0

For instance:

com.google.common.util.concurrent.UncheckedExecutionException: com.streamsets.pipeline.api.base.OnRecordErrorException: JDBC_02 - Exception executing query: 'SELECT * 
FROM ALUNOS
WHERE (1=0) OR (CD_UNIDADES='001')' - 'Column Referenced not found in table list. (CD_UNIDADES) 


 FROM ALUNOS

 WHERE ( 1 = 0 ) OR ( << Syntax Error >>  CD_UNIDADES = '001' ) 
'
    at com.google.common.cache.LocalCache$Segment.get(LocalCache.java:2203)

Is there a way to avoid this behavior (pipeline shutdown) when a exception occurs in a stage ?

Thank you.

RenĂª

edit retag flag offensive close merge delete