Error while producing records - Oracle CDC Data Generator

asked 2020-09-04 06:40:59 -0500

Grimur gravatar image

Hi everyone,

I am getting record error exceptions from the Oracle CDC Client. I am sure there are multiple things that could be wrong. I do have "send to error" enabled and a log file to write error records.

However, the Oracle CDC record errors aren't added for further details. Anyone know how to enable this ?

java.lang.NullPointerException at com.streamsets.pipeline.stage.origin.jdbc.cdc.oracle.OracleCDCSource.expired(OracleCDCSource.java:1999) at com.streamsets.pipeline.stage.origin.jdbc.cdc.oracle.OracleCDCSource.discardOldUncommitted(OracleCDCSource.java:1961) at com.streamsets.pipeline.stage.origin.jdbc.cdc.oracle.OracleCDCSource.generateRecords(OracleCDCSource.java:822) at com.streamsets.pipeline.stage.origin.jdbc.cdc.oracle.OracleCDCSource.lambda$startGeneratorThread$5(OracleCDCSource.java:463) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

edit retag flag offensive close merge delete

Comments

We are passing Oracle CDC error records to a separate pipeline for handling. This way you can use an expression evaluator to map the record attributes you want to insert into the log file. For instance ${record:attribute('oracle.cdc.query') might provide what you need.

KateF gravatar imageKateF ( 2020-09-21 08:39:17 -0500 )edit