Why Jython-Evaluator is producing multiple records for each input record when used with Multitable-Consumer as the origin in the pipeline?

asked 2020-10-06 15:07:18 -0500

anonymous user


Description: When jython-evaluator processor with default code as-is added to the pipeline with multi-table-consumer origin, the output of the jython-evaluator is producing randomly multiple records for each input record.

Initially I thought my script has the problem but the issue remains same even when I use the default code for the jython.

Tried with various jdbc-multitable-consumer configurations, but no luck. Any thoughts on what could be the reason? and how to resolve this?

Note: Using 3.17 version of sdc

edit retag flag offensive close merge delete


I can't seem to reproduce it on my end. Maybe update your question and add more details about how you've configured the origin, the database tables (do they all have primary keys, etc.) and anything else that you've configured in the pipeline that's not the default behavior?

iamontheinet gravatar imageiamontheinet ( 2020-10-06 17:19:27 -0500 )edit

Hey, I'm using only one table for now in the origin and I'm overriding the offset with another timestamp column, which I don't think is causing an issue. I have provided screenshots for the same in the SS group: https://groups.google.com/a/streamsets.com/g/sdc-user/c/ZmrjmhYThQY (copy url manually)

Sai gravatar imageSai ( 2020-10-08 16:21:21 -0500 )edit