Ask Your Question

How to ignore same records in JDBC Producer

asked 2019-04-11 01:51:50 -0500

lnicolaou gravatar image

updated 2019-04-11 17:41:14 -0500

metadaddy gravatar image

Hi I'm trying to insert data from one database to another with a simple pipeline JDBC Consumer to JDBC Producer. My consumer DB hasn't got a primary key so I can use the "WHERE id > ${'OFFSET'}" in my query. Is there any way that I can stop duplicate entries in my JDBC Producer

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2019-04-11 14:27:02 -0500

iamontheinet gravatar image


Look into using Record Deduplicator.

Cheers, Dash

edit flag offensive delete link more


Thanks @iamontenet thats what I did in the end

lnicolaou gravatar imagelnicolaou ( 2019-04-12 02:21:47 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-04-11 01:51:50 -0500

Seen: 428 times

Last updated: Apr 11 '19