Is it possible origin JDBC multitable reads all records in tables , regardless of offset

asked 2018-08-17 07:18:18 -0500

Dean Han gravatar image

Hi, Here is a request, I want to read all records in all tables in SQLserver with JDBC multitable origin, then router records with jdbc.tablename to different streams of JDBC producer to insert /update records in Mysql. But there is a problem here, after pipeline started and processed first time,then the next query will generate no more data because there is no offset updated/inserted. Even I Enable Non-Incremental Load option in 'Table' tab. So Is it possible origin JDBC multitable reads all records in tables , regardless of offset? Or is there any other solution to read all records in all selected tables in only one Origin? Thanks.

edit retag flag offensive close merge delete

Comments

Anyone can help?

Dean Han gravatar imageDean Han ( 2018-09-09 01:00:33 -0500 )edit

So you want the offset to be reset every time you start a pipeline? If so, have you looked into Reset Origin option which resets offset?

iamontheinet gravatar imageiamontheinet ( 2018-09-10 09:59:49 -0500 )edit