Ask Your Question

How to ensure pipeline is fetching data from all the tables mentioned in JDBC multitable origin?

asked 2018-09-10 23:03:08 -0500

Maithri gravatar image

I am using JDBC Multitable orgin and say any destination.I am trying to pull data from three tables,When previewed it shows data only from the first table.How can I make sure that the pipeline fetches data from all the included tables in JDBC multitable before sending it to any destination?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2018-09-10 23:18:34 -0500

iamontheinet gravatar image


It's probably because the preview result set is limited to 10--by default. Trying increasing the Preview Batch Size in Preview Configuration.

Cheers, Dash

edit flag offensive delete link more


Thank you for the response @iamontheinet I have tried increasing the preview data limit as well.But that is not the issue as all the three tables has 2 records each.So it wont cross 8 records when previewed.

Maithri gravatar imageMaithri ( 2018-09-10 23:41:09 -0500 )edit

BTW, if it's only a test with a total of 6 records, what happens when you run/start the pipeline?

iamontheinet gravatar imageiamontheinet ( 2018-09-10 23:45:33 -0500 )edit

In some cases I could fetch all the data, and in some cases it fetched data from only one table.And my intention behind posting this question is how to make sure that the data being sent is as required.To eliminate the trial and error method everytime to ensure whether all the data are being sent.

Maithri gravatar imageMaithri ( 2018-09-10 23:58:01 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower


Asked: 2018-09-10 23:03:08 -0500

Seen: 521 times

Last updated: Sep 21 '18