Ask Your Question
0

How to ensure pipeline is fetching data from all the tables mentioned in JDBC multitable origin?

asked 2018-09-10 23:03:08 -0500

Maithri gravatar image

I am using JDBC Multitable orgin and say any destination.I am trying to pull data from three tables,When previewed it shows data only from the first table.How can I make sure that the pipeline fetches data from all the included tables in JDBC multitable before sending it to any destination?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
0

answered 2018-09-10 23:18:34 -0500

iamontheinet gravatar image

Hi!

It's probably because the preview result set is limited to 10--by default. Trying increasing the Preview Batch Size in Preview Configuration.

Cheers, Dash

edit flag offensive delete link more

Comments

Thank you for the response @iamontheinet I have tried increasing the preview data limit as well.But that is not the issue as all the three tables has 2 records each.So it wont cross 8 records when previewed.

Maithri gravatar imageMaithri ( 2018-09-10 23:41:09 -0500 )edit

Can you take a screenshot of your origin config and add it to your question?

iamontheinet gravatar imageiamontheinet ( 2018-09-10 23:43:34 -0500 )edit

BTW, if it's only a test with a total of 6 records, what happens when you run/start the pipeline?

iamontheinet gravatar imageiamontheinet ( 2018-09-10 23:45:33 -0500 )edit

In some cases I could fetch all the data, and in some cases it fetched data from only one table.And my intention behind posting this question is how to make sure that the data being sent is as required.To eliminate the trial and error method everytime to ensure whether all the data are being sent.

Maithri gravatar imageMaithri ( 2018-09-10 23:58:01 -0500 )edit

can you share to solution?

ThuyLe gravatar imageThuyLe ( 2018-09-21 15:06:35 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-09-10 23:03:08 -0500

Seen: 125 times

Last updated: 11 hours ago