Ask Your Question

How to combine results from each forked dataflow?

asked 2018-03-07 23:30:14 -0500

casel.chen gravatar image

I have a user list, for each user I want to query serviceA to get resultA, and at the sametime query serviceB to get resultB, then combine resultA with resultB as well as the original user info, how to achieve that by streamsets dc?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2018-03-08 10:28:31 -0500

metadaddy gravatar image

You would have to combine the streams in the pipeline, then use one of the script evaluators to iterate through the batch and combine the records programmatically.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools



Asked: 2018-03-07 23:30:14 -0500

Seen: 700 times

Last updated: Mar 08 '18