Ask Your Question

Merge the different streams

asked 2019-01-07 09:24:35 -0500

srinath_222 gravatar image


I want to merge two records coming from different streams and in my output I want a single record in destination.

I couldn't find anything like joiner in here, is there any alternative of joiner in Streamsets.

edit retag flag offensive close merge delete


@iamontheinet any suggestions ?

srinath_222 gravatar imagesrinath_222 ( 2019-01-07 15:05:12 -0500 )edit

1 Answer

Sort by ยป oldest newest most voted

answered 2019-01-08 09:38:48 -0500

iamontheinet gravatar image


As you noted, currently there's not a direct way of performing joins. The workaround that I can think would be to create two pipelines and store the data into a database (for example) using JDBC Producer destination and then perform joins.

Cheers, Dash

edit flag offensive delete link more


Other options: use a join query in the JDBC Query Consumer or you can use the JDBC Lookup processor to perform a lookup query against a table.

iamontheinet gravatar imageiamontheinet ( 2019-01-08 11:20:26 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-01-07 09:24:35 -0500

Seen: 517 times

Last updated: Jan 08 '19