Ask Your Question

Can you dynamically set data format in a destination?

asked 2018-07-17 10:17:34 -0500

sureshvattikuti2398 gravatar image

updated 2018-07-17 16:50:43 -0500

metadaddy gravatar image

My pipeline needs to set output data format dynamically, at runtime, to different configurations, such as binary, JSON etc. How do I do this?

edit retag flag offensive close merge delete


It's not clear what you're asking for here - can you give a bit more detail?

metadaddy gravatar imagemetadaddy ( 2018-07-17 13:56:36 -0500 )edit

suppose s2 we have data out put format like binary,json,text.but i dont want select options run time want to pass the parameters .how it possible?

sureshvattikuti2398 gravatar imagesureshvattikuti2398 ( 2018-07-17 15:15:14 -0500 )edit

1 Answer

Sort by ยป oldest newest most voted

answered 2018-07-17 16:49:25 -0500

metadaddy gravatar image

Use a Stream Selector and multiple destinations, one for each data format. The Stream Selector simply sends each record to the appropriate destination.

You can use runtime parameters so that you can edit destination config, e.g. directory name, in one place rather than having to paste the same configuration into each destination.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2018-07-17 10:17:34 -0500

Seen: 114 times

Last updated: Jul 17 '18