How to put conditions for fields that does not appear always?

asked 2020-04-22 06:15:18 -0500

Maria gravatar image

Hi all,

I am streaming real-time data from a HTTP client. The results are in json format. Records can have different number of fields. For example, if I have a topic, the topic can have from 1 to 15 different sub-topics. I want to convert this json file to a tsv file. I have the following pipeline. I think, I can feed the records into a pre-defined table. If the data is not there, I can pass NA. Does anyone know what is pre-defined table in streamsets or any suggestion for a better solution?image description Thanks

edit retag flag offensive close merge delete


I'm not sure what you're asking here. Do you need to set a default value in a field if it is not in the record?

metadaddy gravatar imagemetadaddy ( 2020-04-23 21:09:40 -0500 )edit