Ask Your Question

Can StreamSets take JSON file as input and output as CSV?

asked 2019-06-10 04:14:13 -0600

anonymous user


updated 2019-06-10 09:08:15 -0600

metadaddy gravatar image

Question as subject. if there any simple doc to guide me to test it out?

edit retag flag offensive close merge delete

1 Answer

Sort by » oldest newest most voted

answered 2019-06-10 09:08:02 -0600

metadaddy gravatar image

updated 2019-06-10 09:09:45 -0600

This is fairly straightforward. The one wrinkle is that JSON data is an unordered map, but CSV data is an ordered list. You’ll need to use one or more processors to get the data into the shape you want.

In particular:

  • You will need to use the Field Order processor to convert the unordered map into an ordered list-map or list
  • If the JSON is not ‘flat’, you will need to use Field Flattener
  • You may need to use Field Renamer to rename fields

If you are new to StreamSets Data Collector, the taxi data tutorial is a great place to start.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2019-06-10 04:14:13 -0600

Seen: 589 times

Last updated: Jun 10 '19