Ask Your Question
1

Can StreamSets take JSON file as input and output as CSV?

asked 2019-06-10 04:14:13 -0500

anonymous user

Anonymous

updated 2019-06-10 09:08:15 -0500

metadaddy gravatar image

Question as subject. if there any simple doc to guide me to test it out?

edit retag flag offensive close merge delete

1 Answer

Sort by » oldest newest most voted
0

answered 2019-06-10 09:08:02 -0500

metadaddy gravatar image

updated 2019-06-10 09:09:45 -0500

This is fairly straightforward. The one wrinkle is that JSON data is an unordered map, but CSV data is an ordered list. You’ll need to use one or more processors to get the data into the shape you want.

In particular:

  • You will need to use the Field Order processor to convert the unordered map into an ordered list-map or list
  • If the JSON is not ‘flat’, you will need to use Field Flattener
  • You may need to use Field Renamer to rename fields

If you are new to StreamSets Data Collector, the taxi data tutorial is a great place to start.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2019-06-10 04:14:13 -0500

Seen: 114 times

Last updated: Jun 10