Ask Your Question
1

Explode map field the right way

asked 2017-05-18 00:46:15 -0500

angel.angelio gravatar image

updated 2017-05-18 00:48:55 -0500

My records in a pipeline have some map fields and I'm exploding them using a Python stage

for record in records: try: record.value['itemname'] = record.value['mapfield']['itemname'] ...

Is the are build-in stage that does this? I want to keep the key name (itemname, in this case)

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
2

answered 2017-05-19 09:20:12 -0500

I believe that Field Pivoter offers exactly the functionality that you're looking for.

edit flag offensive delete link more

Comments

There's a blog post that explains Field Pivoter and other built-in transformations in some detail: https://streamsets.com/blog/transform-data-streamsets-data-collector/ .

metadaddy gravatar imagemetadaddy ( 2017-05-19 10:58:22 -0500 )edit
1

Something wrong with the link handling for this blog post... maybe this will work? https://streamsets.com/blog/transform-data-streamsets-data-collector/

chris gravatar imagechris ( 2017-11-01 00:08:57 -0500 )edit

Yeah - it looks like, if the link is at the end of the comment, it gets a `

` stuck on it. I fixed my comment now - thanks!

metadaddy gravatar imagemetadaddy ( 2017-11-01 11:46:04 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2017-05-18 00:46:15 -0500

Seen: 163 times

Last updated: May 19 '17