Processing files and send them to s3

asked 2019-04-12 08:48:05 -0500

anonymous user

Anonymous

updated 2019-04-12 09:58:39 -0500

I want to get different avro files from s3, create a file by tag and send it to s3 For example

Origin s3

file1.avro {"tag":"Blue","value"="1"} {"tag":"Red","value"="1"}

file2.avro {"tag":"Blue","value"="2"}

Destination:

Blue.avro {"tag":"Blue","value"="1"} {"tag":"Blue","value"="2"}

Red.avro {"tag":"Red","value"="1"}

I am trying to do it with jython, by record I am creating a dictionary where the key is the tag and adding the record but I am not able to get the whole record. How can I do it? How can I send the dictionary value to the s3? Is it something more appropiate for this case than jython? Thank you!

edit retag flag offensive close merge delete

Comments

@metadaddy, could you help me with this?

lilian gravatar imagelilian ( 2019-04-12 13:52:22 -0500 )edit
1

Can you update the question with your Jython code?

iamontheinet gravatar imageiamontheinet ( 2019-04-12 14:14:40 -0500 )edit