Ask Your Question

How to write custom processor to process Avro message from Kafka to custom destination?

asked 2017-11-29 08:09:37 -0600

casel.chen gravatar image

updated 2017-11-29 12:44:36 -0600

metadaddy gravatar image

How to write custom processor to process avro message from kafka to custom destination which does not support in streamsets destination out of box?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2017-11-29 12:46:31 -0600

metadaddy gravatar image

You just need to write a custom destination - see this tutorial. Use a Kafka origin with the Avro data format and your destination doesn't need to worry about Avro at all - it will just see the in-memory records.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2017-11-29 08:09:37 -0600

Seen: 4,440 times

Last updated: Nov 29 '17