Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Send pictures into kafka?

Hello, I would like to read pictures from a folder, send them into kafka and read them. I have not managed to make it work.

My trials: Binary (Either / or /fileRef) Kafka does not admit it: BINARY_GENERATOR_00 - Record 'resolution.png' cannot convert field path '/' value to byte[] SDC Record: It gets into kafka, but trying to read it produces: KAFKA_37 - Cannot parse record from message 'images::0::1': com.fasterxml.jackson.databind.JsonMappingException: Cannot convert java.util.LinkedHashMap to File Ref Object (through reference chain: com.streamsets.datacollector.restapi.bean.RecordJson["value"]) Tried also some groovy to transform the record into bytes[], but my code did not work.

Any advice on how to send pictures through kafka using streamsets?

Send pictures into kafka?

Hello, I would like to read pictures from a folder, send them into kafka and read them. I have not managed to make it work.

My trials: Binary (Either / or /fileRef) Kafka does not admit it: BINARY_GENERATOR_00 - Record 'resolution.png' cannot convert field path '/' value to byte[] SDC Record: It gets into kafka, but trying to read it produces: KAFKA_37 - Cannot parse record from message 'images::0::1': com.fasterxml.jackson.databind.JsonMappingException: Cannot convert java.util.LinkedHashMap to File Ref Object (through reference chain: com.streamsets.datacollector.restapi.bean.RecordJson["value"]) Tried also some groovy to transform the record into bytes[], but my code did not work.

Any advice on how to send pictures through kafka using streamsets?