Ask Your Question

TimeoutException: expiring records

asked 2018-06-28 17:24:36 -0600

kutny gravatar image

updated 2018-06-29 14:12:55 -0600

metadaddy gravatar image

I'm setting the MySQL Bin Log -> Kafka pipeline on a testing server and getting the following error:

Pipeline Status: RUNNING_ERROR: com.streamsets.pipeline.api.StageException: KAFKA_50 - Error writing data to the Kafka broker: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.TimeoutException: Expiring 1 record(s) for names-0: 30064 ms has passed since last append

Pipeline validation was successful. As I'm new to Kafka I am not sure if something is wrong with Streamsets or Kafka

StreamSets + Kafka run on Docker, see my previous post for details

Thanks a lot for help

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2018-07-03 05:41:04 -0600

kutny gravatar image

Well after changing Partition Strategy from Round robin to Default (with Partition Expression = 0), destroyed and rebuilt the whole cluster, it finally seems to be working correctly!

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2018-06-28 17:24:36 -0600

Seen: 2,169 times

Last updated: Jul 03 '18