Ask Your Question
0

KAFKA_41 - Could not get partition count for topic

asked 2018-10-09 06:06:31 -0500

Hameedh gravatar image

Hi

I am trying to connect to the kafka using Consumer connector and we are using SASL_SSL Protocol. We have provided the following details in the connector Kafka Configuration security.protocol ssl.truststore.location ssl.truststore.password sasl.jaas.config sasl.mechanism auto.offset.reset

Along with these have provided the right consumer group, Topic , Broker and the zoo keeper URI too.

We are getting the below error.

Pipeline 'KafkaConsumer3f9f4943-f4fe-4736-b382-72c24584d12f' validation error : KAFKA_41 - Could not get partition count for topic '.' : com.streamsets.pipeline.api.StageException: KAFKA_41 - Could not get partition count for topic '.' : org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata com.streamsets.datacollector.runner.PipelineRuntimeException: CONTAINER_0800 - Pipeline 'KafkaConsumer3f9f4943-f4fe-4736-b382-72c24584d12f' validation error :KAFKA_41 - Could not get partition count for topic '. : com.streamsets.pipeline.api.StageException: KAFKA_41 - Could not get partition count for topic '.*' : org.apache.kafka.common.errors.TimeoutException: Timeout expired while fetching topic metadata

Please let me know if I am missing anything.

Regards S A Hameedh

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
1

answered 2019-11-28 02:35:53 -0500

sbmiller gravatar image

I do not know if this is an answer to your specific question, but I had the same result today. Streamsets was complaining about a particular topic in a KafKa Producer, I knew that topic was live and working with other streamsets. I came to the conclusion that the failing streamset was corrupt and so I simply deleted it and recreated it exactly. It worked straightaway. I know this is an answer to an old question but it may assist someone in avoiding the head-scratching I went through.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

2 followers

Stats

Asked: 2018-10-09 06:06:31 -0500

Seen: 781 times

Last updated: Oct 09 '18