KAFKA error 37

asked 2019-05-24 17:26:02 -0500

Jmbertoncelli gravatar image

This issue has already been asked but no answer... Could we know what is wrong and how to remedy. Thanks.

KAFKA_37 - Cannot parse record from message 'dlxc-alpha-workshop-workshop-1-customers::8::0': com.streamsets.pipeline.lib.parser.DataParserException: DATA_PARSER_02 - Parser error: 'java.lang.IllegalArgumentException: A metric named sdc.pipeline.dlxcalphamysqlworkshopworkshop3customerscloned708ccd16-6470-4c32-9ff7-d2dce1a8d970.0.custom.KafkaMultitopicConsumer_01.external.system.latency.0.timer already exists'

com.streamsets.pipeline.api.base.OnRecordErrorException: KAFKA_37 - Cannot parse record from message 'dlxc-alpha-workshop-workshop-1-customers::8::0': com.streamsets.pipeline.lib.parser.DataParserException: DATA_PARSER_02 - Parser error: 'java.lang.IllegalArgumentException: A metric named sdc.pipeline.dlxcalphamysqlworkshopworkshop3customerscloned708ccd16-6470-4c32-9ff7-d2dce1a8d970.0.custom.KafkaMultitopicConsumer_01.external.system.latency.0.timer already exists' at com.streamsets.pipeline.stage.origin.multikafka.MultiKafkaSource$MultiTopicCallable.createRecord(MultiKafkaSource.java:192) at com.streamsets.pipeline.stage.origin.multikafka.MultiKafkaSource$MultiTopicCallable.sendBatch(MultiKafkaSource.java:158) at com.streamsets.pipeline.stage.origin.multikafka.MultiKafkaSource$MultiTopicCallable.call(MultiKafkaSource.java:135) at com.streamsets.pipeline.stage.origin.multikafka.MultiKafkaSource$MultiTopicCallable.call(MultiKafkaSource.java:79) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Caused by: com.streamsets.pipeline.lib.parser.DataParserException: DATA_PARSER_02 - Parser error: 'java.lang.IllegalArgumentException: A metric named sdc.pipeline.dlxcalphamysqlworkshopworkshop3customerscloned708ccd16-6470-4c32-9ff7-d2dce1a8d970.0.custom.KafkaMultitopicConsumer_01.external.system.latency.0.timer already exists' at com.streamsets.pipeline.lib.parser.WrapperDataParserFactory$WrapperDataParser.normalizeException(WrapperDataParserFactory.java:147) at com.streamsets.pipeline.lib.parser.WrapperDataParserFactory$WrapperDataParser.parse(WrapperDataParserFactory.java:107) at com.streamsets.pipeline.stage.origin.multikafka.MultiKafkaSource$MultiTopicCallable.createRecord(MultiKafkaSource.java:175) ... 7 more Caused by: java.lang.IllegalArgumentException: A metric named sdc.pipeline.dlxcalphamysqlworkshopworkshop3customerscloned708ccd16-6470-4c32-9ff7-d2dce1a8d970.0.custom.KafkaMultitopicConsumer_01.external.system.latency.0.timer already exists at com.codahale.metrics.MetricRegistry.register(MetricRegistry.java:97) at com.streamsets.datacollector.metrics.MetricsConfigurator$1.run(MetricsConfigurator.java:88) at com.streamsets.datacollector.metrics.MetricsConfigurator$1.run(MetricsConfigurator.java:83) at java.security.AccessController.doPrivileged(Native Method) at com.streamsets.datacollector.metrics.MetricsConfigurator.create(MetricsConfigurator.java:83) at com.streamsets.datacollector.metrics.MetricsConfigurator.createTimer(MetricsConfigurator.java:107) at com.streamsets.datacollector.metrics.MetricsConfigurator.createStageTimer(MetricsConfigurator.java:103) at com.streamsets.datacollector.runner.ProtoContext.createTimer(ProtoContext.java:225) at com.streamsets.pipeline.lib.sampling.RecordSampler.updateTimer(RecordSampler.java:97) at com.streamsets.pipeline.lib.sampling.RecordSampler.sample(RecordSampler.java:67) at com.streamsets.pipeline.lib.parser.sdcrecord.SdcRecordDataParser.parse(SdcRecordDataParser.java:48) at com.streamsets.pipeline.lib.parser.WrapperDataParserFactory$WrapperDataParser.lambda$parse$0(WrapperDataParserFactory.java:105) at com.streamsets.pipeline.api.impl.CreateByRef.call(CreateByRef.java:40) at com.streamsets.pipeline.lib.parser.WrapperDataParserFactory$WrapperDataParser.parse(WrapperDataParserFactory.java:105) ... 8 more

edit retag flag offensive close merge delete