Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib

Hi Guys,

Getting this error frequently despite of addition of streamsets-datacollector-mapr_6_0-lib rpm.Any kind of solution regarding this is much appreciated.

error : Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib

Ashish.

click to hide/show revision 2
None

Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib

Hi Guys,

Getting this error frequently despite of addition of streamsets-datacollector-mapr_6_0-lib rpm.Any streamsets-datacollector-mapr_6_0-lib rpm. Any kind of solution regarding this is much appreciated.

error : Could *Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib

Ashish.streamsets-datacollector-mapr_6_0-lib*

Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib

Getting this error frequently despite of addition of streamsets-datacollector-mapr_6_0-lib rpm. Any kind of solution regarding this is much appreciated.

error : *Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib*

Output of ps

 ps -ef | grep streamsets
sdc        9352      1  0 15:43 ?        00:00:00 /bin/bash /opt/streamsets-datacollector/libexec/_sdc -verbose
sdc        9478   9352  0 15:43 ?        00:01:40 /usr/bin/java -classpath /opt/streamsets-datacollector/libexec/bootstrap-libs/main/streamsets-datacollector-bootstrap-3.2.0.0.jar:/opt/streamsets-datacollector/root-lib/* -Djava.security.manager -Djava.security.policy=file:///etc/sdc/sdc-security.policy -Xmx1024m -Xms1024m -server -XX:-OmitStackTraceInFastThrow -Dsdc.dist.dir=/opt/streamsets-datacollector -Dsdc.resources.dir=/opt/streamsets-datacollector/resources -Dsdc.hostname=ip-10-10-16-7.ec2.internal -Dsdc.conf.dir=/etc/sdc -Dsdc.data.dir=/var/lib/sdc -Dsdc.log.dir=/var/log/sdc -javaagent:/opt/streamsets-datacollector/libexec/bootstrap-libs/main/streamsets-datacollector-bootstrap-3.2.0.0.jar -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -Djdk.nio.maxCachedBufferSize=262144 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/var/log/sdc/sdc_heapdump_1527003823.hprof -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/var/log/sdc/gc.log com.streamsets.pipeline.BootstrapMain -mainClass com.streamsets.datacollector.main.DataCollectorMain -apiClasspath /opt/streamsets-datacollector/api-lib/*.jar -containerClasspath /etc/sdc:/opt/streamsets-datacollector/container-lib/*.jar -streamsetsLibrariesDir /opt/streamsets-datacollector/streamsets-libs -userLibrariesDir /opt/streamsets-datacollector/user-libs/ -configDir /etc/sdc -libsCommonLibDir /opt/streamsets-datacollector/libs-common-lib/ -streamsetsLibrariesExtraDir /opt/streamsets-datacollector/streamsets-libs-extras/
root      50941 126623  0 22:43 pts/0    00:00:00 grep --color=auto streamsets

Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib

Getting this error frequently despite of addition of streamsets-datacollector-mapr_6_0-lib rpm. Any kind of solution regarding this is much appreciated.

error : *Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib*

Output of psI have reinstalled the Streamsets and checked the certificates and added even aws rpm.I have checked the streamsets-datacollector-mapr_json-protolib-3.2.0.0.jar is working and followed the documents to check if the mapr stage library is on the blacklist.

 ps -ef | grep streamsets
sdc        9352      1  0 15:43 ?        00:00:00 /bin/bash /opt/streamsets-datacollector/libexec/_sdc -verbose
sdc        9478   9352  0 15:43 ?        00:01:40 /usr/bin/java -classpath /opt/streamsets-datacollector/libexec/bootstrap-libs/main/streamsets-datacollector-bootstrap-3.2.0.0.jar:/opt/streamsets-datacollector/root-lib/* -Djava.security.manager -Djava.security.policy=file:///etc/sdc/sdc-security.policy -Xmx1024m -Xms1024m -server -XX:-OmitStackTraceInFastThrow -Dsdc.dist.dir=/opt/streamsets-datacollector -Dsdc.resources.dir=/opt/streamsets-datacollector/resources -Dsdc.hostname=ip-10-10-16-7.ec2.internal -Dsdc.conf.dir=/etc/sdc -Dsdc.data.dir=/var/lib/sdc -Dsdc.log.dir=/var/log/sdc -javaagent:/opt/streamsets-datacollector/libexec/bootstrap-libs/main/streamsets-datacollector-bootstrap-3.2.0.0.jar -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -Djdk.nio.maxCachedBufferSize=262144 -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/var/log/sdc/sdc_heapdump_1527003823.hprof -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/var/log/sdc/gc.log com.streamsets.pipeline.BootstrapMain -mainClass com.streamsets.datacollector.main.DataCollectorMain -apiClasspath /opt/streamsets-datacollector/api-lib/*.jar -containerClasspath /etc/sdc:/opt/streamsets-datacollector/container-lib/*.jar -streamsetsLibrariesDir /opt/streamsets-datacollector/streamsets-libs -userLibrariesDir /opt/streamsets-datacollector/user-libs/ -configDir /etc/sdc -libsCommonLibDir /opt/streamsets-datacollector/libs-common-lib/ -streamsetsLibrariesExtraDir /opt/streamsets-datacollector/streamsets-libs-extras/
root      50941 126623  0 22:43 pts/0    00:00:00 grep --color=auto streamsets

MapR DB JSON 1 CONTAINER_0901 - Could not find stage definition for 'streamsets-datacollector-mapr_6_0-lib:com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget' CREATION_006 - Stage definition not found Library 'streamsets-datacollector-mapr_6_0-lib' Stage 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget' Version '1' VALIDATION_0006 - Stage definition does not exist, library 'streamsets-datacollector-mapr_6_0-lib', name 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget', version '1' VALIDATION_0006 - Stage definition does not exist, library 'streamsets-datacollector-mapr_6_0-lib', name 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget', version '1'

Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib

Getting this error frequently despite of addition of streamsets-datacollector-mapr_6_0-lib rpm. Any kind of solution regarding this is much appreciated.

error : *Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib*

I have reinstalled the Streamsets and checked the certificates and added even aws rpm.I have checked the streamsets-datacollector-mapr_json-protolib-3.2.0.0.jar is working and followed the documents to check if the mapr stage library is on the blacklist.

MapR DB JSON 1 CONTAINER_0901 - Could not find stage definition for 'streamsets-datacollector-mapr_6_0-lib:com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget' CREATION_006 - Stage definition not found Library 'streamsets-datacollector-mapr_6_0-lib' Stage 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget' Version '1' VALIDATION_0006 - Stage definition does not exist, library 'streamsets-datacollector-mapr_6_0-lib', name 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget', version '1' VALIDATION_0006 - Stage definition does not exist, library 'streamsets-datacollector-mapr_6_0-lib', name 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget', version '1'

The output of fuser /opt/streamsets-datacollector/streamsets-libs/streamsets-datacollector-mapr_6_0-lib/lib/streamsets-datacollector-mapr_json*.jar it executed the command and gave no result.

Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib

Getting this error frequently despite of addition of streamsets-datacollector-mapr_6_0-lib rpm. Any kind of solution regarding this is much appreciated.

error : *Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib*

I have reinstalled the Streamsets and checked the certificates and added even aws rpm.I have checked the streamsets-datacollector-mapr_json-protolib-3.2.0.0.jar is working and followed the documents to check if the mapr stage library is on the blacklist.

MapR DB JSON 1 CONTAINER_0901 - Could not find stage definition for 'streamsets-datacollector-mapr_6_0-lib:com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget' CREATION_006 - Stage definition not found Library 'streamsets-datacollector-mapr_6_0-lib' Stage 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget' Version '1' VALIDATION_0006 - Stage definition does not exist, library 'streamsets-datacollector-mapr_6_0-lib', name 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget', version '1' VALIDATION_0006 - Stage definition does not exist, library 'streamsets-datacollector-mapr_6_0-lib', name 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget', version '1'

The output of fuser /opt/streamsets-datacollector/streamsets-libs/streamsets-datacollector-mapr_6_0-lib/lib/streamsets-datacollector-mapr_json*.jar it executed the command and gave no result.

it worked but now getting below error

java.io.FileNotFoundException: /var/lib/sdc/runInfo/nctpipelinebd67416e-81af-44c8-bfc8-dd39f7692c91/0/pipelineStateHistory.json (Permission denied) ( View Stack Trace... )

Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib

Getting this error frequently despite of addition of streamsets-datacollector-mapr_6_0-lib rpm. Any kind of solution regarding this is much appreciated.

error : *Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib*

I have reinstalled the Streamsets and checked the certificates and added even aws rpm.I have checked the streamsets-datacollector-mapr_json-protolib-3.2.0.0.jar is working and followed the documents to check if the mapr stage library is on the blacklist.

MapR DB JSON 1 CONTAINER_0901 - Could not find stage definition for 'streamsets-datacollector-mapr_6_0-lib:com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget' CREATION_006 - Stage definition not found Library 'streamsets-datacollector-mapr_6_0-lib' Stage 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget' Version '1' VALIDATION_0006 - Stage definition does not exist, library 'streamsets-datacollector-mapr_6_0-lib', name 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget', version '1' VALIDATION_0006 - Stage definition does not exist, library 'streamsets-datacollector-mapr_6_0-lib', name 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget', version '1'

The output of fuser /opt/streamsets-datacollector/streamsets-libs/streamsets-datacollector-mapr_6_0-lib/lib/streamsets-datacollector-mapr_json*.jar it executed the command and gave no result.

it worked but now getting below error

java.io.FileNotFoundException: /var/lib/sdc/runInfo/nctpipelinebd67416e-81af-44c8-bfc8-dd39f7692c91/0/pipelineStateHistory.json (Permission denied) ( View Stack Trace... )

Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib

Getting this error frequently despite of addition of streamsets-datacollector-mapr_6_0-lib rpm. Any kind of solution regarding this is much appreciated.

error : *Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib*

I have reinstalled the Streamsets and checked the certificates and added even aws rpm.I have checked the streamsets-datacollector-mapr_json-protolib-3.2.0.0.jar is working and followed the documents to check if the mapr stage library is on the blacklist.

MapR DB JSON 1 CONTAINER_0901 - Could not find stage definition for 'streamsets-datacollector-mapr_6_0-lib:com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget' CREATION_006 - Stage definition not found Library 'streamsets-datacollector-mapr_6_0-lib' Stage 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget' Version '1' VALIDATION_0006 - Stage definition does not exist, library 'streamsets-datacollector-mapr_6_0-lib', name 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget', version '1' VALIDATION_0006 - Stage definition does not exist, library 'streamsets-datacollector-mapr_6_0-lib', name 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget', version '1'

The output of fuser /opt/streamsets-datacollector/streamsets-libs/streamsets-datacollector-mapr_6_0-lib/lib/streamsets-datacollector-mapr_json*.jar it executed the command and gave no result.

it worked but now getting below error

java.io.FileNotFoundException: /var/lib/sdc/runInfo/nctpipelinebd67416e-81af-44c8-bfc8-dd39f7692c91/0/pipelineStateHistory.json (Permission denied) ( View Stack Trace... )