Ask Your Question
1

Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib

asked 2018-05-22 08:59:39 -0500

Ashishgottipamula gravatar image

updated 2018-06-14 10:14:38 -0500

metadaddy gravatar image

Getting this error frequently despite of addition of streamsets-datacollector-mapr_6_0-lib rpm. Any kind of solution regarding this is much appreciated.

error : *Could not find stage definition for stage name: com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget, library: streamsets-datacollector-mapr_6_0-lib*

I have reinstalled the Streamsets and checked the certificates and added even aws rpm.I have checked the streamsets-datacollector-mapr_json-protolib-3.2.0.0.jar is working and followed the documents to check if the mapr stage library is on the blacklist.

MapR DB JSON 1 CONTAINER_0901 - Could not find stage definition for 'streamsets-datacollector-mapr_6_0-lib:com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget' CREATION_006 - Stage definition not found Library 'streamsets-datacollector-mapr_6_0-lib' Stage 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget' Version '1' VALIDATION_0006 - Stage definition does not exist, library 'streamsets-datacollector-mapr_6_0-lib', name 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget', version '1' VALIDATION_0006 - Stage definition does not exist, library 'streamsets-datacollector-mapr_6_0-lib', name 'com_streamsets_pipeline_stage_destination_mapr_MapRJsonDTarget', version '1'

The output of fuser /opt/streamsets-datacollector/streamsets-libs/streamsets-datacollector-mapr_6_0-lib/lib/streamsets-datacollector-mapr_json*.jar it executed the command and gave no result.

it worked but now getting below error

java.io.FileNotFoundException: /var/lib/sdc/runInfo/nctpipelinebd67416e-81af-44c8-bfc8-dd39f7692c91/0/pipelineStateHistory.json (Permission denied) ( View Stack Trace... )

edit retag flag offensive close merge delete

Comments

I tried reinstalling the libraries was not successful and even reinstalled streamsets.I have installed the required certificates and packages it asked but still the issue remains the same.

Ashishgottipamula gravatar imageAshishgottipamula ( 2018-05-22 11:08:45 -0500 )edit

Rebooted my MAPR cluster but still no luck is it some kind of bug .

Ashishgottipamula gravatar imageAshishgottipamula ( 2018-05-22 11:13:12 -0500 )edit

Yes followed the document properly.

Ashishgottipamula gravatar imageAshishgottipamula ( 2018-05-22 11:55:25 -0500 )edit

1 Answer

Sort by ยป oldest newest most voted
1

answered 2018-05-22 15:49:53 -0500

junko_urata gravatar image

updated 2018-05-22 15:53:50 -0500

Pointers are:

  • After you installed streamsets-datacollector-mapr_6_0-lib rpm, you will need to run setup-mapr script again
  • Please confirm you have streamsets-datacollector-mapr_json-* jar files under /opt/streamsets-datacollector/streamsets-libs/streamsets-datacollector-mapr_6_0-lib/lib/
edit flag offensive delete link more

Comments

I have done that as a part of installation process.I see all the required jar files in this directory.

Ashishgottipamula gravatar imageAshishgottipamula ( 2018-05-22 16:55:07 -0500 )edit

Can you run fuser streamsets-datacollector-mapr_json-protolib-*.jar to see if the jar is loaded to the streamsets service?

junko_urata gravatar imagejunko_urata ( 2018-05-22 17:19:13 -0500 )edit

streamsets-datacollector-mapr_json-protolib-3.2.0.0.jar is there.

Ashishgottipamula gravatar imageAshishgottipamula ( 2018-05-22 17:24:13 -0500 )edit

I mean, I wanted to check if the process which started streamsets service loaded the jar file. Were you able to find out the process ID which runs streamsets service (i.e ps -ef | grep streamsets )? Did fuser command above show the same process ID?

junko_urata gravatar imagejunko_urata ( 2018-05-22 17:39:27 -0500 )edit

Just added the result I do not see any mapr am i looking it right

Ashishgottipamula gravatar imageAshishgottipamula ( 2018-05-22 17:52:58 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-05-22 08:59:39 -0500

Seen: 118 times

Last updated: Jun 11