Ask Your Question
1

Issues in using external libraries

asked 2019-01-29 01:59:51 -0600

aqunaibi gravatar image

updated 2019-01-29 09:23:39 -0600

metadaddy gravatar image

Dear All,

I have installed streamsets StreamSets Data Collector 3.4.1 using my Cloudera Enterprise 5.11.1 cluster.

I am facing an issue to set up JDBC connectors with below error:

ERROR ProductionPipelineRunnable - An exception occurred while running the pipeline, com.streamsets.datacollector.runner.PipelineRuntimeException: CONTAINER_0800 - Pipeline 'DNATCPPROD17c249a3-57ed-4423-8ea2-b610466bd82d' validation error : JDBC_28 - Failed to create JDBC driver, JDBC driver JAR may be missing: java.lang.ClassNotFoundException: oracle.jdbc.driver.OracleDriver

I noticed the following error in my log file /var/log/sdc/sdc.log

2019-01-29 09:02:49,503 [user:] [pipeline:] [runner:] [thread:main] ERROR ClassLoaderStageLibraryTask - The following stages have invalid classpath: streamsets-datacollector-hdp_2_5-lib, streamsets-datacollector-cdh_5_15-lib, streamsets-datacollector-cdh_6_0-lib, streamsets-datacollector-emr_hadoop_2_8_3-lib, streamsets-datacollector-cdh_5_14-lib, streamsets-datacollector-wholefile-transformer-lib, streamsets-datacollector-hdp_2_6-lib, streamsets-datacollector-hdp_2_4-lib

The JAR is available here:

/opt/cloudera/parcels/STREAMSETS_DATACOLLECTOR-3.4.1/streamsets-libs/streamsets-datacollector-jdbc-lib/lib/streamsets-datacollector-jdbc-lib-3.4.1.jar

Any clue ?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
0

answered 2019-01-29 09:30:21 -0600

metadaddy gravatar image

updated 2019-01-29 10:20:37 -0600

You will need to download the Oracle JDBC driver and install it as an external library. See the documentation on installing external libraries, particularly the sections relating to Cloudera Manager.

The invalid classpath issue is fairly safe to ignore; we cleaned up a lot of spurious errors in Data Collector 3.7.0.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2019-01-29 01:59:51 -0600

Seen: 18 times

Last updated: Jan 29