Ask Your Question
1

Read from Hadoop FS

asked 2018-01-08 10:16:06 -0500

Francisco gravatar image

updated 2018-07-30 07:19:05 -0500

Maithri gravatar image

I am trying to read from HDFS directory. I try to follow all the steps in the HDFS Requirements and i was able to preview the data. But when i try to run the pipeline this never start. In logs appear this error: " Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/hadoop/mapreduce/Job at com.streamsets.pipeline.hadoop.HadoopMapReduceBinding.init(HadoopMapReduceBinding.java:82) at com.streamsets.pipeline.BootstrapClusterBatch.main(BootstrapClusterBatch.java:33) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.RunJar.run(RunJar.java:221) at org.apache.hadoop.util.RunJar.main(RunJar.java:136) Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.mapreduce.Job at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ... 8 more " Can anyone help? Thanks.

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
0

answered 2018-07-30 05:38:08 -0500

Maithri gravatar image

Sometimes this happens with unsupported stage library version or mismatch.Try changing the stage library version.

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-01-08 10:16:06 -0500

Seen: 45 times

Last updated: Jul 30