Ask Your Question

SparkTransformer Tutorial issues

asked 2018-08-20 11:38:18 -0600

Steve Ball gravatar image

updated 2018-08-20 14:13:25 -0600

Following tutorial to build my own (Java) custom SparkTransformer and I get exceptions such as

Pipeline Status: RUN_ERROR: java.lang.NoClassDefFoundError: com/fasterxml/jackson/databind/type/ReferenceType

Pipeline Status: RUN_ERROR: java.lang.NoClassDefFoundError: Could not initialize class org.apache.spark.rdd.RDDOperationScope$

I guess its a config issue but online documentation is of no help

edit retag flag offensive close merge delete


what version of StreamSets Data Collector?

todd gravatar imagetodd ( 2018-08-24 07:08:50 -0600 )edit

1 Answer

Sort by ยป oldest newest most voted

answered 2018-08-28 03:17:21 -0600

Steve Ball gravatar image

we're using version 3.4.1 however we have got it working with an old version current pom entry <dependency> <groupid>com.streamsets</groupid> <artifactid>streamsets-datacollector-spark-api</artifactid> <version>3.4.1</version> </dependency>

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2018-08-20 11:38:18 -0600

Seen: 247 times

Last updated: Aug 20 '18