Ask Your Question
0

SparkTransformer Tutorial issues

asked 2018-08-20 11:38:18 -0500

Steve Ball gravatar image

updated 2018-08-20 14:13:25 -0500

Following tutorial to build my own (Java) custom SparkTransformer and I get exceptions such as

Pipeline Status: RUN_ERROR: java.lang.NoClassDefFoundError: com/fasterxml/jackson/databind/type/ReferenceType

Pipeline Status: RUN_ERROR: java.lang.NoClassDefFoundError: Could not initialize class org.apache.spark.rdd.RDDOperationScope$

I guess its a config issue but online documentation is of no help

edit retag flag offensive close merge delete

Comments

what version of StreamSets Data Collector?

todd gravatar imagetodd ( 2018-08-24 07:08:50 -0500 )edit

1 Answer

Sort by ยป oldest newest most voted
0

answered 2018-08-28 03:17:21 -0500

Steve Ball gravatar image

we're using version 3.4.1 however we have got it working with an old version 2.7.2.0 current pom entry <dependency> <groupid>com.streamsets</groupid> <artifactid>streamsets-datacollector-spark-api</artifactid> <version>3.4.1</version> </dependency>

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-08-20 11:38:18 -0500

Seen: 63 times

Last updated: Aug 20