Ask Your Question
0

hive queries from spark evaluator processor

asked 2019-01-18 09:05:18 -0500

elisavet gravatar image

Hi,

I follow this tutorial https://github.com/streamsets/tutoria... which shows how to make java code running in spark evaluator.

My goal is to use the tutorial's java code in spark evaluator processor to make queries in hive.

I managed to do this locally by adding the driver in my java project, but when I upload the project's jar on streamsets as an external library, it shows the following error:

SPARK_07 - Spark job failed with error: Job aborted due to stage failure: Task 3 in stage 0.0 failed 1 times, most recent failure: Lost task 3.0 in stage 0.0 (TID 3, localhost, executor driver): java.sql.SQLException: No suitable driver found for jdbc:hive2://<host>:<port>/<db>

Could you please help me with this issue?

Thank you, Elisavet

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
0

answered 2019-01-21 10:53:12 -0500

iamontheinet gravatar image

Hi!

From the error it appears that you also need to install Hive JDBC driver.

Cheers, Dash

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2019-01-18 09:05:18 -0500

Seen: 73 times

Last updated: Jan 21