Ask Your Question
1

Getting HIVE_07 and HADOOPFS_25

asked 2018-07-09 11:11:51 -0500

supahcraig gravatar image

updated 2018-09-05 00:47:35 -0500

Shruthi gravatar image

I'm running the Streamsets docker container on my laptop, trying to push data into a hadoop cluster which is not on my laptop. I've followed one of the tutorials I found on github, but I'm getting tripped up by the Hadoop Configuration Directory. When I validate the pipeline, it throws HIVE_07 & HADOOPFS_25 stating:

HIVE_07 - Configuration dir '/etc/hive/conf' does not exist HADOOPFS_25 - Hadoop configuration directory '/etc/hive/conf' does not exist

These of course do exist, just not local to my Streamsets install. Am I completely off in left field, or is there a way to make this work if Streamsets is not running local to my Hadoop cluster?

edit retag flag offensive close merge delete

Comments

Hi, Can you provide link to the tutorial you're following?

iamontheinet gravatar imageiamontheinet ( 2018-07-09 16:09:10 -0500 )edit

https://github.com/streamsets/tutorials/blob/master/tutorial-hivedrift/readme.md

supahcraig gravatar imagesupahcraig ( 2018-07-10 13:09:21 -0500 )edit

See Shruthi's answer below.

iamontheinet gravatar imageiamontheinet ( 2018-07-10 13:20:04 -0500 )edit

1 Answer

Sort by ยป oldest newest most voted
1

answered 2018-07-10 08:17:43 -0500

Shruthi gravatar image

updated 2018-09-07 05:25:25 -0500

Streamsets should have access to your hadoop/hive configuration files. For that you can create one directory say 'resources' inside streamsets and put all hadoop/hive configuration files there. That is, /streamsets/resources/your_conf_files then mention this path in 'Hadoop Configuration Directory'

edit flag offensive delete link more

Comments

That was my guess.....seems odd to have to copy config files off the cluster and have them live in sdc. But it got me past that error. (now I can't connect to hive, when it rains it pours).

supahcraig gravatar imagesupahcraig ( 2018-07-10 14:46:19 -0500 )edit

Now whats your error?

Shruthi gravatar imageShruthi ( 2018-07-11 00:02:56 -0500 )edit

HIVE_22 - Cannot make connection with default hive database starting with URL: jdbc:hive2://10.4.16.16:9083/cnelson. Reason:HIVE_22 - Cannot make connection with default hive database starting with URL: jdbc:hive2://10.4.16.16:9083/cnelson. Reason:null

supahcraig gravatar imagesupahcraig ( 2018-07-11 07:26:42 -0500 )edit

Which hive/hadoop version are you using

Shruthi gravatar imageShruthi ( 2018-07-11 08:07:16 -0500 )edit

Also check whether you have placed all the configuration files mentioned here https://github.com/streamsets/tutorials/blob/master/tutorial-hivedrift/readme.md

Shruthi gravatar imageShruthi ( 2018-07-11 08:11:21 -0500 )edit
Login/Signup to Answer

Question Tools

2 followers

Stats

Asked: 2018-07-09 11:11:51 -0500

Seen: 217 times

Last updated: Sep 07