Ask Your Question
1

HIVE_06 - Configuration file 'core-site.xml' is missing from 'hadoop-conf'

asked 2018-06-14 16:47:58 -0500

this post is marked as community wiki

This post is a wiki. Anyone with karma >75 is welcome to improve it.

Hi, I'm following this tutorial https://github.com/streamsets/tutoria... but i have this error HIVE_06 - Configuration file 'core-site.xml' is missing from 'hadoop-conf' What can be?, thanks

edit retag flag offensive close merge delete

2 Answers

Sort by ยป oldest newest most voted
1

answered 2018-06-14 16:54:35 -0500

metadaddy gravatar image

It looks like you might not have followed these instructions:

Note: SDC requires the configuration files for Hadoop and Hive to be accessible in a single directory. Before you add the Hive and Hadoop pipeline stages, create a directory named hadoop-conf under SDC's resources directory, and link the core-site.xml, hdfs-site.xml and hive-site.xml configuration files from your distribution into the hadoop-conf directory.

edit flag offensive delete link more

Comments

If I followed those instructions, just omit this chown -R sdc:sdc hadoop-conf,but still the error follows

Issantv@gmail.com gravatar imageIssantv@gmail.com ( 2018-06-14 17:29:00 -0500 )edit

Why did you omit that? You may have a permissions error where Data Collector can't see the file.

metadaddy gravatar imagemetadaddy ( 2018-06-14 17:59:49 -0500 )edit

create the folder with the xml files in this path /home/training/streamsets-datacollector-3.3.0/resources/hadoop-conf but when you put this command chown -R sdc:sdc hadoop-conf I receive this message chown: invalid user: `sdc:sdc'

Issantv@gmail.com gravatar imageIssantv@gmail.com ( 2018-06-15 08:40:58 -0500 )edit
1

answered 2018-07-10 05:57:01 -0500

Step1: Crate a hadoop-conf folder under resource of your streamset

  • sudo mkdir /home/training/streamsets-datacollector-3.3.0/resources/hadoop-conf

Step2: Then, keep the below files from Hadoop and hive config under hadoop-conf.

core-site.xml hdfs-site.xml hive-site.xml

Step3: restart streamsets and now run your pipeline.

PS: - No need to make link for core-site.xml, hdfs-site.xml, hive-site.xml if you keep whole file under hadoop-conf. - No need to run any - chown -R sdc:sdc hadoop-conf

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-06-14 16:47:58 -0500

Seen: 131 times

Last updated: Jul 10