Ask Your Question
1

SDC_RESOURCES

asked 2018-09-10 06:32:59 -0600

AWT gravatar image

Hi there,

I have streamsets 3.4.x installed in Machine A and the Cloudera edgenode is Machine B. Question is how to do I get SDC_RESOURCES which is pointing to /var/lib/sdc-resources so do I just create a hadoop-conf directory and then copy core-site.xml, hdfs-site.xml and hive-site.xml from Cloudera to the directory, /var/lib/sdc-resources? This article mentioned about soft link - https://github.com/streamsets/tutoria...

If I were to do soft link, do I create a SSH key to be able to password access from Machine A to Machine B? Or must Streamsets be installed at the same node as Cloudera node that contain the three *.xml files?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
2

answered 2018-09-10 07:31:39 -0600

metadaddy gravatar image

Creating a hadoop-conf directory, then copying the xml files is fine. Soft links are just a convenience if you happen to be running Data Collector on a Hadoop node.

edit flag offensive delete link more

Comments

1

Thanks for the response. I copied and validated the flow. It's all good now.

AWT gravatar imageAWT ( 2018-09-11 05:19:28 -0600 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-09-10 06:32:59 -0600

Seen: 107 times

Last updated: Sep 11