Ask Your Question


asked 2018-09-10 06:32:59 -0500

AWT gravatar image

Hi there,

I have streamsets 3.4.x installed in Machine A and the Cloudera edgenode is Machine B. Question is how to do I get SDC_RESOURCES which is pointing to /var/lib/sdc-resources so do I just create a hadoop-conf directory and then copy core-site.xml, hdfs-site.xml and hive-site.xml from Cloudera to the directory, /var/lib/sdc-resources? This article mentioned about soft link -

If I were to do soft link, do I create a SSH key to be able to password access from Machine A to Machine B? Or must Streamsets be installed at the same node as Cloudera node that contain the three *.xml files?

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2018-09-10 07:31:39 -0500

metadaddy gravatar image

Creating a hadoop-conf directory, then copying the xml files is fine. Soft links are just a convenience if you happen to be running Data Collector on a Hadoop node.

edit flag offensive delete link more



Thanks for the response. I copied and validated the flow. It's all good now.

AWT gravatar imageAWT ( 2018-09-11 05:19:28 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower


Asked: 2018-09-10 06:32:59 -0500

Seen: 187 times

Last updated: Sep 11 '18