Ask Your Question
0

Does the node access the streamsets DC UI need to be the same node streamsets was installed on?

asked 2018-01-02 14:43:16 -0500

lampshadesdrifter gravatar image

I have a cluster of machines hosting hadoop (MapR) and have install streamsets on one of the nodes (say node002) following the RPM documentation. However, I am accessing the web UI for the data collector from another node, node001.

My question is, when I specify files paths (eg. an origin directory), which file system is the web UI going to be referring to? Eg. if I put an origin directory as /home/myuser/mydata, will the pipeline created in the web UI be looking for that directory in node001 or node002? New to using streamsets, so a more detailed answer would be appreciated. Thanks.

** Ultimately I am asking this because I am currently getting "FileNotFound" and "permission denied" errors while trying to follow the documentation's tutorial and am trying to debug the situation.

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
0

answered 2018-01-03 14:23:24 -0500

jeff gravatar image

In the specific example you posted, it will be the path to the local file on the machine running that particular SDC instance. It sounds like what you really need is a MapR-FS path where it will be loading files from?

edit flag offensive delete link more

Comments

I am trying to load files from a path on the local FS of the node running the SDC service (centos 7). Yet, even when setting the user env. vars., still getting saying dir. not exist (docs: https://streamsets.com/documentation/datacollector/latest/help/index.html#Configuration/DCEnvironmentConfig.ht)

lampshadesdrifter gravatar imagelampshadesdrifter ( 2018-01-03 15:45:39 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-01-02 14:43:16 -0500

Seen: 75 times

Last updated: Jan 03