Ask Your Question
0

Streamsets : Hadoop FS

asked 2018-03-08 20:32:58 -0500

Vivian Y gravatar image

In order to write into HDFS in streamsets, is it compulsory to install streamsets through Cloudera Manager in Kerberos Environment? Is it possible to use a standalone installation , to connect to HDFS?

edit retag flag offensive close merge delete

2 Answers

Sort by ยป oldest newest most voted
0

answered 2018-03-09 08:34:32 -0500

kirti gravatar image

updated 2018-03-09 08:37:32 -0500

For this purpose, it is not necessary to install StreamSets Datacollector using Cloudera Manager.

One can use standalone installation. In fact, we use both standalone as well as CM based installation for testing in Kerberized environment.

Just make sure to follow the directions available in documentation for Kerberos Authentication in HDFS Destination.

edit flag offensive delete link more
0

answered 2018-03-09 08:30:38 -0500

todd gravatar image

You can use standalone or CM in a Kerberos env to write to HDFS Destination. At this time, StreamSets does not have a standalone HDFS Origin. Keep an eye on https://issues.streamsets.com/browse/...

For more on HDFS and Kerberos, you might start here https://streamsets.com/documentation/...

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-03-08 20:32:58 -0500

Seen: 77 times

Last updated: Mar 09