Ask Your Question

Streamsets : Hadoop FS

asked 2018-03-08 20:32:58 -0500

Vivian Y gravatar image

In order to write into HDFS in streamsets, is it compulsory to install streamsets through Cloudera Manager in Kerberos Environment? Is it possible to use a standalone installation , to connect to HDFS?

edit retag flag offensive close merge delete

2 Answers

Sort by ยป oldest newest most voted

answered 2018-03-09 08:34:32 -0500

kirti gravatar image

updated 2018-03-09 08:37:32 -0500

For this purpose, it is not necessary to install StreamSets Datacollector using Cloudera Manager.

One can use standalone installation. In fact, we use both standalone as well as CM based installation for testing in Kerberized environment.

Just make sure to follow the directions available in documentation for Kerberos Authentication in HDFS Destination.

edit flag offensive delete link more

answered 2018-03-09 08:30:38 -0500

tmcgrath gravatar image

You can use standalone or CM in a Kerberos env to write to HDFS Destination. At this time, StreamSets does not have a standalone HDFS Origin. Keep an eye on

For more on HDFS and Kerberos, you might start here

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2018-03-08 20:32:58 -0500

Seen: 31 times

Last updated: Mar 09