StreamSets on Docker - Cloudera Kerberos authentication

asked 2018-11-08 10:35:47 -0500

Daniel gravatar image


We have a kerberized cloudera hadoop cluster. We also have a Streamsets docker image (outside of the Cloudera Cluster) and we try to send data to the HDFS (Stage Library: CDH 5.11.2) from the Streamsets docker container. The pipeline throw’s an error:

Pipeline Status: START_ERROR: HADOOPFS_01 - Failed to configure or connect to the 'hdfs://host:port/user/username' Hadoop file system: Provided Subject must contain a KerberosPrincipal

Could you help us how can we setup the kerberos authentication in a Streamsets docker container? Is there any workaround using this HDFS Library with Kerberos enabled? Thanks, Daniel

edit retag flag offensive close merge delete


What do you have set as "kerberos.client.principal" in your file?

jeff gravatar imagejeff ( 2018-11-09 09:57:59 -0500 )edit