StreamSets on Docker - Cloudera Kerberos authentication

asked 2018-11-08 10:35:47 -0600

Daniel gravatar image

Hi,

We have a kerberized cloudera hadoop cluster. We also have a Streamsets docker image (outside of the Cloudera Cluster) and we try to send data to the HDFS (Stage Library: CDH 5.11.2) from the Streamsets docker container. The pipeline throw’s an error:

Pipeline Status: START_ERROR: HADOOPFS_01 - Failed to configure or connect to the 'hdfs://host:port/user/username' Hadoop file system: org.apache.hadoop.security.KerberosAuthException: Provided Subject must contain a KerberosPrincipal

Could you help us how can we setup the kerberos authentication in a Streamsets docker container? Is there any workaround using this HDFS Library with Kerberos enabled? Thanks, Daniel

edit retag flag offensive close merge delete

Comments

What do you have set as "kerberos.client.principal" in your sdc.properties file?

jeff gravatar imagejeff ( 2018-11-09 09:57:59 -0600 )edit