Need help to fix user related issue to connect with Hadoop FS as destination

asked 2018-12-21 01:34:58 -0600

Arnab gravatar image

Hi. I am facing a issue while trying to establish a pipe between Kafka Consumer and Hadoop FS. I am getting user related issue at Hadoop FS end . The error message is as follow: HADOOPFS_59 - Recovery failed to rename old _tmp_ files: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.authorize.AuthorizationException): User: sdc is not allowed to impersonate hdfs

Can anyone help?

Configuration details at Hadoop FS: Hadoop FS tab: Hadoop FS URI: hdfs://hadoop-hadoop-hdfs-nn-0.hadoop-hadoop-hdfs-nn.datalake.svc.cluster.local:9000/ HDFS User: hdfs

Output File tab: File Type: Text files Files Prefix: sdc-${sdc:id()} Directory Template: /tmp/out/${YYYY()}-${MM()}-${DD()}-${hh()} Validate HDFS Permissions: not Ticked.

edit retag flag offensive close merge delete