Ask Your Question

Revision history [back]

click to hide/show revision 1
initial version

Need help to fix user related issue to connect with Hadoop FS as destination

Hi. I am facing a issue while trying to establish a pipe between Kafka Consumer and Hadoop FS. I am getting user related issue at Hadoop FS end . The error message is as follow: HADOOPFS_59 - Recovery failed to rename old _tmp_ files: org.apache.hadoop.ipc.RemoteException( User: sdc is not allowed to impersonate hdfs

Can anyone help?

Configuration details at Hadoop FS: Hadoop FS tab: Hadoop FS URI: hdfs://hadoop-hadoop-hdfs-nn-0.hadoop-hadoop-hdfs-nn.datalake.svc.cluster.local:9000/ HDFS User: hdfs

Output File tab: File Type: Text files Files Prefix: sdc-${sdc:id()} Directory Template: /tmp/out/${YYYY()}-${MM()}-${DD()}-${hh()} Validate HDFS Permissions: not Ticked.