Ask Your Question
0

Can't submit MapReduce job: Permission denied:

asked 2019-08-09 10:16:44 -0500

CaptinCCat gravatar image

Hi all, Im still trying to get MapReducer working, error by error.

And now im getting this

MAPREDUCE_0005 - Can't submit MapReduce job: Permission denied: user=sdc, access=EXECUTE, inode="/hadoop/var0/user":hdfs:hadoop:drwx

I created a user folder under /hadoop/var0, and the permissions are as follows drwxrwxrwx So i dont see why this shouldnt be working? I have also configured in the yarn-site.xml the min.user.id property. As the one pre-req to get it going.

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
1

answered 2019-08-09 15:27:41 -0500

jeff gravatar image

Do you have a non-standard HDFS setup? Normally, the path to HDFS user directories would be /user/user1, /user/user2/, etc. Did you follow the HDFS setup instructions as documented here, with your modified structure? Can you show the full output of hadoop fs -ls /hadoop/var0 and hadoop fs -ls /hadoop/var0/user and hadoop fs -ls /hadoop/var0/user/sdc ?

edit flag offensive delete link more

Comments

1

Thanks, I got it figured out. I just recently came onto the team, and we were missing some things for setup.

CaptinCCat gravatar imageCaptinCCat ( 2019-08-19 13:52:09 -0500 )edit
1

Would you mind posting a brief explanation of what you did to fix it? That way, this Q&A may be useful for someone else in the future.

jeff gravatar imagejeff ( 2019-08-19 13:53:59 -0500 )edit
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2019-08-09 10:16:44 -0500

Seen: 71 times

Last updated: Aug 09