Ask Your Question
0

How to queue information in cluster batch with HadoopFS as Origin

asked 2018-07-06 15:49:36 -0500

newbee2018 gravatar image

updated 2018-07-09 12:18:12 -0500

I have created my pipeline in Cluster Batch mode, which will read from Hadoop origin and write to different hadoop hdfs location on different server. The pipeline job get submitted to default queue in yarn.

I want to know how can I change this queue from default to different queue name.

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted
1

answered 2018-07-09 12:17:35 -0500

newbee2018 gravatar image

Under HadoopFS, in Hadoop FS Configuration add key as mapred.job.queue.name and value filed add the "Specifiic Queuename"

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower

Stats

Asked: 2018-07-06 15:49:36 -0500

Seen: 27 times

Last updated: Jul 09