Ask Your Question

How to queue information in cluster batch with HadoopFS as Origin

asked 2018-07-06 15:49:36 -0500

newbee2018 gravatar image

updated 2018-07-09 12:18:12 -0500

I have created my pipeline in Cluster Batch mode, which will read from Hadoop origin and write to different hadoop hdfs location on different server. The pipeline job get submitted to default queue in yarn.

I want to know how can I change this queue from default to different queue name.

edit retag flag offensive close merge delete

1 Answer

Sort by ยป oldest newest most voted

answered 2018-07-09 12:17:35 -0500

newbee2018 gravatar image

Under HadoopFS, in Hadoop FS Configuration add key as and value filed add the "Specifiic Queuename"

edit flag offensive delete link more
Login/Signup to Answer

Question Tools

1 follower


Asked: 2018-07-06 15:49:36 -0500

Seen: 198 times

Last updated: Jul 09 '18