Import and export scheduler queue/pool information using Cloudera Manager

Some time it is very difficult to manage so many scheduler queues. In case if some thing goes wrong with your cluster or you want to build another cluster with exact replica of existing cluster, it is very difficult to create scheduler queues manually. So to avoid this manual process follow below steps

The Fair Scheduler queue/pool configurations are available in JSON format at Cloudera Manager home -> YARN -> configuration: Search for below terms

Fair Scheduler Allocations (Deployed)
Fair Scheduler Allocations (Staged)

A list specifying the rules to run to determine which Fair Scheduler configuration to use. (Typically edited using the Rules configuration UI.):

Fair Scheduler Configuration Rules (Deployed)
Fair Scheduler Configuration Rules (Staged)

Take above properties as backup and restore those in new cluster. Restart the service or refresh the outdated pool configurations to take effect.

P.S: To stay safe, save the the yarn-site.xml and fair-scheduler.xml file contents, for future reference.
Previous
Next Post »