How to Set Up High Availability for Resource Manager – Part 6

YARN is the Processing Layer of Hadoop, which consists of the Master (Resource Manager) and Slave (Node Manager) services to process the data. Resource Manager (RM) is the critical component that is responsible for resource allocation and management among all the jobs running in Hadoop Cluster.

It is always recommended and best practice to have the Cluster High Availability (HA) enabled on Critical services like Namenode and Resource Manager.

Requirements

In this article, we will see the steps to enable High Availability on Resource Manager.

Enabling High Availability on Resource Manager

1. Go to Cloudera Manager at the following addresses and navigate to YARN –> Actions –> Enable High Availability.

http://13.233.129.39:7180/cmf/home
Cloudera Manager Dashboard
Cloudera Manager Dashboard
Enable High Availability
Enable High Availability

2. Select a server where you are going to have a second Resource Manager. Usually, we will be having a second master server to deploy High Availability. Here, we are selecting master2 for enabling HA.

Add Resource Manager Host
Add Resource Manager Host
Select Resource Manager Hosts
Select Resource Manager Hosts

3. Once selected the master2, click ‘Continue’ to proceed.

Resource Manager Hosts
Resource Manager Hosts

4. Enabling HA process will be started. You can view the background operations by clicking each steps.

Enable High Availability Process
Enable High Availability Process

5. Once all the processes completed, you will be getting ‘Finished’ status. Click ‘Finish’.

Finish High Availability Process
Finish High Availability Process

6. Verify the Resource Manager High availability by viewing the Yarn instances at Cloudera Manager –> YARN –> Instances.

Verify High Availability
Verify High Availability

You can see two Resource Manager, one will be in the state ‘Active’, another will be in ‘Standby’.

Check Resource Manager High Availability
Check Resource Manager High Availability
Conclusion

In this article, we have gone through the step by step procedure to enable High Availability on Resource Manager. Whenever the Active Resource Manager goes down, the Standby Resource manager will become Active so that production will not be having an outage.

If you liked this article, then do subscribe to email alerts for Linux tutorials. If you have any questions or doubts? do ask for help in the comments section.

If You Appreciate What We Do Here On TecMint, You Should Consider:

TecMint is the fastest growing and most trusted community site for any kind of Linux Articles, Guides and Books on the web. Millions of people visit TecMint! to search or browse the thousands of published articles available FREELY to all.

If you like what you are reading, please consider buying us a coffee ( or 2 ) as a token of appreciation.

Support Us

We are thankful for your never ending support.

Got something to say? Join the discussion.

Have a question or suggestion? Please leave a comment to start the discussion. Please keep in mind that all comments are moderated and your email address will NOT be published.

This site uses Akismet to reduce spam. Learn how your comment data is processed.