Install Hadoop Multinode Cluster using CDH4 in RHEL/CentOS 6.5

Best Affordable Linux and WordPress Services For Your Business
Outsource Your Linux and WordPress Project and Get it Promptly Completed Remotely and Delivered Online.

If You Appreciate What We Do Here On TecMint, You Should Consider:

  1. Stay Connected to: Twitter | Facebook | Google Plus
  2. Subscribe to our email updates: Sign Up Now
  3. Get your own self-hosted blog with a Free Domain at ($3.45/month).
  4. Become a Supporter - Make a contribution via PayPal
  5. Support us by purchasing our premium books in PDF format.
  6. Support us by taking our online Linux courses

We are thankful for your never ending support.

Kuldeep Kulkarni

I'm Kuldeep Kulkarni - Crazy about Linux, Hadoop etc open-source technologies!! By profession I'm Senior system engineer and hadoop administrator in well known IT industry since 2011. Always enthusiastic about sharing my knowledge via blogs :)

Your name can also be listed here. Got a tip? Submit it here to become an TecMint author.

RedHat RHCE and RHCSA Certification Book
Linux Foundation LFCS and LFCE Certification Preparation Guide

You may also like...

46 Responses

  1. suresh kumar says:

    All the daemons started properly but slaves are not communicating with master one throwing an error port no 22 connection refused

    how can resolve this problem

  2. Rohit says:

    How about writing a blog on how to install pig using hadoop single node cluster

  3. Adiputra says:

    need tutorial using nosql and hadoop please

  4. Nitish says:

    Getting Error in Step 11 : Create HDFS /tmp and MapReduce /var Directories

    sudo -u hdfs hadoop fs -mkdir /tmp
    Error is:-
    mkdir: Call From master/ to master:8020 failed on connection exception: Connection refused; For more details see:

    The hdfs-site.xml is configured as:-



    The address and port on which the NameNode UI will listen.

    Can you please assist me in understanding what I missed.

    Telnet isn’t working as no process is listening on 8020 port.


  5. harini says:

    @Lyle Gilbert I have same issue as u had.Can u please help me fix it?

  6. Govind says:

    HI sir, can we also have this setup using Ansible.? please.

  7. Lyle Gilbert says:

    I apologize for my ignorance in advance, but when i follow your instructions i can get to
    sudo -u hdfs hadoop fs -mkdir /tmp
    and all i get is the following error
    mkdir: Call From master/ to master:8020 failed on connection exception: Connection refused; For more details see:
    I do a netstat -tulpn and do not see anything listening on that port. what config should i modify?

    • Lyle Gilbert says:

      I have found the issue, it was an error in my hdfs-site.xml
      again thank you for this wonderful tutorial

      • HAIFA BEN AOUICHA says:

        Hello Lyle,

        May you please give me further details about the modifications you brought to the HDFS-site.xml.

        I am facing the same issue as you : connection refused in port 8020 and telnet / netstat commands don’t fetch any process listening in port 8020.

        Thanks a lot in advance for your feedback, best regards

  8. Ravi says:

    Helle Kuldeep,
    Thanks for this article. I’m trying to install on Centos7, few of the commands are outdated :(
    Do you have an video of making the cluster ?


  9. manish says:

    hello Kuldeep.
    Thanks for the instructions above. I am new in hadoop + linux world. It worked very well for me untill this step.

    Next, copy ‘mapred-site.xml‘ file to node machine using the following scp command.
    [[email protected] conf]# scp /etc/hadoop/conf/mapred-site.xml node:/etc/hadoop/conf/
    mapred-site.xml 100% 200 0.2KB/s 00:00

    I didnt have mapred-site.xml file and thus i created it using vi . I copied the xml you provided.
    However when i am trying to SCP this file to the node: i get an error :
    ssh: Could not resolve hostname node: name of service not known. Lost connection.

    What should i do in order to fix this?


Leave a Reply to harini Cancel reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.