Install Single Node Hadoop(2.7.2) on Mac

http://blog.hampisoftware.com/index.php/2016/02/22/install-single-node-hadoop-on-mac/

Install Single Node Hadoop on Mac

Operating System: Mac OSX Yosemite
Hadoop Version 2.7.2

Pre-requisites
We need to enable SSH to localhost without a passphrase.

Go to System Preferences, then check “Remote Login” to ON.

Now in a terminal window, ensure that the following succeeds with no passphrase.
$>ssh localhost

Download Hadoop Distribution
Download the latest hadoop distribution from http://mirrors.ibiblio.org/apache/hadoop/common/hadoop-2.7.2/

Hadoop Configuration Files

Go to the directory where your hadoop distribution is installed.

Then change the following files
hadoop_distro/etc/hadoop/hdfs-site.xml

1
2
3
4
5
6
<configuration>
    <property>
        <name>dfs.replication</name>
        <value>1</value>
    </property>
</configuration>

hadoop_distro/etc/hadoop/core-site.xml

1
2
3
4
5
6
<configuration>
    <property>
        <name>fs.defaultFS</name>
        <value>hdfs://localhost:9000</value>
    </property>
</configuration>

hadoop_distro/etc/hadoop/yarn-site.xml

1
2
3
4
5
6
<configuration>
    <property>
        <name>yarn.nodemanager.aux-services</name>
        <value>mapreduce_shuffle</value>
    </property>
</configuration>

hadoop_distro/etc/hadoop/mapred-site.xml

1
2
3
4
5
6
<configuration>
    <property>
        <name>mapreduce.framework.name</name>
        <value>yarn</value>
    </property>
</configuration>

Format HDFS 
$bin/hdfs namenode -format

Start HDFS
$sbin/start-dfs.sh

Start YARN
$sbin/start-yarn.sh

更多相關資料:

https://github.com/100steps/Blogs/issues/10

發表評論
所有評論
還沒有人評論,想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章