小晨精品hadoop2安装文档

  • 格式:docx
  • 大小:51.79 KB
  • 文档页数:26

hadoop2安装文档

1. 安装jdk

每台机器都安装

2. 安装ssh

每台机器都安装

3. 安装zookeeper

随便找奇数台机器上安装。

我的是在:master1ha:2181,master2:2181,master2ha:2181

4. 配置host、机器规划

机器规划:

master1: 192.168.0.201 (active namenode,RM)

master1-ha: 192.168.0.202 (standby namenode,jn,zk)

master2:

192.168.0.203 (active namenode,jn,RM,zk)

master2-ha: 192.168.0.204 (standby namenode,jn,zk)

h2slave1: 192.168.0.205 (datanode,nodemanager)

h2slave2: 192.168.0.206 (datanode,nodemanager)

h2slave3: 192.168.0.207 (datanode,nodemanager)

配置hosts

192.168.0.201 master1

192.168.0.202 master1ha 192.168.0.203 master2

192.168.0.204 master2ha

192.168.0.205 slave1

192.168.0.206 slave2

192.168.0.207 slave3

5. 安装hadoop2

5.1. 上传

用工具上传hadoop2安装文件

或者命令

su – hadoop

cd /home/hadoop

rz -y

5.2. 解压

tar -zxvf hadoop-2.6.0.tar.gz

5.3. 重命名

mv hadoop-2.2.0 hadoop

5.4. 配置环境变量

su – root

vi /etc/profile

添加配置

export HADOOP_HOME=/home/hadoop/hadoop

export PATH=$PATH:$HADOOP_HOME/sbin

source /etc/peofile

su - hadoop

5.5. 配置hadoop2配置文件

将配置文件上传到/home/hadoop/hadoop/etc/hadoop下 5.5.1. core-site.xml

fs.defaultFS

viewfs:///

fs.viewfs.mounttable.default.link./tmp

hdfs://hadoop-cluster1/tmp

fs.viewfs.mounttable.default.link./tmp1

hdfs://hadoop-cluster2/tmp1

5.5.2. hdfs-site.xml

services

hadoop-cluster1,hadoop-cluster2

nodes.hadoop-cluster1

nn1,nn2

node.rpc-address.hadoop-cluster1.nn1

master1:9000

node.rpc-address.hadoop-cluster1.nn2

master1ha:9000

node.http-address.hadoop-cluster1.nn1

master1:50070

node.http-address.hadoop-cluster1.nn2

master1ha:50070

node.secondary.http-address.hadoop-cluster1.nn1

master1:9001

node.secondary.http-address.hadoop-cluster1.nn2

master1ha:9001

dfs.client.failover.proxy.provider.hadoop-cluster1

node.ha.ConfiguredFailoverProxyProvider

nodes.hadoop-cluster2

nn3,nn4

node.rpc-address.hadoop-cluster2.nn3

master2:9000

node.rpc-address.hadoop-cluster2.nn4

master2ha:9000

node.http-address.hadoop-cluster2.nn3

master2:50070

node.http-address.hadoop-cluster2.nn4

master2ha:50070

node.secondary.http-address.hadoop-cluster2.nn3

master2:9001

node.secondary.http-address.hadoop-cluster2.nn4

master2ha:9001

dfs.client.failover.proxy.provider.hadoop-cluster2

node.ha.ConfiguredFailoverProxyProvider

.dir

/home/hadoop/hadoop/namedir

node.shared.edits.dir.hadoop-cluster1.nn1

qjournal://master1ha:8485;master2:8485;master2ha:8485/cluster1

node.shared.edits.dir.hadoop-cluster1.nn2

qjournal://master1ha:8485;master2:8485;master2ha:8485/cluster1

node.shared.edits.dir.hadoop-cluster2.nn3

qjournal://master1ha:8485;master2:8485;master2ha:8485/cluster2

node.shared.edits.dir.hadoop-cluster2.nn4