小晨精品hadoop2安装文档
- 格式:docx
- 大小:51.79 KB
- 文档页数:26
hadoop2安装文档
1. 安装jdk
每台机器都安装
2. 安装ssh
每台机器都安装
3. 安装zookeeper
随便找奇数台机器上安装。
我的是在:master1ha:2181,master2:2181,master2ha:2181
4. 配置host、机器规划
机器规划:
master1: 192.168.0.201 (active namenode,RM)
master1-ha: 192.168.0.202 (standby namenode,jn,zk)
master2:
192.168.0.203 (active namenode,jn,RM,zk)
master2-ha: 192.168.0.204 (standby namenode,jn,zk)
h2slave1: 192.168.0.205 (datanode,nodemanager)
h2slave2: 192.168.0.206 (datanode,nodemanager)
h2slave3: 192.168.0.207 (datanode,nodemanager)
配置hosts
192.168.0.201 master1
192.168.0.202 master1ha 192.168.0.203 master2
192.168.0.204 master2ha
192.168.0.205 slave1
192.168.0.206 slave2
192.168.0.207 slave3
5. 安装hadoop2
5.1. 上传
用工具上传hadoop2安装文件
或者命令
su – hadoop
cd /home/hadoop
rz -y
5.2. 解压
tar -zxvf hadoop-2.6.0.tar.gz
5.3. 重命名
mv hadoop-2.2.0 hadoop
5.4. 配置环境变量
su – root
vi /etc/profile
添加配置
export HADOOP_HOME=/home/hadoop/hadoop
export PATH=$PATH:$HADOOP_HOME/sbin
source /etc/peofile
su - hadoop
5.5. 配置hadoop2配置文件
将配置文件上传到/home/hadoop/hadoop/etc/hadoop下 5.5.1. core-site.xml
fs.defaultFS
viewfs:///
fs.viewfs.mounttable.default.link./tmp
hdfs://hadoop-cluster1/tmp
fs.viewfs.mounttable.default.link./tmp1
hdfs://hadoop-cluster2/tmp1
5.5.2. hdfs-site.xml
services
hadoop-cluster1,hadoop-cluster2
nodes.hadoop-cluster1
nn1,nn2
node.rpc-address.hadoop-cluster1.nn1
master1:9000
node.rpc-address.hadoop-cluster1.nn2
master1ha:9000
node.http-address.hadoop-cluster1.nn1
master1:50070
node.http-address.hadoop-cluster1.nn2
master1ha:50070
node.secondary.http-address.hadoop-cluster1.nn1
master1:9001
node.secondary.http-address.hadoop-cluster1.nn2
master1ha:9001
dfs.client.failover.proxy.provider.hadoop-cluster1
node.ha.ConfiguredFailoverProxyProvider
nodes.hadoop-cluster2
nn3,nn4
node.rpc-address.hadoop-cluster2.nn3
master2:9000
node.rpc-address.hadoop-cluster2.nn4
master2ha:9000
node.http-address.hadoop-cluster2.nn3
master2:50070
node.http-address.hadoop-cluster2.nn4
master2ha:50070
node.secondary.http-address.hadoop-cluster2.nn3
master2:9001
node.secondary.http-address.hadoop-cluster2.nn4
master2ha:9001
dfs.client.failover.proxy.provider.hadoop-cluster2
node.ha.ConfiguredFailoverProxyProvider
.dir
/home/hadoop/hadoop/namedir
node.shared.edits.dir.hadoop-cluster1.nn1
qjournal://master1ha:8485;master2:8485;master2ha:8485/cluster1
node.shared.edits.dir.hadoop-cluster1.nn2
qjournal://master1ha:8485;master2:8485;master2ha:8485/cluster1
node.shared.edits.dir.hadoop-cluster2.nn3
qjournal://master1ha:8485;master2:8485;master2ha:8485/cluster2
node.shared.edits.dir.hadoop-cluster2.nn4