在之前博文中提及的高可用集群的基础上,我们这次添加YARN这个模块。
更新部署表如下:
RS:Resource Manager
NM:NodeManager
1、修改mapred-site.xml
vim /data/hadoop/hadoop-3.3.0/etc/hadoop/mapred-site.xml # 修改配置如下 <configuration> <property> <name>mapreduce.framework.name</name> <value>yarn</value> </property> </configuration>
2、修改yarn-site.xml
vim /data/hadoop/hadoop-3.3.0/etc/hadoop/yarn-site.xml #修改配置如下
<configuration>
<property>
<name>yarn.resourcemanager.ha.enabled</name>
<value>true</value>
</property>
<property>
<name>yarn.resourcemanager.cluster-id</name>
<value>cluster1</value>
</property>
<property>
<name>yarn.resourcemanager.ha.rm-ids</name>
<value>rm1,rm2</value>
</property>
<property>
<name>yarn.resourcemanager.hostname.rm1</name>
<value>hadoopnode3</value>
</property>
<property>
<name>yarn.resourcemanager.hostname.rm2</name>
<value>hadoopnode4</value>
</property>
<property>
<name>yarn.resourcemanager.webapp.address.rm1</name>
<value>hadoopnode3:8088</value>
</property>
<property>
<name>yarn.resourcemanager.webapp.address.rm2</name>
<value>hadoopnode4:8088</value>
</property>
<property>
<name>hadoop.zk.address</name>
<value>hadoopnode2:2181,hadoopnode3:2181,hadoopnode4:2181</value>
</property>
</configuration>
3、把配置文件同步全部节点
scp yarn-site.xml mapred-site.xml hadoopnode2:/data/hadoop/hadoop-3.3.0/etc/hadoop/
scp yarn-site.xml mapred-site.xml hadoopnode3:/data/hadoop/hadoop-3.3.0/etc/hadoop/
scp yarn-site.xml mapred-site.xml hadoopnode4:/data/hadoop/hadoop-3.3.0/etc/hadoop/
4、启动YARN
start-yarn.sh
在部署的对应节点上输入jps,可以看到相关进程启动
5、访问可视化
访问:192.168.206.134:8088
至此,YARN模块部署完成!