通过Cloudera Manager部署CDH5.15.1的webUI界面详解
作者：尹正杰
版权声明：原创作品，谢绝转载！否则将追究法律责任。
本篇博客CDH的部署完全通过Cloudera Manager的webUI的安装向导来完成的，关于CM的部署详情请参考：https://www.cnblogs.com/yinzhengjie/p/9495964.html。
一.安装CHD的服务
1>.CM的webUI界面默认的用户名/密码都是小写的admin,我们输入用户名和密码进行登录。操作如下：
2>.同一CM的协议，点击继续
3>.选择CM的免费版本
4>.点击继续
5>.为 CDH 群集安装指定主机
6>.选择CDH本地版本（即我们自己下载好的版本）
7>.CDH的默认存放路径介绍
8>.当CDH安装完毕后，点击继续
9>.等待检查主机完成
10>.我们可以根据下面的提示去相应的服务器做具体的操作，做完操作后点击“重新运行”以验证你是否配置成功！
11>.解决告警信息后，点击完成
[root@node101 ~]# xcall.sh date -R ============= node101.yinzhengjie.org.cn : date -R ============ Thu, 13 Sep 2018 12:32:15 +0800 命令执行成功 ============= node102.yinzhengjie.org.cn : date -R ============ Thu, 13 Sep 2018 12:32:11 +0800 命令执行成功 ============= node103.yinzhengjie.org.cn : date -R ============ Thu, 13 Sep 2018 12:32:11 +0800 命令执行成功 [root@node101 ~]#
[root@node101 ~]# xcall.sh "echo 10 > /proc/sys/vm/swappiness" ============= node101.yinzhengjie.org.cn : echo 10 > /proc/sys/vm/swappiness ============ 命令执行成功 ============= node102.yinzhengjie.org.cn : echo 10 > /proc/sys/vm/swappiness ============ 命令执行成功 ============= node103.yinzhengjie.org.cn : echo 10 > /proc/sys/vm/swappiness ============ 命令执行成功 [root@node101 ~]# [root@node101 ~]# xcall.sh cat /proc/sys/vm/swappiness ============= node101.yinzhengjie.org.cn : cat /proc/sys/vm/swappiness ============ 10 命令执行成功 ============= node102.yinzhengjie.org.cn : cat /proc/sys/vm/swappiness ============ 10 命令执行成功 ============= node103.yinzhengjie.org.cn : cat /proc/sys/vm/swappiness ============ 10 命令执行成功 [root@node101 ~]#
[root@node101 ~]# xcall.sh "echo never > /sys/kernel/mm/transparent_hugepage/defrag" ============= node101.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/defrag ============ 命令执行成功 ============= node102.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/defrag ============ 命令执行成功 ============= node103.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/defrag ============ 命令执行成功 [root@node101 ~]# [root@node101 ~]# xcall.sh cat /sys/kernel/mm/transparent_hugepage/defrag ============= node101.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/defrag ============ always madvise [never] 命令执行成功 ============= node102.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/defrag ============ always madvise [never] 命令执行成功 ============= node103.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/defrag ============ always madvise [never] 命令执行成功 [root@node101 ~]#
[root@node101 ~]# xcall.sh "echo never > /sys/kernel/mm/transparent_hugepage/enabled" ============= node101.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/enabled ============ 命令执行成功 ============= node102.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/enabled ============ 命令执行成功 ============= node103.yinzhengjie.org.cn : echo never > /sys/kernel/mm/transparent_hugepage/enabled ============ 命令执行成功 [root@node101 ~]# [root@node101 ~]# xcall.sh "cat /sys/kernel/mm/transparent_hugepage/enabled" ============= node101.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/enabled ============ always madvise [never] 命令执行成功 ============= node102.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/enabled ============ always madvise [never] 命令执行成功 ============= node103.yinzhengjie.org.cn : cat /sys/kernel/mm/transparent_hugepage/enabled ============ always madvise [never] 命令执行成功 [root@node101 ~]#
12>.自定义需要安装的服务
13>.分配角色
14>.等待审核
15>.集群设置
16>.等待安装完成
17>.完成安装后，点击继续
18>.CDH部署成功界面
19>.进入CDH主界面
二.验证CHD服务是否可用
1>.验证zookeeper是否可以正常使用
[root@node101 ~]# zookeeper-client -server node101.yinzhengjie.org.cn Connecting to node101.yinzhengjie.org.cn 2018-09-15 11:26:03,624 [myid:] - INFO [main:Environment@100] - Client environment:zookeeper.version=3.4.5-cdh5.15.1--1, built on 08/09/2018 16:19 GMT 2018-09-15 11:26:03,628 [myid:] - INFO [main:Environment@100] - Client environment:host.name=node101.yinzhengjie.org.cn 2018-09-15 11:26:03,628 [myid:] - INFO [main:Environment@100] - Client environment:java.version=1.8.0_131 2018-09-15 11:26:03,630 [myid:] - INFO [main:Environment@100] - Client environment:java.vendor=Oracle Corporation 2018-09-15 11:26:03,630 [myid:] - INFO [main:Environment@100] - Client environment:java.home=/soft/jdk1.8.0_131/jre 2018-09-15 11:26:03,630 [myid:] - INFO [main:Environment@100] - Client environment:java.class.path=/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../build/classes:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../build/lib/*.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-log4j12-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/netty-3.10.5.Final.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/log4j-1.2.16.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../lib/jline-2.11.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../zookeeper-3.4.5-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/lib/zookeeper/bin/../src/java/lib/*.jar:/etc/zookeeper/conf::/etc/zookeeper/conf:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/zookeeper.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/zookeeper-3.4.5-cdh5.15.1.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-log4j12-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/netty-3.10.5.Final.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/log4j-1.2.16.jar:/opt/cloudera/parcels/CDH-5.15.1-1.cdh5.15.1.p0.4/bin/../lib/zookeeper/lib/jline-2.11.jar 2018-09-15 11:26:03,630 [myid:] - INFO [main:Environment@100] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib 2018-09-15 11:26:03,630 [myid:] - INFO [main:Environment@100] - Client environment:java.io.tmpdir=/tmp 2018-09-15 11:26:03,630 [myid:] - INFO [main:Environment@100] - Client environment:java.compiler=<NA> 2018-09-15 11:26:03,630 [myid:] - INFO [main:Environment@100] - Client environment:os.name=Linux 2018-09-15 11:26:03,631 [myid:] - INFO [main:Environment@100] - Client environment:os.arch=amd64 2018-09-15 11:26:03,631 [myid:] - INFO [main:Environment@100] - Client environment:os.version=3.10.0-327.el7.x86_64 2018-09-15 11:26:03,631 [myid:] - INFO [main:Environment@100] - Client environment:user.name=root 2018-09-15 11:26:03,631 [myid:] - INFO [main:Environment@100] - Client environment:user.home=/root 2018-09-15 11:26:03,631 [myid:] - INFO [main:Environment@100] - Client environment:user.dir=/root 2018-09-15 11:26:03,632 [myid:] - INFO [main:ZooKeeper@438] - Initiating client connection, connectString=node101.yinzhengjie.org.cn sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@506c589e Welcome to ZooKeeper! 2018-09-15 11:26:03,650 [myid:] - INFO [main-SendThread(node101.yinzhengjie.org.cn:2181):ClientCnxn$SendThread@975] - Opening socket connection to server node101.yinzhengjie.org.cn/172.30.1.101:2181. Will not attempt to authenticate using SASL (unknown error) JLine support is enabled 2018-09-15 11:26:03,710 [myid:] - INFO [main-SendThread(node101.yinzhengjie.org.cn:2181):ClientCnxn$SendThread@852] - Socket connection established, initiating session, client: /172.30.1.101:60205, server: node101.yinzhengjie.org.cn/172.30.1.101:2181 2018-09-15 11:26:03,720 [myid:] - INFO [main-SendThread(node101.yinzhengjie.org.cn:2181):ClientCnxn$SendThread@1235] - Session establishment complete on server node101.yinzhengjie.org.cn/172.30.1.101:2181, sessionid = 0x265db13b97d0001, negotiated timeout = 30000 WATCHER:: WatchedEvent state:SyncConnected type:None path:null [zk: node101.yinzhengjie.org.cn(CONNECTED) 0]
[zk: node101.yinzhengjie.org.cn(CONNECTED) 0] ls / [zookeeper] [zk: node101.yinzhengjie.org.cn(CONNECTED) 1] quit Quitting... 2018-09-15 11:27:09,798 [myid:] - INFO [main:ZooKeeper@684] - Session: 0x265db13b97d0001 closed 2018-09-15 11:27:09,799 [myid:] - INFO [main-EventThread:ClientCnxn$EventThread@512] - EventThread shut down You have new mail in /var/spool/mail/root [root@node101 ~]# [root@node101 ~]#
2>.查看hdfs目录信息（注意权限，如果你想要往指定目录写数据的话，可以指定ACL）
[root@node101 ~]# hdfs dfs -ls -R / drwxrwxrwt - hdfs supergroup 0 2018-09-15 11:06 /tmp drwxrwxrwt - mapred hadoop 0 2018-09-15 11:06 /tmp/logs drwxr-xr-x - hdfs supergroup 0 2018-09-15 11:06 /user drwxrwxrwx - mapred hadoop 0 2018-09-15 11:06 /user/history drwxrwx--- - mapred hadoop 0 2018-09-15 11:06 /user/history/done ls: Permission denied: user=root, access=READ_EXECUTE, inode="/user/history/done":mapred:hadoop:drwxrwx--- drwxrwxrwt - mapred hadoop 0 2018-09-15 11:06 /user/history/done_intermediate [root@node101 ~]#
3>.查看hdfs的webUI界面
查看hdfs的界面如下，试试有种似曾相识的感脚？
