每周总结--Hadoop的学习(3)

这周完成内容：

1.shell脚本--myhadoop.sh,hadoop集群启动和关闭

#!/bin/bash

if [ $# -lt 1 ]

then

echo "No Args Input..."

exit ;

fi

case $1 in

"start")

echo " =================== 启动 hadoop 集群 ==================="

echo " --------------- 启动 hdfs ---------------"

ssh centos01 "/opt/modules/hadoop-3.0.0/sbin/start-dfs.sh"

echo " --------------- 启动 yarn ---------------"

ssh centos02 "/opt/modules/hadoop-3.0.0/sbin/start-yarn.sh"

echo " --------------- 启动 historyserver ---------------"

ssh centos01 "/opt/modules/hadoop-3.0.0/bin/mapred --daemon start

historyserver"

;;

"stop")

echo " =================== 关闭 hadoop 集群 ==================="

echo " --------------- 关闭 historyserver ---------------"

ssh centos01 "/opt/modules/hadoop-3.0.0/bin/mapred --daemon stop

historyserver"

echo " --------------- 关闭 yarn ---------------"

ssh centos02 "/opt/modules/hadoop-3.0.0/sbin/stop-yarn.sh"

echo " --------------- 关闭 hdfs ---------------"

ssh centos01 "/opt/modules/hadoop-3.0.0/sbin/stop-dfs.sh"

;;

*)

echo "Input Args Error..."

;;

esac

2.shell脚本--查看进程

#!/bin/bash

for host in centos01 centos02 centos03

do

echo =============== $host ===============

ssh $host jps

done

3.学习HDFS的shell操作

4.下载IDEA

5.配置windows环境变量

遇到问题：

jpsall脚本出现问题

解决：https://blog.csdn.net/weixin_45711348/article/details/115219463?spm=1001.2014.3001.5501

下周目标：继续学习hadoop