zoukankan      html  css  js  c++  java
  • 集群同步hive的脚本

    程序员就是把一切手工做的事情变成让计算机来做,从而可以让自己偷偷懒。

    以下就是个非常low的hive文件夹同步程序,至于节点超过100个或者1000个的,可以加个循环了。

    #!/bin/sh
    
    #================ hive 安装包同步 =================#
    # 该脚本用来将name节点的hive文件夹同步到data节点   #
    # 当hive安装包变动时,需要同步data节点,否则oozie  #
    # 通过shell调用hive程序时,会因为分配的节点hive安  #
    # 装包不同步而引起错误                             #
    #==================================================#
    
    # 1.清理旧的hive
    ssh -t hadoop@dwprod-dataslave1 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave2 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave3 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave4 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave5 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave6 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave7 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave8 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave9 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave10 rm -r /opt/local/hive
    
    # 2.拷贝新的hive
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave1:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave2:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave3:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave4:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave5:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave6:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave7:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave8:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave9:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave10:/opt/local/

  • 相关阅读:
    apt常用命令(安装,更新,删除)
    记录一次坑爹的VM连接主机的路程
    VM安装centos
    初窥DB2之insert语句
    关于虚拟机的linux不能使用shell连接时的处理方法
    linux命令之查看字符集
    趣图:学JavaScript
    PHP搭建大文件切割分块上传功能示例
    判断变量是否不为空,函数isset()、!empty()与!is_null()的比较
    Javascript 中 null、NaN和undefined的区别
  • 原文地址:https://www.cnblogs.com/30go/p/8776823.html
Copyright © 2011-2022 走看看