zoukankan      html  css  js  c++  java
  • 集群同步hive的脚本

    程序员就是把一切手工做的事情变成让计算机来做,从而可以让自己偷偷懒。

    以下就是个非常low的hive文件夹同步程序,至于节点超过100个或者1000个的,可以加个循环了。

    #!/bin/sh
    
    #================ hive 安装包同步 =================#
    # 该脚本用来将name节点的hive文件夹同步到data节点   #
    # 当hive安装包变动时,需要同步data节点,否则oozie  #
    # 通过shell调用hive程序时,会因为分配的节点hive安  #
    # 装包不同步而引起错误                             #
    #==================================================#
    
    # 1.清理旧的hive
    ssh -t hadoop@dwprod-dataslave1 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave2 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave3 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave4 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave5 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave6 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave7 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave8 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave9 rm -r /opt/local/hive
    ssh -t hadoop@dwprod-dataslave10 rm -r /opt/local/hive
    
    # 2.拷贝新的hive
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave1:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave2:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave3:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave4:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave5:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave6:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave7:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave8:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave9:/opt/local/
    scp -r -q /opt/local/hive hadoop@dwprod-dataslave10:/opt/local/

  • 相关阅读:
    查看Android应用所需权限(uses-permission)
    Android Camera后台拍照
    傅里叶变换
    linux文件系统问题:wrong fs type, bad option, bad superblock
    H3 android 系统编译
    开源股票数据工具
    获取股票实时交易数据的方法
    获取历史和实时股票数据接口
    CRC在线计算工具
    硬盘自动挂载
  • 原文地址:https://www.cnblogs.com/30go/p/8776823.html
Copyright © 2011-2022 走看看