zoukankan      html  css  js  c++  java
  • 【kafka】一键启动kafka脚本

    3.1 创建文件
    cd bin 跳转到bin文件夹里
    touch  start-kafka-cluster.sh --新建一键启动文件
    touch  stop-kafka-cluster.sh --新建一键停止文件

    3.2 编写start
    start-kafka-cluster.sh内容:
    #!/bin/bash
    brokers="hadoop01 hadoop02 hadoop03"
    KAFKA_HOME="/home/hadoop/kafka_2.12-2.3.0"
    KAFKA_NAME="kafka_2.12-2.3.0"

    echo "INFO : Begin to start kafka cluster ..."

    for broker in $brokers
    do
      echo "INFO : Starting ${KAFKA_NAME} on ${broker} ..."
      ssh ${broker} -C "source /etc/profile; sh ${KAFKA_HOME}/bin/kafka-server-start.sh -daemon ${KAFKA_HOME}/config/server.properties"
      if [[ $? -eq 0 ]]; then
          echo "INFO:[${broker}] Start successfully"
      fi
    done
    echo "INFO:Kafka cluster starts successfully !"

    3.2 编写stop
    stop-kafka-cluster.sh内容:
    #!/bin/bash
    brokers="hadoop01 hadoop02 hadoop03"
    KAFKA_HOME="/home/hadoop/kafka_2.11-2.3.0"
    KAFKA_NAME="kafka_2.11-2.3.0"
    echo "INFO : Begin to stop kafka cluster ..."
    for broker in $brokers
    do
      echo "INFO : Shut down ${KAFKA_NAME} on ${broker} ..."
      ssh ${broker} "source /etc/profile;bash ${KAFKA_HOME}/bin/kafka-server-stop.sh"
      if [[ $? -ne 0 ]]; then
          echo "INFO : Shut down ${KAFKA_NAME} on ${broker} is down"
      fi
    done
    注1:如 cat -v start-kafka-cluster.sh 或 cat -v start-kafka-cluster.sh 遇见每行末尾有“^M”,则使用cat filename |tr -d ' ' > newfilename 命令
    注2:修改kafka-server-stop.sh(因为安装后本身stop文件不能真正停止kafka进程):
    #PIDS=$(ps ax | grep -i 'kafka.Kafka' | grep java | grep -v grep | awk '{print $1}')
    PIDS=$(ps ax | grep -i 'kafka.Kafka' | awk '{print $1}' | xargs kill -SIGTERM)

    具体执行过程如下:

    [hadoop@hadoop01 ~]$ jps --查看kafka是否启动
    8736 NodeManager
    8593 ResourceManager
    8083 DataNode
    7942 NameNode
    21336 Jps
    8330 SecondaryNameNode
    13595 Kafka
    [hadoop@hadoop01 ~]$ cd bin
    [hadoop@hadoop01 bin]$ sh stop-kafka-cluster.sh --启动stop脚本
    INFO : Begin to stop kafka cluster ...
    INFO : Shut down kafka_2.12-2.3.0 on hadoop01 ...
    No kafka server to stop
    INFO : Shut down kafka_2.12-2.3.0 on hadoop01 is down
    INFO : Shut down kafka_2.12-2.3.0 on hadoop02 ...
    No kafka server to stop
    INFO : Shut down kafka_2.12-2.3.0 on hadoop02 is down
    INFO : Shut down kafka_2.12-2.3.0 on hadoop03 ...
    No kafka server to stop
    INFO : Shut down kafka_2.12-2.3.0 on hadoop03 is down
    INFO : kafka cluster shut down completed!
    [hadoop@hadoop01 bin]$ jps --查看是否停止成功
    8736 NodeManager
    8593 ResourceManager
    8083 DataNode
    21428 Jps
    7942 NameNode
    8330 SecondaryNameNode
    [hadoop@hadoop01 bin]$ sh start-kafka-cluster.sh --启动start脚本
    INFO : Begin to start kafka cluster ...
    INFO : Starting kafka_2.12-2.3.0 on hadoop01 ...
    INFO:[hadoop01] Start successfully
    INFO : Starting kafka_2.12-2.3.0 on hadoop02 ...
    INFO:[hadoop02] Start successfully
    INFO : Starting kafka_2.12-2.3.0 on hadoop03 ...
    INFO:[hadoop03] Start successfully
    INFO:Kafka cluster starts successfully !
    [hadoop@hadoop01 bin]$ jps --查看节点1是否启动成功
    8736 NodeManager
    8593 ResourceManager
    8083 DataNode
    21923 Jps
    7942 NameNode
    21847 Kafka
    8330 SecondaryNameNode
    [hadoop@hadoop01 bin]$ ssh hadoop02 --查看节点2是否启动成功
    Last login: Wed Oct  2 09:21:59 2019 from gateway
    [hadoop@hadoop02 ~]$ jps
    10564 NodeManager
    10888 QuorumPeerMain
    15563 Jps
    10431 DataNode
    15439 Kafka
  • 相关阅读:
    js获取Session问题 dodo
    复制一个datatable的指定行到另外一个datatable dodo
    sqlserver数据库备份与还原语句 dodo
    net软件测试实战技术大全 dodo
    AJAX 浏览器支持 dodo
    使用 vs2005进行负载测试 dodo
    sql使用in批量删除 dodo
    各种浏览器兼容存在的方法:Xenocode Browser Sandbox dodo
    C#调用Windows API函数 dodo
    ewebeditor在ie8下报错 dodo
  • 原文地址:https://www.cnblogs.com/CQ-LQJ/p/11617134.html
Copyright © 2011-2022 走看看