kafka配置

参考
https://blog.csdn.net/laoyang360/article/details/51417009

kafka 单机安装部署
安装顺序
1.jdk
2.zookeeper
3.kafka
4.测试停止

解压zook文件,设置变量

>>export zookeeper_home=/data/zookeeper-3.4.12/
>>source /etc/profile
>>sh $zookeeper_home/bin/zkServer.sh start
ZooKeeper JMX enabled by default
Using config: /data/zookeeper-3.4.12/bin/../conf/zoo.cfg
grep: /data/zookeeper-3.4.12/bin/../conf/zoo.cfg: No such file or directory
mkdir: cannot create directory ‘’: No such file or directory
Starting zookeeper ... STARTED

解压kafka
创建日志文件夹 /data/log
kafka配置
编辑 kafka_2.11-1.1.0/config/server.properties
listeners=PLAINTEXT://10.10.6.154:9092
advertised.listeners=PLAINTEXT://10.10.6.154:9092

编辑 zookeeper.properties
dataDir=/data/kafka_2.11-1.1.0/zookeeper
dataLogDir=/data/log/zookeeper
maxClientCnxns=100
tickTime=2000
initLimit=10

启动脚本
#!/bin/bash
#启动zookeeper
/data/kafka_2.11-1.1.0/bin/zookeeper-server-start.sh /data/kafka_2.11-1.1.0/config/zookeeper.properties &
sleep 3 #等3秒后执行
#启动kafka
/data/kafka_2.11-1.1.0/bin/kafka-server-start.sh /data/kafka_2.11-1.1.0/config/server.properties &

创建测试topic
./kafka-topics.sh --create --zookeeper 10.10.6.222:2181,10.10.6.154:2181 --replication-factor 1 --partitions 1 --topic three

查看topic
./kafka-topics.sh -list -zookeeper 10.10.6.154:2181,10.10.6.222:2181

生产消息
./kafka-console-producer.sh --broker-list 10.10.6.154:9092,10.10.6.222:9092 --topic

消费者
./kafka-console-consumer.sh --zookeeper 10.10.6.222:2181,10.10.6.154:2181 --topic test --from-beginning