centos install kafka and zookeeper

1.安装zookeeper

ZooKeeper is a distributed, open-source coordination service for distributed applications.
1.下载
　　wget http://apache.fayea.com/zookeeper/zookeeper-3.3.6/zookeeper-3.3.6.tar.gz
2.解压复制
　　sudo mv zookeeper-3.3.6 /var/

3.编辑配置文件
　　在/var/zookeeper-3.3.6 下面的conf 里面有一个zoo_sample.cfg 复制一个zoo.cfg 然后编辑内容。我这里是都放在/var/data/下的 所以配置是这样的
　　

# The number of milliseconds of each tick
tickTime=2000
# The number of ticks that the initial 
# synchronization phase can take
initLimit=10
# The number of ticks that can pass between 
# sending a request and getting an acknowledgement
syncLimit=5
# the directory where the snapshot is stored.
dataDir=/var/data/zookeeper
# the port at which the clients will connect
clientPort=2181

    在此之前在先新建文件夹以及权限设置这种

　4.启动

　　进入到bin目录 执行./zkServer.sh start

　　然后ps-ef|grep zoo能看到进程说明已经启动成功

　5.测试

　　在bin目录下执行./zkCli.sh -server 127.0.0.1 然后下面会出现一堆日志信息

　　正常的是这样的

　　

Connecting to 127.0.0.1:2181
2016-12-14 15:33:45,074 - INFO  [main:Environment@97] - Client environment:zookeeper.version=3.3.6-1366786, built on 07/29/2012 06:22 GMT
2016-12-14 15:33:45,077 - INFO  [main:Environment@97] - Client environment:host.name=iZ2322gd8vdZ
2016-12-14 15:33:45,077 - INFO  [main:Environment@97] - Client environment:java.version=1.7.0_67
2016-12-14 15:33:45,078 - INFO  [main:Environment@97] - Client environment:java.vendor=Oracle Corporation
2016-12-14 15:33:45,078 - INFO  [main:Environment@97] - Client environment:java.home=/usr/java/jdk1.7.0_67/jre
2016-12-14 15:33:45,079 - INFO  [main:Environment@97] - Client environment:java.class.path=/var/zookeeper-3.3.6/bin/../build/classes:/var/zookeeper-3.3.6/bin/../build/lib/*.jar:/var/zookeeper-3.3.6/bin/../zookeeper-3.3.6.jar:/var/zookeeper-3.3.6/bin/../lib/log4j-1.2.15.jar:/var/zookeeper-3.3.6/bin/../lib/jline-0.9.94.jar:/var/zookeeper-3.3.6/bin/../src/java/lib/*.jar:/var/zookeeper-3.3.6/bin/../conf:.:/usr/java/jdk1.7.0_67/lib:/usr/java/jdk1.7.0_67/jre/lib
2016-12-14 15:33:45,081 - INFO  [main:Environment@97] - Client environment:java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
2016-12-14 15:33:45,081 - INFO  [main:Environment@97] - Client environment:java.io.tmpdir=/tmp
2016-12-14 15:33:45,082 - INFO  [main:Environment@97] - Client environment:java.compiler=<NA>
2016-12-14 15:33:45,082 - INFO  [main:Environment@97] - Client environment:os.name=Linux
2016-12-14 15:33:45,083 - INFO  [main:Environment@97] - Client environment:os.arch=amd64
2016-12-14 15:33:45,083 - INFO  [main:Environment@97] - Client environment:os.version=2.6.32-431.23.3.el6.x86_64
2016-12-14 15:33:45,084 - INFO  [main:Environment@97] - Client environment:user.name=root
2016-12-14 15:33:45,084 - INFO  [main:Environment@97] - Client environment:user.home=/root
2016-12-14 15:33:45,084 - INFO  [main:Environment@97] - Client environment:user.dir=/var/zookeeper-3.3.6/bin
2016-12-14 15:33:45,086 - INFO  [main:ZooKeeper@379] - Initiating client connection, connectString=127.0.0.1:2181 sessionTimeout=30000 watcher=org.apache.zookeeper.ZooKeeperMain$MyWatcher@13a1d5cb
Welcome to ZooKeeper!
2016-12-14 15:33:45,102 - INFO  [main-SendThread():ClientCnxn$SendThread@1058] - Opening socket connection to server /127.0.0.1:2181
2016-12-14 15:33:45,110 - INFO  [main-SendThread(localhost:2181):ClientCnxn$SendThread@947] - Socket connection established to localhost/127.0.0.1:2181, initiating session
JLine support is enabled
2016-12-14 15:33:45,120 - INFO  [main-SendThread(localhost:2181):ClientCnxn$SendThread@736] - Session establishment complete on server localhost/127.0.0.1:2181, sessionid = 0x158fc21940d0002, negotiated timeout = 30000

   到这里zookeeper就安装结束了有什么不明白的可以去官网看看.这个是独立安装 也可以用kafka里面的那个

2.安装kafka

　1.下载

　　 wget http://apache.fayea.com/kafka/0.10.1.0/kafka_2.10-0.10.1.0.tgz

      惯例解压然后复制

　　tar -xvf kafka_2.10-0.10.1.0

　　mv kafka_2.10-0.10.1.0 /var/

   2.编辑配置文件

　　在kafka下面执行

　　vi bin/kafka-server-start.sh  默认

　　export KAFKA_HEAP_OPTS="-Xmx1G -Xms1G" 我用的是这个 ，根据大家的配置自己配置就可以了 

　3.启动

　　bin/kafka-server-start.sh config/server.properties &

　4.测试

　　1.新建topic 

　　　　bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic test

　　2.查看新建的topic

　　　　bin/kafka-topics.sh --list --zookeeper localhost:2181

　　3.使用刚才新建的topic 新建一个消息

　　　　bin/kafka-console-producer.sh --broker-list localhost:9092 --topic test

　　　　然后就可以输入了

　　　　我随便输入的hello 1212121

　　4.再开一个终端 执行bin下面的

　　　　bin/kafka-console-consumer.sh --zookeeper localhost:2181 --topic test --from-beginning

　　　　会看到输入的信息，至此全部完成。关于客户端的用法会在接下来的文章里出现