zoukankan      html  css  js  c++  java
  • CentOS6.5+hadoop-2.5.2+hbase-1.0.1.1+zookeeper-3.4.6之zookeeper配置

    当hadoop集群如上篇博客CentOS6.5上搭建hadoop 2.5.2 笔记配置成功后,其他配置就容易了许多。

    下面来记录zookeeper的配置过程,

    1、在下载的zookeeper 压缩包中,并不包含真正使用的配置文件,而是一个/conf/zoo_sample.cfg文件,需要使用复制命令复制一份为zoo.cfg的文件。

    #cp zoo_sample.cfg zoo.cfg

    2、在该文件中已经包含了部分配置,只需要修改一下dataDir路径,并配置一下server的hostname:port即可(其中server.1中的1,为服务序号,需要再zookeeper的安装目录下创建data文件夹,在里边创建myid文件,里边的内容即为该服务序号,结构为/zookeeper-3.4.6/data/myid),zoo.cfg如下:

    # The number of milliseconds of each tick
    tickTime=2000
    # The number of ticks that the initial 
    # synchronization phase can take
    initLimit=10
    # The number of ticks that can pass between 
    # sending a request and getting an acknowledgement
    syncLimit=5
    # the directory where the snapshot is stored.
    # do not use /tmp for storage, /tmp here is just 
    # example sakes.
    dataDir=/data/hadoop/zookeeper-3.4.6/data
    # the port at which the clients will connect
    clientPort=2181
    # the maximum number of client connections.
    # increase this if you need to handle more clients
    #maxClientCnxns=60
    #
    # Be sure to read the maintenance section of the 
    # administrator guide before turning on autopurge.
    #
    # http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
    #
    # The number of snapshots to retain in dataDir
    #autopurge.snapRetainCount=3
    # Purge task interval in hours
    # Set to "0" to disable auto purge feature
    #autopurge.purgeInterval=1
    dataLogDir=/data/hadoop/zookeeper-3.4.6/datalog
    server.1=master:2888:3888
    server.2=slave1:2888:3888
    server.3=slave2:2888:3888
    master的/data/myid的内容:
    1

     将配置好的安装目录拷贝到其他机器:

    scp -r /data/hadoop/zookeeper-3.4.6/ slave1:/data/hadoop/
    scp -r /data/hadoop/zookeeper-3.4.6/ slave2:/data/hadoop/

    同样需要在其他机器上配置myid文件,内容要与zoo.cfg中的序号对应。

    如上都配置完成后,即可启动zookeeper,到目录/zookeeper-3.4.6/bin/,执行:

    ./zkServer.sh start
    [root@master bin]# ./zkServer.sh start
    JMX enabled by default
    Using config: /data/hadoop/zookeeper-3.4.6/bin/../conf/zoo.cfg
    Starting zookeeper ... STARTED
    [root@master bin]# jps
    3553 QuorumPeerMain
    3571 Jps

    三个机器都启动后,可以使用

    ./zkCli.sh master:2181来测试各节点是否安装成功

    参考资料:http://zookeeper.apache.org/doc/trunk/zookeeperStarted.html

  • 相关阅读:
    再次或多次格式化导致namenode的ClusterID和datanode的ClusterID之间不一致的问题解决办法
    Linux安装aria2
    POJ 3335 Rotating Scoreboard 半平面交
    hdu 1540 Tunnel Warfare 线段树 区间合并
    hdu 3397 Sequence operation 线段树 区间更新 区间合并
    hud 3308 LCIS 线段树 区间合并
    POJ 3667 Hotel 线段树 区间合并
    POJ 2528 Mayor's posters 贴海报 线段树 区间更新
    POJ 2299 Ultra-QuickSort 求逆序数 线段树或树状数组 离散化
    POJ 3468 A Simple Problem with Integers 线段树成段更新
  • 原文地址:https://www.cnblogs.com/mecca/p/4535239.html
Copyright © 2011-2022 走看看