Codis 集群搭建

Codis 集群搭建

1 安装go1.3.1 CentOS 7.0 安装go 1.3.1

1.1 下载go安装包 golang中国上下载 下载到Downloads下

1.2 解压 tar -zxf go1.3.1.linux-amd64.tar.gz -C /usr/local/

1.3 修改 etc/profile 文件在文件后加入 export的几行，在unset下面直接加，不要有空行

   unset i
   unset -f pathmunge
   export GOROOT=/usr/local/go
   export PATH=$GOROOT/bin:$PATH
   export GOPATH=/data/gopkg

1.4 然后执行 source /etc/profile 刷新配置文件

1.5 运行命令 go 测试go是否安装成功

1.6 在usr/local/go/test 下 运行 go run helloworld.go 测试

2 安装git yum -y install git

3 配置hosts文件 3个机器都是相同的配置

   cd /etc
   vi hosts

   [will@weiguoyuan etc]$ more hosts
   127.0.0.1   localhost localhost.localdomain localhost4 localhost4.localdomain4
   ::1         localhost localhost.localdomain localhost6 localhost6.localdomain6
   10.64.4.57  weiguoyuan
   10.64.4.95  weiguoyuan2
   10.64.4.99  hemy

还需要配置windows下的hosts文件 否则在windows下的jodis客户端访问codis集群机器找不到主机名对应的ip

   C:WindowsSystem32driversetc 

   # Copyright (c) 1993-2009 Microsoft Corp.
   #
   # This is a sample HOSTS file used by Microsoft TCP/IP for Windows.
   #
   # This file contains the mappings of IP addresses to host names. Each
   # entry should be kept on an individual line. The IP address should
   # be placed in the first column followed by the corresponding host name.
   # The IP address and the host name should be separated by at least one
   # space.
   #
   # Additionally, comments (such as these) may be inserted on individual
   # lines or following the machine name denoted by a '#' symbol.
   #
   # For example:
   #
   #      102.54.94.97     rhino.acme.com          # source server
   #       38.25.63.10     x.acme.com              # x client host

   # localhost name resolution is handled within DNS itself.
   #    127.0.0.1       localhost
   #    ::1             localhost

   10.64.4.57   weiguoyuan
   10.64.4.95   weiguoyuan2
   10.64.4.99   hemy

4 安装zookeeper 集群 3个机器上每个机器上都安装一个zookeeper

4.1 官网下载 下载到Downloads下

4.2 tar -xzf zookeeper.**.tar.gz -C /usr/local

4.3 cd /usr/local/zookeeper*/conf

4.4 cp zookeeper.cfg zoo.cfg

4.5 vi zoo.cfg（三个zookeeper的配置文件相同）　在尾部加上节点信息 （节点之前通信），

　　将dataDir=/tmp/zookeeper 修改为dataDir=/data/zookeeper 因为tmp目录在机器重启后会清空，所有权限的用户都可以修改

  [will@weiguoyuan conf]$ more zoo.cfg 
  # The number of milliseconds of each tick
  tickTime=2000
  # The number of ticks that the initial 
  # synchronization phase can take
  initLimit=10
  # The number of ticks that can pass between 
  # sending a request and getting an acknowledgement
  syncLimit=5
  # the directory where the snapshot is stored.
  # do not use /tmp for storage, /tmp here is just 
  # example sakes.
  dataDir=/data/zookeeper
  # the port at which the clients will connect
  clientPort=2181
  # the maximum number of client connections.
  # increase this if you need to handle more clients
  #maxClientCnxns=60
  #
  # Be sure to read the maintenance section of the 
  # administrator guide before turning on autopurge.
  #
  # http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance
  #
  # The number of snapshots to retain in dataDir
  #autopurge.snapRetainCount=3
  # Purge task interval in hours
  # Set to "0" to disable auto purge feature
  #autopurge.purgeInterval=1
  server.1=10.64.4.57:2888:3888
  server.2=10.64.4.95:2888:3888
  server.3=10.64.4.99:2888:3888

4.6 配置zookeeper节点id

先启动3个机器的zookeeper zookeeper会自动生成/data/zookeeper文件夹
再设置节点的myid myid对应的zoo.cfg的server.ID比如192.168.253.128机器上的myid文件内容为1（3个机器分别生成123

    echo "1" >/data/zookeeper/myid #3个机器上分别执行
    echo "2" >/data/zookeeper/myid
    echo "3" >/data/zookeeper/myid

4.7 启动zookeeper

    cd /usr/local/zookeeper/bin
   ./zkServer.sh start
   ./zkServer.sh stop
   ./zkServer.sh status 查看节点状态有 leader,fellower

5 安装codis 编译 3个机器上都需安装

    go get -d github.com/wandoulabs/codis

    cd $GOPATH/src/github.com/wandoulabs/codis

    ./bootstrap.sh （这步比较慢 失败了可以重试）

    make gotest

Codis 配置

1 官方文档 命令方式配置 https://github.com/wandoulabs/codis/blob/master/doc/tutorial_zh.md

2 编写脚本 脚本方式配置

2.1 配置config.ini 3个机器都得配置

   cd /data/gopkg/src/github.com/wandoulabs/codis/sample
   vi config.ini

   [will@weiguoyuan sample]$ more config.ini 
   zk=10.64.4.57:2181,10.64.4.95:2181,10.64.4.99:2181 #zookeeper列表
   product=test
   proxy_id=proxy_1 #3个机器上分别是 proxy_1 proxy_2 proxy_3
   net_timeout=5
   dashboard_addr=weiguoyuan:18087
   coordinator=zookeeper

2.2 配置 start_redis.sh 3个机器都要配置

   cd /data/gopkg/src/github.com/wandoulabs/codis/sample
   vi start_redis.sh

   [will@weiguoyuan sample]$ more start_redis.sh 
   #!/bin/sh
   nohup ../bin/codis-server ./redis_conf/6380.conf &> ./log/redis_6380.log &
   nohup ../bin/codis-server ./redis_conf/6381.conf &> ./log/redis_6381.log &
   nohup ../bin/codis-server ./redis_conf/6382.conf &> ./log/redis_6382.log &
   nohup ../bin/codis-server ./redis_conf/6383.conf &> ./log/redis_6383.log &

   echo "sleep 3s"
   sleep 3
   tail -n 30 ./log/redis_6380.log
   tail -n 30 ./log/redis_6381.log
   tail -n 30 ./log/redis_6382.log
   tail -n 30 ./log/redis_6383.log

2.3 配置 add_group.sh 只需一个机器配置

    cd /data/gopkg/src/github.com/wandoulabs/codis/sample
    vi start_redis.sh

    [will@weiguoyuan sample]$ more add_group.sh 
    #!/bin/sh

    echo "add group 1 with a master(localhost:6381), Notice: do not use localhost when in produciton"
    ../bin/codis-config -c config.ini -L ./log/cconfig.log server add 1 10.64.4.57:6380 master
    ../bin/codis-config -c config.ini -L ./log/cconfig.log server add 1 10.64.4.95:6380 slave
    ../bin/codis-config -c config.ini -L ./log/cconfig.log server add 1 10.64.4.99:6380 slave
    ../bin/codis-config -c config.ini -L ./log/cconfig.log server add 2 10.64.4.57:6381 master
    ../bin/codis-config -c config.ini -L ./log/cconfig.log server add 2 10.64.4.95:6381 slave
    ../bin/codis-config -c config.ini -L ./log/cconfig.log server add 2 10.64.4.99:6381 slave

    echo "add group 2 with a master(localhost:6382), Notice: do not use localhost when in produciton"
    ../bin/codis-config -c config.ini -L ./log/cconfig.log server add 3 10.64.4.95:6382 master
    ../bin/codis-config -c config.ini -L ./log/cconfig.log server add 3 10.64.4.57:6382 slave
    ../bin/codis-config -c config.ini -L ./log/cconfig.log server add 3 10.64.4.99:6382 slave
    ../bin/codis-config -c config.ini -L ./log/cconfig.log server add 4 10.64.4.99:6383 master
    ../bin/codis-config -c config.ini -L ./log/cconfig.log server add 4 10.64.4.95:6383 slave
    ../bin/codis-config -c config.ini -L ./log/cconfig.log server add 4 10.64.4.57:6383 slave

2.4 配置 initslot.sh 只需一个机器配置

    cd /data/gopkg/src/github.com/wandoulabs/codis/sample
       vi initslot.sh

       [will@weiguoyuan sample]$ more initslot.sh 
       #!/bin/sh
       echo "slots initializing..."
       ../bin/codis-config -c config.ini slot init -f
       echo "done"

       echo "set slot ranges to server groups..."
       ../bin/codis-config -c  config.ini slot range-set 0 255 1 online
       ../bin/codis-config -c  config.ini slot range-set 256 511 2 online
       ../bin/codis-config -c  config.ini slot range-set 512 767 3 online
       ../bin/codis-config -c  config.ini slot range-set 768 1023 4 online
       echo "done"

2.5 修改 start_proxy.sh 机器1 不用修改另外两个机器修改

       cd /data/gopkg/src/github.com/wandoulabs/codis/sample
       vi start_proxy.sh

       [will@weiguoyuan sample]$ more start_proxy.sh 
       #!/bin/sh
       echo "shut down proxy_1..."
       ../bin/codis-config -c config.ini proxy offline proxy_1 //修改这里
       echo "done"

       echo "start new proxy..."
       nohup ../bin/codis-proxy --log-level info -c config.ini -L ./log/proxy.log  --cpu=8 --addr=0.0.0.0:190
       00 --http-addr=0.0.0.0:11000 &
       echo "done"

       echo "sleep 3s"
       sleep 3
       tail -n 30 ./log/proxy.log

2.6 修改 set_proxy_online.sh 机器1 不用修改另外两个机器修改

  cd /data/gopkg/src/github.com/wandoulabs/codis/sample
  vi set_proxy_online.sh

  [will@weiguoyuan sample]$ more set_proxy_online.sh 
  #!/bin/sh
  echo "set proxy_1 online"
  ../bin/codis-config -c config.ini proxy online proxy_1 #修改这里
  echo "done"

Codis 集群启动

1 启动3个机器

2 关闭3个机器防火墙

CentOS防火墙分为2中 firewalld 和 iptables
如果是firewalld systemctl stop firewalld.service
如果是iptables  systemctl stop iptables.service

3 启动3个机器的zookeeper

cd /usr/local/zookeeper/bin ./zkServer.sh start

4 在没有配置add_group.sh的两个机器上(机器2和3)

cd /data/gopkg/src/github.com/wandoulabs/codis/sample ./start_redis.sh

5 在配置add_group.sh的机器上(机器1) 上

cd /data/gopkg/src/github.com/wandoulabs/codis/sample ./startall.sh

6 在机器1上打开火狐浏览器 打开网址 http://localhost:18087/admin 可以看到节点 代理信息

7 在机器2和3上分别启动代理

cd /data/gopkg/src/github.com/wandoulabs/codis/sample ./start_proxy.sh

8 在机器1上浏览器http://localhost:18087/admin的代理信息中 设置proxy_2 proxy_3 online

9 可以通过windows上的jodis客户端访问Codis集群了

利用Asis2生成 Webservice服务

http://www.cnblogs.com/weixiaole/p/4372319.html

codis-ha

官方文档 https://github.com/ngaut/codis-ha

go get github.com/ngaut/codis-ha

cd codis-ha

go build

codis-ha --codis-config=localhost:18087 --productName=test

参考

   http://navyaijm.blog.51cto.com/4647068/1637688
   https://github.com/wandoulabs/codis/blob/master/doc/tutorial_zh.md