mongodb3.4 sharding安装文档

下载

wget -c https://fastdl.mongodb.org/linux/mongodb-linux-x86_64-rhel70-3.4.4.tgz 
下载相对应的测试机为7.0系统因此使用7的 
7|6 安装以及配置没有区别

安装

二进制的软件包，解压即用

安装前配置

hugepage_transport禁用该项。
echo '''         
if test -f /sys/kernel/mm/transparent_hugepage/enabled; then
    echo never > /sys/kernel/mm/transparent_hugepage/enabled
fi
if test -f /sys/kernel/mm/transparent_hugepage/defrag; then
    echo never > /sys/kernel/mm/transparent_hugepage/defrag
fi
''' >>/etc/rc.local
echo 0 > /proc/sys/vm/zone_reclaim_mode

配置

mongo-config

systemLog:
   destination: file
   path: "/data/logs/mongo-config.log"
   logAppend: true
storage:
   dbPath: "/data/mongodb/data/mongo-config"
   journal:
      enabled: true
   syncPeriodSecs: 60
   engine: wiredTiger 
   wiredTiger:
      engineConfig:
         cacheSizeGB: 1
         statisticsLogDelaySecs: 0
         journalCompressor: snappy
      collectionConfig:
         blockCompressor: snappy
      indexConfig:
         prefixCompression: true
operationProfiling:
   slowOpThresholdMs: 200
   mode: slowOp
#security:
   ##keyFile: /data/mongodb/config/data/keyfile
   #authorization: enabled
processManagement:
   fork: true
   pidFilePath: "/home/service/mongodb-3.4.4/mongo-config.pid"
net:
   bindIp: 192.168.233.138,127.0.0.1
   port: 30000
replication:
  replSetName: configRS
sharding:
 clusterRole: configsvr
 
#启动
#!/bin/bash
MONGODB_HOME=/home/service/mongodb-3.4.4
numactl --interleave=all ${MONGODB_HOME}/bin/mongod -f  /home/service/mongodb-3.4.4/conf/mongo-config.conf

mongos

systemLog:
 destination: file
 path: /data/logs/mongos.log
 logAppend: true
processManagement:
  fork: true
  pidFilePath: /home/service/mongodb-3.4.4/mongos.pid
net:
 port: 30001
 bindIp: 192.168.233.139,127.0.0.1
sharding:
 configDB:   configRS/192.168.233.139:30000,192.168.233.138:30000,192.168.233.135:30000

shard0 (shard1|2同0 仅需更改目录端口即可，其他两台机器配置同这个 改ip即可)

systemLog:
   destination: file
   path: /data/logs/mongo_logs/shard0.log
   logAppend: true
storage:
   journal:
      enabled: true
   dbPath: /data/mongo_data/shard0
   directoryPerDB: true
   engine: wiredTiger
   wiredTiger:
      engineConfig:
         cacheSizeGB: 10
         statisticsLogDelaySecs: 0
         journalCompressor: snappy
         directoryForIndexes: true
      collectionConfig:
         blockCompressor: snappy
      indexConfig:
         prefixCompression: true
net:
   port: 27017
   bindIp: 192.168.233.135,127.0.0.1

replication:
   oplogSizeMB: 1024
   replSetName: "shard0"
   secondaryIndexPrefetch: "all"

#security:
   #keyFile: /data/mongo_data/keyfile
   #clusterAuthMode: "keyFile"
   #authorization: enabled

sharding:
   clusterRole: shardsvr

processManagement:
   fork: true
   pidFilePath: "/home/service/mongodb-3.2.8/shard0.pid"

operationProfiling:
   slowOpThresholdMs: 10
   mode: "slowOp"

启动config（全部启动）

#!/bin/bash
MONGODB_HOME=/home/service/mongodb-3.4.4
numactl --interleave=all ${MONGODB_HOME}/bin/mongod -f  /home/service/mongodb-3.4.4/conf/mongo-config.conf

启动shard012

#!/bin/bash
MONGODB_HOME=/home/service/mongodb-3.4.4
numactl --interleave=all ${MONGODB_HOME}/bin/mongod -f /home/service/mongodb-3.4.4/conf/shard0.conf

初始化configsrv

任何一台即可

mongo --port 30000

# /home/service/mongodb-3.4.4/bin/mongo --port 30000
MongoDB shell version v3.4.4
connecting to: mongodb://127.0.0.1:30000/
MongoDB server version: 3.4.4
Welcome to the MongoDB shell.
For interactive help, type "help".
For more comprehensive documentation, see
        http://docs.mongodb.org/
Questions? Try the support group
        http://groups.google.com/group/mongodb-user
Server has startup warnings: 
2017-05-22T16:55:21.147+0800 I CONTROL  [initandlisten] 
2017-05-22T16:55:21.147+0800 I CONTROL  [initandlisten] ** WARNING: Access control is not enabled for the database.
2017-05-22T16:55:21.147+0800 I CONTROL  [initandlisten] **          Read and write access to data and configuration is unrestricted.
2017-05-22T16:55:21.147+0800 I CONTROL  [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended.
2017-05-22T16:55:21.147+0800 I CONTROL  [initandlisten] 
2017-05-22T16:55:21.148+0800 I CONTROL  [initandlisten] 
2017-05-22T16:55:21.148+0800 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'.
2017-05-22T16:55:21.148+0800 I CONTROL  [initandlisten] **        We suggest setting it to 'never'
2017-05-22T16:55:21.148+0800 I CONTROL  [initandlisten] 
2017-05-22T16:55:21.148+0800 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'.
2017-05-22T16:55:21.148+0800 I CONTROL  [initandlisten] **        We suggest setting it to 'never'
2017-05-22T16:55:21.148+0800 I CONTROL  [initandlisten] 
> rs.initiate({_id:"configRS0", configsvr: true, members:[ { _id:0,host:"192.168.233.135:30000"}, { _id:1,host:"192.168.233.138:30000"}, { _id:2,host:"192.168.233.139:30000"} ] });
{ "ok" : 1 }

配置副本集

# /home/service/mongodb-3.4.4/bin/mongo --port 27017
MongoDB shell version v3.4.4
connecting to: mongodb://127.0.0.1:27017/
MongoDB server version: 3.4.4
Welcome to the MongoDB shell.
For interactive help, type "help".
For more comprehensive documentation, see
        http://docs.mongodb.org/
Questions? Try the support group
        http://groups.google.com/group/mongodb-user
Server has startup warnings: 
2017-05-22T18:22:56.293+0800 I CONTROL  [initandlisten] 
2017-05-22T18:22:56.294+0800 I CONTROL  [initandlisten] ** WARNING: Access control is not enabled for the database.
2017-05-22T18:22:56.294+0800 I CONTROL  [initandlisten] **          Read and write access to data and configuration is unrestricted.
2017-05-22T18:22:56.294+0800 I CONTROL  [initandlisten] ** WARNING: You are running this process as the root user, which is not recommended.
2017-05-22T18:22:56.294+0800 I CONTROL  [initandlisten] 
2017-05-22T18:22:56.294+0800 I CONTROL  [initandlisten] 
2017-05-22T18:22:56.294+0800 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/enabled is 'always'.
2017-05-22T18:22:56.294+0800 I CONTROL  [initandlisten] **        We suggest setting it to 'never'
2017-05-22T18:22:56.294+0800 I CONTROL  [initandlisten] 
2017-05-22T18:22:56.294+0800 I CONTROL  [initandlisten] ** WARNING: /sys/kernel/mm/transparent_hugepage/defrag is 'always'.
2017-05-22T18:22:56.294+0800 I CONTROL  [initandlisten] **        We suggest setting it to 'never'
2017-05-22T18:22:56.294+0800 I CONTROL  [initandlisten] 
> use admin;
switched to db admin
>config = {_id:"shard0",members:[{_id:0,host:"192.168.233.135:27017",priority:1},{_id:1,host:"192.168.233.139:27017",priority:3},{_id:2,host:"192.168.233.138:27017",arbiterOnly:true}]}
{
        "_id" : "shard0",
        "members" : [
                {
                        "_id" : 0,
                        "host" : "192.168.233.135:27017",
                        "priority" : 1
                },
                {
                        "_id" : 1,
                        "host" : "192.168.233.139:27017",
                        "priority" : 3
                },
                {
                        "_id" : 2,
                        "host" : "192.168.233.138:27017",
                        "arbiterOnly" : true
                }
        ]
}
> rs.initiate(config);
{ "ok" : 1 }


修改priority：
shard0:PRIMARY> cfg = rs.config();
{
        "_id" : "shard0",
        "version" : 1,
        "protocolVersion" : NumberLong(1),
        "members" : [
                {
                        "_id" : 0,
                        "host" : "192.168.233.135:27017",
                        "arbiterOnly" : false,
                        "buildIndexes" : true,
                        "hidden" : false,
                        "priority" : 1,
                        "tags" : {

                        },
                        "slaveDelay" : NumberLong(0),
                        "votes" : 1
                },
                {
                        "_id" : 1,
                        "host" : "192.168.233.139:27017",
                        "arbiterOnly" : false,
                        "buildIndexes" : true,
                        "hidden" : false,
                        "priority" : 3,
                        "tags" : {

                        },
                        "slaveDelay" : NumberLong(0),
                        "votes" : 1
                },
                {
                        "_id" : 2,
                        "host" : "192.168.233.138:27017",
                        "arbiterOnly" : true,
                        "buildIndexes" : true,
                        "hidden" : false,
                        "priority" : 1,
                        "tags" : {

                        },
                        "slaveDelay" : NumberLong(0),
                        "votes" : 1
                }
        ],
        "settings" : {
                "chainingAllowed" : true,
                "heartbeatIntervalMillis" : 2000,
                "heartbeatTimeoutSecs" : 10,
                "electionTimeoutMillis" : 10000,
                "catchUpTimeoutMillis" : 2000,
                "getLastErrorModes" : {

                },
                "getLastErrorDefaults" : {
                        "w" : 1,
                        "wtimeout" : 0
                },
                "replicaSetId" : ObjectId("5922bdcd0ef1a7889bb9056f")
        }
}
shard0:PRIMARY> cfg.members[0].priority = 99;
99
shard0:PRIMARY> rs.reconfig(cfg)
{ "ok" : 1 }

修改完成 135:27017 成为新的主节点，

副本集shard1,2同0初始化方法一样，这里不在演示。（注意priority值越大就越优先成为主节点）

 

添加sharding

任意一台登陆mongos 30001端口

# /home/service/mongodb-3.4.4/bin/mongo --port 30001                        
MongoDB shell version v3.4.4
connecting to: mongodb://127.0.0.1:30001/
MongoDB server version: 3.4.4
Server has startup warnings: 
2017-05-22T19:16:52.825+0800 I CONTROL  [main] 
2017-05-22T19:16:52.825+0800 I CONTROL  [main] ** WARNING: Access control is not enabled for the database.
2017-05-22T19:16:52.825+0800 I CONTROL  [main] **          Read and write access to data and configuration is unrestricted.
2017-05-22T19:16:52.825+0800 I CONTROL  [main] ** WARNING: You are running this process as the root user, which is not recommended.
2017-05-22T19:16:52.825+0800 I CONTROL  [main] 
mongos> db.runCommand({"addShard":"shard2/192.168.233.135:29017,192.168.233.138:29017,192.168.233.139:29017"});
{ "shardAdded" : "shard2", "ok" : 1 }
mongos> db.runCommand({"addShard":"shard1/192.168.233.135:28017,192.168.233.138:28017,192.168.233.138:29017"});
{ "shardAdded" : "shard1", "ok" : 1 }
mongos> db.runCommand({"addShard":"shard0/192.168.233.135:27017,192.168.233.138:27017,192.168.233.139:27017"});
{ "shardAdded" : "shard0", "ok" : 1 }

#分片添加完成

开启库分片&&开启表分片

mongos> use admin
switched to db admin
mongos> db.runCommand({enablesharding :"test"});
{ "ok" : 1 }
mongos> sh.shardCollection("test.Log", { id: 1});
{ "collectionsharded" : "test.Log", "ok" : 1 }

验证

mongo用–auth选项开启认证，但是在开启认证之前必须有一个有userAdminAnyDatabase角色的管理员账户。 
因此首先我们要创建一个账户，然后修改配置文件加上auth选项，重启mongo。

 

mongo内置用户角色说明：

1. 数据库用户角色：read、readWrite；
2. 数据库管理角色：dbAdmin、dbOwner、userAdmin；
3. 集群管理角色：clusterAdmin、clusterManager、clusterMonitor、hostManager；
4. 备份恢复角色：backup、restore；
5. 所有数据库角色：readAnyDatabase、readWriteAnyDatabase、userAdminAnyDatabase、dbAdminAnyDatabase
6. 超级用户角色：root （如果用户同时有dbOwner 、userAdmin、userAdminAnyDatabase三个角色，就间接或直接提供了系统超级用户的访问）

创建用户

mongos> use admin;
switched to db admin
mongos> db.createUser({
... user: "admin",
... pwd: "admin",
... roles: [{role:"root",db:"admin"}]
... });
Successfully added user: {
        "user" : "admin",
        "roles" : [
                {
                        "role" : "root",
                        "db" : "admin"
                }
        ]
}

关闭三台机器上的mongod和configsvr以及mongos服务

将配置文件注释的key选项打开

security:
   keyFile: /data/mongodb/config/data/keyfile
   authorization: enabled

生成keyfile 
openssl rand -base64 753 >keyfile 
chmod 600 keyfile 
注意权限600

将keyfile 复制到各自的目录 （所有机器用一个key）
configsrv mongos shard0 shard1 shard2

启动脚本

#!/bin/sh  
#  
#chkconfig: 2345 80 90  
#description: mongodb  
MONGODB_HOME=/home/service/mongodb-3.4.4
start() {
 numactl --interleave=all ${MONGODB_HOME}/bin/mongod -f ${MONGODB_HOME}/conf/configsvr.conf 
}

stop() {
 numactl --interleave=all ${MONGODB_HOME}/bin/mongod -f ${MONGODB_HOME}/conf/configsvr.conf  --shutdown
}

case "$1" in
  start)
 start
 ;;
  stop)
 stop
 ;;
  restart)
 stop
 start
 ;;
  *)
 echo $"Usage: $0 {start|stop|restart}"  
 exit 1
esac