zoukankan      html  css  js  c++  java

  • Mongodb集群与分片 2

    前面我们介绍了简单的集群配置实例。在简单实例中，虽然MongoDB auto-Sharding解决了海量存储问题，和动态扩容问题，但是离我们在真实环境下面所需要的高可靠性和高可用性还有一定的距离。
    下面我们就介绍一个接近实际的解决方案：
    • Shard：使用Replica Sets，来确保数据的可靠性。通过这个方案，可以在每个节点有数据的备份、实现自动控制容错转移和自动恢复
    • Config：使用3个配置服务器，确保元数据完整性
    • Route：配合LVS，实现负载均衡，提高接入性能。
     

    1、配置集群目录

     
    数据存储目录：
     1 $ mkdir -p /home/scotte.ye/data/10001
 2 $ mkdir -p /home/scotte.ye/data/10002
 3 $ mkdir -p /home/scotte.ye/data/10003
 4 
 5 $ mkdir -p /home/scotte.ye/data/10011
 6 $ mkdir -p /home/scotte.ye/data/10012
 7 $ mkdir -p /home/scotte.ye/data/10013
 8 
 9 $ mkdir -p /home/scotte.ye/data/config1
10 $ mkdir -p /home/scotte.ye/data/config2
11 $ mkdir -p /home/scotte.ye/data/config3
    View Code

    日志目录：

    1 $ mkdir -p /home/scotte.ye/data/logs
    View Code
    2、配置 Shard Replica Sets
     
    配置第一组Sets
    1 //10001
2 $ ./mongod --shardsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/10001/ -port=10001 --nohttpinterface --replSet set1
3 
4 //10002
5 $ ./mongod --shardsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/10002/ -port=10002 --nohttpinterface --replSet set1
6 
7 //10003
8 $ ./mongod --shardsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/10003/ -port=10003 --nohttpinterface --replSet set1
    View Code

    配置集群

     1 $ ./mongo -port 10001
 2 MongoDB shell version: 2.0.2
 3 connecting to: 127.0.0.1:10001/test
 4 >#配置集合1
 5 >#构建参数
 6 >cfg={_id:'set1',
 7 members:[{_id:1,host:'192.168.35.106:10001'},
 8                 {_id:1,host:'192.168.35.106:10002'},
 9                 {_id:1,host:'192.168.35.106:10003'}]
10 };
11 {
12      "_id":"set1",
13      "members":[
14           {
15                "_id":1,
16                "host":"192.168.35.106:10001"
17           },
18           {
19                "_id":2,
20                "host":"192.168.35.106:10002"
21           },
22           {
23                "_id":3,
24                "host":"192.168.35.106:10003"
25           }
26      ]
27 }
28 >#让参数生效
29 >rs.initiate(cfg);
30 {
31      "info":"Config now saved locally. Should come online in about aminute.",
32      "OK":1
33 }
34 >#查看运行状态
35 >rs.status();
36 {
37         "set" : "set1",
38         "date" : ISODate("2012-02-29T12:02:46Z"),
39         "myState" : 2,
40         "syncingTo" : "192.168.35.106:10003",
41         "members" : [
42                 {
43                         "_id" : 1,
44                         "name" : "192.168.35.106:10001",
45                         "health" : 1,
46                         "state" : 2,
47                         "stateStr" : "PRIMARY",
48                         "optime" : {
49                                 "t" : 1330435339000,
50                                 "i" : 2413
51                         },
52                         "optimeDate" : ISODate("2012-02-28T13:22:19Z"),
53                         "self" : true
54                 },
55                 {
56                         "_id" : 2,
57                         "name" : "192.168.35.106:10002",
58                         "health" : 1,
59                         "state" : 2,
60                         "stateStr" : "SECONDARY",
61                         "uptime" : 1112736,
62                         "optime" : {
63                                 "t" : 1330435339000,
64                                 "i" : 2413
65                         },
66                         "optimeDate" : ISODate("2012-02-28T13:22:19Z"),
67                         "lastHeartbeat" : ISODate("2012-02-29T12:02:45Z"),
68                         "pingMs" : 0
69                 },
70                 {
71                         "_id" : 3,
72                         "name" : "192.168.35.106:10003",
73                         "health" : 1,
74                         "state" : 1,
75                         "stateStr" : "SECONDARY",
76                         "uptime" : 1112736,
77                         "optime" : {
78                                 "t" : 1330435339000,
79                                 "i" : 2413
80                         },
81                         "optimeDate" : ISODate("2012-02-28T13:22:19Z"),
82                         "lastHeartbeat" : ISODate("2012-02-29T12:02:46Z"),
83                         "pingMs" : 0
84                 }
85         ],
86         "ok" : 1
87 }
    View Code

    配置第二组sets

    1 //10011
2 $ ./mongod --shardsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/10011/ -port=10011 --nohttpinterface --replSet set2
3 
4 //10012
5 $ ./mongod --shardsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/10012/ -port=10012 --nohttpinterface --replSet set2
6 
7 //10013
8 $ ./mongod --shardsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/10013/ -port=10013 --nohttpinterface --replSet set2
    View Code

    配置集群

     1 $ ./mongo -port 10011
 2 MongoDB shell version: 2.0.2
 3 connecting to: 127.0.0.1:10011/test
 4 >#配置集合1
 5 >#构建参数
 6 >cfg={_id:'set2',
 7 members:[{_id:1,host:'192.168.35.106:10011'},
 8                 {_id:1,host:'192.168.35.106:10012'},
 9                 {_id:1,host:'192.168.35.106:10013'}]
10 };
11 {
12      "_id":"set2",
13      "members":[
14           {
15                "_id":1,
16                "host":"192.168.35.106:10011"
17           },
18           {
19                "_id":2,
20                "host":"192.168.35.106:10012"
21           },
22           {
23                "_id":3,
24                "host":"192.168.35.106:10013"
25           }
26      ]
27 }
28 >#让参数生效
29 >rs.initiate(cfg);
30 {
31      "info":"Config now saved locally. Should come online in about aminute.",
32      "OK":1
33 }
34 >#查看运行状态
35 >rs.status();
36 {
37         "set" : "set2",
38         "date" : ISODate("2012-02-29T12:12:46Z"),
39         "myState" : 2,
40         "syncingTo" : "192.168.35.106:10011",
41         "members" : [
42                 {
43                         "_id" : 1,
44                         "name" : "192.168.35.106:10011",
45                         "health" : 1,
46                         "state" : 2,
47                         "stateStr" : "PRIMARY",
48                         "optime" : {
49                                 "t" : 1330435339000,
50                                 "i" : 2413
51                         },
52                         "optimeDate" : ISODate("2012-02-28T13:22:19Z"),
53                         "self" : true
54                 },
55                 {
56                         "_id" : 2,
57                         "name" : "192.168.35.106:10012",
58                         "health" : 1,
59                         "state" : 2,
60                         "stateStr" : "SECONDARY",
61                         "uptime" : 1112736,
62                         "optime" : {
63                                 "t" : 1330435339000,
64                                 "i" : 2413
65                         },
66                         "optimeDate" : ISODate("2012-02-28T13:22:19Z"),
67                         "lastHeartbeat" : ISODate("2012-02-29T12:02:45Z"),
68                         "pingMs" : 0
69                 },
70                 {
71                         "_id" : 3,
72                         "name" : "192.168.35.106:10013",
73                         "health" : 1,
74                         "state" : 1,
75                         "stateStr" : "SECONDARY",
76                         "uptime" : 1112736,
77                         "optime" : {
78                                 "t" : 1330435339000,
79                                 "i" : 2413
80                         },
81                         "optimeDate" : ISODate("2012-02-28T13:22:19Z"),
82                         "lastHeartbeat" : ISODate("2012-02-29T12:02:46Z"),
83                         "pingMs" : 0
84                 }
85         ],
86         "ok" : 1
87 }
    View Code

    启用config servier

    1 $ ./mongod --configsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/config1/ -port=20000 --nohttpinterface
2 $ ./mongod --configsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/config2/ -port=20001 --nohttpinterface
3 $ ./mongod --configsvr --fork -logpath=/home/data/logs/null -dbpath=/home/data/config3/ -port=20002 --nohttpinterface
    View Code

    启用Route server

    1 $ ./mongos -configdb="192.168.35.106:20000,192.168.35.106:20001,192.168.35.106:20002" --fork -logpath=/home/data/logs/null
2 >#查看是否正常运行
3 >ps aux|grep mongos|grep -v grep
4 root      2726  0.0  0.1 174192  3392 ?        Sl   Feb16   3:20 ./mongos -configdb=192.168.35.106:20000,192.168.35.106:20001,192.168.35.106:20002 --fork -logpath=/home/data/logs/null
    View Code

    开始配置Sharding

     1 $ ./mongo -port 10001
 2 MongoDB shell version: 2.0.2
 3 connecting to: 127.0.0.1:10001/test
 4 >#进入管理数据库
 5 >use admin
 6 switched to db admin
 7 >#添加Sharding
 8 > db.runcommand({addshard:'set1/192.168.35.106:10001,192.168.35.106:10002,192.168.35.106:10003'})
 9 {"shardAdded":"set1","ok":1}
10 > db.runCommand({addshard:'set2/192.168.35.106:10011,192.168.35.106:10012,192.168.35.106:10013'})
11 {"shardAdded":"set2","ok":1}
12 >#让test数据库支持Sharding
13 >db.runCommand({enablesharding:'test'})
14 {"ok":1}
15 >#让数据库中的一个集合生效，且根据ID来进行分片
16 >db.runCommand({shardcollection:'test.user',key:{_id:1}})
17 {"collectionshrded":"test.user","ok":1}
18 
19 注：另外可以通过下面两个命令查看sharding情况:
20 >db.runCommand({listshards:1}
21 >printShardingStatus();
    View Code
  • 相关阅读:
    Informatica_(6)性能调优
    Informatica_(5)高级应用
    Informatica_(4)工作流
    Informatica_(3)组件
    Informatica_(2)第一个例子
    Informatica_(1)安装
    Linux_(4)Shell编程(下)
    Linux_(3)Shell编程(上)
    Linux_(2)基本命令(下)
    B
  • 原文地址：https://www.cnblogs.com/chaoa/p/3914151.html
Copyright © 2011-2022 走看看