Mongodb高可用分片集羣搭建

原創 snipercai 2019-05-08 00:11

1 安裝前準備

1.1 主機列表

本次實驗選擇5臺主機

節點ip OS版本 jdk版本 hostname 安裝軟件
192.168.0.1 RHEL7.4 openjdk-1.8.0.131 mongodb01 config1/config2/config3
192.168.0.2 RHEL7.4 openjdk-1.8.0.131 mongodb02 mongos1/mongos2/mongos3
192.168.0.3 RHEL7.4 openjdk-1.8.0.131 mongodb03 shard01主/arbiter02/shard03從
192.168.0.4 RHEL7.4 openjdk-1.8.0.131 mongodb04 shard01從/shard02主/arbiter03
192.168.0.5 RHEL7.4 openjdk-1.8.0.131 mongodb05 arbiter01/shard02從/shard03主

 1.2 安裝包下載

官方下載地址：
https://www.mongodb.com/download-center/community

軟件包說明

Package Name Description
mongodb-org A metapackage that will automatically install the four component packages listed below.
mongodb-org-server Contains the mongod daemon, associated init script, and a configuration file(/etc/mongod.conf). You can use the initialization script to start mongod with the configuration file. For details, see Run MongoDB Community Edition.
mongodb-org-mongos Contains the mongos daemon.
mongodb-org-shell Contains the mongo shell.
mongodb-org-tools Contains the following MongoDB tools: mongoimport bsondump, mongodump, mongoexport, mongofiles, mongorestore, mongostat, and mongotop.

本文選擇3.4.20 for redhat7版本下載:
https://repo.mongodb.org/yum/redhat/7/mongodb-org/3.4/x86_64/RPMS/mongodb-org-server-3.4.20-1.el7.x86_64.rpm
https://repo.mongodb.org/yum/redhat/7/mongodb-org/3.4/x86_64/RPMS/mongodb-org-mongos-3.4.20-1.el7.x86_64.rpm
https://repo.mongodb.org/yum/redhat/7/mongodb-org/3.4/x86_64/RPMS/mongodb-org-tools-3.4.20-1.el7.x86_64.rpm
https://repo.mongodb.org/yum/redhat/7/mongodb-org/3.4/x86_64/RPMS/mongodb-org-shell-3.4.20-1.el7.x86_64.rpm

1.3 配置yum源

cat << EOF > /etc/yum.repos.d/mongodb3.4.20.repo
[mongodb3.4.20]
name=mongodb3.4.20
baseurl=ftp://192.168.0.1/pub/mongodb3.4.20/
enabled=1
gpgcheck=0
gpgkey=
EOF

1.4 安裝mongodb

yum install -y mongodb-org-server

1.5 目錄創建

mkdir -p /var/run/mongodb
mkdir -p /data/mongod{1..3}
mkdir -p /data/mongoc{1..3}
mkdir -p /etc/mongo

chown -R mongod.mongod /data
chown -R mongod.mongod /var/run/mongodb

1.5 創建集羣祕鑰

openssl rand -base64 756 > /etc/mongo/mongo.key  
chown -R mongod.mongod /etc/mongo
chmod -R 600 /etc/mongo

scp -r /etc/mongo 192.168.0.2:/etc/
scp -r /etc/mongo 192.168.0.3:/etc/
scp -r /etc/mongo 192.168.0.4:/etc/
scp -r /etc/mongo 192.168.0.5:/etc/

副本集總體思路是用戶名、密碼和keyfile文件，keyfile需要各個副本集服務啓動時加載而且要是同一文件，然後在操作庫是需要用戶名、密碼
KeyFile文件必須滿足條件:
（1）至少6個字符，小於1024字節，採base64編碼，756生成出來剛好1024個字符的祕鑰文件
（2）認證時候不考慮文件中空白字符
（3）連接到副本集的成員和mongos進成的keyfile文件內容必須一樣
（4）必須是base64編碼,但是不能有等號
（5）文件權限必須是x00,也就是說，不能分配任何權限給group成員和other成員

2 Config server部署 

2.1 config server配置

  生成三個config server的配置文件

cat << EOF > /etc/mongo/mongoc1.conf
systemLog:
  destination: file
  logAppend: true
  logRotate: reopen
  timeStampFormat: iso8601-local
  path: /var/log/mongodb/mongoc1.log

storage:
  dbPath: /data/mongoc1
  journal:
    enabled: true
  mmapv1:
    smallFiles: true
  wiredTiger:
    engineConfig:
      cacheSizeGB: 1
      directoryForIndexes: true
    collectionConfig:
      blockCompressor: zlib
    indexConfig:
      prefixCompression: true
  directoryPerDB: true
      
processManagement:
  fork: true
  pidFilePath: /var/run/mongodb/mongoc1.pid

net:
  port: 27019
  bindIp: 0.0.0.0

setParameter:
   enableLocalhostAuthBypass: true
   
security:
  keyFile: /etc/mongo/mongo.key
  authorization: enabled

replication:
  replSetName: mongoc
  oplogSizeMB: 1024
  
sharding:
  clusterRole: configsvr

EOF

cat << EOF > /etc/mongo/mongoc2.conf
systemLog:
  destination: file
  logAppend: true
  logRotate: reopen
  timeStampFormat: iso8601-local
  path: /var/log/mongodb/mongoc2.log

storage:
  dbPath: /data/mongoc2
  journal:
    enabled: true
  mmapv1:
    smallFiles: true
  wiredTiger:
    engineConfig:
      cacheSizeGB: 1
      directoryForIndexes: true
    collectionConfig:
      blockCompressor: zlib
    indexConfig:
      prefixCompression: true
  directoryPerDB: true
      
processManagement:
  fork: true
  pidFilePath: /var/run/mongodb/mongoc2.pid

net:
  port: 27029
  bindIp: 0.0.0.0

setParameter:
   enableLocalhostAuthBypass: true
   
security:
  keyFile: /etc/mongo/mongo.key
  authorization: enabled

replication:
  replSetName: mongoc
  oplogSizeMB: 1024
  
sharding:
  clusterRole: configsvr

EOF

cat << EOF > /etc/mongo/mongoc3.conf
systemLog:
  destination: file
  logAppend: true
  logRotate: reopen
  timeStampFormat: iso8601-local
  path: /var/log/mongodb/mongoc3.log

storage:
  dbPath: /data/mongoc3
  journal:
    enabled: true
  mmapv1:
    smallFiles: true
  wiredTiger:
    engineConfig:
      cacheSizeGB: 1
      directoryForIndexes: true
    collectionConfig:
      blockCompressor: zlib
    indexConfig:
      prefixCompression: true
  directoryPerDB: true
      
processManagement:
  fork: true
  pidFilePath: /var/run/mongodb/mongoc3.pid

net:
  port: 27039
  bindIp: 0.0.0.0

setParameter:
   enableLocalhostAuthBypass: true
   
security:
  keyFile: /etc/mongo/mongo.key
  authorization: enabled

replication:
  replSetName: mongoc
  oplogSizeMB: 1024
  
sharding:
  clusterRole: configsvr

EOF

 注意：

enableLocalhostAuthBypass: true  //以便從本機可以進行初始化腳本執行，否則無法通過認證，報錯

{
        "ok" : 0,
        "errmsg" : "not authorized on admin to execute command { replSetGetStatus: 1.0 }",
        "code" : 13,
        "codeName" : "Unauthorized"
}

2.2 修改配置文件權限

chown -R mongod.mongod /etc/mongo

2.3 啓動服務

mongod -f /etc/mongo/mongoc1.conf
mongod -f /etc/mongo/mongoc2.conf
mongod -f /etc/mongo/mongoc3.conf

[root@localhost mongodb]# mongod -f /etc/mongo/mongoc1.conf
about to fork child process, waiting until server is ready for connections.
forked process: 10942
child process started successfully, parent exiting
[root@localhost mongodb]# mongod -f /etc/mongo/mongoc2.conf
mongod -f /etc/mongo/mongoc3.confabout to fork child process, waiting until server is ready for connections.
forked process: 10981
child process started successfully, parent exiting
[root@localhost mongodb]# mongod -f /etc/mongo/mongoc3.conf
about to fork child process, waiting until server is ready for connections.
forked process: 11016
child process started successfully, parent exiting

 2.4 檢查服務狀態

[root@localhost mongodb]# netstat -anp|grep :270
tcp        0      0 0.0.0.0:27039           0.0.0.0:*               LISTEN      11016/mongod        
tcp        0      0 0.0.0.0:27019           0.0.0.0:*               LISTEN      10942/mongod        
tcp        0      0 0.0.0.0:27029           0.0.0.0:*               LISTEN      10981/mongod        

2.5 初始化

# mongo --port 27019
MongoDB shell version v3.4.20
connecting to: mongodb://127.0.0.1:27019/
MongoDB server version: 3.4.20
> use adminuse admin
switched to db admin 
> rs.initiate(
{
  _id: "mongoc",
  version: 1,
  protocolVersion: 1,
  writeConcernMajorityJournalDefault: true,
  configsvr: true,
  members: [
    {
      _id: 0,
      host: "192.168.0.1:27019",
      arbiterOnly: false,
      buildIndexes: true,
      hidden: false,
      priority: 66,
      tags: {
        mongoc: "YES"
      },
      slaveDelay: 0,
      votes: 1
    },
    {
      _id: 1,
      host: "192.168.0.1:27029",
      arbiterOnly: false,
      buildIndexes: true,
      hidden: false,
      priority: 55,
      tags: {
        mongoc: "NO"
      },
      slaveDelay: 0,
      votes: 1
    },
    {
      _id: 2,
      host: "192.168.0.1:27039",
      arbiterOnly: false,
      buildIndexes: true,
      hidden: false,
      priority: 33,
      tags: {
        mongoc: "NO"
      },
      slaveDelay: 0,
      votes: 1
    }
  ],
  settings: {
    chainingAllowed : true,
  }
}
)

{ "ok" : 1 }

2.6 查看集羣狀態

mongoc:SECONDARY> rs.status()
{
        "set" : "mongoc",
        "date" : ISODate("2019-05-06T10:15:44.833Z"),
        "myState" : 2,
        "term" : NumberLong(0),
        "syncingTo" : "",
        "syncSourceHost" : "",
        "syncSourceId" : -1,
        "configsvr" : true,
        "heartbeatIntervalMillis" : NumberLong(2000),
        "optimes" : {
                "lastCommittedOpTime" : {
                        "ts" : Timestamp(0, 0),
                        "t" : NumberLong(-1)
                },
                "appliedOpTime" : {
                        "ts" : Timestamp(1557137738, 1),
                        "t" : NumberLong(-1)
                },
                "durableOpTime" : {
                        "ts" : Timestamp(1557137738, 1),
                        "t" : NumberLong(-1)
                }
        },
        "members" : [
                {
                        "_id" : 0,
                        "name" : "192.168.0.1:27019",
                        "health" : 1,
                        "state" : 2,
                        "stateStr" : "SECONDARY",
                        "uptime" : 37,
                        "optime" : {
                                "ts" : Timestamp(1557137738, 1),
                                "t" : NumberLong(-1)
                        },
                        "optimeDate" : ISODate("2019-05-06T10:15:38Z"),
                        "syncingTo" : "",
                        "syncSourceHost" : "",
                        "syncSourceId" : -1,
                        "infoMessage" : "could not find member to sync from",
                        "configVersion" : 1,
                        "self" : true,
                        "lastHeartbeatMessage" : ""
                },
                {
                        "_id" : 1,
                        "name" : "192.168.0.1:27029",
                        "health" : 1,
                        "state" : 2,
                        "stateStr" : "SECONDARY",
                        "uptime" : 5,
                        "optime" : {
                                "ts" : Timestamp(1557137738, 1),
                                "t" : NumberLong(-1)
                        },
                        "optimeDurable" : {
                                "ts" : Timestamp(1557137738, 1),
                                "t" : NumberLong(-1)
                        },
                        "optimeDate" : ISODate("2019-05-06T10:15:38Z"),
                        "optimeDurableDate" : ISODate("2019-05-06T10:15:38Z"),
                        "lastHeartbeat" : ISODate("2019-05-06T10:15:44.029Z"),
                        "lastHeartbeatRecv" : ISODate("2019-05-06T10:15:41.100Z"),
                        "pingMs" : NumberLong(0),
                        "lastHeartbeatMessage" : "",
                        "syncingTo" : "",
                        "syncSourceHost" : "",
                        "syncSourceId" : -1,
                        "infoMessage" : "",
                        "configVersion" : 1
                },
                {
                        "_id" : 2,
                        "name" : "192.168.0.1:27039",
                        "health" : 1,
                        "state" : 2,
                        "stateStr" : "SECONDARY",
                        "uptime" : 5,
                        "optime" : {
                                "ts" : Timestamp(1557137738, 1),
                                "t" : NumberLong(-1)
                        },
                        "optimeDurable" : {
                                "ts" : Timestamp(1557137738, 1),
                                "t" : NumberLong(-1)
                        },
                        "optimeDate" : ISODate("2019-05-06T10:15:38Z"),
                        "optimeDurableDate" : ISODate("2019-05-06T10:15:38Z"),
                        "lastHeartbeat" : ISODate("2019-05-06T10:15:44.030Z"),
                        "lastHeartbeatRecv" : ISODate("2019-05-06T10:15:41.097Z"),
                        "pingMs" : NumberLong(0),
                        "lastHeartbeatMessage" : "",
                        "syncingTo" : "",
                        "syncSourceHost" : "",
                        "syncSourceId" : -1,
                        "infoMessage" : "",
                        "configVersion" : 1
                }
        ],
        "ok" : 1
}

3 Shard server部署

3.1 Shard server配置

  生成三個shard server的配置文件

cat << EOF > /etc/mongo/mongod1.conf
systemLog:
  destination: file
  logAppend: true
  logRotate: reopen
  timeStampFormat: iso8601-local
  path: /var/log/mongodb/mongod1.log

storage:
  dbPath: /data/mongod1
  journal:
    enabled: true
  mmapv1:
    smallFiles: true
  wiredTiger:
    engineConfig:
      cacheSizeGB: 1
      directoryForIndexes: true
    collectionConfig:
      blockCompressor: zlib
    indexConfig:
      prefixCompression: true
  directoryPerDB: true

processManagement:
  fork: true  
  pidFilePath: /var/run/mongodb/mongod1.pid

net:
  port: 27017
  bindIp: 0.0.0.0

security:
  keyFile: /etc/mongo/mongo.key
  authorization: enabled

replication:
  replSetName: shard1
sharding:
  clusterRole: shardsvr

EOF

cat << EOF > /etc/mongo/mongod2.conf
systemLog:
  destination: file
  logAppend: true
  logRotate: reopen
  timeStampFormat: iso8601-local
  path: /var/log/mongodb/mongod2.log

storage:
  dbPath: /data/mongod2
  journal:
    enabled: true
  mmapv1:
    smallFiles: true
  wiredTiger:
    engineConfig:
      cacheSizeGB: 1
      directoryForIndexes: true
    collectionConfig:
      blockCompressor: zlib
    indexConfig:
      prefixCompression: true
  directoryPerDB: true

processManagement:
  fork: true  
  pidFilePath: /var/run/mongodb/mongod2.pid

net:
  port: 27027
  bindIp: 0.0.0.0

security:
  keyFile: /etc/mongo/mongo.key
  authorization: enabled

replication:
  replSetName: shard2
sharding:
  clusterRole: shardsvr

EOF

cat << EOF > /etc/mongo/mongod3.conf
systemLog:
  destination: file
  logAppend: true
  logRotate: reopen
  timeStampFormat: iso8601-local
  path: /var/log/mongodb/mongod3.log

storage:
  dbPath: /data/mongod3
  journal:
    enabled: true
  mmapv1:
    smallFiles: true
  wiredTiger:
    engineConfig:
      cacheSizeGB: 1
      directoryForIndexes: true
    collectionConfig:
      blockCompressor: zlib
    indexConfig:
      prefixCompression: true
  directoryPerDB: true

processManagement:
  fork: true  
  pidFilePath: /var/run/mongodb/mongod3.pid

net:
  port: 27037
  bindIp: 0.0.0.0

security:
  keyFile: /etc/mongo/mongo.key
  authorization: enabled

replication:
  replSetName: shard3
sharding:
  clusterRole: shardsvr

EOF

3.2 修改配置文件權限

chown -R mongod.mongod /etc/mongo

3.3 啓動服務

mongod -f /etc/mongo/mongod1.conf
mongod -f /etc/mongo/mongod2.conf
mongod -f /etc/mongo/mongod3.conf

[root@localhost ~]# mongod -f /etc/mongo/mongod1.conf
mongod -f /etc/mongo/mongod2.conf
mongod -f /etc/mongo/mongod3.confabout to fork child process, waiting until server is ready for connections.
forked process: 9836
child process started successfully, parent exiting
[root@localhost ~]# mongod -f /etc/mongo/mongod2.conf
about to fork child process, waiting until server is ready for connections.
forked process: 9863
child process started successfully, parent exiting
[root@localhost ~]# mongod -f /etc/mongo/mongod3.conf
about to fork child process, waiting until server is ready for connections.
forked process: 9890
child process started successfully, parent exiting

 3.4 檢查服務狀態

[root@localhost mongodb]# netstat -anp|grep :27
tcp        0      0 0.0.0.0:27037           0.0.0.0:*               LISTEN      10660/mongod        
tcp        0      0 0.0.0.0:27017           0.0.0.0:*               LISTEN      10606/mongod        
tcp        0      0 0.0.0.0:27027           0.0.0.0:*               LISTEN      10633/mongod   

3.5 初始化shard1集羣

# mongo --port 27017
MongoDB shell version v3.4.20
connecting to: mongodb://127.0.0.1:27019/
MongoDB server version: 3.4.20
> use admin
switched to db admin 
> rs.initiate(
{
  _id: "shard1",
  version: 1,
  protocolVersion: 1,
  writeConcernMajorityJournalDefault: true,
  members: [
    {
      _id: 0,
      host: "192.168.0.3:27017",
      arbiterOnly: false,
      buildIndexes: true,
      hidden: false,
      priority: 66,
      tags: {
        mongoc: "YES"
      },
      slaveDelay: 0,
      votes: 1
    },
    {
      _id: 1,
      host: "192.168.0.4:27017",
      arbiterOnly: false,
      buildIndexes: true,
      hidden: false,
      priority: 55,
      tags: {
        mongoc: "NO"
      },
      slaveDelay: 0,
      votes: 1
    },
    {
      _id: 2,
      host: "192.168.0.5:27017",
      arbiterOnly: true,
      buildIndexes: true,
      hidden: false,
      priority: 33,
      slaveDelay: 0,
      votes: 1
    }
  ],
  settings: {
    chainingAllowed : true,
  }
}
)

{ "ok" : 1 }

注意：

arbiters節點不能設置tags，如果設置會初始化報錯：

{
        "ok" : 0,
        "errmsg" : "Cannot set tags on arbiters.",
        "code" : 93,
        "codeName" : "InvalidReplicaSetConfig"
}

3.6 查看shard1集羣狀態

shard1:PRIMARY> rs.status()
{
        "set" : "shard1",
        "date" : ISODate("2019-05-06T11:14:18.379Z"),
        "myState" : 1,
        "term" : NumberLong(1),
        "syncingTo" : "",
        "syncSourceHost" : "",
        "syncSourceId" : -1,
        "heartbeatIntervalMillis" : NumberLong(2000),
        "optimes" : {
                "lastCommittedOpTime" : {
                        "ts" : Timestamp(1557141251, 1),
                        "t" : NumberLong(1)
                },
                "appliedOpTime" : {
                        "ts" : Timestamp(1557141251, 1),
                        "t" : NumberLong(1)
                },
                "durableOpTime" : {
                        "ts" : Timestamp(1557141251, 1),
                        "t" : NumberLong(1)
                }
        },
        "members" : [
                {
                        "_id" : 0,
                        "name" : "192.168.0.3:27017",
                        "health" : 1,
                        "state" : 1,
                        "stateStr" : "PRIMARY",
                        "uptime" : 2024,
                        "optime" : {
                                "ts" : Timestamp(1557141251, 1),
                                "t" : NumberLong(1)
                        },
                        "optimeDate" : ISODate("2019-05-06T11:14:11Z"),
                        "syncingTo" : "",
                        "syncSourceHost" : "",
                        "syncSourceId" : -1,
                        "infoMessage" : "could not find member to sync from",
                        "electionTime" : Timestamp(1557141160, 1),
                        "electionDate" : ISODate("2019-05-06T11:12:40Z"),
                        "configVersion" : 1,
                        "self" : true,
                        "lastHeartbeatMessage" : ""
                },
                {
                        "_id" : 1,
                        "name" : "192.168.0.4:27017",
                        "health" : 1,
                        "state" : 2,
                        "stateStr" : "SECONDARY",
                        "uptime" : 108,
                        "optime" : {
                                "ts" : Timestamp(1557141251, 1),
                                "t" : NumberLong(1)
                        },
                        "optimeDurable" : {
                                "ts" : Timestamp(1557141251, 1),
                                "t" : NumberLong(1)
                        },
                        "optimeDate" : ISODate("2019-05-06T11:14:11Z"),
                        "optimeDurableDate" : ISODate("2019-05-06T11:14:11Z"),
                        "lastHeartbeat" : ISODate("2019-05-06T11:14:18.178Z"),
                        "lastHeartbeatRecv" : ISODate("2019-05-06T11:14:16.815Z"),
                        "pingMs" : NumberLong(0),
                        "lastHeartbeatMessage" : "",
                        "syncingTo" : "192.168.0.3:27017",
                        "syncSourceHost" : "192.168.0.3:27017",
                        "syncSourceId" : 0,
                        "infoMessage" : "",
                        "configVersion" : 1
                },
                {
                        "_id" : 2,
                        "name" : "192.168.0.5:27017",
                        "health" : 1,
                        "state" : 7,
                        "stateStr" : "ARBITER",
                        "uptime" : 108,
                        "lastHeartbeat" : ISODate("2019-05-06T11:14:18.180Z"),
                        "lastHeartbeatRecv" : ISODate("2019-05-06T11:14:16.729Z"),
                        "pingMs" : NumberLong(0),
                        "lastHeartbeatMessage" : "",
                        "syncingTo" : "",
                        "syncSourceHost" : "",
                        "syncSourceId" : -1,
                        "infoMessage" : "",
                        "configVersion" : 1
                }
        ],
        "ok" : 1
}

3.7 初始化shard2集羣

# mongo --port 27027
MongoDB shell version v3.4.20
connecting to: mongodb://127.0.0.1:27019/
MongoDB server version: 3.4.20
> use admin
switched to db admin 
> rs.initiate(
{
  _id: "shard2",
  version: 1,
  protocolVersion: 1,
  writeConcernMajorityJournalDefault: true,
  members: [
    {
      _id: 0,
      host: "192.168.0.4:27027",
      arbiterOnly: false,
      buildIndexes: true,
      hidden: false,
      priority: 66,
      tags: {
        mongoc: "YES"
      },
      slaveDelay: 0,
      votes: 1
    },
    {
      _id: 1,
      host: "192.168.0.5:27027",
      arbiterOnly: false,
      buildIndexes: true,
      hidden: false,
      priority: 55,
      tags: {
        mongoc: "NO"
      },
      slaveDelay: 0,
      votes: 1
    },
    {
      _id: 2,
      host: "192.168.0.3:27027",
      arbiterOnly: true,
      buildIndexes: true,
      hidden: false,
      priority: 33,
      slaveDelay: 0,
      votes: 1
    }
  ],
  settings: {
    chainingAllowed : true,
  }
}
)

{ "ok" : 1 }

注意：

如果設置初始化報錯，因爲arbiters節點無法執行初始化，可以換一個非arbiters節點重新連接mongo進行初始化即可，建議在主節點上進行初始化：

{
        "ok" : 0,
        "errmsg" : "This node, 192.168.0.3:27027, with _id 2 is not electable under the new configuration version 1 for replica set shard2",
        "code" : 93,
        "codeName" : "InvalidReplicaSetConfig"

3.8 查看shard2集羣狀態

shard2:PRIMARY> rs.status()
{
        "set" : "shard2",
        "date" : ISODate("2019-05-06T12:24:18.775Z"),
        "myState" : 1,
        "term" : NumberLong(1),
        "syncingTo" : "",
        "syncSourceHost" : "",
        "syncSourceId" : -1,
        "heartbeatIntervalMillis" : NumberLong(2000),
        "optimes" : {
                "lastCommittedOpTime" : {
                        "ts" : Timestamp(1557145450, 1),
                        "t" : NumberLong(1)
                },
                "appliedOpTime" : {
                        "ts" : Timestamp(1557145450, 1),
                        "t" : NumberLong(1)
                },
                "durableOpTime" : {
                        "ts" : Timestamp(1557145450, 1),
                        "t" : NumberLong(1)
                }
        },
        "members" : [
                {
                        "_id" : 0,
                        "name" : "192.168.0.4:27027",
                        "health" : 1,
                        "state" : 1,
                        "stateStr" : "PRIMARY",
                        "uptime" : 81,
                        "optime" : {
                                "ts" : Timestamp(1557145450, 1),
                                "t" : NumberLong(1)
                        },
                        "optimeDate" : ISODate("2019-05-06T12:24:10Z"),
                        "syncingTo" : "",
                        "syncSourceHost" : "",
                        "syncSourceId" : -1,
                        "infoMessage" : "could not find member to sync from",
                        "electionTime" : Timestamp(1557145448, 1),
                        "electionDate" : ISODate("2019-05-06T12:24:08Z"),
                        "configVersion" : 1,
                        "self" : true,
                        "lastHeartbeatMessage" : ""
                },
                {
                        "_id" : 1,
                        "name" : "192.168.0.5:27027",
                        "health" : 1,
                        "state" : 2,
                        "stateStr" : "SECONDARY",
                        "uptime" : 20,
                        "optime" : {
                                "ts" : Timestamp(1557145450, 1),
                                "t" : NumberLong(1)
                        },
                        "optimeDurable" : {
                                "ts" : Timestamp(1557145450, 1),
                                "t" : NumberLong(1)
                        },
                        "optimeDate" : ISODate("2019-05-06T12:24:10Z"),
                        "optimeDurableDate" : ISODate("2019-05-06T12:24:10Z"),
                        "lastHeartbeat" : ISODate("2019-05-06T12:24:16.918Z"),
                        "lastHeartbeatRecv" : ISODate("2019-05-06T12:24:14.932Z"),
                        "pingMs" : NumberLong(0),
                        "lastHeartbeatMessage" : "",
                        "syncingTo" : "192.168.0.4:27027",
                        "syncSourceHost" : "192.168.0.4:27027",
                        "syncSourceId" : 0,
                        "infoMessage" : "",
                        "configVersion" : 1
                },
                {
                        "_id" : 2,
                        "name" : "192.168.0.3:27027",
                        "health" : 1,
                        "state" : 7,
                        "stateStr" : "ARBITER",
                        "uptime" : 20,
                        "lastHeartbeat" : ISODate("2019-05-06T12:24:16.921Z"),
                        "lastHeartbeatRecv" : ISODate("2019-05-06T12:24:14.879Z"),
                        "pingMs" : NumberLong(0),
                        "lastHeartbeatMessage" : "",
                        "syncingTo" : "",
                        "syncSourceHost" : "",
                        "syncSourceId" : -1,
                        "infoMessage" : "",
                        "configVersion" : 1
                }
        ],
        "ok" : 1
}

3.9 初始化shard3集羣

# mongo --port 27037
MongoDB shell version v3.4.20
connecting to: mongodb://127.0.0.1:27019/
MongoDB server version: 3.4.20
> use admin
switched to db admin 
> rs.initiate(
{
  _id: "shard3",
  version: 1,
  protocolVersion: 1,
  writeConcernMajorityJournalDefault: true,
  members: [
    {
      _id: 0,
      host: "192.168.0.5:27037",
      arbiterOnly: false,
      buildIndexes: true,
      hidden: false,
      priority: 66,
      tags: {
        mongoc: "YES"
      },
      slaveDelay: 0,
      votes: 1
    },
    {
      _id: 1,
      host: "192.168.0.3:27037",
      arbiterOnly: false,
      buildIndexes: true,
      hidden: false,
      priority: 55,
      tags: {
        mongoc: "NO"
      },
      slaveDelay: 0,
      votes: 1
    },
    {
      _id: 2,
      host: "192.168.0.4:27037",
      arbiterOnly: true,
      buildIndexes: true,
      hidden: false,
      priority: 33,
      slaveDelay: 0,
      votes: 1
    }
  ],
  settings: {
    chainingAllowed : true,
  }
}
)

{ "ok" : 1 }

3.10 查看shard3集羣狀態

shard3:PRIMARY> rs.status()
{
        "set" : "shard3",
        "date" : ISODate("2019-05-06T12:05:16.024Z"),
        "myState" : 2,
        "term" : NumberLong(2),
        "syncingTo" : "192.168.0.5:27037",
        "syncSourceHost" : "192.168.0.5:27037",
        "syncSourceId" : 0,
        "heartbeatIntervalMillis" : NumberLong(2000),
        "optimes" : {
                "lastCommittedOpTime" : {
                        "ts" : Timestamp(1557144307, 1),
                        "t" : NumberLong(2)
                },
                "appliedOpTime" : {
                        "ts" : Timestamp(1557144307, 1),
                        "t" : NumberLong(2)
                },
                "durableOpTime" : {
                        "ts" : Timestamp(1557144307, 1),
                        "t" : NumberLong(2)
                }
        },
        "members" : [
                {
                        "_id" : 0,
                        "name" : "192.168.0.5:27037",
                        "health" : 1,
                        "state" : 1,
                        "stateStr" : "PRIMARY",
                        "uptime" : 82,
                        "optime" : {
                                "ts" : Timestamp(1557144307, 1),
                                "t" : NumberLong(2)
                        },
                        "optimeDurable" : {
                                "ts" : Timestamp(1557144307, 1),
                                "t" : NumberLong(2)
                        },
                        "optimeDate" : ISODate("2019-05-06T12:05:07Z"),
                        "optimeDurableDate" : ISODate("2019-05-06T12:05:07Z"),
                        "lastHeartbeat" : ISODate("2019-05-06T12:05:14.898Z"),
                        "lastHeartbeatRecv" : ISODate("2019-05-06T12:05:14.289Z"),
                        "pingMs" : NumberLong(0),
                        "lastHeartbeatMessage" : "",
                        "syncingTo" : "",
                        "syncSourceHost" : "",
                        "syncSourceId" : -1,
                        "infoMessage" : "",
                        "electionTime" : Timestamp(1557144256, 1),
                        "electionDate" : ISODate("2019-05-06T12:04:16Z"),
                        "configVersion" : 1
                },
                {
                        "_id" : 1,
                        "name" : "192.168.0.3:27037",
                        "health" : 1,
                        "state" : 2,
                        "stateStr" : "SECONDARY",
                        "uptime" : 5081,
                        "optime" : {
                                "ts" : Timestamp(1557144307, 1),
                                "t" : NumberLong(2)
                        },
                        "optimeDate" : ISODate("2019-05-06T12:05:07Z"),
                        "syncingTo" : "192.168.0.5:27037",
                        "syncSourceHost" : "192.168.0.5:27037",
                        "syncSourceId" : 0,
                        "infoMessage" : "",
                        "configVersion" : 1,
                        "self" : true,
                        "lastHeartbeatMessage" : ""
                },
                {
                        "_id" : 2,
                        "name" : "192.168.0.4:27037",
                        "health" : 1,
                        "state" : 7,
                        "stateStr" : "ARBITER",
                        "uptime" : 82,
                        "lastHeartbeat" : ISODate("2019-05-06T12:05:14.898Z"),
                        "lastHeartbeatRecv" : ISODate("2019-05-06T12:05:15.690Z"),
                        "pingMs" : NumberLong(0),
                        "lastHeartbeatMessage" : "",
                        "syncingTo" : "",
                        "syncSourceHost" : "",
                        "syncSourceId" : -1,
                        "infoMessage" : "",
                        "configVersion" : 1
                }
        ],
        "ok" : 1
}

4 Route部署

4.1 Route配置

cat << EOF > /etc/mongo/mongos1.conf
systemLog:
  destination: file
  logAppend: true
  path: /var/log/mongodb/mongos1.log

processManagement:
  fork: true
  pidFilePath: /var/run/mongodb/mongos1.pid

net:
  bindIp: 0.0.0.0
  port: 27015

security:
  keyFile: /etc/mongo/mongo.key

sharding:
  configDB: mongoc/192.168.0.1:27019,192.168.0.1:27029,192.168.0.1:27039
EOF

cat << EOF > /etc/mongo/mongos2.conf
systemLog:
  destination: file
  logAppend: true
  path: /var/log/mongodb/mongos2.log

processManagement:
  fork: true
  pidFilePath: /var/run/mongodb/mongos2.pid

net:
  bindIp: 0.0.0.0
  port: 27025

security:
  keyFile: /etc/mongo/mongo.key

sharding:
  configDB: mongoc/192.168.0.1:27019,192.168.0.1:27029,192.168.0.1:27039
EOF

cat << EOF > /etc/mongo/mongos3.conf
systemLog:
  destination: file
  logAppend: true
  path: /var/log/mongodb/mongos3.log

processManagement:
  fork: true
  pidFilePath: /var/run/mongodb/mongos3.pid

net:
  bindIp: 0.0.0.0
  port: 27035

security:
  keyFile: /etc/mongo/mongo.key

sharding:
  configDB: mongoc/192.168.0.1:27019,192.168.0.1:27029,192.168.0.1:27039
EOF

4.2 修改配置文件權限

chown -R mongod.mongod /etc/mongo

4.3 啓動服務

mongos -f /etc/mongo/mongos1.conf
mongos -f /etc/mongo/mongos2.conf
mongos -f /etc/mongo/mongos3.conf

[root@localhost mongo]# mongos -f /etc/mongo/mongos1.conf
about to fork child process, waiting until server is ready for connections.
forked process: 10720
child process started successfully, parent exiting
[root@localhost mongo]# mongos -f /etc/mongo/mongos2.conf
about to fork child process, waiting until server is ready for connections.
forked process: 10741
child process started successfully, parent exiting
[root@localhost mongo]# mongos -f /etc/mongo/mongos3.conf
about to fork child process, waiting until server is ready for connections.
forked process: 10761
child process started successfully, parent exiting

注意：

route啓動的命令是mongos，不是config或者shard server所用的mongod

 4.4 檢查服務狀態

[root@localhost mongo]# netstat -anp|grep 27     
tcp        0      0 0.0.0.0:27035           0.0.0.0:*               LISTEN      10761/mongos        
tcp        0      0 0.0.0.0:27015           0.0.0.0:*               LISTEN      10720/mongos        
tcp        0      0 0.0.0.0:27025           0.0.0.0:*               LISTEN      10741/mongos        

4.5 創建管理員用戶

# mongo --port 27015
MongoDB shell version v3.4.20
connecting to: mongodb://127.0.0.1:27015/
MongoDB server version: 3.4.20
Welcome to the MongoDB shell.
For interactive help, type "help".
For more comprehensive documentation, see
        http://docs.mongodb.org/
Questions? Try the support group
        http://groups.google.com/group/mongodb-user
mongos> use admin
mongos> db.createUser(
{
    user: "root",
    pwd: "root12345",
    roles: [ { role: "__system", db: "admin" } ]
  }
)
Successfully added user: {
        "user" : "root",
        "roles" : [
                {
                        "role" : "__system",
                        "db" : "admin"
                }
        ]
}

4.6 使用新管理員用戶登錄

mongo -uroot -proot12345  --port 27015 --authenticationDatabase admin

4.7 添加shard

sh.addShard("shard1/192.168.0.3:27017,192.168.0.4:27017,192.168.0.5:27017")
sh.addShard("shard2/192.168.0.3:27027,192.168.0.4:27027,192.168.0.5:27027")
sh.addShard("shard3/192.168.0.3:27037,192.168.0.4:27037,192.168.0.5:27037")

mongos> sh.addShard("shard1/192.168.0.3:27017,192.168.0.4:27017,192.168.0.527017")sh.addShard("shard1/192.168.0.3:27017,192.168.0.4:27017,192.168.0.5:27017")
{ "shardAdded" : "shard1", "ok" : 1 }
mongos> sh.addShard("shard2/192.168.0.3:27027,192.168.0.4:27027,192.168.0.5:27027")sh.addShard("shard2/192.168.0.3:27027,192.168.0.4:27027,192.168.0.5:27027")
{ "shardAdded" : "shard2", "ok" : 1 }
mongos> sh.addShard("shard3/192.168.0.5:27037,10.124.3.119:27037,10.124.3.120:27037")sh.addShard("shard3/10.124.3.118:27037,192.168.0.4:27037,192.168.0.5:27037")
{ "shardAdded" : "shard3", "ok" : 1 }

4.8 查看狀態

mongos> sh.status()
--- Sharding Status --- 
  sharding version: {
        "_id" : 1,
        "minCompatibleVersion" : 5,
        "currentVersion" : 6,
        "clusterId" : ObjectId("5cd00957fa232d6987f3c1de")
  }
  shards:
        {  "_id" : "shard1",  "host" : "shard1/192.168.0.3:27017,192.168.0.4:27017",  "state" : 1 }
        {  "_id" : "shard2",  "host" : "shard2/192.168.0.4:27027,192.168.0.5:27027",  "state" : 1 }
        {  "_id" : "shard3",  "host" : "shard3/192.168.0.3:27037,192.168.0.5:27037",  "state" : 1 }
  active mongoses:
        "3.4.20" : 3
  autosplit:
        Currently enabled: yes
  balancer:
        Currently enabled:  yes
        Currently running:  no
NaN
        Failed balancer rounds in last 5 attempts:  0
        Migration Results for the last 24 hours: 
                No recent migrations
  databases:

 

 

 

 

發表評論
所有評論
還沒有人評論，想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章

windows搭建mongodb分片集羣

實驗目標： 同一個服務器搭建mongodb分片羣集 OS:Win10 Mongodb：4.2 新手實驗記錄，如不正確，請批准指正。   第一步：創建分片集羣的實例   cd C:\Program Files\MongoDB\Server

woaigreydogs 2020-07-08 09:09:02

安裝mongodb複製集

安裝mongodb複製集步驟如下： 1、進入官網https://www.mongodb.com下載頁面。 2、將文件放入linux服務器（此處下載的是紅帽6.X或CentOS6.X）安裝文件：mongodb-linux-x86_64-

华华鱼 2020-07-08 11:42:12

MongoDB三大系統庫詳解

一、概述   MongoDB默認會創建admin、config、local、test數據庫。test庫是一個默認的數據庫，除了test庫外admin、config、local庫爲系統庫。admin庫主要存儲MongoDB的用戶、角

_梓杰_ 2020-07-08 11:20:01

MongoDB各類場景的故障恢復概要(持續更新)

文章目錄一、CPU/IOPS打滿三、活躍連接數打高四、磁盤打高/滿五、副本集故障5.1 複製延遲5.2 複製中斷六、分片故障6.1 shard節點宕機七、數據丟失八、其它場景8.1 內存打高 一、CPU/IOPS打滿 結合mong

_梓杰_ 2020-07-08 11:20:01

現場填坑系列--mongodb 複製集跨機房同步網絡問題探查

接到現場報告，客戶MongoDB間數據延遲越來越大，有的已經超過2-3個小時，造成有些打到延遲mongodb上面的數據庫請求無法反應數據庫的最新更改。這個問題反覆出現在高峯期尤其明顯，持續近一月。 架構 客戶爲異地雙機房架構，兩地機房相隔

yizhu2000 2020-07-08 09:39:05

mongodb隨記

monggoDb使用 插入嵌套字典 數據集代碼 { "_id": 3, "project_id": 1, "col_id": 1, "case_id": 3, "name": "鎮上",

xvnmeng 2020-07-08 08:23:44

MongoDb操作手冊

 MongoVUE 是個比較好用的MongoDB客戶端，需要註冊，但是可以變成永久使用， 一、基礎操作 新增一個連接      進入的界面形如 二、進階操作   1、查看所有數據，會有三種格式的觀看方式，分別爲樹形，表格，bjos

wangyonghua8 2020-07-08 07:35:08

centos7 安裝MongoDB4.2.1 簡單步驟

整理了centos7 下安裝最新的mondb數據庫以及簡單配置,需要的小夥伴拿走吧 ~~ centos7 安裝MongoDB4.2.1 簡單步驟

宇小子 2020-07-08 05:36:26

[Centos] 安裝和配置 MongoDB

1. 下載安裝包 wget https://fastdl.mongodb.org/linux/mongodb-linux-x86_64-4.2.0.tgz 2. 解壓文件 將文件放在 /usr/local 目錄下 tar zxf

風の唄を聴け 2020-07-08 04:26:33

MongoDB java連接參數說明

    MongoDB在java中使用時，客戶端連接參數說明；     此說明居於mongo驅動包：mongodb-driver-3.4.2，官方驅動下載地址：http://central.maven.org/maven2/org/mon

lgh1117 2020-07-08 03:03:37

CentOS7安裝MongoDB4

一、安裝 把mongodb安裝包上傳到服務器，然後解壓縮 # tar zxvf mongodb-linux-x86_64-rhel70-4.2.8.tgz # mv mongodb-linux-x86_64-rhel70-4.2.8 /u

盛桃云 2020-07-08 01:53:08

mongodb查詢語法

mongodb查詢語法 所有操作分爲聚合查詢和非聚合查詢 聚合查詢中又分爲：聚合階段，和聚合操作 聚合階段主要對文檔進行：選擇，投影，分組，加減字段，排序，連接 聚合操作是用來實現聚合階段的功能。 如爲了實現選擇，可以使用數學表達式  

wyg_031113 2020-07-08 01:12:25

mongodb之操作接口大全

mongodb之操作接口大全 mongodb可以使用不同的引擎，比如WiredTiger, In-Memory等等。所以引擎會定義一個通用的接口和實現。在src/mongo/db/catalog目錄下定義了Mongod中的文檔，數據庫，集

wyg_031113 2020-07-08 01:12:25

mongodb之圖聚合查詢 之圖查詢$graphLookup

mongodb之圖聚合查詢 之圖查詢$graphLookup 官網的流程解釋： $graphLookup Performs a recursive search on a collection, with options for rest

wyg_031113 2020-07-08 01:12:25

mongodb之mongod啓動，各核心類之間的關係

mongodb之mongod啓動，各核心類之間的關係 目錄 mongodb之mongod啓動 main函數位置 mongodb核心類：TransportLayerASIO 類ServiceEntryPointMongod負責處理客戶端的命

wyg_031113 2020-07-08 01:12:25