MongoDB數據庫複製集

原創 一二毛錢 2019-08-29 13:25

MongoDB數據庫複製集

一、複製集概述；
二、複製集原理；
三、案例：搭建Mongodb實現應用複製集；

一、複製集概述：

組成：
Mongodb複製集（副本集replica set）由一組Mongod實例（進程）組成，包含一個Primary節點和多個Secondary節點，Mongodb Driver（客戶端）的所有數據都寫入Primary，Secondary通過oplog來同步Primary的數據，保證主節點和從節點數據的一致性，複製集在完成主從複製的基礎上，通過心跳機制，一旦primary節點出現宕機，則觸發選舉一個新的主節點，剩下的secondary節點指向新的primary，時間應該在10-30s內完成感知primary節點故障，實現高可用數據庫集羣；
特點：
主是唯一的，但不是固定的；
由大多數據原則保證數據的一致性；
從庫無法寫入（默認情況下，不使用驅動連接時，也是不能查詢的）；
相對於傳統的主從結構，複製集可以自動容災；

二、複製集原理：

角色（按是否存儲數據劃分）：
Primary：主節點，由選舉產生，負責客戶端的寫操作，產生oplog日誌文件；
Secondary：從節點，負責客戶端的讀操作，提供數據的備份和故障的切換；
Arbiter：仲裁節點，只參與選舉的投票，不會成爲primary，也不向Primary同步數據，若部署了一個2個節點的複製集，1個Primary，1個Secondary，任意節點宕機，複製集將不能提供服務了（無法選出Primary），這時可以給複製集添加一個Arbiter節點，即使有節點宕機，仍能選出Primary；
角色（按類型區分）：
Standard（標準）：這種是常規節點，它存儲一份完整的數據副本，參與投票選舉，有可能成爲主節點；
Passive（被動）：存儲完整的數據副本，參與投票，不能成爲活躍節點。
Arbiter（投票）：仲裁節點只參與投票，不接收復制的數據，也不能成爲活躍節點。
注：每個參與節點（非仲裁者）有個優先權（0-1000），優先權（priority）爲0則是被動的，不能成爲活躍節點，優先權不爲0的，按照由大到小選出活躍節點，優先值一樣的則看誰的數據比較新；
注：Mongodb 3.0裏，複製集成員最多50個，參與Primary選舉投票的成員最多7個；

選舉：
每個節點通過優先級定義出節點的類型（標準、被動、投票）；
標準節點通過對比自身數據進行選舉出peimary節點或者secondary節點；
影響選舉的因素：
1.心跳檢測：複製集內成員每隔兩秒向其他成員發送心跳檢測信息，若10秒內無響應，則標記其爲不可用；
2.連接：在多個節點中，最少保證兩個節點爲活躍狀態，如果集羣中共三個節點，掛掉兩個節點，那麼剩餘的節點無論狀態是primary還是處於選舉過程中，都會直接被降權爲secondary；
觸發選舉的情況：
1.初始化狀態 2.從節點們無法與主節點進行通信 3.主節點辭職
主節點辭職的情況：
1.在接收到replSetStepDown命令後；
2.在現有的環境中，其他secondary節點的數據落後於本身10s內，且擁有更高優先級；
3.當主節點無法與羣集中多數節點通信；
注：當主節點辭職後，主節點將關閉自身所有的連接，避免出現客戶端在從節點進行寫入操作；
MongoDB數據庫複製集

三、案例：搭建Mongodb實現應用複製集；

案例拓撲：
MongoDB數據庫複製集
異常處理：
當Primary宕機時，如果有數據未同步到Secondary，當Primary重新加入時，如果新的Primary上已經發生了寫操作，則舊Primary需要回滾部分操作，以保證數據集與新的Primary一致。舊Primary將回滾的數據寫到單獨的rollback目錄下，數據庫管理員可根據需要使用mongorestore進行恢復。

案例環境：
系統 主機名 IP地址 所需軟件
Centos 7.4 mongodb.benet.com 192.168.100.101 mongodb-linux-x86_64-rhel70-3.6.3.tgz

實驗步驟：

  • 安裝mongodb；
    創建並啓動四個實例；
    配置實例；
    創建複製集並添加節點；
    模擬Primary節點出現故障，查看角色切換情況；
    手動切換Primary角色；
    指定節點的優先級，驗證角色重選情況；
    將標準節點統統停掉，被動節點也不會成爲主節點；
    查詢複製集狀態以及查看oplog日誌文件的大小；
    部署用戶認證登錄（密鑰對）的複製集；
安裝mongodb；
下載mongodb軟件包；
[root@mongodb ~]# tar zxvf mongodb-linux-x86_64-rhel70-3.6.3.tgz
[root@mongodb ~]# mv mongodb-linux-x86_64-rhel70-3.6.3 /usr/local/mongodb         
[root@mongodb ~]# echo "export PATH=/usr/local/mongodb/bin:\$PATH" >>/etc/profile
[root@mongodb ~]# source /etc/profile
[root@mongodb ~]# ulimit -n 25000
[root@mongodb ~]# ulimit -u 25000 
[root@mongodb ~]# echo 0 >/proc/sys/vm/zone_reclaim_mode 
[root@mongodb ~]# sysctl -w vm.zone_reclaim_mode=0
[root@mongodb ~]# echo never >/sys/kernel/mm/transparent_hugepage/enabled 
[root@mongodb ~]# echo never >/sys/kernel/mm/transparent_hugepage/defrag

創建並啓動四個實例；
[root@mongodb ~]# cd /usr/local/mongodb/bin/
[root@mongodb bin]# mkdir {../mongodb1,../mongodb2,../mongodb3,../mongodb4}
[root@mongodb bin]# mkdir ../logs
[root@mongodb bin]# touch ../logs/mongodb{1..4}.log
[root@mongodb bin]# chmod 777 ../logs/mongodb*
[root@mongodb bin]# cat <<END >>/usr/local/mongodb/bin/mongodb1.conf
bind_ip=192.168.100.101
port=27017
dbpath=/usr/local/mongodb/mongodb1/
logpath=/usr/local/mongodb/logs/mongodb1.log
logappend=true
fork=true
maxConns=5000
replSet=haha
#replication name
END
[root@mongodb bin]# cat <<END >>/usr/local/mongodb/bin/mongodb2.conf
bind_ip=192.168.100.101
port=27018
dbpath=/usr/local/mongodb/mongodb2/
logpath=/usr/local/mongodb/logs/mongodb2.log
logappend=true
fork=true
maxConns=5000
replSet=haha
END
[root@mongodb bin]# cat <<END >>/usr/local/mongodb/bin/mongodb3.conf
bind_ip=192.168.100.101
port=27019
dbpath=/usr/local/mongodb/mongodb3/
logpath=/usr/local/mongodb/logs/mongodb3.log
logappend=true
fork=true
maxConns=5000
replSet=haha
END
[root@mongodb bin]# cat <<END >>/usr/local/mongodb/bin/mongodb4.conf
bind_ip=192.168.100.101
port=27020
dbpath=/usr/local/mongodb/mongodb4/
logpath=/usr/local/mongodb/logs/mongodb4.log
logappend=true
fork=true
maxConns=5000
replSet=haha
END
[root@mongodb bin]# cd
[root@mongodb ~]# mongod -f  /usr/local/mongodb/bin/mongodb1.conf
[root@mongodb ~]# mongod -f  /usr/local/mongodb/bin/mongodb2.conf
[root@mongodb ~]# mongod -f  /usr/local/mongodb/bin/mongodb3.conf
[root@mongodb ~]# mongod -f  /usr/local/mongodb/bin/mongodb4.conf
[root@mongodb ~]# netstat -utpln |grep mongod
tcp        0      0 192.168.100.101:27019   0.0.0.0:*               LISTEN      2271/mongod         
tcp        0      0 192.168.100.101:27020   0.0.0.0:*               LISTEN      15260/mongod        
tcp        0      0 192.168.100.101:27017   0.0.0.0:*               LISTEN      2440/mongod         
tcp        0      0 192.168.100.101:27018   0.0.0.0:*               LISTEN      1412/mongod  
[root@mongodb ~]# echo -e "/usr/local/mongodb/bin/mongod -f  /usr/local/mongodb/bin/mongodb1.conf \n/usr/local/mongodb/bin/mongod -f  /usr/local/mongodb/bin/mongodb2.conf\n/usr/local/mongodb/bin/mongod -f  /usr/local/mongodb/bin/mongodb3.conf\n/usr/local/mongodb/bin/mongod -f  /usr/local/mongodb/bin/mongodb4.conf">>/etc/rc.local
[root@mongodb ~]# chmod +x /etc/rc.local
[root@mongodb ~]# cat <<END >>/etc/init.d/mongodb
#!/bin/bash
INSTANCE=\$1
ACTION=\$2
case "\$ACTION" in
'start')
/usr/local/mongodb/bin/mongod -f /usr/local/mongodb/bin/"\$INSTANCE".conf;;
'stop')
/usr/local/mongodb/bin/mongod -f /usr/local/mongodb/bin/"\$INSTANCE".conf --shutdown;;
'restart')
/usr/local/mongodb/bin/mongod -f /usr/local/mongodb/bin/"\$INSTANCE".conf --shutdown
/usr/local/mongodb/bin/mongod -f /usr/local/mongodb/bin/"\$INSTANCE".conf;;
esac
END
[root@mongodb ~]# chmod +x /etc/init.d/mongodb
[root@mongodb ~]# /etc/init.d/mongodb mongodb1 stop
killing process with pid: 1301
[root@mongodb ~]# /etc/init.d/mongodb mongodb1 start
about to fork child process, waiting until server is ready for connections.
forked process: 1457
child process started successfully, parent exiting
[root@mongodb ~]# mongo --port 27017 --host 192.168.100.101

配置實例；
[root@mongodb ~]# mongo --port 27017 --host 192.168.100.101
> show dbs
2018-04-19T04:34:35.871+0800 E QUERY    [thread1] Error: listDatabases failed:{
    "ok" : 0,
    "errmsg" : "not master and slaveOk=false",
    "code" : 13435,
    "codeName" : "NotMasterNoSlaveOk"
} :
_getErrorWithCode@src/mongo/shell/utils.js:25:13
Mongo.prototype.getDBs@src/mongo/shell/mongo.js:65:1
shellHelper.show@src/mongo/shell/utils.js:816:19
shellHelper@src/mongo/shell/utils.js:706:15
@(shellhelp2):1:1
> rs.status()
{
    "info" : "run rs.initiate(...) if not yet done for the set",
    "ok" : 0,
    "errmsg" : "no replset config has been received",
    "code" : 94,
    "codeName" : "NotYetInitialized"
}
> rs.isMaster()                 ##查看複製集節點
{
    "ismaster" : false,
    "secondary" : false,
    "info" : "Does not have a valid replica set config",
    "isreplicaset" : true,
    "maxBsonObjectSize" : 16777216,
    "maxMessageSizeBytes" : 48000000,
    "maxWriteBatchSize" : 100000,
    "localTime" : ISODate("2018-04-18T20:36:31.698Z"),
    "minWireVersion" : 0,
    "maxWireVersion" : 6,
    "readOnly" : false,
    "ok" : 1
}
> exit
[root@mongodb ~]# mongo --port 27018 --host 192.168.100.101
> show dbs
2018-04-19T04:34:56.884+0800 E QUERY    [thread1] Error: listDatabases failed:{
    "ok" : 0,
    "errmsg" : "not master and slaveOk=false",
    "code" : 13435,
    "codeName" : "NotMasterNoSlaveOk"
} :
_getErrorWithCode@src/mongo/shell/utils.js:25:13
Mongo.prototype.getDBs@src/mongo/shell/mongo.js:65:1
shellHelper.show@src/mongo/shell/utils.js:816:19
shellHelper@src/mongo/shell/utils.js:706:15
@(shellhelp2):1:1
> exit

創建複製集並添加節點；
[root@mongodb ~]# mongo --port 27017 --host 192.168.100.101
>cfg={"_id":"haha","members":[{"_id":0,"host":"192.168.100.101:27017"},{"_id":1,"host":"192.168.100.101:27018"},{"_id":2,"host":"192.168.100.101:27019"}]}          ##添加節點
{
    "_id" : "haha",
    "members" : [
        {
            "_id" : 0,
            "host" : "192.168.100.101:27017"
        },
        {
            "_id" : 1,
            "host" : "192.168.100.101:27018"
        },
        {
            "_id" : 2,
            "host" : "192.168.100.101:27019"
        }
    ]
}
> rs.initiate(cfg)          ##初始化節點
{
    "ok" : 1,
    "operationTime" : Timestamp(1524083843, 1),
    "$clusterTime" : {
        "clusterTime" : Timestamp(1524083843, 1),
        "signature" : {
            "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
            "keyId" : NumberLong(0)
        }
    }
}
haha:OTHER> 
haha:PRIMARY> 
haha:PRIMARY> rs.status()
{
    "set" : "haha",
    "date" : ISODate("2018-04-18T20:37:54.095Z"),
    "myState" : 1,
    "term" : NumberLong(1),
    "heartbeatIntervalMillis" : NumberLong(2000),
    "optimes" : {
        "lastCommittedOpTime" : {
            "ts" : Timestamp(1524083855, 5),
            "t" : NumberLong(1)
        },
        "readConcernMajorityOpTime" : {
            "ts" : Timestamp(1524083855, 5),
            "t" : NumberLong(1)
        },
        "appliedOpTime" : {
            "ts" : Timestamp(1524083855, 5),
            "t" : NumberLong(1)
        },
        "durableOpTime" : {
            "ts" : Timestamp(1524083855, 5),
            "t" : NumberLong(1)
        }
    },
    "members" : [
        {
            "_id" : 0,
            "name" : "192.168.100.101:27017",
            "health" : 1,
            "state" : 1,
            "stateStr" : "PRIMARY",
            "uptime" : 329,
            "optime" : {
                "ts" : Timestamp(1524083855, 5),
                "t" : NumberLong(1)
            },
            "optimeDate" : ISODate("2018-04-18T20:37:35Z"),
            "infoMessage" : "could not find member to sync from",
            "electionTime" : Timestamp(1524083854, 1),
            "electionDate" : ISODate("2018-04-18T20:37:34Z"),
            "configVersion" : 1,
            "self" : true
        },
        {
            "_id" : 1,
            "name" : "192.168.100.101:27018",
            "health" : 1,
            "state" : 2,
            "stateStr" : "SECONDARY",
            "uptime" : 30,
            "optime" : {
                "ts" : Timestamp(1524083855, 5),
                "t" : NumberLong(1)
            },
            "optimeDurable" : {
                "ts" : Timestamp(1524083855, 5),
                "t" : NumberLong(1)
            },
            "optimeDate" : ISODate("2018-04-18T20:37:35Z"),
            "optimeDurableDate" : ISODate("2018-04-18T20:37:35Z"),
            "lastHeartbeat" : ISODate("2018-04-18T20:37:54.043Z"),
            "lastHeartbeatRecv" : ISODate("2018-04-18T20:37:52.499Z"),
            "pingMs" : NumberLong(0),
            "syncingTo" : "192.168.100.101:27017",
            "configVersion" : 1
        },
        {
            "_id" : 2,
            "name" : "192.168.100.101:27019",
            "health" : 1,
            "state" : 2,
            "stateStr" : "SECONDARY",
            "uptime" : 30,
            "optime" : {
                "ts" : Timestamp(1524083855, 5),
                "t" : NumberLong(1)
            },
            "optimeDurable" : {
                "ts" : Timestamp(1524083855, 5),
                "t" : NumberLong(1)
            },
            "optimeDate" : ISODate("2018-04-18T20:37:35Z"),
            "optimeDurableDate" : ISODate("2018-04-18T20:37:35Z"),
            "lastHeartbeat" : ISODate("2018-04-18T20:37:54.043Z"),
            "lastHeartbeatRecv" : ISODate("2018-04-18T20:37:52.500Z"),
            "pingMs" : NumberLong(0),
            "syncingTo" : "192.168.100.101:27017",
            "configVersion" : 1
        }
    ],
    "ok" : 1,
    "operationTime" : Timestamp(1524083855, 5),
    "$clusterTime" : {
        "clusterTime" : Timestamp(1524083855, 5),
        "signature" : {
            "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
            "keyId" : NumberLong(0)
        }
    }
}
haha:PRIMARY> rs.addArb("192.168.100.101:27020")            ##添加仲裁節點
{
    "ok" : 1,
    "operationTime" : Timestamp(1524083905, 1),
    "$clusterTime" : {
        "clusterTime" : Timestamp(1524083905, 1),
        "signature" : {
            "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
            "keyId" : NumberLong(0)
        }
    }
}
haha:PRIMARY> rs.status()
{
    "set" : "haha",
    "date" : ISODate("2018-04-18T20:38:41.468Z"),
    "myState" : 1,
    "term" : NumberLong(1),
    "heartbeatIntervalMillis" : NumberLong(2000),
    "optimes" : {
        "lastCommittedOpTime" : {
            "ts" : Timestamp(1524083915, 1),
            "t" : NumberLong(1)
        },
        "readConcernMajorityOpTime" : {
            "ts" : Timestamp(1524083915, 1),
            "t" : NumberLong(1)
        },
        "appliedOpTime" : {
            "ts" : Timestamp(1524083915, 1),
            "t" : NumberLong(1)
        },
        "durableOpTime" : {
            "ts" : Timestamp(1524083915, 1),
            "t" : NumberLong(1)
        }
    },
    "members" : [
        {
            "_id" : 0,
            "name" : "192.168.100.101:27017",
            "health" : 1,
            "state" : 1,
            "stateStr" : "PRIMARY",
            "uptime" : 376,
            "optime" : {
                "ts" : Timestamp(1524083915, 1),
                "t" : NumberLong(1)
            },
            "optimeDate" : ISODate("2018-04-18T20:38:35Z"),
            "infoMessage" : "could not find member to sync from",
            "electionTime" : Timestamp(1524083854, 1),
            "electionDate" : ISODate("2018-04-18T20:37:34Z"),
            "configVersion" : 2,
            "self" : true
        },
        {
            "_id" : 1,
            "name" : "192.168.100.101:27018",
            "health" : 1,
            "state" : 2,
            "stateStr" : "SECONDARY",
            "uptime" : 78,
            "optime" : {
                "ts" : Timestamp(1524083905, 1),
                "t" : NumberLong(1)
            },
            "optimeDurable" : {
                "ts" : Timestamp(1524083905, 1),
                "t" : NumberLong(1)
            },
            "optimeDate" : ISODate("2018-04-18T20:38:25Z"),
            "optimeDurableDate" : ISODate("2018-04-18T20:38:25Z"),
            "lastHeartbeat" : ISODate("2018-04-18T20:38:41.134Z"),
            "lastHeartbeatRecv" : ISODate("2018-04-18T20:38:40.134Z"),
            "pingMs" : NumberLong(0),
            "configVersion" : 2
        },
        {
            "_id" : 2,
            "name" : "192.168.100.101:27019",
            "health" : 1,
            "state" : 2,
            "stateStr" : "SECONDARY",
            "uptime" : 78,
            "optime" : {
                "ts" : Timestamp(1524083905, 1),
                "t" : NumberLong(1)
            },
            "optimeDurable" : {
                "ts" : Timestamp(1524083905, 1),
                "t" : NumberLong(1)
            },
            "optimeDate" : ISODate("2018-04-18T20:38:25Z"),
            "optimeDurableDate" : ISODate("2018-04-18T20:38:25Z"),
            "lastHeartbeat" : ISODate("2018-04-18T20:38:41.134Z"),
            "lastHeartbeatRecv" : ISODate("2018-04-18T20:38:40.136Z"),
            "pingMs" : NumberLong(0),
            "configVersion" : 2
        },
        {
            "_id" : 3,
            "name" : "192.168.100.101:27020",
            "health" : 1,
            "state" : 7,
            "stateStr" : "ARBITER",
            "uptime" : 16,
            "lastHeartbeat" : ISODate("2018-04-18T20:38:41.137Z"),
            "lastHeartbeatRecv" : ISODate("2018-04-18T20:38:40.140Z"),
            "pingMs" : NumberLong(0),
            "configVersion" : 2
        }
    ],
    "ok" : 1,
    "operationTime" : Timestamp(1524083915, 1),
    "$clusterTime" : {
        "clusterTime" : Timestamp(1524083915, 1),
        "signature" : {
            "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
            "keyId" : NumberLong(0)
        }
    }
}
注：rs.add()和rs.remove()命令分別用於添加和刪除標準節點
haha:PRIMARY> show dbs
admin   0.000GB
config  0.000GB
local   0.000GB
haha:PRIMARY> use cloud
switched to db cloud
haha:PRIMARY> db.users.insert({"id":"1","name":"xiaoming"})
WriteResult({ "nInserted" : 1 })
haha:PRIMARY> db.users.find()
{ "_id" : ObjectId("5ad7b245f6308759d4605b5c"), "id" : "1", "name" : "xiaoming" }
haha:PRIMARY> show dbs
admin   0.000GB
cloud   0.000GB
config  0.000GB
local   0.000GB
haha:PRIMARY> exit
[root@mongodb ~]# mongo --port 27018 --host 192.168.100.101
haha:SECONDARY> rs.status()
{
    "set" : "haha",
    "date" : ISODate("2018-04-18T20:50:50.975Z"),
    "myState" : 2,
    "term" : NumberLong(1),
    "syncingTo" : "192.168.100.101:27017",
    "heartbeatIntervalMillis" : NumberLong(2000),
    "optimes" : {
        "lastCommittedOpTime" : {
            "ts" : Timestamp(1524084645, 1),
            "t" : NumberLong(1)
        },
        "readConcernMajorityOpTime" : {
            "ts" : Timestamp(1524084645, 1),
            "t" : NumberLong(1)
        },
        "appliedOpTime" : {
            "ts" : Timestamp(1524084645, 1),
            "t" : NumberLong(1)
        },
        "durableOpTime" : {
            "ts" : Timestamp(1524084645, 1),
            "t" : NumberLong(1)
        }
    },
    "members" : [
        {
            "_id" : 0,
            "name" : "192.168.100.101:27017",
            "health" : 1,
            "state" : 1,
            "stateStr" : "PRIMARY",
            "uptime" : 805,
            "optime" : {
                "ts" : Timestamp(1524084645, 1),
                "t" : NumberLong(1)
            },
            "optimeDurable" : {
                "ts" : Timestamp(1524084645, 1),
                "t" : NumberLong(1)
            },
            "optimeDate" : ISODate("2018-04-18T20:50:45Z"),
            "optimeDurableDate" : ISODate("2018-04-18T20:50:45Z"),
            "lastHeartbeat" : ISODate("2018-04-18T20:50:49.966Z"),
            "lastHeartbeatRecv" : ISODate("2018-04-18T20:50:49.997Z"),
            "pingMs" : NumberLong(0),
            "electionTime" : Timestamp(1524083854, 1),
            "electionDate" : ISODate("2018-04-18T20:37:34Z"),
            "configVersion" : 2
        },
        {
            "_id" : 1,
            "name" : "192.168.100.101:27018",
            "health" : 1,
            "state" : 2,
            "stateStr" : "SECONDARY",
            "uptime" : 1497,
            "optime" : {
                "ts" : Timestamp(1524084645, 1),
                "t" : NumberLong(1)
            },
            "optimeDate" : ISODate("2018-04-18T20:50:45Z"),
            "syncingTo" : "192.168.100.101:27017",
            "configVersion" : 2,
            "self" : true
        },
        {
            "_id" : 2,
            "name" : "192.168.100.101:27019",
            "health" : 1,
            "state" : 2,
            "stateStr" : "SECONDARY",
            "uptime" : 805,
            "optime" : {
                "ts" : Timestamp(1524084645, 1),
                "t" : NumberLong(1)
            },
            "optimeDurable" : {
                "ts" : Timestamp(1524084645, 1),
                "t" : NumberLong(1)
            },
            "optimeDate" : ISODate("2018-04-18T20:50:45Z"),
            "optimeDurableDate" : ISODate("2018-04-18T20:50:45Z"),
            "lastHeartbeat" : ISODate("2018-04-18T20:50:49.811Z"),
            "lastHeartbeatRecv" : ISODate("2018-04-18T20:50:49.965Z"),
            "pingMs" : NumberLong(0),
            "syncingTo" : "192.168.100.101:27017",
            "configVersion" : 2
        },
        {
            "_id" : 3,
            "name" : "192.168.100.101:27020",
            "health" : 1,
            "state" : 7,
            "stateStr" : "ARBITER",
            "uptime" : 745,
            "lastHeartbeat" : ISODate("2018-04-18T20:50:49.966Z"),
            "lastHeartbeatRecv" : ISODate("2018-04-18T20:50:50.378Z"),
            "pingMs" : NumberLong(0),
            "configVersion" : 2
        }
    ],
    "ok" : 1,
    "operationTime" : Timestamp(1524084645, 1),
    "$clusterTime" : {
        "clusterTime" : Timestamp(1524084645, 1),
        "signature" : {
            "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
            "keyId" : NumberLong(0)
        }
    }
}
haha:SECONDARY> show dbs            ##secondary節點默認無法讀取，可以通過以下方式或者驅動方式實現
2018-04-19T04:52:42.813+0800 E QUERY    [thread1] Error: listDatabases failed:{
    "operationTime" : Timestamp(1524084755, 1),
    "ok" : 0,
    "errmsg" : "not master and slaveOk=false",
    "code" : 13435,
    "codeName" : "NotMasterNoSlaveOk",
    "$clusterTime" : {
        "clusterTime" : Timestamp(1524084755, 1),
        "signature" : {
            "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
            "keyId" : NumberLong(0)
        }
    }
} :
_getErrorWithCode@src/mongo/shell/utils.js:25:13
Mongo.prototype.getDBs@src/mongo/shell/mongo.js:65:1
shellHelper.show@src/mongo/shell/utils.js:816:19
shellHelper@src/mongo/shell/utils.js:706:15
@(shellhelp2):1:1
haha:SECONDARY> db.getMongo().setSlaveOk();
haha:SECONDARY> show dbs
admin   0.000GB
cloud   0.000GB
config  0.000GB
local   0.000GB
haha:SECONDARY> use cloud
switched to db cloud
haha:SECONDARY> db.users.insert({"id":"2","name":"xiaohong"})       ##secondary節點無法寫入
WriteResult({ "writeError" : { "code" : 10107, "errmsg" : "not master" } })
haha:SECONDARY> db.users.find()
{ "_id" : ObjectId("5ad7b245f6308759d4605b5c"), "id" : "1", "name" : "xiaoming" }
haha:SECONDARY> exit

模擬Primary節點出現故障，查看角色切換情況；
[root@mongodb ~]# mongod -f /usr/local/mongodb/bin/mongodb1.conf --shutdown
killing process with pid: 1457
[root@mongodb ~]# mongo --port 27018 --host 192.168.100.101 
haha:SECONDARY> rs.status()
{
    "set" : "haha",
    "date" : ISODate("2018-04-18T21:16:22.623Z"),
    "myState" : 2,
    "term" : NumberLong(2),
    "syncingTo" : "192.168.100.101:27019",
    "heartbeatIntervalMillis" : NumberLong(2000),
    "optimes" : {
        "lastCommittedOpTime" : {
            "ts" : Timestamp(1524086155, 1),
            "t" : NumberLong(1)
        },
        "readConcernMajorityOpTime" : {
            "ts" : Timestamp(1524086155, 1),
            "t" : NumberLong(1)
        },
        "appliedOpTime" : {
            "ts" : Timestamp(1524086174, 1),
            "t" : NumberLong(2)
        },
        "durableOpTime" : {
            "ts" : Timestamp(1524086174, 1),
            "t" : NumberLong(2)
        }
    },
    "members" : [
        {
            "_id" : 0,
            "name" : "192.168.100.101:27017",
            "health" : 0,
            "state" : 8,
            "stateStr" : "(not reachable/healthy)",
            "uptime" : 0,
            "optime" : {
                "ts" : Timestamp(0, 0),
                "t" : NumberLong(-1)
            },
            "optimeDurable" : {
                "ts" : Timestamp(0, 0),
                "t" : NumberLong(-1)
            },
            "optimeDate" : ISODate("1970-01-01T00:00:00Z"),
            "optimeDurableDate" : ISODate("1970-01-01T00:00:00Z"),
            "lastHeartbeat" : ISODate("2018-04-18T21:16:19.030Z"),
            "lastHeartbeatRecv" : ISODate("2018-04-18T21:16:03.344Z"),
            "pingMs" : NumberLong(0),
            "lastHeartbeatMessage" : "Connection refused",
            "configVersion" : -1
        },
        {
            "_id" : 1,
            "name" : "192.168.100.101:27018",
            "health" : 1,
            "state" : 2,
            "stateStr" : "SECONDARY",
            "uptime" : 3029,
            "optime" : {
                "ts" : Timestamp(1524086174, 1),
                "t" : NumberLong(2)
            },
            "optimeDate" : ISODate("2018-04-18T21:16:14Z"),
            "syncingTo" : "192.168.100.101:27019",
            "infoMessage" : "syncing from: 192.168.100.101:27019",
            "configVersion" : 2,
            "self" : true
        },
        {
            "_id" : 2,
            "name" : "192.168.100.101:27019",
            "health" : 1,
            "state" : 1,
            "stateStr" : "PRIMARY",
            "uptime" : 2337,
            "optime" : {
                "ts" : Timestamp(1524086174, 1),
                "t" : NumberLong(2)
            },
            "optimeDurable" : {
                "ts" : Timestamp(1524086174, 1),
                "t" : NumberLong(2)
            },
            "optimeDate" : ISODate("2018-04-18T21:16:14Z"),
            "optimeDurableDate" : ISODate("2018-04-18T21:16:14Z"),
            "lastHeartbeat" : ISODate("2018-04-18T21:16:19.030Z"),
            "lastHeartbeatRecv" : ISODate("2018-04-18T21:16:21.575Z"),
            "pingMs" : NumberLong(0),
            "electionTime" : Timestamp(1524086173, 1),
            "electionDate" : ISODate("2018-04-18T21:16:13Z"),
            "configVersion" : 2
        },
        {
            "_id" : 3,
            "name" : "192.168.100.101:27020",
            "health" : 1,
            "state" : 7,
            "stateStr" : "ARBITER",
            "uptime" : 2277,
            "lastHeartbeat" : ISODate("2018-04-18T21:16:19.030Z"),
            "lastHeartbeatRecv" : ISODate("2018-04-18T21:16:20.894Z"),
            "pingMs" : NumberLong(0),
            "configVersion" : 2
        }
    ],
    "ok" : 1,
    "operationTime" : Timestamp(1524086174, 1),
    "$clusterTime" : {
        "clusterTime" : Timestamp(1524086174, 1),
        "signature" : {
            "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
            "keyId" : NumberLong(0)
        }
    }
}
haha:SECONDARY> exit
[root@mongodb ~]# mongo --port 27019 --host 192.168.100.101
haha:PRIMARY> exit
[root@mongodb ~]# mongod -f /usr/local/mongodb/bin/mongodb1.conf

手動切換Primary角色；
[root@mongodb ~]# mongo --port 27019 --host 192.168.100.101
haha:PRIMARY> rs.stepDown(60,30)
haha:SECONDARY> exit
[root@mongodb ~]# mongo --port 27018 --host 192.168.100.101
haha:PRIMARY> exit

指定節點的優先級，驗證角色重選情況；
[root@mongodb ~]# mongo --port 27018 --host 192.168.100.101
haha:PRIMARY> cfg={"_id":"haha","members":[{"_id":0,"host":"192.168.100.101:27017","priority":100},{"_id":1,"host":"192.168.100.101:27018","priority":100},{"_id":2,"host":"192.168.100.101:27019","priority":10}]}
{
    "_id" : "haha",
    "members" : [
        {
            "_id" : 0,
            "host" : "192.168.100.101:27017",
            "priority" : 100
        },
        {
            "_id" : 1,
            "host" : "192.168.100.101:27018",
            "priority" : 100
        },
        {
            "_id" : 2,
            "host" : "192.168.100.101:27019",
            "priority" : 10
        }
    ]
}
haha:PRIMARY> rs.reconfig(cfg)
{
    "ok" : 1,
    "operationTime" : Timestamp(1524086716, 1),
    "$clusterTime" : {
        "clusterTime" : Timestamp(1524086716, 1),
        "signature" : {
            "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
            "keyId" : NumberLong(0)
        }
    }
}
haha:PRIMARY> rs.isMaster()
{
    "hosts" : [
        "192.168.100.101:27017",
        "192.168.100.101:27018",
        "192.168.100.101:27019"
    ],
    "setName" : "haha",
    "setVersion" : 3,
    "ismaster" : true,
    "secondary" : false,
    "primary" : "192.168.100.101:27018",
    "me" : "192.168.100.101:27018",
    "electionId" : ObjectId("7fffffff0000000000000003"),
    "lastWrite" : {
        "opTime" : {
            "ts" : Timestamp(1524086733, 1),
            "t" : NumberLong(3)
        },
        "lastWriteDate" : ISODate("2018-04-18T21:25:33Z"),
        "majorityOpTime" : {
            "ts" : Timestamp(1524086733, 1),
            "t" : NumberLong(3)
        },
        "majorityWriteDate" : ISODate("2018-04-18T21:25:33Z")
    },
    "maxBsonObjectSize" : 16777216,
    "maxMessageSizeBytes" : 48000000,
    "maxWriteBatchSize" : 100000,
    "localTime" : ISODate("2018-04-18T21:25:42.122Z"),
    "logicalSessionTimeoutMinutes" : 30,
    "minWireVersion" : 0,
    "maxWireVersion" : 6,
    "readOnly" : false,
    "ok" : 1,
    "operationTime" : Timestamp(1524086733, 1),
    "$clusterTime" : {
        "clusterTime" : Timestamp(1524086733, 1),
        "signature" : {
            "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
            "keyId" : NumberLong(0)
        }
    }
}
haha:PRIMARY> exit
[root@mongodb ~]# mongod -f /usr/local/mongodb/bin/mongodb2.conf --shutdown
[root@mongodb ~]# mongo --port 27017 --host 192.168.100.101 
haha:PRIMARY> exit

將標準節點統統停掉，被動節點也不會成爲主節點；
[root@mongodb ~]# mongod -f /usr/local/mongodb/bin/mongodb1.conf --shutdown
[root@mongodb ~]# mongo --port 27019 --host 192.168.100.101 
haha:SECONDARY> rs.status()
{
    "set" : "haha",
    "date" : ISODate("2018-04-18T21:29:42.973Z"),
    "myState" : 2,
    "term" : NumberLong(5),
    "heartbeatIntervalMillis" : NumberLong(2000),
    "optimes" : {
        "lastCommittedOpTime" : {
            "ts" : Timestamp(1524086961, 1),
            "t" : NumberLong(5)
        },
        "readConcernMajorityOpTime" : {
            "ts" : Timestamp(1524086961, 1),
            "t" : NumberLong(5)
        },
        "appliedOpTime" : {
            "ts" : Timestamp(1524086961, 1),
            "t" : NumberLong(5)
        },
        "durableOpTime" : {
            "ts" : Timestamp(1524086961, 1),
            "t" : NumberLong(5)
        }
    },
    "members" : [
        {
            "_id" : 0,
            "name" : "192.168.100.101:27017",
            "health" : 0,
            "state" : 8,
            "stateStr" : "(not reachable/healthy)",
            "uptime" : 0,
            "optime" : {
                "ts" : Timestamp(0, 0),
                "t" : NumberLong(-1)
            },
            "optimeDurable" : {
                "ts" : Timestamp(0, 0),
                "t" : NumberLong(-1)
            },
            "optimeDate" : ISODate("1970-01-01T00:00:00Z"),
            "optimeDurableDate" : ISODate("1970-01-01T00:00:00Z"),
            "lastHeartbeat" : ISODate("2018-04-18T21:29:38.566Z"),
            "lastHeartbeatRecv" : ISODate("2018-04-18T21:29:26.484Z"),
            "pingMs" : NumberLong(0),
            "lastHeartbeatMessage" : "Connection refused",
            "configVersion" : -1
        },
        {
            "_id" : 1,
            "name" : "192.168.100.101:27018",
            "health" : 0,
            "state" : 8,
            "stateStr" : "(not reachable/healthy)",
            "uptime" : 0,
            "optime" : {
                "ts" : Timestamp(0, 0),
                "t" : NumberLong(-1)
            },
            "optimeDurable" : {
                "ts" : Timestamp(0, 0),
                "t" : NumberLong(-1)
            },
            "optimeDate" : ISODate("1970-01-01T00:00:00Z"),
            "optimeDurableDate" : ISODate("1970-01-01T00:00:00Z"),
            "lastHeartbeat" : ISODate("2018-04-18T21:29:38.566Z"),
            "lastHeartbeatRecv" : ISODate("2018-04-18T21:26:42.249Z"),
            "pingMs" : NumberLong(0),
            "lastHeartbeatMessage" : "Connection refused",
            "configVersion" : -1
        },
        {
            "_id" : 2,
            "name" : "192.168.100.101:27019",
            "health" : 1,
            "state" : 2,
            "stateStr" : "SECONDARY",
            "uptime" : 3826,
            "optime" : {
                "ts" : Timestamp(1524086961, 1),
                "t" : NumberLong(5)
            },
            "optimeDate" : ISODate("2018-04-18T21:29:21Z"),
            "infoMessage" : "could not find member to sync from",
            "configVersion" : 3,
            "self" : true
        }
    ],
    "ok" : 1,
    "operationTime" : Timestamp(1524086961, 1),
    "$clusterTime" : {
        "clusterTime" : Timestamp(1524086961, 1),
        "signature" : {
            "hash" : BinData(0,"AAAAAAAAAAAAAAAAAAAAAAAAAAA="),
            "keyId" : NumberLong(0)
        }
    }
}
haha:SECONDARY> exit
[root@mongodb ~]# mongod -f /usr/local/mongodb/bin/mongodb1.conf
[root@mongodb ~]# mongod -f /usr/local/mongodb/bin/mongodb2.conf
[root@mongodb ~]# netstat -utpln |grep mongod
tcp        0      0 192.168.100.101:27019   0.0.0.0:*               LISTEN      1357/mongod         
tcp        0      0 192.168.100.101:27020   0.0.0.0:*               LISTEN      1385/mongod         
tcp        0      0 192.168.100.101:27017   0.0.0.0:*               LISTEN      14363/mongod        
tcp        0      0 192.168.100.101:27018   0.0.0.0:*               LISTEN      14442/mongod

查詢複製集狀態以及查看oplog日誌文件的大小；
[root@mongodb ~]# mongo --port 27018 --host 192.168.100.101
haha:PRIMARY> use local
haha:PRIMARY> rs.printSlaveReplicationInfo()            ##查看節點信息
source: 192.168.100.101:27017
    syncedTo: Thu Apr 19 2018 05:34:37 GMT+0800 (CST)
    0 secs (0 hrs) behind the primary 
source: 192.168.100.101:27019
    syncedTo: Thu Apr 19 2018 05:34:37 GMT+0800 (CST)
    0 secs (0 hrs) behind the primary 
haha:PRIMARY> rs.printReplicationInfo()
configured oplog size:   990MB
log length start to end: 3464secs (0.96hrs)
oplog first event time:  Thu Apr 19 2018 04:37:23 GMT+0800 (CST)
oplog last event time:   Thu Apr 19 2018 05:35:07 GMT+0800 (CST)
now:                     Thu Apr 19 2018 05:35:16 GMT+0800 (CST)
haha:PRIMARY> db.oplog.rs.stats()
{
    "ns" : "local.oplog.rs",
    "size" : 50356,
    "count" : 450,
    "avgObjSize" : 111,
    "storageSize" : 61440,
    "capped" : true,
    "max" : -1,
    "maxSize" : 1038090240,     ##單位是KB
...

部署用戶認證登錄（密鑰對）的複製集；
[root@mongodb ~]# mongo --port 27018 --host 192.168.100.101
haha:PRIMARY> use admin
switched to db admin
haha:PRIMARY> db.createUser({"user":"root","pwd":"123","roles":["root"]})
Successfully added user: { "user" : "root", "roles" : [ "root" ] }
haha:PRIMARY> exit
[root@mongodb ~]# echo -e "clusterAuthMode=keyFile\nkeyFile=/usr/local/mongodb/bin/cloudkey1" >>/usr/local/mongodb/bin/mongodb1.conf
[root@mongodb ~]# echo -e "clusterAuthMode=keyFile\nkeyFile=/usr/local/mongodb/bin/cloudkey2" >>/usr/local/mongodb/bin/mongodb2.conf
[root@mongodb ~]# echo -e "clusterAuthMode=keyFile\nkeyFile=/usr/local/mongodb/bin/cloudkey3" >>/usr/local/mongodb/bin/mongodb3.conf
[root@mongodb ~]# echo "haha key" >/usr/local/mongodb/bin/cloudkey1
[root@mongodb ~]# echo "haha key" >/usr/local/mongodb/bin/cloudkey2
[root@mongodb ~]# echo "haha key" >/usr/local/mongodb/bin/cloudkey3
[root@mongodb ~]# chmod 600 /usr/local/mongodb/bin/cloudkey*
[root@mongodb ~]# /etc/init.d/mongodb mongodb1 restart
[root@mongodb ~]# /etc/init.d/mongodb mongodb2 restart
[root@mongodb ~]# /etc/init.d/mongodb mongodb3 restart
[root@mongodb ~]# mongo --port 27018 --host 192.168.100.101
haha:PRIMARY> show dbs
2018-04-19T12:02:57.720+0800 E QUERY    [thread1] Error: listDatabases failed:{
    "operationTime" : Timestamp(1524110569, 1),
    "ok" : 0,
    "errmsg" : "not authorized on admin to execute command { listDatabases: 1.0, $clusterTime: { clusterTime: Timestamp(1524110569, 1), signature: { hash: BinData(0, 85A5B587BFFE4B2FB534789EA87032CB263D8121), keyId: 6545890313586606081 } }, $db: \"admin\" }",
...
haha:PRIMARY> use admin
switched to db admin
haha:PRIMARY>db.auth("root","123")
1
haha:PRIMARY> show dbs
admin   0.000GB
cloud   0.000GB
config  0.000GB
local   0.000GB
haha:PRIMARY> exit
發表評論
所有評論
還沒有人評論，想成為第一個評論的人麼? 請在上方評論欄輸入並且點擊發布.
相關文章

Redis 數據持久化方案

Redis 數據持久化方案 一、持久化方案 RDB（Redis DataBase）：指定的時間間隔內保存數據快照（SNAPSHOTTING），fork出子進程，之後再由子進程完成這些持久化的工作； AOF（Append Only

乾源 2020-07-08 12:09:41

#Redis#Mac中docker安裝Redis步驟記錄

一、前提條件 mac已經安裝docker 二、安裝步驟如下： 1、拉取鏡像命令： docker pull redis sing default tag: latest latest: Pulling from library/redis

码农丁丁 2020-07-08 10:28:41

mogodb日常工作記錄

查詢相關 db.getCollection('Examda_News_VisitLog').find({"newsId":"20061109480192959"}) db.getCollection('Examda_News_V

kangyu0414 2020-07-08 03:32:52

mongodb查詢語法

mongodb查詢語法 所有操作分爲聚合查詢和非聚合查詢 聚合查詢中又分爲：聚合階段，和聚合操作 聚合階段主要對文檔進行：選擇，投影，分組，加減字段，排序，連接 聚合操作是用來實現聚合階段的功能。 如爲了實現選擇，可以使用數學表達式  

wyg_031113 2020-07-08 01:12:25

利用ycsb測試redis性能

1、redis的安裝 在http://redis.io/download上面下載了redis-2.8.3.tar.gz存放在/home/hs/program目錄下cd /home/hs/program tar -zxvf redis-

在hust快乐的学习 2020-07-07 23:02:50

淘寶海量數據產品技術架構

轉自： http://blog.csdn.net/smarttony/article/details/6667944  淘寶數據魔方技術架構解析 淘寶網擁有國內最具商業價值的海量數據。截至當前，每天有超過30億的店鋪、商品瀏覽記錄，

迷失的小书童 2020-07-07 20:59:04

noSQL簡介

NoSQL，泛指非關係型的數據庫。隨着互聯網web2.0網站的興起，傳統的關係數據庫在應付web2.0網站，特別是超大規模和高併發的SNS類型的web2.0純動態網站已經顯得力不從心，暴露了很多難以克服的問題，而非關係型的數據庫則

Jerry Lee の blog 2020-07-07 18:08:03

Redis 腳本基本使用

>原文鏈接：http://www.redis.cn/commands/eval.html EVAL 和 EVALSHA 命令是從 Redis 2.6.0 版本開始的，使用內置的 Lua 解釋器，可以對 Lua 腳本進行求值。 EVAL的第

发面团 2020-07-07 16:41:20

Redis 集羣密碼配置

>補充一下密碼相關配置 在config配置文件中與密碼有關的兩個配置屬性： 1）requirepass 爲節點設置密碼，訪問該節點需要首先使用 auth xxxxxx 命令。 2）masterauth 設置主機密碼，用於從機連接主機。

发面团 2020-07-07 15:59:35

白話翻譯 Redis-conf

>一篇易懂的 Redis-conf 翻譯，貼出來方便查閱 ~~~properties # Redis configuration file example. Redis配置文件示例 # # Note that in order to re

发面团 2020-07-07 15:59:35

Redis 多機多節點集羣搭建方案（5.0版本）

>搭建環境： a)redis的安裝包，redis-5.0.8.tar.gz b)gcc安裝包gcc_rpm.tar.gz c)VM10 d)CentOS鏡像文件 >搭建步驟： 1、準備工作： （1）在linux下新建一個存儲集羣的目錄re

发面团 2020-07-07 15:59:35

Redis Key過期及清除策略

>Key過期命令： 127.0.0.1:6379> EXPIRE name 10  # 設置key的過期時間，單位是秒 (integer) 1 127.0.0.1:6379> ttl name  # 查看當前key的剩餘時間 (i

发面团 2020-07-07 15:59:34

Redis 常用配置參數

1. Redis默認不是以守護進程的方式運行，可以通過該配置項修改，使用yes啓用守護進程   daemonize no 2. 當Redis以守護進程方式運行時，Redis默認會把pid寫入/var/run/redis.pid文件，可以通

发面团 2020-07-07 15:59:34

Membase

The simple, fast, elastic(伸縮的) NoSQL database. Membase Server Membase Server is the lowest latency, highest thr

lmm2003 2020-07-07 14:48:13

大數據量處理的方法探討

       首先聲明，這篇文章是我整理所得，裏邊有很多地方嚴格的奉行了魯迅先生的拿來主義……，之所以還厚着臉皮的放在這裏，目的就是拋磚引玉，放出問題，供大家一起討論！   應用場景：大數據量處理是指同時需要對數據進行檢索查詢，同時有高併

wangdingbang 2020-07-07 05:15:27