Keepalived+redis高可用redis主從環境搭建

環境信息：

master ： 10.1.58.19
slave：10.1.58.29
VIP：10.1.58.150

安裝軟件包關聯

#yum -y install libnl-devel
#yum -y install libnfnetlink-devel

1、確認lvs是否安裝
如下命令檢查kernel是否已經支持LVS的IPVS模塊：

#modprobe -l |grep ipvs
kernel/net/netfilter/ipvs/ip_vs.ko
kernel/net/netfilter/ipvs/ip_vs_rr.ko
kernel/net/netfilter/ipvs/ip_vs_wrr.ko
kernel/net/netfilter/ipvs/ip_vs_lc.ko
kernel/net/netfilter/ipvs/ip_vs_wlc.ko
kernel/net/netfilter/ipvs/ip_vs_lblc.ko
kernel/net/netfilter/ipvs/ip_vs_lblcr.ko
kernel/net/netfilter/ipvs/ip_vs_dh.ko
kernel/net/netfilter/ipvs/ip_vs_sh.ko
kernel/net/netfilter/ipvs/ip_vs_sed.ko
kernel/net/netfilter/ipvs/ip_vs_nq.ko
kernel/net/netfilter/ipvs/ip_vs_ftp.ko
kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko

安裝IPVS管理軟件

#yum install ipvsadm -y

2、部署keepalived
主/備：

# wget http://www.keepalived.org/software/keepalived-1.3.6.tar.gz
# tar xzvf keepalived-1.3.6.tar.gz
# cd keepalived-1.3.6
# ./configure --prefix=/home/yzkf/app/keepalived 
# make
# make  install
# ln -s /home/yzkf/app/keepalived/sbin/keepalived /sbin/keepalived
# ll /sbin/keepalived
lrwxrwxrwx 1 root root 41 Oct 25 11:20 /sbin/keepalived -> /home/yzkf/app/keepalived/sbin/keepalived

製作隨機啓動，在源代碼目錄下(如果需要製作隨機啓動，可以用下面的方法)

#cp /home/yzkf/src_soft/keepalived-1.3.6/keepalived/etc/init.d/keepalived.rh.init /etc/init.d/keepalived
#chkconfig --add keepalived
#chkconfig  keepalived on

備註：因爲啓動腳本啓動時會去讀取默認的配置文件,即/etc/keepalived/keepalived.conf，所以需要修改/etc/init.d/keepalived的內容：如下

start() {
        echo -n "Starting Keepalived for LVS: "
        daemon keepalived  -f /home/yzkf/app/keepalived/etc/keepalived/keepalived.conf -D
        RETVAL=$?
        echo
        [ $RETVAL -eq 0 ] && touch /var/lock/subsys/keepalived
        return $RETVAL
}

3、部署redis主從
redis配置文件不能使用bind指令，具體安裝步驟參考文檔《Redis單實例安裝部署》

4、配置keepalived
4.1、修改主節點keepalived配置：

#cat /home/yzkf/app/keepalived/etc/keepalived/keepalived.conf 
! Configuration File for keepalived
global_defs {
    notification_email {
     [email protected]
   }
   notification_email_from [email protected]
   smtp_server smtp.richinfo.cn    
   smtp_connect_timeout 30
   router_id redis-10.1.58.19        
}

vrrp_script chk_redis 
{ 
     script "/home/yzkf/app/script/redis/redis_check.sh 127.0.0.1 56379" 
     interval 2 
     timeout 2
     fall 3
     weight  -10
}

vrrp_script chk_redis_port 
{
     script      "/bin/echo </dev/tcp/127.0.0.1/56379"
     interval    1
     timeout 2
     fall 3
     weight  -10
}

vrrp_instance redis {
     state BACKUP 
     interface eth1  
     virtual_router_id 50 
     priority  100       
     #nopreempt # no seize,must add
     preempt_delay       5
     advert_int 1
     authentication {   #all node must same
         auth_type PASS
         auth_pass rcsoa_redis_test!@
    } 
    virtual_ipaddress {  
         10.1.58.150/24
    }
    track_script { 
         chk_redis 
         chk_redis_port
    } 
     notify_master "/home/yzkf/app/script/redis/redis_master.sh 127.0.0.1 10.1.58.29 56379"
     notify_backup "/home/yzkf/app/script/redis/redis_backup.sh 127.0.0.1 10.1.58.29 56379"
     notify_fault /home/yzkf/app/script/redis/keepalived_fault.sh 
     notify_stop /home/yzkf/app/script/redis/keepalived_stop.sh 
}

redis監控腳本：

$ cat /home/yzkf/app/script/redis/redis_check.sh 
#!/bin/bash 

passwd=F33czco

ALIVE=`/home/yzkf/app/redis/bin/redis-cli  -h $1 -p $2 -a ${passwd} PING` 
LOGFILE="/home/yzkf/logs/redis/keepalived-redis-check.log" 

v_date=`date +"%Y%m%d %T"`

echo "${v_date} [CHECK]" >> $LOGFILE

if [ $ALIVE == "PONG" ]; then :
    echo "Success: redis-cli -h $1 -p $2 PING $ALIVE" >> $LOGFILE 2>&1
    exit 0 
else 
    echo "Failed:redis-cli -h $1 -p $2 PING $ALIVE " >> $LOGFILE 2>&1
    exit 1 
fi

redis監控腳本：redis_master.sh

$ cat  /home/yzkf/app/script/redis/redis_master.sh  
#!/bin/bash

passwd=F33czco

REDISCLI="/home/yzkf/app/redis/bin/redis-cli -h $1 -p $3 -a ${passwd}" 
LOGFILE="/home/yzkf/logs/redis/keepalived-redis-state.log" 

v_date=`date +"%Y%m%d %T"`

echo "${v_date} Begin [master]" >> $LOGFILE 2>&1 

###echo "Run MASTER cmd ..." >> $LOGFILE 2>&1
###$REDISCLI SLAVEOF $2 $3 >> $LOGFILE  
###sleep 10 #delay 10 s wait data async cancel sync
echo "Run SLAVEOF NO ONE cmd ..." >> $LOGFILE
$REDISCLI SLAVEOF NO ONE >> $LOGFILE 2>&1

v_date=`date +"%Y%m%d %T"`

echo "${v_date} END [master]" >> $LOGFILE 2>&1

# send mail
echo "[WARNING] 10.1.58.19 SERVER GET VIP:10.1.58.150, Entering MASTER STATE"| mutt -s "Keepalived STATUS Warning-rcsoa_test env" [email protected] [email protected]

redis監控腳本：redis_backup.sh

$ cat  /home/yzkf/app/script/redis/redis_backup.sh
#!/bin/bash

passwd=F33czco

REDISCLI="/home/yzkf/app/redis/bin/redis-cli -h $1 -p $3 -a ${passwd}" 
LOGFILE="/home/yzkf/logs/redis/keepalived-redis-state.log" 

v_date=`date +"%Y%m%d %T"`

echo "${v_date} Begin [backup]" >> $LOGFILE 

echo "Run SLAVEOF cmd ..." >> $LOGFILE 
$REDISCLI SLAVEOF $2 $3 >> $LOGFILE 2>&1 
#sleep 15 #delay 15 s wait data sync exchange role

v_date=`date +"%Y%m%d %T"`

echo "${v_date} End [backup]" >> $LOGFILE

# send mail
echo "[WARNING] 10.1.58.19 SERVER REMOVE VIP:10.1.58.150, Entering BACKUP STATE"| mutt -s "Keepalived STATUS Warning-rcsoa_test env" [email protected] [email protected]

redis_fault.sh 腳本：

$ cat /home/yzkf/app/script/redis/redis_fault.sh
#!/bin/bash

LOGFILE=/home/yzkf/logs/redis/keepalived-redis-state.log 
v_date=`date +"%Y%m%d %T"`

echo "${v_date} [fault]" >> $LOGFILE

#send mail
echo "[WARNING] Keepalived status is fail on server:10.1.58.19"| mutt -s "Keepalived STATUS" [email protected] [email protected]

redis_stop.sh 腳本：

$ cat /home/yzkf/app/script/redis/keepalived_stop.sh
#!/bin/bash

LOGFILE=/home/yzkf/logs/redis/keepalived-redis-state.log 
v_date=`date +"%Y%m%d %T"`

echo "${v_date} [stop]" >> $LOGFILE

# send mail
echo "[WARNING] Keepalived status is  stop on  SERVER:10.1.58.19"| mutt -s "Keepalived STATUS Warning" [email protected] [email protected]

4.2、修改備節點keepalived配置

$ cat /home/yzkf/app/keepalived/etc/keepalived/keepalived.conf
! Configuration File for keepalived

global_defs {
    notification_email {
     [email protected]
   }
   notification_email_from [email protected]
   smtp_server pop.richinfo.cn    
   smtp_connect_timeout 30
   router_id redis-10.1.58.29        
}

vrrp_script chk_redis 
{ 
     script "/home/yzkf/app/script/redis/redis_check.sh 127.0.0.1 56379" 
     interval 2
     timeout 2
     fall 3
     weight  -10
}

vrrp_script chk_redis_port 
{
     script      "/bin/echo </dev/tcp/127.0.0.1/56379"
     interval    1
     timeout 2
     fall 3
     weight  -10
}

vrrp_instance redis {
    state BACKUP   
    interface eth0   
    virtual_router_id 50  
    priority  100       
    preempt_delay       5
    advert_int 1
    authentication {   #all node must same
        auth_type PASS
        auth_pass rcsoa_redis_test!#
    } 
    virtual_ipaddress { 
        10.1.58.150/24
    }
    track_script { 
         chk_redis 
         chk_redis_port
    } 
    notify_master "/home/yzkf/app/script/redis/redis_master.sh 127.0.0.1 10.1.58.19 56379"
    notify_backup "/home/yzkf/app/script/redis/redis_backup.sh 127.0.0.1 10.1.58.19 56379"
    notify_fault /home/yzkf/app/script/redis/keepalived_fault.sh 
    notify_stop /home/yzkf/app/script/redis/keepalived_stop.sh 
}

redis監控腳本（跟主一樣）。

5.1、啓動redis

5.2、啓動keepalived

#service keepalived start

5.3、嘗試通過VIP連接redis：

[root@localhost ~]# /home/middle/app/redis/bin/redis-cli -h 192.168.19.239 -p 6379 -a test1
192.168.19.239:6379> info replication
# Replication
role:master
connected_slaves:1
slave0:ip=192.168.19.242,port=6379,state=online,offset=14,lag=1
master_replid:ffa361951c84f0ce9b7cac18c52d527600a422c0
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:14
second_repl_offset:-1
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:1
repl_backlog_histlen:14

嘗試寫一些數據：

192.168.19.239:6379> set Hello Redis
OK
192.168.19.239:6379> get Hello
"Redis"

從Master讀取數據：

[root@localhost ~]# /home/middle/app/redis/bin/redis-cli -h 192.168.19.240 -p 6379 -a test1 get Hello    
"Redis"

從slave讀取數據：

[root@puppetm ~]# /home/middle/app/redis/bin/redis-cli -h 192.168.19.242 -p 6379 -a test1 get Hello 
"Redis"

5.4、模擬故障產生
使用kill -9 redis 模擬機器宕機

查看Master上的Keepalived日誌

同時Slave上的日誌顯示：

可以發現，Slave已經接管服務，並且擔任Master的角色了

同時VIP也漂移到slave上：

Keepalived+redis高可用redis主從環境搭建

ORACLE性能優化

ORACLE數據庫的比較常用命令

ORACLE 備份恢復之RMAN詳解

oracle常見錯誤代號

目錄結構及主要內容

https://yachay.unat.edu.pe/blog/index.php?comment_area=format_blog&comment_component=blog&comment_co

linux以太網驅動總結