環境如下:
192.168.2.199
vm1.example.com HA主服務器
192.168.2.202
vm2.example.com HA備服務器
192.168.2.205
vm3.example.com
192.168.2.175
vm4.example.com
其中1和2做HA,3和4做httpd的lvs。虛擬IP爲192.168.2.213
1、使用keepalixed+haproxy負載均衡
lvs 適合應用層負載均衡,nginx haproxy適合做網站的負載均衡,haproxy 吞吐量比較高,一般和lvs結合:user->vip+proxy->realserver[root@vm1 ~]# /etc/init.d/keepalived stop 關閉1和2的keepalived
lftp i:~> get pub/docs/haproxy/haproxy-1.4.24.tar.gz
[root@vm1 ~]# yum install rpm-build pcre-devel -y
[root@vm1 ~]# rpmbuild -tb haproxy-1.4.24.tar.gz
[root@vm1 ~]# rpm -ivh /root/rpmbuild/RPMS/x86_64/haproxy-1.4.24-1.x86_64.rpm
[root@vm1 ~]# mkdir /usr/share/haproxy
[root@vm1 ~]# vim /etc/haproxy/haproxy.cfg
option redispatch 更改
stats uri /status 添加
listen www.haproxy.com *:80
balance roundrobin
server web1 192.168.2.205:80 cookie app1inst1 check inter 2000 rise 2 fall 3
server web2 192.168.2.175:80 cookie app1inst2 check inter 2000 rise 2 fall 3
之後的全部刪除。
[root@vm1 ~]# /etc/init.d/haproxy start
在真機中寫入解析,192.168.2.199 www.haproxy.com
2、打開日誌記錄
[root@vm1 ~]# vim /etc/haproxy/haproxy.cfgglobal
log 127.0.0.1 local0 指定日誌設備
#log 127.0.0.1 local1 notice
log 127.0.0.1 local0 info 指定日誌類型
maxconn 4096
chroot /usr/share/haproxy
uid 99
gid 99
daemon
#debug
#quiet
defaults
log global
mode http
option httplog
option dontlognull
retries 3
option redispatch
maxconn 2000
contimeout 5000
clitimeout 50000
srvtimeout 50000
#stats uri /status
listen www.haproxy.com *:80 這裏真機訪問測試的話,做vm1的解析
balance roundrobin
server web1 192.168.2.205:80 cookie app1inst1 check inter 2000 rise 2 fall 3 #2秒檢測,成功判定2次,失敗判定3次
server web2 192.168.2.175:80 cookie app1inst2 check inter 2000 rise 2 fall 3
listen status *:8080
stats enable
stats uri /status
stats auth admin:mmmmmm 認證
stats refresh 5s 刷新時間
[root@vm1 ~]# vim /etc/rsyslog.conf 添加
$ModLoad imudp
$UDPServerRun 514
#### RULES ####
local0.* /var/log/haproxy.log
[root@vm1 ~]# /etc/init.d/rsyslog restart
[root@vm1 ~]# /etc/init.d/haproxy restart
[root@vm1 ~]# cat /var/log/haproxy.log
瀏覽器訪問http://192.168.2.199:8080/status
3、結合keepalived高可用和haproxy負載均衡
[root@vm1 ~]# vim /etc/keepalived/keepalived.conf 主結點配置! Configuration File for keepalived
vrrp_script check_haproxy {
script "/etc/keepalived/check_haproxy"
interval 2 檢測腳本運行頻率
weight 2
}
global_defs {
notification_email {
root@localhost
}
notification_email_from [email protected]
smtp_server 127.0.0.1
smtp_connect_timeout 30
router_id LVS_DEVEL
}
vrrp_instance VI_1 {
state MASTER
interface eth0
virtual_router_id 94
priority 100
advert_int 1
authentication {
auth_type PASS
auth_pass 1111
}
virtual_ipaddress {
192.168.2.213
}
track_script {
check_haproxy
}
}
腳本的編寫
[root@vm1 ~]# vim /etc/keepalived/check_haproxy
#!/bin/bash
/etc/init.d/haproxy status &> /dev/null || /etc/init.d/haproxy restart &> /dev/null
if [ $? -ne 0 ];then
/etc/init.d/keepalived stop &> /dev/null
fi
[root@vm1 ~]# chmod +x /etc/keepalived/check_haproxy
[root@vm1 ~]# scp /etc/keepalived/check_haproxy vm2.example.com:/etc/keepalived/
[root@vm1 ~]# scp rpmbuild/RPMS/x86_64/haproxy-1.4.24-1.x86_64.rpm vm2.example.com:
修改備結點的配置文件
[root@vm2 ~]# vim /etc/keepalived/keepalived.conf
! Configuration File for keepalived
vrrp_script check_haproxy {
script "/etc/keepalived/check_haproxy"
interval 2
weight 2
}
global_defs {
notification_email {
root@localhost
}
notification_email_from [email protected]
smtp_server 127.0.0.1
smtp_connect_timeout 30
router_id LVS_DEVEL
}
vrrp_instance VI_1 {
state BACKUP
interface eth0
virtual_router_id 94
priority 50
advert_int 1
authentication {
auth_type PASS
auth_pass 1111
}
virtual_ipaddress {
192.168.2.213
}
track_script {
check_haproxy
}
}
備結點安裝haproxy
[root@vm2 ~]# rpm -ivh haproxy-1.4.24-1.x86_64.rpm
[root@vm2 ~]# mkdir /usr/share/haproxy
[root@vm1 ~]# scp /etc/haproxy/haproxy.cfg vm2.example.com:/etc/haproxy/ 發送配置文件
[root@vm2 ~]# vim /etc/rsyslog.conf
$ModLoad imudp
$UDPServerRun 514
#### RULES ####
local0.* /var/log/haproxy.log
[root@vm2 ~]# /etc/init.d/rsyslog restart
啓動服務測試
[root@vm1 ~]# /etc/init.d/keepalived start
[root@vm2 ~]# /etc/init.d/keepalived start
這時,在主結點上和備結點就可以看到haproxy啓動,主結點擁有虛擬IP:213,使用ip addr show查看,同時查看日誌tail -f /var/log/messages
訪問192.168.2.213就可以輪尋,這時關閉1的keepalived,2就成爲主結點,擁有IP,不影響訪問。再次開啓1的keepalived會回切回去。
即keep每隔2s檢測ha狀態,沒啓動則重啓,重啓不了就關閉keep,讓他跳到備結點。所謂的虛擬ip是跟着haproxy正常的主機的,因此保證了高可用。
最後自己做遺留得問題是:虛擬ip可以添加,但是隻有自己可以用w3m訪問,真機訪問不了,也ping不同。
日誌如下
Jun 11 11:31:17 ha1 Keepalived_vrrp[9217]: VRRP_Instance(VI_1) setting protocol VIPs.
Jun 11 11:31:17 ha1 Keepalived_vrrp[9217]: VRRP_Instance(VI_1) Sending gratuitous ARPs on eth0 for 192.168.0.213
Jun 11 11:31:17 ha1 Keepalived_healthcheckers[9216]: Netlink reflector reports IP 192.168.0.213 added
Jun 11 11:31:22 ha1 Keepalived_vrrp[9217]: VRRP_Instance(VI_1) Sending gratuitous ARPs on eth0 for 192.168.0.213
最後拔掉網線正常了,原因是局域網中存在該虛擬ip。