一、同步流複製的架構
PostgreSQL從9.1版本之後提供了同步複製的架構。同步複製要求在數據寫入Standby數據庫後,事務的commit才返回,所以Standby庫出現問題時,會導致主庫被hang住。解決這個問題的方法是啓動兩個Standby數據庫,這兩個standby數據庫只要有一個是正常的,就不會讓主庫hang住。所以在實際應用中,同步流複製,總是有1個主庫和2個以上的Standby庫。
二、同步複製的配置
實現同步複製功能主要是在主庫上配置參數"synchronous_standby_names",這個參數指定多個Standby的名稱,各個名稱通過逗號分隔,而Standby名稱是在Standby連接到主庫時,由連接參數"application_name"指定的。要使用同步複製,在Standby數據庫中,recovery.conf
裏的primary_conninfo一定要指定連接參數"application_name"。recovery.conf的示例如下:
standby_mode = 'on'
primary_conninfo = 'application_name=standby01 user=repluesr password=XXXXXX host=172.16.0.111 port=5432 sslmode=disable sslcompression=1'
三、系統環境
系統平臺:centos6.5
PostgreSQL版本:postgresql9.4.3
防火牆關閉/iptables
selinux設置成
SELINUX=disabled
主機名 | IP地址 | 角色 | 數據目錄 |
postgresql01 | 172.16.0.111 | 主庫 | /home/postgres/pgsql/data |
postgresql02 | 172.16.0.112 | Standby | /home/postgres/pgsql/data |
postgresql03 | 172.16.0.113 | Standby | /home/postgres/pgsql/data |
四、源碼包安裝
1、在三臺安裝依賴包
yum -y install gcc*
yum -y install readline-devel
2、在三臺增加用戶
# adduser postgres
# passwd postgres
Changing password for user postgres.
New password:
BAD PASSWORD: it is too simplistic/systematic
BAD PASSWORD: is too simple
Retype new password:
passwd: all authentication tokens updated successfully.
注意:主庫安裝與配置好後,在把全部的文件拷備到standby中。
以下是主庫操作
3. 下載PostgreSQL 源碼包
# wget http://ftp.postgresql.org/pub/source/v9.4.3/postgresql-9.4.3.tar.bz2
4. 解壓源碼包
# tar xjf postgresql-9.4.3.tar.bz2
5. 進入解壓後的目錄
# cd postgresql-9.4.3
6.開始編譯安裝PostgreSQL 數據庫。
[root@postgresql01 postgresql-9.4.3]# ./configure --prefix=/home/postgres/pgsql
[root@postgresql01 postgresql-9.4.3]#gmake
[root@postgresql01 postgresql-9.4.3]# gmake install
7.設置環境
[root@postgresql01 postgresql-9.4.3]# cd /home/postgres/
[root@postgresql01 postgres]# ls
pgsql
[root@postgresql01 postgres]# vi .bash_profile
把 PATH=$PATH:$HOME/bin
改成 PATH=$PATH:$HOME/bin:/home/postgres/pgsql/bin
保存退出。
讓環境變量生效
[root@postgresql01 postgres]# source .bash_profile
8.初始化數據庫
8.1新建數據目錄
[root@postgresql01 postgres]# mkdir /home/postgres/pgsql/data
8.2更改權限
[root@postgresql01 postgres]# chown postgres:postgres /home/postgres/pgsql/data
8.3切換到postgres用戶
[root@postgresql01 postgres]# su - postgres
8.4init db
[postgres@postgresql01 ~]$ /home/postgres/pgsql/bin/initdb -D /home/postgres/pgsql/data
到這裏數據的初始化就完成
9.系統服務
9.1回到root用戶
[postgres@postgresql01 ~]$ exit
9.2複製安裝目錄下的linux文件/etc/init.d/
進入postgresql的安裝目錄
[root@postgresql01 postgres]# cd /root/postgresql-9.4.3/
[root@postgresql01 postgresql-9.4.3]# cp contrib/start-scripts/linux /etc/init.d/postgresql
9.3修改/etc/init.d/postgresql 注意:紅色是修改部分
[root@postgresql postgresql-9.4.3]# vi /etc/init.d/postgresql
#! /bin/sh
# chkconfig: 2345 98 02
# description: PostgreSQL RDBMS
# This is an example of a start/stop script for SysV-style init, such
# as is used on Linux systems. You should edit some of the variables
# and maybe the 'echo' commands.
#
# Place this file at /etc/init.d/postgresql (or
# /etc/rc.d/init.d/postgresql) and make symlinks to
# /etc/rc.d/rc0.d/K02postgresql
# /etc/rc.d/rc1.d/K02postgresql
# /etc/rc.d/rc2.d/K02postgresql
# /etc/rc.d/rc3.d/S98postgresql
# /etc/rc.d/rc4.d/S98postgresql
# /etc/rc.d/rc5.d/S98postgresql
# Or, if you have chkconfig, simply:
# chkconfig --add postgresql
#
# Proper init scripts on Linux systems normally require setting lock
# and pid files under /var/run as well as reacting to network
# settings, so you should treat this with care.
# Original author: Ryan Kirkpatrick <[email protected]>
# contrib/start-scripts/linux
## EDIT FROM HERE
# Installation prefix
prefix=/home/postgres /pgsql
# Data directory
PGDATA="/home/postgres/pgsql/data"
# Who to run the postmaster as, usually "postgres". (NOT "root")
PGUSER=postgres
# Where to keep a log file
PGLOG="$PGDATA/serverlog"
# It's often a good idea to protect the postmaster from being killed by the
# OOM killer (which will tend to preferentially kill the postmaster because
# of the way it accounts for shared memory). Setting the OOM_SCORE_ADJ value
# to -1000 will disable OOM kill altogether. If you enable this, you probably
# want to compile PostgreSQL with "-DLINUX_OOM_SCORE_ADJ=0", so that
# individual backends can still be killed by the OOM killer.
#OOM_SCORE_ADJ=-1000
# Older Linux kernels may not have /proc/self/oom_score_adj, but instead
# /proc/self/oom_adj, which works similarly except the disable value is -17.
# For such a system, enable this and compile with "-DLINUX_OOM_ADJ=0".
#OOM_ADJ=-17
## STOP EDITING HERE
# The path that is to be used for the script
PATH=/usr/local/sbin:/usr/local/bin:/sbin:/bin:/usr/sbin:/usr/bin
# What to use to start up the postmaster. (If you want the script to wait
# until the server has started, you could use "pg_ctl start -w" here.
# But without -w, pg_ctl adds no value.)
DAEMON="$prefix/bin/postmaster"
# What to use to shut down the postmaster
PGCTL="$prefix/bin/pg_ctl"
set -e
# Only start if we can find the postmaster.
test -x $DAEMON ||
{
echo "$DAEMON not found"
if [ "$1" = "stop" ]
then exit 0
else exit 5
fi
}
# Parse command line parameters.
case $1 in
start)
echo -n "Starting PostgreSQL: "
test x"$OOM_SCORE_ADJ" != x && echo "$OOM_SCORE_ADJ" > /proc/self/oom_score_adj
test x"$OOM_ADJ" != x && echo "$OOM_ADJ" > /proc/self/oom_adj
su - $PGUSER -c "$DAEMON -D '$PGDATA' &" >>$PGLOG 2>&1
echo "ok"
;;
stop)
echo -n "Stopping PostgreSQL: "
su - $PGUSER -c "$PGCTL stop -D '$PGDATA' -s -m fast"
echo "ok"
;;
restart)
echo -n "Restarting PostgreSQL: "
su - $PGUSER -c "$PGCTL stop -D '$PGDATA' -s -m fast -w"
test x"$OOM_SCORE_ADJ" != x && echo "$OOM_SCORE_ADJ" > /proc/self/oom_score_adj
test x"$OOM_ADJ" != x && echo "$OOM_ADJ" > /proc/self/oom_adj
su - $PGUSER -c "$DAEMON -D '$PGDATA' &" >>$PGLOG 2>&1
echo "ok"
;;
reload)
echo -n "Reload PostgreSQL: "
su - $PGUSER -c "$PGCTL reload -D '$PGDATA' -s"
echo "ok"
;;
status)
su - $PGUSER -c "$PGCTL status -D '$PGDATA'"
;;
*)
# Print help
echo "Usage: $0 {start|stop|restart|reload|status}" 1>&2
exit 1
;;
esac
exit 0
9.4啓動數據庫
[root@postgresql01 postgresql-9.4.3]# /etc/init.d/postgresql start
9.5讓數據庫開機啓動
[root@postgresql01 postgresql-9.4.3]# chkconfig --add postgresql
[root@postgresql01 postgresql-9.4.3]# chkconfig postgresql on
9.6創建數據操作歷史記錄文件
[root@postgresql01 postgresql-9.4.3]# touch /home/postgres/pgsql/.pgsql_history
[root@postgresql01 postgresql-9.4.3]# chown postgres:postgres /home/postgres/pgsql/.pgsql_history
10.測試使用
[postgres@postgresql01 ~]$ createdb test
[postgres@postgresql01 ~]$ psql test
psql (9.4.3)
Type "help" for help.
test=#
源碼編譯安裝成功
五、配置同步流複製
配置如下:
1.在主庫增加同步的用戶名與密碼
[postgres@postgresql01 ~]$ psql -d postgres
psql (9.4.3)
Type "help" for help.
postgres=# CREATE ROLE repluser REPLICATION LOGIN PASSWORD 'zhf#2015';
CREATE ROLE
postgres=#
2.在主庫postgresql01上進行配置
修改以下參數
在主庫的/home/postgres/pgsql/data/pg_hba.conf中做如下配置:
[postgres@postgresql01 ~]$ vi /home/postgres/pgsql/data/pg_hba.conf
增加以下:
host replication repluser 172.16.0.0/24 md5
2.在主庫postgreso1的/home/postgres/pgsql/data/postgresql.conf中設置如下三個參數
[postgres@postgresql01 ~]$ vi /home/postgres/pgsql/data/postgresql.conf
isten_addresses = '*'
max_wal_senders = 5
wal_level = hot_standby
3.在主數據上指定同步複製的Standby名稱,在postgresql01的/home/postgres/pgsql/data/postgresql.conf增加如下一行:
synchronous_standby_names = 'standby01,standby02'
4.停止主庫postgresql
[root@postgresql01 ~]# /etc/init.d/postgresql stop
5.把主庫安裝文件拷備到兩臺standby中
[root@postgresql01 ~]# scp -r /home/postgres/pgsql 172.16.0.112:/home/postgres/
[root@postgresql01 ~]# scp -r /home/postgres/pgsql 172.16.0.113:/home/postgres/
[root@postgresql01 ~]# scp -r /etc/init.d/postgresql 172.16.0.112:/etc/init.d/
[root@postgresql01 ~]# scp -r /etc/init.d/postgresql 172.16.0.113:/etc/init.d/
6.在兩臺standby中設置權限兩臺都操作如下:
[root@postgresql02 ~]# cd /home/postgres/pgsql/
[root@postgresql02 pgsql]# chown -R postgres:postgres data
[root@postgresql02 pgsql]# chmod +x /etc/init.d/postgresql
[root@postgresql02 postgres]# chkconfig --add postgresql
[root@postgresql02 postgres]# chkconfig postgresql on
[root@postgresql03 ~]# cd /home/postgres/pgsql/
[root@postgresql03 pgsql]# chown -R postgres:postgres data
[root@postgresql03 pgsql]# chmod +x /etc/init.d/postgresql
[root@postgresql03 postgres]# chkconfig --add postgresql
[root@postgresql03 postgres]# chkconfig postgresql on
7. 在兩臺standby中設置環境變量兩臺都操作如下:
[root@postgresql02 pgsql]# cd /home/postgres/
把 PATH=$PATH:$HOME/bin
改成 PATH=$PATH:$HOME/bin:/home/postgres/pgsql/bin
保存退出。
讓環境變量生效:
[root@postgresql02 postgres]# source .bash_profile
[root@postgresql03 pgsql]# cd /home/postgres/
把 PATH=$PATH:$HOME/bin
改成 PATH=$PATH:$HOME/bin:/home/postgres/pgsql/bin
保存退出。
讓環境變量生效:
[root@postgresql03 postgres]# source .bash_profile
8.在備庫postgresql02上進行配置
把配置文件拷過來
[root@postgresql02 postgres]# su - postgres
[postgres@postgresql02 ~]$ cd pgsql/data/
[postgres@postgresql02 data]$ cp /home/postgres/pgsql/share/recovery.conf.sample ./recovery.conf
在postgresql02的/home/postgres/pgsql/data/recovery.conf中的配置“primary_conninfo”裏增加 連接參數“appliction_name”,如下:
standby_mode = on
primary_conninfo = 'application_name=standby01 user=repluser password=zhf#2015 host=172.16.0.111 port=5432 sslmode=disable sslcompression=1'
在postgresql02的/home/postgres/pgsql/data/postgresql.conf中的配置參數
hot_standby = on
完成配置後,啓動數據庫,如下:
[root@postgresql02 postgres]# /etc/init.d/postgresql start
9.在備庫postgresql03上進行配置
把配置文件拷過來
[root@postgresql03 postgres]# su - postgres
[postgres@postgresql03 ~]$ cd pgsql/data/
[postgres@postgresql03 data]$ cp /home/postgres/pgsql/share/recovery.conf.sample ./recovery.conf
在postgresql03的/home/postgres/pgsql/data/recovery.conf中的配置“primary_conninfo”裏增加 連接參數“appliction_name”,如下:
standby_mode = on
primary_conninfo = 'application_name=standby02 user=repluser password=zhf#2015 host=172.16.0.111 port=5432 sslmode=disable sslcompression=1'
在postgresql03的/home/postgres/pgsql/data/postgresql.conf中的配置參數
hot_standby = on
完成配置後,啓動數據庫,如下:
[root@postgresql03 postgres]# /etc/init.d/postgresql start
10.啓動主庫 postgresql01
11.測試在主庫中
[postgres@postgresql01 data]$ psql test
psql (9.4.3)
Type "help" for help.
test=# create table test01(id int primary key,note text);
CREATE TABLE
test=# insert into test01 values(1,'1111111');
INSERT 0 1
test=# insert into test01 values(2,'2222222');
INSERT 0 1
在備庫查詢數據
在備庫postgresql02中查看
[postgres@postgresql02 ~]$ psql test
psql (9.4.3)
Type "help" for help.
test=# select * from test01;
id | note
----+---------
1 | 1111111
2 | 2222222
(2 rows)
test=#
在備庫postgresql03中查看
[root@postgresql03 postgres]# su - postgres
[postgres@postgresql03 ~]$ psql test
psql (9.4.3)
Type "help" for help.
test=# select * from test01;
id | note
----+---------
1 | 1111111
2 | 2222222
(2 rows)
test=#