RAC搭建手冊
二．配置hostname和hosts文件兩臺都需要設置... 1
一．環境介紹
scan-ip | 172.20.0.174 |
rac1-public ip | 172.20.0.25 |
rac2-public ip | 172.20.0.26 |
rac1-vip | 172.20.0.186 |
rac2-vip | 172.20.0.189 |
rac1-private ip | 192.168.2.112 |
rac2-private ip | 192.168.2.107 |
二．配置hostname和hosts文件兩臺都需要設置
172.20.0.25 rac1:
[root@localhost ~]# vi /etc/sysconfig/network NETWORKING=yes HOSTNAME=rac1 |
172.20.0.26 rac2
[root@localhost ~]# vi /etc/sysconfig/network NETWORKING=yes HOSTNAME=rac2 |
[root@localhost ~]# vi /etc/hosts 172.20.0.25 rac1 172.20.0.186 rac1-vip 192.168.2.112 rac1-priv 172.20.0.26 rac2 172.20.0.189 rac2-vip 192.168.2.107 rac2-priv 172.20.0.174 scan-ip |
三．關閉防火牆，NTP服務，關閉selinux
rac1和rac2都需要關閉
[root@rac1 ~]# vi /etc/sysconfig/selinux SELINUX=disabled 這裏需要重啓生效 [root@rac1 ~]# getenforce disabled [root@rac1 ~]#/etc/init.d/iptables stop [root@rac1 ~]# chkconfig iptables off [root@rac1 ~]# chkconfig ntpd off |
四．創建必要的用戶、組和目錄，並授權
兩個節點rac1和rac2都需要創建，這裏只演示rac1上面的操作。
[root@rac1 ~]# /usr/sbin/groupadd -g 1000 oinstall [root@rac1 ~]# /usr/sbin/groupadd -g 1020 asmadmin [root@rac1 ~]# /usr/sbin/groupadd -g 1021 asmdba [root@rac1 ~]# /usr/sbin/groupadd -g 1022 asmoper [root@rac1 ~]# /usr/sbin/groupadd -g 1031 dba [root@rac1 ~]# /usr/sbin/groupadd -g 1032 oper [root@rac1 ~]# useradd -d /opt/grid -u 1100 -g oinstall -G asmadmin,asmdba,asmoper,oper,dba grid [root@rac1 ~]# useradd -d /opt/oracle -u 1101 -g oinstall -G dba,asmdba,oper oracle [root@rac1 ~]# passwd oracle Changing password for user oracle. New password: BAD PASSWORD: it is based on a dictionary word BAD PASSWORD: is too simple Retype new password: passwd: all authentication tokens updated successfully. [root@rac1 ~]# passwd grid Changing password for user grid. New password: BAD PASSWORD: it is too short BAD PASSWORD: is too simple Retype new password: passwd: all authentication tokens updated successfully. [root@rac1 ~]# mkdir -p /u01/app/11.2.0/grid [root@rac1 ~]# mkdir -p /u01/app/grid [root@rac1 ~]# mkdir /u01/app/oracle [root@rac1 ~]# chown -R grid:oinstall /u01 [root@rac1 ~]# chown oracle:oinstall /u01/app/oracle [root@rac1 ~]# chmod -R 775 /u01/ [root@rac1 ~]# |
五. 節點配置檢查
查看內存和swap大小，內存大小：至少2.5GB
root@rac1 ~]# grep MemTotal /proc/meminfo MemTotal: 8061904 kB [root@rac1 ~]# grep SwapTotal /proc/meminfo SwapTotal: 3145720 kB [root@rac1 ~]# |
六．參數文件修改
（1）內核參數設置：
[root@rac1 ~]# vi /etc/sysctl.conf # Controls the maximum shared segment size, in bytes kernel.shmmax = 68719476736（已有）物理內存的1/2（M）*1024*1024
# Controls the maximum number of shared memory segments, in pages kernel.shmall = 4294967296（已有） #oracle setting fs.aio-max-nr = 1048576 fs.file-max = 6815744 kernel.shmmni = 4096 kernel.sem = 250 32000 100 128 net.ipv4.ip_local_port_range = 9000 65500 net.core.rmem_default = 262144 net.core.rmem_max = 4194304 net.core.wmem_default = 262144 net.core.wmem_max = 1048576 |
#/sbin/sysctl -p 執行該命令，使修改生效
[root@rac1 ~]# /sbin/sysctl -p |
（2）配置oracle、grid用戶的shell限制
[root@rac1 ~]# vi /etc/security/limits.conf oracle hard nproc 16384 oracle soft nofile 1024 oracle hard nofile 65536 oracle soft stack 10240 grid soft nproc 2047 grid hard nproc 16384 grid soft nofile 1024 grid hard nofile 65536 |
（3）配置login
[root@rac1 ~]# vi /etc/pam.d/login |
七．安裝所需的依賴包
yum -y install binutils compat-libstdc++-33 elfutils-libelf elfutils-libelf-devel gcc gcc-c++ yum -y install glibc glibc-common glibc-devel glibc-headers ksh libaio libaio-devel yum -y install libgcc libstdc++ libstdc++-devel make numactl-devel sysstat unixODBC unixODBC-devel yum install libcap |
八．添加軟連接
[root@rac1 ~]# cd /lib64 ln -s libcap.so.2 libcap.so.1 |
九．配置grid和oracle用戶環境變量
Oracle_sid需要根據節點不同進行修改
[root@rac1 ~]# su - grid export TMP=/tmp export TMPDIR=$TMP export ORACLE_SID=+ASM1 # RAC1 export ORACLE_SID=+ASM2 # RAC2 export ORACLE_BASE=/u01/app/grid export ORACLE_HOME=/u01/app/11.2.0/grid export PATH=/usr/sbin:$PATH export PATH=$ORACLE_HOME/bin:$PATH export LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib export CLASSPATH=$ORACLE_HOME/JRE:$ORACLE_HOME/jlib:$ORACLE_HOME/rdbms/jlib umask 022 |
需要注意的是ORACLE_UNQNAME是數據庫名，創建數據庫時指定多個節點是會創建多個實例，ORACLE_SID指的是數據庫實例名
[root@rac1 ~]# su - oracle export TMP=/tmp export TMPDIR=$TMP export ORACLE_SID=orcl1 # RAC1 export ORACLE_SID=orcl2 # RAC2 export ORACLE_UNQNAME=orcl export ORACLE_BASE=/u01/app/oracle export ORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1 export TNS_ADMIN=$ORACLE_HOME/network/admin export PATH=/usr/sbin:$PATH export PATH=$ORACLE_HOME/bin:$PATH export LD_LIBRARY_PATH=$ORACLE_HOME/lib:/lib:/usr/lib |
$ source .bash_profile使配置文件生效
十．手工配置grid用戶互信
配置過程如下： 各節點生成Keys： 配置過程如下： 各節點生成Keys： [root@rac1 ~]# su - grid [grid@rac1 ~]$ mkdir ~/.ssh [grid@rac1 ~]$ chmod 700 ~/.ssh [grid@rac1 ~]$ ssh-keygen -t rsa [grid@rac1 ~]$ ssh-keygen -t dsa [root@rac2 ~]# su - grid [grid@rac2 ~]$ mkdir ~/.ssh [grid@rac2 ~]$ chmod 700 ~/.ssh [grid@rac2 ~]$ ssh-keygen -t rsa [grid@rac2 ~]$ ssh-keygen -t dsa
在節點1上進行互信配置： [grid@rac1 ~]$ touch ~/.ssh/authorized_keys [grid@rac1 ~]$ cd ~/.ssh [grid@rac1 .ssh]$ ssh rac1 cat ~/.ssh/id_rsa.pub >> authorized_keys [grid@rac1 .ssh]$ ssh rac2 cat ~/.ssh/id_rsa.pub >> authorized_keys [grid@rac1 .ssh]$ ssh rac1 cat ~/.ssh/id_dsa.pub >> authorized_keys [grid@rac1 .ssh]$ ssh rac2 cat ~/.ssh/id_dsa.pub >> authorized_keys
在rac1把存儲公鑰信息的驗證文件傳送到rac2上 [grid@rac1 .ssh]$ pwd /home/grid/.ssh [grid@rac1 .ssh]$ scp authorized_keys rac2:'pwd' grid@rac2's password: authorized_keys 100% 1644 1.6KB/s 00:00
設置驗證文件的權限 在每一個節點執行： $ chmod 600 ~/.ssh/authorized_keys
啓用用戶一致性 在你要運行OUI的節點以grid用戶運行(這裏選擇rac1)： [grid@rac1 .ssh]$ exec /usr/bin/ssh-agent $SHELL [grid@rac1 .ssh]$ ssh-add Identity added: /home/grid/.ssh/id_rsa (/home/grid/.ssh/id_rsa) Identity added: /home/grid/.ssh/id_dsa (/home/grid/.ssh/id_dsa)
驗證ssh配置是否正確 以grid用戶在所有節點分別執行： ssh rac1 date ssh rac2 date ssh rac1-priv date ssh rac2-priv date
如果不需要輸入密碼就可以輸出時間，說明ssh驗證配置成功。必須把以上命令在兩個節點都運行，每一個命令在第一次執行的時候需要輸入yes。 如果不運行這些命令，即使ssh驗證已經配好，安裝clusterware的時候也會出現錯誤： The specified nodes are not clusterable 因爲，配好ssh後，還需要在第一次訪問時輸入yes，纔算是真正的無障礙訪問其他服務器。 |
需要注意的是生成密鑰時不設置密碼，授權文件權限爲600，同時需要兩個節點互相ssh通過一次。
十一.配置裸盤
使用asm管理存儲需要裸盤，前面配置了共享硬盤到兩臺主機上。配置裸盤的方式有兩種（1）oracleasm添加
（2）/etc/udev/rules.d/60-raw.rules配置文件添加(字符方式幫綁定udev)
採用第二種
fdisk /dev/sdb Command (m forhelp): n Command action e extended p primary partition (1-4) p Partition number (1-4): 1 ……. 這裏我分了三個區：OCR(投票盤),DATA（數據文件））,FAR（快速恢復區） 最後 w 命令保存更改 partx -a /dev/sdb |
分別在兩個節點創建裸設備映射（兩個節點都要編輯）（兩個節點都要編輯）
[root@rac1 rules.d]# vi /etc/udev/rules.d/60-raw.rules # Enter raw device bindings here. # # An example would be: # ACTION=="add", KERNEL=="sda", RUN+="/bin/raw /dev/raw/raw1 %N" # to bind /dev/raw/raw1 to /dev/sda, or # ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="1", RUN+="/bin/raw /dev/raw/raw2 %M %m" # to bind /dev/raw/raw2 to the device with major 8, minor 1. ACTION=="add", KERNEL=="sdb1", RUN+="/bin/raw /dev/raw/raw1 %N" ACTION=="add", KERNEL=="sdb2", RUN+="/bin/raw /dev/raw/raw2 %N" ACTION=="add", KERNEL=="sdb3", RUN+="/bin/raw /dev/raw/raw3 %N" KERNEL=="raw[1-3]",OWNER="grid",GROUP="asmadmin" MODE="660" |
啓動並查看裸盤
[root@rac1 ~]# start_udev Starting udev: [ OK ] [root@rac1 ~]# ll /dev/raw/ total 0 crw-rw---- 1 grid asmadmin 162, 1 Apr 13 13:51 raw1 crw-rw---- 1 grid asmadmin 162, 2 Apr 13 13:51 raw2 crw-rw---- 1 grid asmadmin 162, 3 Apr 13 13:51 raw3 crw-rw---- 1 root disk 162, 0 Apr 13 13:51 rawctl |
[root@rac1 rules.d]# raw -qa /dev/raw/raw1: bound to major 8, minor 17 /dev/raw/raw2: bound to major 8, minor 18 /dev/raw/raw3: bound to major 8, minor 19 查看裸設備的主從設備號 [root@rac1 rules.d]# ls -l /dev/raw/ total 0 crw-rw---- 1 grid asmadmin 162, 1 Aug 5 12:44 raw1 crw-rw---- 1 grid asmadmin 162, 2 Aug 5 12:44 raw2 crw-rw---- 1 grid asmadmin 162, 3 Aug 5 12:44 raw3 |
節點2強制刷新
[root@rac2 rules.d]# partprobe [root@rac2 ~]# start_udev Starting udev: [ OK ] [root@rac1 rules.d]# raw -qa /dev/raw/raw1: bound to major 8, minor 17 /dev/raw/raw2: bound to major 8, minor 18 /dev/raw/raw3: bound to major 8, minor 19 查看裸設備的主從設備號 [root@rac1 rules.d]# ls -l /dev/raw/ total 0 crw-rw---- 1 grid asmadmin 162, 1 Aug 5 12:44 raw1 crw-rw---- 1 grid asmadmin 162, 2 Aug 5 12:44 raw2 crw-rw---- 1 grid asmadmin 162, 3 Aug 5 12:44 raw3 |
十二.grid安裝
rac1到grid軟件目錄下執行runcluvfy.sh命令開始預安裝檢查：
在grid下解壓grid，執行預安裝檢查。
[grid@rac1 ~]$ cd grid/ [grid@rac1 grid]$ ls install readme.html response rpm runcluvfy.sh runInstaller sshsetup stage welcome.html [grid@rac1 grid]$ pwd /opt/grid/grid [grid@rac1 grid]$ ./runcluvfy.sh stage -pre crsinst -n rac1,rac2 -fixup -verbose |
查看cvu報告，修正錯誤, 各項都檢查通過即可開始安裝grid
登陸到圖形化界面
[root@rac1 ~]#xhost + [root@rac1 ~]#su – grid [grid@rac1 ~]$cd grid [grid@rac1 grid]$./runInstaller |
已經手動做過互信，這裏可以跳過，直接下一步
在兩個節點上分別執行這兩個腳本
執行腳本時注意順序，一定是先執行rac1，然後去rac2上執行
執行完之後點擊ok
rac1:
[root@rac1 ~]# cd /u01/app/oraInventory/ [root@rac1 oraInventory]# ./orainstRoot.sh Changing permissions of /u01/app/oraInventory. Adding read,write permissions for group. Removing read,write,execute permissions for world.
Changing groupname of /u01/app/oraInventory to oinstall. The execution of the script is complete. [root@rac1 oraInventory]# clear [root@rac1 oraInventory]# cd /u01/app/11.2.0/grid/ [root@rac1 grid]# ./root.sh Performing root user operation for Oracle 11g
The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= /u01/app/11.2.0/grid
Enter the full pathname of the local bin directory: [/usr/local/bin]: Copying dbhome to /usr/local/bin ... Copying oraenv to /usr/local/bin ... Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed.
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params Creating trace directory User ignored Prerequisites during installation Installing Trace File Analyzer OLR initialization - successful root wallet root wallet cert root cert export peer wallet profile reader wallet pa wallet peer wallet keys pa wallet keys peer cert request pa cert request peer cert pa cert peer root cert TP profile reader root cert TP pa root cert TP peer pa cert TP pa peer cert TP profile reader pa cert TP profile reader peer cert TP peer user cert pa user cert Adding Clusterware entries to upstart CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1' CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1' CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1' CRS-2672: Attempting to start 'ora.gipcd' on 'rac1' CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.cssd' on 'rac1' CRS-2672: Attempting to start 'ora.diskmon' on 'rac1' CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded
ASM created and started successfully.
Disk Group OCR created successfully.
clscfg: -install mode specified Successfully accumulated necessary OCR keys. Creating OCR keys for user 'root', privgrp 'root'.. Operation successful. CRS-4256: Updating the profile Successful addition of voting disk 9ee58ddd21094f61bf43065b4875e9a4. Successfully replaced voting disk group with +OCR. CRS-4256: Updating the profile CRS-4266: Voting file(s) successfully replaced ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 9ee58ddd21094f61bf43065b4875e9a4 (/dev/raw/raw1) [OCR] Located 1 voting disk(s). CRS-2672: Attempting to start 'ora.asm' on 'rac1' CRS-2676: Start of 'ora.asm' on 'rac1' succeeded CRS-2672: Attempting to start 'ora.OCR.dg' on 'rac1' CRS-2676: Start of 'ora.OCR.dg' on 'rac1' succeeded Configure Oracle Grid Infrastructure for a Cluster ... succeeded |
rac2
[root@rac2 CVU_11.2.0.4.0_grid]# cd /u01/app/oraInventory/ ContentsXML/ logs/ oraInst.loc orainstRoot.sh [root@rac2 CVU_11.2.0.4.0_grid]# cd /u01/app/oraInventory/ [root@rac2 oraInventory]# ./orainstRoot.sh Changing permissions of /u01/app/oraInventory. Adding read,write permissions for group. Removing read,write,execute permissions for world.
Changing groupname of /u01/app/oraInventory to oinstall. The execution of the script is complete. [root@rac2 oraInventory]# cd ../11.2.0/grid/ [root@rac2 grid]# ./r racg/ rdbms/ relnotes/ root.sh rootupgrade.sh [root@rac2 grid]# ./root.sh Performing root user operation for Oracle 11g
The following environment variables are set as: ORACLE_OWNER= grid ORACLE_HOME= /u01/app/11.2.0/grid
Enter the full pathname of the local bin directory: [/usr/local/bin]: Copying dbhome to /usr/local/bin ... Copying oraenv to /usr/local/bin ... Copying coraenv to /usr/local/bin ...
Creating /etc/oratab file... Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params Creating trace directory User ignored Prerequisites during installation Installing Trace File Analyzer
OLR initialization - successful Adding Clusterware entries to upstart CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node rac1, number 1, and is terminating An active cluster was found during exclusive startup, restarting to join the cluster Configure Oracle Grid Infrastructure for a Cluster ... succeeded |
點擊ok繼續安裝
[root@rac1 ~]#su – grid [grid@rac1 ~]$asmca
|
[rooot@rac1 ~]#xhost + [root@rac1 ~]#su – oracle [oracle@rac1 ~]$cd database [oracle@rac1 ~]$./runInstaller |
rac1
[root@rac1 ~]# cd /u01/app/oracle/product/11.2.0/db_1/ [root@rac1 db_1]# ./root.sh Performing root user operation for Oracle 11g
The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /u01/app/oracle/product/11.2.0/db_1
Enter the full pathname of the local bin directory: [/usr/local/bin]: The contents of "dbhome" have not changed. No need to overwrite. The contents of "oraenv" have not changed. No need to overwrite. The contents of "coraenv" have not changed. No need to overwrite.
Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Finished product-specific root actions. [root@rac1 db_1]# |
rac2
[root@rac2 grid]# cd /u01/app/oracle/product/11.2.0/db_1/ [root@rac2 db_1]# ./root.sh Performing root user operation for Oracle 11g
The following environment variables are set as: ORACLE_OWNER= oracle ORACLE_HOME= /u01/app/oracle/product/11.2.0/db_1
Enter the full pathname of the local bin directory: [/usr/local/bin]: The contents of "dbhome" have not changed. No need to overwrite. The contents of "oraenv" have not changed. No need to overwrite. The contents of "coraenv" have not changed. No need to overwrite.
Entries will be added to the /etc/oratab file as needed by Database Configuration Assistant when a database is created Finished running generic part of root script. Now product-specific root actions will be performed. Finished product-specific root actions. [root@rac2 db_1]# |
十五.DBCA創建實例
在oracle下解壓安裝包
登陸到圖形化界面
[root@rac1 ~]#xhost + [root@rac1 ~]#su – oracle [oracle@rac1 ~]$ dbca |
安裝完成。