1.安裝操作系統，每臺機器兩塊網卡，CUSTOM軟件包安裝（system tools,DEVELOP),關閉防火牆
2.添加用戶組
groupadd -g 501 oinstall
groupadd -g 502 dba
groupadd -g 504 asmadmin
groupadd -g 506 asmdba
groupadd -g 507 asmoper
useradd -u 501 -g oinstall -G asmadmin,asmdba,asmoper,dba grid
useradd -u 502 -g oinstall -G dba,asmdba oracle
修改密碼
passwd grid
passwd oracle
3.修改/etc/hosts
127.0.0.1 localhost.localdomain localhost
192.168.2.77 racdb1
192.168.2.78 racdb2
192.168.3.77 racdb1_priv
192.168.3.78 racdb2_priv
192.168.2.215 racdb1_vip
192.168.2.216 racdb2_vip
192.168.2.217 racscan
4.修改/etc/sysctl.conf內核參數增加
kernel.shmmni = 4096
kernel.sem = 250 32000 100 128
net.ipv4.ip_local_port_range = 9000 65500
net.core.rmem_default = 262144
net.core.rmem_max = 4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048576
fs.file-max = 6815744
fs.aio-max-nr = 1048576
net.ipv4.tcp_tw_reuse = 1
net.ipv4.tcp_tw_recycle = 1
kernel.core_uses_pid = 1
sysctl -p命令激活
5.vi /etc/security/limits.conf
grid soft nproc 2047
grid hard nproc 16384
grid soft nofile 1024
grid hard nofile 65536
oracle soft nproc 2047
oracle hard nproc 16384
oracle soft nofile 1024
oracle hard nofile 65536
6.vi /etc/pam.d/login 增加如下
session required /lib64/security/pam_limits.so
7.修改profile，增加如下
if [ $USER = "oracle" ] || [ $USER = "grid" ]; then
if [ $SHELL = "/bin/ksh" ]; then
ulimit -p 16384
ulimit -n 65536
else
ulimit -u 16384 -n 65536
fi
umask 022
fi
8.創建目錄
mkdir -p /oracle/app/oraInventory
chown -R grid:oinstall /oracle/app/oraInventory
chmod -R 775 /oracle/app/oraInventory
mkdir -p /oracle/app/gridbase
chown -R grid:oinstall /oracle/app/gridbase
chmod -R 775 /oracle/app/gridbase
mkdir -p /oracle/app/grid
chown -R grid:oinstall /oracle/app/grid
chmod -R 775 /oracle/app/grid
mkdir -p /oracle/app/oracle/cfgtoollogs
chown -R oracle:oinstall /oracle/app/oracle
chmod -R 775 /oracle/app/oracle
mkdir -p /oracle/app/oracle/product/11.2.0/db_1
chown -R oracle:oinstall /oracle/app/oracle/product/11.2.0/db_1
chmod -R 775 /oracle/app/oracle/product/11.2.0/db_1
chown grid:oinstall /oracle/app
chmod 775 /oracle/app
9.軟件包檢測
rpm -q --qf '%{NAME}-%{VERSION}-%{RELEASE} (%{ARCH})\n' binutils \
binutils \
compat-libstdc++ \
elfutils-libelf \
elfutils-libelf-devel \
expat \
gcc \
gcc-c++ \
glibc \
glibc-common \
glibc-devel \
glibc-headers \
libaio \
libaio-devel \
libgcc \
libstdc++ \
libstdc++-devel \
make \
pdksh \
sysstat \
unixODBC \
unixODBC-devel
輸出如下
binutils-2.17.50.0.6-20.el5 (x86_64)
binutils-2.17.50.0.6-20.el5 (x86_64)
package compat-libstdc++ is not installed
elfutils-libelf-0.137-3.el5 (x86_64)
elfutils-libelf-0.137-3.el5 (i386)
elfutils-libelf-devel-0.137-3.el5 (x86_64)
expat-1.95.8-8.3.el5_5.3 (x86_64)
expat-1.95.8-8.3.el5_5.3 (i386)
gcc-4.1.2-52.el5 (x86_64)
gcc-c++-4.1.2-52.el5 (x86_64)
glibc-2.5-81 (x86_64)
glibc-2.5-81 (i686)
glibc-common-2.5-81 (x86_64)
glibc-devel-2.5-81 (x86_64)
glibc-devel-2.5-81 (i386)
glibc-headers-2.5-81 (x86_64)
libaio-0.3.106-5 (x86_64)
libaio-0.3.106-5 (i386)
package libaio-devel is not installed
libgcc-4.1.2-52.el5 (x86_64)
libgcc-4.1.2-52.el5 (i386)
libstdc++-4.1.2-52.el5 (x86_64)
libstdc++-4.1.2-52.el5 (i386)
libstdc++-devel-4.1.2-52.el5 (x86_64)
make-3.81-3.el5 (x86_64)
package pdksh is not installed
package sysstat is not installed
package unixODBC is not installed
package unixODBC-devel is not installed
按照操作系統軟件包的安裝多少可能有差異，自行安裝not installed部分
安裝方法 1
虛擬機裝載LINUX系統光盤
mount /dev/sr0 /mnt
cd /mnt/Server
安裝not installed部分
rpm -ivh elfutils-libelf-devel-0.137-3.el5.x86_64.rpm elfutils-libelf-devel-static-0.137-3.el5.x86_64.rpm
rpm -ivh gcc-4.1.2-52.el5.x86_64.rpm glibc-devel-2.5-81.x86_64.rpm glibc-headers-2.5-81.x86_64.rpm kernel-headers-2.6.18-308.el5.x86_64.rpm
rpm -ivh gcc-c++-4.1.2-52.el5.x86_64.rpm libstdc++-devel-4.1.2-52.el5.x86_64.rpm
rpm -ivh libaio-devel-0.3.106-5.x86_64.rpm
rpm -ivh unixODBC-2.2.11-10.el5.x86_64.rpm unixODBC-libs-2.2.11-10.el5.x86_64.rpm
rpm -ivh unixODBC-devel-2.2.11-10.el5.x86_64.rpm
rpm -ivh pdksh-5.2.14-37.el5.x86_64.rpm
rpm -ivh compat-libstdc++-*.rpm
軟件包安裝完成之後，再次檢查。
binutils-2.17.50.0.6-20.el5 (x86_64)
binutils-2.17.50.0.6-20.el5 (x86_64)
package compat-libstdc++ is not installed -- rpm –qa是檢查不出來的，但是實際上裝了的
elfutils-libelf-0.137-3.el5 (x86_64)
elfutils-libelf-devel-0.137-3.el5 (x86_64)
expat-1.95.8-8.3.el5_5.3 (x86_64)
expat-1.95.8-8.3.el5_5.3 (i386)
gcc-4.1.2-52.el5 (x86_64)
gcc-c++-4.1.2-52.el5 (x86_64)
glibc-2.5-81 (x86_64)
glibc-2.5-81 (i686)
glibc-common-2.5-81 (x86_64)
glibc-devel-2.5-81 (x86_64)
glibc-headers-2.5-81 (x86_64)
libaio-0.3.106-5 (x86_64)
libaio-0.3.106-5 (i386)
libaio-devel-0.3.106-5 (x86_64)
libgcc-4.1.2-52.el5 (x86_64)
libgcc-4.1.2-52.el5 (i386)
libstdc++-4.1.2-52.el5 (x86_64)
libstdc++-4.1.2-52.el5 (i386)
libstdc++-devel-4.1.2-52.el5 (x86_64)
make-3.81-3.el5 (x86_64)
pdksh-5.2.14-37.el5 (x86_64)
sysstat-7.0.2-11.el5 (x86_64)
unixODBC-2.2.11-10.el5 (x86_64)
unixODBC-devel-2.2.11-10.el5 (x86_64)
10.grid用戶，ORACLE用戶增加環境變量
節點一 grid
export ORACLE_BASE=/oracle/app/gridbase
export ORACLE_HOME=/oracle/app/grid
export ORACLE_SID=+ASM1
export PATH=$PATH:$ORACLE_HOME/bin:$HOME/bin:.
節點二 grid
export ORACLE_BASE=/oracle/app/gridbase
export ORACLE_HOME=/oracle/app/grid
export ORACLE_SID=+ASM2
export PATH=$PATH:$ORACLE_HOME/bin:$HOME/bin:.
節點一 ORACLE
export ORACLE_BASE=/oracle/app/oracle
export ORACLE_HOME=/oracle/app/oracle/product/11.2.0/db_1
export ORACLE_SID=racdb1
export PATH=$PATH:$ORACLE_HOME/bin:$HOME/bin:.
節點二
export ORACLE_BASE=/oracle/app/oracle
export ORACLE_HOME=/oracle/app/oracle/product/11.2.0/db_1
export ORACLE_SID=racdb2
export PATH=$PATH:$ORACLE_HOME/bin:$HOME/bin:.
11.ntsysv去除sendmail服務開啓
12.配置硬盤
3個CRS盤 2G
3個DATA 5G
2個FRA 5G
修改虛擬機配置
disk.locking = "false"
diskLib.dataCacheMaxSize = "0"
diskLib.dataCacheMaxReadAheadSize = "0"
diskLib.DataCacheMinReadAheadSize = "0"
diskLib.dataCachePageSize = "4096"
diskLib.maxUnsyncedWrites = "0"
scsi1:0.deviceType = "disk"
scsi1:1.deviceType = "disk"
scsi1:2.deviceType = "disk"
scsi1:3.deviceType = "disk"
scsi1:4.deviceType = "disk"
scsi1:5.deviceType = "disk"
scsi1:6.deviceType = "disk"
scsi1:8.deviceType = "disk"
12 開啓虛擬機，在一個節點分區
fdisk /dev/sdb，過程不再贅述
中間報錯WARNING: Re-reading the partition table failed with error 16: Device or resource busy.
The kernel still uses the old table.
The new table will be used at the next reboot.
可忽略
完成後另一節點partprobe讀取。
13 重啓兩個節點
vi /etc/udev/rules.d/60-raw.rules
ACTION=="add", KERNEL=="sdb", RUN+="/bin/raw /dev/raw/raw1 %N"
ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="16", RUN+="/bin/raw /dev/raw/raw1 %M %m"
ACTION=="add", KERNEL=="sdc", RUN+="/bin/raw /dev/raw/raw2 %N"
ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="32", RUN+="/bin/raw /dev/raw/raw2 %M %m"
ACTION=="add", KERNEL=="sdd", RUN+="/bin/raw /dev/raw/raw3 %N"
ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="48", RUN+="/bin/raw /dev/raw/raw3 %M %m"
ACTION=="add", KERNEL=="sde", RUN+="/bin/raw /dev/raw/raw4 %N"
ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="64", RUN+="/bin/raw /dev/raw/raw4 %M %m"
ACTION=="add", KERNEL=="sdf", RUN+="/bin/raw /dev/raw/raw5 %N"
ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="80", RUN+="/bin/raw /dev/raw/raw5 %M %m"
ACTION=="add", KERNEL=="sdg", RUN+="/bin/raw /dev/raw/raw6 %N"
ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="96", RUN+="/bin/raw /dev/raw/raw6 %M %m"
ACTION=="add", KERNEL=="sdh", RUN+="/bin/raw /dev/raw/raw7 %N"
ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="112", RUN+="/bin/raw /dev/raw/raw7 %M %m"
ACTION=="add", KERNEL=="sdi", RUN+="/bin/raw /dev/raw/raw8 %N"
ACTION=="add", ENV{MAJOR}=="8", ENV{MINOR}=="128", RUN+="/bin/raw /dev/raw/raw8 %M %m"
KERNEL=="raw[1-8]", OWNER="grid" GROUP="asmadmin", MODE="0660"
ROOT 用戶運行命令start_udev
14 .開啓VSFTP服務，上傳11.2.0.3軟件