修改主機名
hostnamectl set-hostname <hostname>
配置yum
cd /etc/yum.repos.d/
vi rhel-source.repo
[oel7_local]
name = oracle Enterprise Linux 7
baseurl=file:///mnt/
gpgcheck=0
enabled=1
安裝、配置chrony時間同步
開機啓動：#systemctl enable chronyd.service
啓動時間同步服務：# systemctl start chronyd.service
vi /etc/chrony.conf
server 127.127.1.0 prefer
重啓時間同步服務：# systemctl restart chronyd.service
查看時間同步狀態：# systemctl status chronyd.service
查看時間同步源：# chronyc sources -v
查看時間同步源狀態：# chronyc sourcestats -v
關閉防火牆
systemctl stop firewalld
永久關閉防火牆
systemctl disable firewalld
安裝、配置unbound DNS服務
yum install unbound
開機啓動systemctl enable unbound
vi /etc/unbound/unbound.conf
interface:0.0.0.0 —38行
access-control:0.0.0.0/0 allow —177行
username: "" —214行
vi /etc/unbound/local.d/localdomain.conf
local-zone: “localdomain.” static
local-data: “localdomain. 86400 IN SOA ns.localdomain. root 1 1D 1H 1W 1H”
local-data: “rac1.localdomain. IN A 192.168.56.11”
local-data: “rac2.localdomain. IN A 192.168.56.22”
local-data: “www.whb.com. IN A 192.168.56.101”
local-data: “www.whb.com. IN A 192.168.56.102”
local-data: “www.whb.com. IN A 192.168.56.103”
local-data-ptr: “192.168.56.11 rac1.localdomain.”
local-data-ptr: “192.168.56.22 rac2.localdomain.”
local-data-ptr: “192.168.56.101 www.whb.com.”
local-data-ptr: “192.168.56.102 www.whb.com.”
local-data-ptr: “192.168.56.103 www.whb.com.”
vi /etc/sysconfig/network-scripts/ifcfg-enp0s3
在網卡添加DNS1=192.168.56.11
重啓systemctl restart unbound
查看狀態systemctl status unbound
驗證unbound-checkconf
驗證nslookup
# nslookup www.whb.com
Server: 127.0.0.1
Address: 127.0.0.1#53
Name: www.whb.com
Address: 192.168.56.101
Name: www.whb.com
Address: 192.168.56.102
Name: www.whb.com
Address: 192.168.56.103
配置iscsi服務器
yum -y install targetcli
systemctl start target
systemctl enable target
關閉防火牆systemctl stop firewalld
永久關閉防火牆systemctl disable firewalld
分區fdisk /dev/sdb
Command (m for help): n
Partition type:
p primary (0 primary, 0 extended, 4 free)
e extended
Select (default p): p
Partition number (1-4, default 1):
First sector (2048-146800639, default 2048):
Using default value 2048
Last sector, +sectors or +size{K,M,G} (2048-146800639, default 146800639):
Using default value 146800639
Partition 1 of type Linux and of size 70 GiB is set
選擇分區的類型
Command (m for help): t
Selected partition 1
Hex code (type L to list all codes): 8e
Changed type of partition 'Linux' to 'Linux LVM'
列出分區表
Command (m for help): p
Disk /dev/sdb: 75.2 GB, 75161927680 bytes, 146800640 sectors
Units = sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disk label type: dos
Disk identifier: 0xe31a29d3
Device Boot Start End Blocks Id System
/dev/sdb1 2048 146800639 73399296 8e Linux LVM
Command (m for help): w
創建物理卷pvcreate /dev/sdb1
創建卷組vgcreate vg_iscsi /dev/sdb1
創建邏輯卷
lvcreate -L 1.5G -n lv_ocr1 vg_iscsi
lvcreate -L 1.5G -n lv_ocr2 vg_iscsi
lvcreate -L 1.5G -n lv_ocr3 vg_iscsi
lvcreate -L 38G -n lv_migr vg_iscsi
lvcreate -L 20G -n lv_data vg_iscsi
lvcreate -L 7G -n lv_arc vg_iscsi
targetcli配置
targetcli
/> ls
o- / ............................................................................ [...]
o- backstores ................................................................. [...]
| o- block ..................................................... [Storage Objects: 0]
| o- fileio .................................................... [Storage Objects: 0]
| o- pscsi ..................................................... [Storage Objects: 0]
| o- ramdisk ................................................... [Storage Objects: 0]
o- iscsi ............................................................... [Targets: 0]
o- loopback ............................................................ [Targets: 0]
建立存儲設備
/> /backstores/block create ocr1 /dev/vg_iscsi/lv_ocr1
Created block storage object ocr1 using /dev/vg_iscsi/lv_ocr1.
/> /backstores/block create ocr1 /dev/vg_iscsi/lv_ocr2
Storage object block/ocr1 exists
/> /backstores/block create ocr2 /dev/vg_iscsi/lv_ocr2
Created block storage object ocr2 using /dev/vg_iscsi/lv_ocr2.
/> /backstores/block create ocr3 /dev/vg_iscsi/lv_ocr3
Created block storage object ocr3 using /dev/vg_iscsi/lv_ocr3.
/> /backstores/block create data /dev/vg_iscsi/lv_data
Created block storage object data using /dev/vg_iscsi/lv_data.
/> /backstores/block create arc /dev/vg_iscsi/lv_arc
Created block storage object arc using /dev/vg_iscsi/lv_arc.
/> /backstores/block create migr /dev/vg_iscsi/lv_migr
Created block storage object migr using /dev/vg_iscsi/lv_migr.
/> ls
o- / ............................................................................ [...]
o- backstores ................................................................. [...]
| o- block ..................................................... [Storage Objects: 6]
| | o- arc ................... [/dev/vg_iscsi/lv_arc (7.0GiB) write-thru deactivated]
| | o- data ................ [/dev/vg_iscsi/lv_data (20.0GiB) write-thru deactivated]
| | o- migr ................ [/dev/vg_iscsi/lv_migr (38.0GiB) write-thru deactivated]
| | o- ocr1 ................. [/dev/vg_iscsi/lv_ocr1 (1.5GiB) write-thru deactivated]
| | o- ocr2 ................. [/dev/vg_iscsi/lv_ocr2 (1.5GiB) write-thru deactivated]
| | o- ocr3 ................. [/dev/vg_iscsi/lv_ocr3 (1.5GiB) write-thru deactivated]
| o- fileio .................................................... [Storage Objects: 0]
| o- pscsi ..................................................... [Storage Objects: 0]
| o- ramdisk ................................................... [Storage Objects: 0]
o- iscsi ............................................................... [Targets: 0]
o- loopback ............................................................ [Targets: 0]
/>
建立target的id
wwn命名必須 iqn.2017-01.com.xxx:server
/> /iscsi create iqn.2017-11.com.whb:whb
Created target iqn.2017-11.com.whb:whb.
Created TPG 1.
Global pref auto_add_default_portal=true
Created default portal listening on all IPs (0.0.0.0), port 3260.
/> /iscsi/iqn.2017-11.com.whb:whb/tpg1/acls create iqn.2017-11.com.whb:rac
Created Node ACL for iqn.2017-11.com.whb:rac
創建lun
/> cd /iscsi/iqn.2017-11.com.whb:whb/tpg1/acls/iqn.2017-11.com.whb:rac
/iscsi/iqn.20...1.com.whb:rac> /iscsi/iqn.2017-11.com.whb:whb/tpg1/luns create /backstores/block/arc
Created LUN 0.
Created LUN 0->0 mapping in node ACL iqn.2017-11.com.whb:rac
/iscsi/iqn.20...1.com.whb:rac> /iscsi/iqn.2017-11.com.whb:whb/tpg1/luns create /backstores/block/data
Created LUN 1.
Created LUN 1->1 mapping in node ACL iqn.2017-11.com.whb:rac
/iscsi/iqn.20...1.com.whb:rac> /iscsi/iqn.2017-11.com.whb:whb/tpg1/luns create /backstores/block/migr
Created LUN 2.
Created LUN 2->2 mapping in node ACL iqn.2017-11.com.whb:rac
/iscsi/iqn.20...1.com.whb:rac> /iscsi/iqn.2017-11.com.whb:whb/tpg1/luns create /backstores/block/ocr1
Created LUN 3.
Created LUN 3->3 mapping in node ACL iqn.2017-11.com.whb:rac
/iscsi/iqn.20...1.com.whb:rac> /iscsi/iqn.2017-11.com.whb:whb/tpg1/luns create /backstores/block/ocr2
Created LUN 4.
Created LUN 4->4 mapping in node ACL iqn.2017-11.com.whb:rac
/iscsi/iqn.20...1.com.whb:rac> /iscsi/iqn.2017-11.com.whb:whb/tpg1/luns create /backstores/block/ocr3
/> ls
o- / ............................................................................ [...]
o- backstores ................................................................. [...]
| o- block ..................................................... [Storage Objects: 6]
| | o- arc ..................... [/dev/vg_iscsi/lv_arc (7.0GiB) write-thru activated]
| | o- data .................. [/dev/vg_iscsi/lv_data (20.0GiB) write-thru activated]
| | o- migr .................. [/dev/vg_iscsi/lv_migr (38.0GiB) write-thru activated]
| | o- ocr1 ................... [/dev/vg_iscsi/lv_ocr1 (1.5GiB) write-thru activated]
| | o- ocr2 ................... [/dev/vg_iscsi/lv_ocr2 (1.5GiB) write-thru activated]
| | o- ocr3 ................... [/dev/vg_iscsi/lv_ocr3 (1.5GiB) write-thru activated]
| o- fileio .................................................... [Storage Objects: 0]
| o- pscsi ..................................................... [Storage Objects: 0]
| o- ramdisk ................................................... [Storage Objects: 0]
o- iscsi ............................................................... [Targets: 1]
| o- iqn.2017-11.com.whb:whb .............................................. [TPGs: 1]
| o- tpg1 .................................................. [no-gen-acls, no-auth]
| o- acls ............................................................. [ACLs: 1]
| | o- iqn.2017-11.com.whb:rac ................................. [Mapped LUNs: 6]
| | o- mapped_lun0 ...................................... [lun0 block/arc (rw)]
| | o- mapped_lun1 ..................................... [lun1 block/data (rw)]
| | o- mapped_lun2 ..................................... [lun2 block/migr (rw)]
| | o- mapped_lun3 ..................................... [lun3 block/ocr1 (rw)]
| | o- mapped_lun4 ..................................... [lun4 block/ocr2 (rw)]
| | o- mapped_lun5 ..................................... [lun5 block/ocr3 (rw)]
| o- luns ............................................................. [LUNs: 6]
| | o- lun0 .................................. [block/arc (/dev/vg_iscsi/lv_arc)]
| | o- lun1 ................................ [block/data (/dev/vg_iscsi/lv_data)]
| | o- lun2 ................................ [block/migr (/dev/vg_iscsi/lv_migr)]
| | o- lun3 ................................ [block/ocr1 (/dev/vg_iscsi/lv_ocr1)]
| | o- lun4 ................................ [block/ocr2 (/dev/vg_iscsi/lv_ocr2)]
| | o- lun5 ................................ [block/ocr3 (/dev/vg_iscsi/lv_ocr3)]
| o- portals ....................................................... [Portals: 1]
| o- 0.0.0.0:3260 ........................................................ [OK]
o- loopback ............................................................ [Targets: 0]
/>
iscsi客戶端配置
yum install iscsi* -y
修改/etc/iscsi/initiatorname.iscsi文件
vim /etc/iscsi/initiatorname.iscsi
InitiatorName=iqn.2017-11.com.whb:rac
開機啓動
systemctl start iscsid
systemctl enable iscsid
查找
iscsiadm -m discovery -t st -p 192.168.56.33
iscsiadm -m discovery -t st -p 192.168.56.44
掛載
iscsiadm -m node -T iqn.2017-11.com.whb:whb -p 192.168.56.33 -l
iscsiadm -m node -T iqn.2017-11.com.whb:whb -p 192.168.56.44 -l
驗證
lsblk
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 60G 0 disk
├─sda1 8:1 0 1G 0 part /boot
└─sda2 8:2 0 59G 0 part
├─rhel-root 253:0 0 55.1G 0 lvm /
└─rhel-swap 253:1 0 3.9G 0 lvm [SWAP]
sdb 8:16 0 7G 0 disk
└─mpathc 253:4 0 7G 0 mpath
sdc 8:32 0 20G 0 disk
└─mpathb 253:3 0 20G 0 mpath
sdd 8:48 0 38G 0 disk
└─mpathd 253:5 0 38G 0 mpath
sde 8:64 0 1.5G 0 disk
└─mpatha 253:2 0 1.5G 0 mpath
sdf 8:80 0 1.5G 0 disk
└─mpathf 253:7 0 1.5G 0 mpath
sdg 8:96 0 1.5G 0 disk
└─mpathe 253:6 0 1.5G 0 mpath
sdh 8:112 0 7G 0 disk
└─mpathc 253:4 0 7G 0 mpath
sdi 8:128 0 20G 0 disk
└─mpathb 253:3 0 20G 0 mpath
sdj 8:144 0 38G 0 disk
└─mpathd 253:5 0 38G 0 mpath
sdk 8:160 0 1.5G 0 disk
└─mpatha 253:2 0 1.5G 0 mpath
sdl 8:176 0 1.5G 0 disk
└─mpathf 253:7 0 1.5G 0 mpath
sdm 8:192 0 1.5G 0 disk
└─mpathe 253:6 0 1.5G 0 mpath
sr0 11:0 1 3.5G 0 rom /mnt
multipath配置
安裝yum install device-mapper-multipath
啓動systemctl start multipathd
開機啓動systemctl enable multipathd
生成配置文件
/sbin/mpathconf --enable
啓動
service multipathd start
查看服務狀態
service multipathd status
重新刷取
multipath -v2
顯示多路徑的佈局
multipath -ll
-------清空所有多路徑
multipath -F
查找udev固化權限配置模板
find / -name 12-*
/usr/share/doc/device-mapper-1.02.79/12-dm-permissions.rules
複製到/etc/udev/rules.d目錄下
編輯添加
ENV{DM_UUID}=="mpath-?*", OWNER:="grid", GROUP:="asmadmin", MODE:="660"
啓動udev
udevadm control --reload-rules
udevadm trigger
查看權限
ls -lh /dev/dm*
調整swap
dd if=/dev/zero of=/home/swap bs=1M count=6144
設置交換分區文件
mkswap /home/swap
啓用交換分區文件
swapon /home/swap
寫入/etc/fstab
/home/swap swap swap defaults 0 0
修改/dev/shm
tmpfs /dev/shm tmpfs defaults,size=3072M 0 0
格式化ASM磁盤頭
dd if=/dev/zero count=10 bs=512 of=/dev/sde1