數據庫版本:oracle 11.2.0.3.5
系統版本:SUSE11SP2 64bit
NFS環境:NETAPP存儲提供
數據庫文件存放在nfs上,主機異常宕機,導致nfs鎖沒釋放,備機無法正常啓動數據庫
oracle@dc_cognos01:~> sqlplus /nolog
SQL*Plus: Release 11.2.0.2.0 Production on Fri Sep 6 10:17:13 2013
Copyright (c) 1982, 2010, Oracle. All rights reserved.
SQL> conn /as sysdba
Connected.
SQL> select status from v$instance;
STATUS
------------------------
STARTED
SQL>
SQL>
SQL> shutdown immediate;
ORA-01507: database not mounted
ORACLE instance shut down.
SQL>
SQL>
SQL>
SQL> startup
ORACLE instance started.
Total System Global Area 1570009088 bytes
Fixed Size 2226832 bytes
Variable Size 402654576 bytes
Database Buffers 1157627904 bytes
Redo Buffers 7499776 bytes
ORA-00205: error in identifying control file, check alert log for more info
查看alert log
ORACLE_BASE from environment = /oracle/app/oracle
Fri Sep 06 10:17:46 2013
ALTER DATABASE MOUNT
ORA-00210: cannot open the specified control file
ORA-00202: control file: '/oracgdb/cognosdb/control03.ctl'
ORA-27086: unable to lock file - already in use
Linux-x86_64 Error: 11: Resource temporarily unavailable
Additional information: 8
ORA-00210: cannot open the specified control file
ORA-00202: control file: '/oracgdb/cognosdb/control02.ctl'
ORA-27086: unable to lock file - already in use
Linux-x86_64 Error: 11: Resource temporarily unavailable
Additional information: 8
ORA-00210: cannot open the specified control file
ORA-00202: control file: '/oracgdb/cognosdb/control01.ctl'
ORA-27086: unable to lock file - already in use
Linux-x86_64 Error: 11: Resource temporarily unavailable
Additional information: 8
ORA-205 signalled during: ALTER DATABASE MOUNT...
Fri Sep 06 10:17:46 2013
Checker run found 3 new persistent data failures
數據庫文件是存放在netapp存儲的nfs上,主機由於網絡原因異常,無法訪問數據文件。nfs鎖也無法釋放。
手工釋放netapp存儲上nfs鎖,在備機上再啓動oracle服務
在備機上卸載數據庫資源和nfs資源
登錄存儲控制器
設置爲高級模式
priv set advanced
查看鎖情況
lock status -h
======== NLM host lpar6
======== NLM host linux
======== NLM host tmsweb01
======== NLM host dc_cognos01
======== NLM host dc_cognos02
21 0x034d4e56:0x0004344d 0:0 1 GRANTED (0xffffff02952f2428)
21 0x034d4e56:0x0004344e 0:0 1 GRANTED (0xffffff02952f3e00)
21 0x034d4e56:0x0004344f 0:0 1 GRANTED (0xffffff02952f2620)
21 0x034d4e56:0x00043450 0:0 1 GRANTED (0xffffff02952f2230)
21 0x034d4e56:0x00043452 0:0 1 GRANTED (0xffffff02952f3c08)
2 0x034d4e56:0x00043447 0:0 1 GRANTED (0xffffff02952f2e00)
2 0x034d4e56:0x00043448 0:0 1 GRANTED (0xffffff02952f2c08)
2 0x034d4e56:0x00043449 0:0 1 GRANTED (0xffffff02952f2a10)
清除已加鎖主機
sm_mon -l dc_cognos02
YS-NPHD1*> lock status -h
======== NLM host lpar6
======== NLM host linux
======== NLM host tmsweb01
======== NLM host dc_cognos01
======== NLM host dc_cognos02
再備機上啓動數據庫成功