oracle rac節點資源狀態異常

前幾天在虛擬機上面安裝了oracle rac，今天把節點啓動起來之後發現rac工作異常

[oracle@node1 bin]$ ./crs_stat -t
Name                     Type                     Target        State         Host                
------------------------------------------------------------
ora....E1.lsnr application        OFFLINE     UNKNOWN     node1            
ora.node1.gsd    application        ONLINE        UNKNOWN     node1            
ora.node1.ons    application        ONLINE        UNKNOWN     node1            
ora.node1.vip    application        ONLINE        ONLINE        node1            
ora....E2.lsnr application        OFFLINE     UNKNOWN     node2            
ora.node2.gsd    application        ONLINE        UNKNOWN     node2            
ora.node2.ons    application        ONLINE        UNKNOWN     node2            
ora.node2.vip    application        ONLINE        ONLINE        node2            
ora.orcl.db        application        OFFLINE     OFFLINE                            
ora....l1.inst application        OFFLINE     OFFLINE                            
ora....l2.inst application        OFFLINE     UNKNOWN     node2

查看偵聽狀態      

[oracle@node1 bin]$ ./crs_stat -t|grep lsnr
ora....E1.lsnr application        OFFLINE     UNKNOWN     node1            
ora....E2.lsnr application        OFFLINE     UNKNOWN     node2

[oracle@node1 bin]$ ./crs_stat -l|head -n 15
NAME=ora.node1.LISTENER_NODE1.lsnr
TYPE=application
TARGET=OFFLINE
STATE=UNKNOWN on node1

NAME=ora.node1.gsd
TYPE=application
TARGET=ONLINE
STATE=UNKNOWN on node1

NAME=ora.node1.ons
TYPE=application
TARGET=ONLINE
STATE=UNKNOWN on node1

嘗試啓動偵聽

[oracle@node1 bin]$ ./crs_start ora.node1.LISTENER_NODE1.lsnr
CRS-1028: Dependency analysis failed because of:
'Resource in UNKNOWN state: ora.node1.LISTENER_NODE1.lsnr'
CRS-0223: Resource 'ora.node1.LISTENER_NODE1.lsnr' has placement error.

查看CRS狀態

[oracle@node1 bin]$ ./crsctl check crs
CSS appears healthy
CRS appears healthy
EVM appears healthy

查看CSS狀態

[oracle@node1 bin]$ ./crsctl check css
CSS appears healthy

首先停止node1上面的nodeapps

[oracle@node1 bin]$ ./srvctl stop nodeapps -n node1
[oracle@node1 bin]$ ./crs_stat -t
Name                     Type                     Target        State         Host                
------------------------------------------------------------
ora....E1.lsnr application        OFFLINE     OFFLINE                            
ora.node1.gsd    application        OFFLINE     OFFLINE                            
ora.node1.ons    application        OFFLINE     OFFLINE                            
ora.node1.vip    application        OFFLINE     OFFLINE                            
ora....E2.lsnr application        OFFLINE     UNKNOWN     node2            
ora.node2.gsd    application        ONLINE        UNKNOWN     node2            
ora.node2.ons    application        ONLINE        UNKNOWN     node2            
ora.node2.vip    application        ONLINE        ONLINE        node2            
ora.orcl.db        application        OFFLINE     OFFLINE                            
ora....l1.inst application        OFFLINE     OFFLINE                            
ora....l2.inst application        OFFLINE     UNKNOWN     node2

然後啓動node1上面的nodeapps

[oracle@node1 bin]$ ./srvctl start nodeapps -n node1
[oracle@node1 bin]$ ./crs_stat -t
Name                     Type                     Target        State         Host                
------------------------------------------------------------
ora....E1.lsnr application        ONLINE        ONLINE        node1            
ora.node1.gsd    application        ONLINE        ONLINE        node1            
ora.node1.ons    application        ONLINE        ONLINE        node1            
ora.node1.vip    application        ONLINE        ONLINE        node1            
ora....E2.lsnr application        OFFLINE     UNKNOWN     node2            
ora.node2.gsd    application        ONLINE        UNKNOWN     node2            
ora.node2.ons    application        ONLINE        UNKNOWN     node2            
ora.node2.vip    application        ONLINE        ONLINE        node2            
ora.orcl.db        application        OFFLINE     OFFLINE                            
ora....l1.inst application        OFFLINE     OFFLINE                            
ora....l2.inst application        OFFLINE     UNKNOWN     node2

再重啓所有資源

[oracle@node1 bin]$./crsctl stop resources
[oracle@node1 bin]$ ./crsctl start resources

然後在node2上面執行同樣的操作，最後發現資源都啓動起來了

[oracle@node1 bin]$ ./crs_stat -t
Name                     Type                     Target        State         Host                
------------------------------------------------------------
ora....E1.lsnr application        ONLINE        ONLINE        node1            
ora.node1.gsd    application        ONLINE        ONLINE        node1            
ora.node1.ons    application        ONLINE        ONLINE        node1            
ora.node1.vip    application        ONLINE        ONLINE        node1            
ora....E2.lsnr application        ONLINE        ONLINE        node2            
ora.node2.gsd    application        ONLINE        ONLINE        node2            
ora.node2.ons    application        ONLINE        ONLINE        node2            
ora.node2.vip    application        ONLINE        ONLINE        node2            
ora.orcl.db        application        ONLINE        ONLINE        node1            
ora....l1.inst application        ONLINE        ONLINE        node1            
ora....l2.inst application        ONLINE        ONLINE        node2

在執行一下

[oracle@node1 bin]$ ./crs_stat -l

所有狀態都是online了，OK！

如果還有某個資源沒有啓動起來，手動執行

[oracle@node1 bin]$ ./crs_start ora.orcl.orcl1.inst(資源名稱)

在沒有打10.2.0.5.0的clusterware補丁之前這個資源的UNKNOWN狀態經常出現（一般出現在虛擬機重啓之後），打完補丁之後每次重啓完一切正常，資源都能順利啓動起來