TCP.VALIDNODE_CHECKING导致crs无法启动

xifenfei

linux 三节点 rac，一个节点无法启动
crs日志
2014-04-22 19:11:01.754: [ CRSMAIN][933831152] Checking compatibility...
2014-04-22 19:11:01.754: [  CLSVER][933831152] Static Version 11.2.0.3.0
2014-04-22 19:11:01.756: [  CLSVER][933831152] Daemon version: 11.2.0.3.0 Software version: 11.2.0.3.0
2014-04-22 19:11:01.757: [  CLSVER][933831152] Active Version from OCR:11.2.0.3.0
2014-04-22 19:11:01.757: [  CLSVER][933831152] Active Version and Software Version are same
2014-04-22 19:11:01.758: [  CLSVER][933831152] Active Version changed to 11.2.0.3.0
2014-04-22 19:11:01.758: [ CRSMAIN][933831152] Registering for mastership change events...
2014-04-22 19:11:01.758: [  OCRSRV][933831152]th_reg_master_change: Master change callback registered
2014-04-22 19:11:01.758: [  OCRAPI][933831152]a_reg_master_change: Registered master change callback
2014-04-22 19:11:01.758: [  OCRSRV][933831152]th_not_master_change: Invoking master change callback. Master [1] Inc [67]
2014-04-22 19:11:01.758: [  OCRAPI][933831152]a_reg_master_change: Notified master change
2014-04-22 19:11:01.758: [ CRSMAIN][933831152] Registering with boot group...
2014-04-22 19:11:01.762: [ CRSMAIN][933831152] Running upgrade config...
2014-04-22 19:11:01.782: [ CRSMAIN][933831152] Running path init...
2014-04-22 19:11:01.788: [    CLSE][933831152]clse_get_auth_loc: Returning default authloc: /oracle/11.2.0/grid/auth/crs/tdxtdb3
2014-04-22 19:11:01.788: [ CRSMAIN][933831152] Using Authorizer location: /oracle/11.2.0/grid/auth/crs/tdxtdb3
2014-04-22 19:11:01.788: [ CRSMAIN][933831152] Initialing cluclu context...
2014-04-22 19:11:01.797: [  CLSCLU][933831152]clsclu_init: rc 0
2014-04-22 19:11:01.797: [ CRSMAIN][933831152] Getting CR Root...
2014-04-22 19:11:01.800: [ CRSMAIN][933831152] Initializing RTI
2014-04-22 19:11:01.800: [ CRSMAIN][933831152] Initializing staging area
2014-04-22 19:11:01.837: [    CLSE][933831152]clse_get_auth_loc: Returning default authloc: /oracle/11.2.0/grid/auth/crs/tdxtdb3
2014-04-22 19:11:01.837: [    CRSD][933831152] AuthLoc /oracle/11.2.0/grid/auth/crs/tdxtdb3
2014-04-22 19:11:01.837: [    CRSD][933831152] PE active version: 11.2.0.3.0
2014-04-22 19:11:01.837: [    CRSD][933831152] PE Engine: NEW
2014-04-22 19:11:01.837: [    CRSD][933831152] Using OCR batch ops : ENABLED
2014-04-22 19:11:01.837: [ CRSMAIN][933831152] Creating RTI lock info...
2014-04-22 19:11:01.837: [ CRSMAIN][933831152] Initializing EVMMgr
2014-04-22 19:11:01.841: [ CRSMAIN][933831152] Getting local nodename...
[   CLWAL][933831152]clsw_Initialize: OLR initlevel [70000]
2014-04-22 19:11:02.086: [ COMMCRS][1081665856]clsclisten: Error listening on: (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.1.79)(PORT=0))

2014-04-22 19:11:02.086: [ COMMCRS][1081665856]clsclisten: op 65 failed, NSerr (12560, 0), transport: (583, 0, 0)

2014-04-22 19:11:02.086: [ CRSMAIN][933831152] Created alert : (:CRSD00133 :  Unable to get E2E port, error: IOException : clsclisten failed with ret 3
(File: caa_Socket.cpp, line: 525

2014-04-22 19:11:02.086: [    CRSD][933831152][PANIC] CRSD exiting: Unable to get E2E port after 2nd attempt
2014-04-22 19:11:02.086: [    CRSD][933831152] Done.

xifenfei

分析grid的sqlnet.ora文件
more $GRID_HOME/network/admin/sqlnet.ora
# sqlnet.ora.tdxtdb3 Network Configuration File: /oracle/11.2.0/grid/network/adminlnet.ora.tdxtdb3
# Generated by Oracle configuration tools.

NAMES.DIRECTORY_PATH= (TNSNAMES, EZCONNECT)

ADR_BASE = /oracle/app

#TCP.VALIDNODE_CHECKING=yes
TCP.VALIDNODE_CHECKING=no

处理方法：注释掉TCP.VALIDNODE_CHECKING=no

xifenfei

参考文档
CTSS Daemon Aborting With "op 65 failed, NSerr (12560, 0), transport: (583, 0, 0)" (Doc ID 1087521.1)

1. APPLIES TO:
   
2. Oracle Server - Enterprise Edition - Version: 11.2.0.1 and later [Release: 11.2 and later ]
   
3. Information in this document applies to any platform.
   
4. SYMPTOMS
   
5. ora.ctssd fails to start
   
6. octssd.log
   
7. 2010-04-14 10:14:03.592: [ CTSS][1]CTSS daemon aborting
   
8. 2010-04-14 10:24:09.197: [ CTSS][1]Oracle Database CTSS Release 11.2.0.1.0 Production Copyright 2006, 2007 Oracle. All rights
   
9. reserved.
   
10. ...
    
11. 2010-04-14 10:24:09.641: [ CTSS][1]ctss_init: CTSS production mode
    
12. 2010-04-14 10:24:09.641: [ CTSS][1]ctss_init: Env var CTSS_REBOOT is undefined or contains non-boolean value. Ignoring
    
13. CTSS_REBOOT.
    
14. 2010-04-14 10:24:09.641: [ CTSS][1]sclsctss_gvss1: NTP default config file found
    
15. 2010-04-14 10:24:09.641: [ CTSS][1]sclsctss_gvss8: Return [0] and NTP status [2].
    
16. 2010-04-14 10:24:09.641: [ CTSS][1]ctss_check_vendor_sw: Vendor time sync software is detected. status [2].
    
17. 2010-04-14 10:24:09.641: [ CTSS][1]ctss_check_vendor_sw: Ctssd is switching to observer role
    
18. 2010-04-14 10:24:09.643: [ CTSS][1]ctsscomm_init: The Socket name is [(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.0.2))]
    
19. 2010-04-14 10:24:09.650: [ COMMCRS][3]clsclisten: Error listening on: (ADDRESS=(PROTOCOL=tcp)(HOST=192.168.0.2))
    
20. 2010-04-14 10:24:09.650: [ COMMCRS][3]clsclisten: op 65 failed, NSerr (12560, 0), transport: (583, 0, 0)
    
21. 2010-04-14 10:24:09.650: [ CTSS][1](:ctsscomm_init3:) clsclisten [(ADDRESS=(PROTOCOL=tcp)(HOST=192.168.0.2))] failed [3]. Return
    
22. [5].
    
23. 2010-04-14 10:24:09.650: [ CTSS][1]ctss_main: COMM init failed [5]
    
24. 2010-04-14 10:24:09.650: [ CTSS][1]ctss_main: CTSS daemon aborting [5].
    
25. 2010-04-14 10:24:09.650: [ CTSS][1]CTSS daemon aborting
    
26. CHANGES
    
27. TCP.VALIDNODE_CHECKING and TCP.INVITED_NODES have been set in $GRID_HOME/network/admin/sqlnet.ora
    
28. CAUSE
    
29. The error message is the same as in unpublished Bug 4621978
    
30. op 65 failed, NSerr (12560, 0), transport: (583, 0, 0)
    
31. According to the bug the problem is related to TCP.VALIDNODE_CHECKING and TCP.INVITED_NODES parameters.
    
32. SOLUTION
    
33. 1. Remove TCP.VALIDNODE_CHECKING and TCP.INVITED_NODES from $GRID_HOME/network/admin/sqlnet.ora and restart Grid Infrastructure
    
34. or
    
35. 2. Add the private interconnect IPs to TCP.INVITED_NODES and restart Grid Infrastructure

复制代码