2节点信息: 操作系统版本:6100-04-00-0000 HA版本:5.4.1.5 IDENTIFIER TIMESTAMP T C RESOURCE_NAME DESCRIPTION 1BA7DF4E 0711095914 P S SRC SOFTWARE PROGRAM ERROR CB4A951F 0711095914 I S SRC SOFTWARE PROGRAM ERROR CB4A951F 0711095914 I S SRC SOFTWARE PROGRAM ERROR 1BA7DF4E 0711095914 P S SRC SOFTWARE PROGRAM ERROR CB4A951F 0711095914 I S SRC SOFTWARE PROGRAM ERROR CB4A951F 0711095914 I S SRC SOFTWARE PROGRAM ERROR 1BA7DF4E 0711095114 P S SRC SOFTWARE PROGRAM ERROR 1BA7DF4E 0711095114 P S SRC SOFTWARE PROGRAM ERROR CB4A951F 0711095114 I S SRC SOFTWARE PROGRAM ERROR CB4A951F 0711095114 I S SRC SOFTWARE PROGRAM ERROR CB4A951F 0711095114 I S SRC SOFTWARE PROGRAM ERROR CB4A951F 0711095114 I S SRC SOFTWARE PROGRAM ERROR AFA89905 0710190214 I O grpsvcs Group Services daemon started 97419D60 0710190214 I O topsvcs Topology Services daemon started A6DF45AA 0710175314 I O RMCdaemon The daemon is started. D221BD55 0710175314 I O perftune RESTRICTED TUNABLES MODIFIED AT REBOOT F3846E13 0710175314 P H ent8 ETHERCHANNEL FAILOVER EC0BCCD4 0710175314 T H ent6 ETHERNET DOWN 67145A39 0710175214 U S SYSDUMP SYSTEM DUMP F48137AC 0710175114 U O minidump COMPRESSED MINIMAL DUMP BD7DCB17 0710175114 I H tty0 FAILURE CAUSED AUTOMATIC RESET 9DBCFDEE 0710175314 T O errdemon ERROR LOGGING TURNED ON
cluster.log信息 如下
Jul 10 17:43:52 uamdb2 daemon:notice xntpd[487470]: time reset (step) -83.054536 s Jul 10 17:53:10 uamdb2 user:err|error root: Oracle CRSD 9080848 set to stop Jul 10 17:53:10 uamdb2 user:err|error root: Oracle CRSD 9080848 shutdown completed Jul 10 17:53:10 uamdb2 user:err|error root: Oracle EVMD set to stop Jul 10 17:53:10 uamdb2 user:err|error root: Oracle CSSD being stopped Jul 10 17:53:26 uamdb2 user:err|error root: Oracle Cluster Ready Services starting up automatically. Jul 10 17:53:27 uamdb2 daemon:notice RMCdaemon[270472]: (Recorded using libct_ffdc.a cv 2):::Error ID: 6eKora0L8ajH/5ug0B2k09....................:::Reference ID: :::Template ID: a6df45aa:::Details File: :::Location: RSCT,rmcd.c,1.67,221 :::RMCD_INFO_0_ST The daemon is started. Jul 10 17:53:45 uamdb2 user:err|error root: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.360652. Jul 10 17:53:45 uamdb2 user:err|error root: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.303354.
Jul 10 17:46:04 uamdb1 local0:crit clstrmgrES[348242]: Thu Jul 10 17:46:04 Removing 2 from ml_idx Jul 10 17:46:04 uamdb1 user:notice HACMP for AIX: EVENT START: node_down uamdb2 Jul 10 17:46:05 uamdb1 user:notice HACMP for AIX: EVENT COMPLETED: node_down uamdb2 0 Jul 10 17:46:05 uamdb1 user:notice HACMP for AIX: EVENT START: node_down_complete uamdb2 Jul 10 17:46:05 uamdb1 user:notice HACMP for AIX: EVENT COMPLETED: node_down_complete uamdb2 0 Jul 10 17:46:26 uamdb1 daemon:notice topsvcs[1007668]: (Recorded using libct_ffdc.a cv 2):::Error ID: 6zV5DL.m1ajH/KHF/A2k09....................:::Reference ID: :::Template ID: 173c787f:::Details File: :::Location: rsct,nim_control.C,1.39.1.34,5796 :::TS_LOC_DOWN_ST Possible malfunction on local adapter Adapter interface name tty0 Adapter offset 1 Adapter IP address 255.255.0.0 Jul 10 17:49:28 uamdb1 local0:crit clstrmgrES[348242]: Thu Jul 10 17:49:28 config_too_long: Timer type is 0 Jul 10 17:49:28 uamdb1 local0:crit clstrmgrES[348242]: Thu Jul 10 17:49:28 config_too_long: Submitted event config_too_long, PID=6660320 Jul 10 18:16:31 uamdb1 user:err|error root: Oracle CRSD 6119628 set to stop Jul 10 18:16:31 uamdb1 user:err|error root: Oracle CRSD 6119628 shutdown completed Jul 10 18:16:31 uamdb1 user:err|error root: Oracle EVMD set to stop Jul 10 18:16:31 uamdb1 user:err|error root: Oracle CSSD being stopped Jul 10 18:16:46 uamdb1 user:err|error root: Oracle Cluster Ready Services starting up automatically. Jul 10 18:16:48 uamdb1 daemon:notice RMCdaemon[254096]: (Recorded using libct_ffdc.a cv 2):::Error ID: 6eKora0EUajH/pFQ/A2k09....................:::Reference ID: :::Template ID: a6df45aa:::Details File: :::Location: RSCT,rmcd.c,1.67,221 :::RMCD_INFO_0_ST The daemon is started.
1节点信息: AFA89905 0710190114 I O grpsvcs Group Services daemon started 97419D60 0710190114 I O topsvcs Topology Services daemon started A6DF45AA 0710181614 I O RMCdaemon The daemon is started. D221BD55 0710181614 I O perftune RESTRICTED TUNABLES MODIFIED AT REBOOT 67145A39 0710181514 U S SYSDUMP SYSTEM DUMP F48137AC 0710181414 U O minidump COMPRESSED MINIMAL DUMP 173C787F 0710181414 I S topsvcs Possible malfunction on local adapter 9DBCFDEE 0710181614 T O errdemon ERROR LOGGING TURNED ON 173C787F 0710174614 I S topsvcs Possible malfunction on local adapter AB59ABFF 0710174614 U U LIBLVM Remote node Concurrent Volume Group fail AB59ABFF 0710174614 U U LIBLVM Remote node Concurrent Volume Group fail AB59ABFF 0710174614 U U LIBLVM Remote node Concurrent Volume Group fail AB59ABFF 0710174614 U U LIBLVM Remote node Concurrent Volume Group fail
cluster.log信息如下:
Jul 10 17:46:04 uamdb1 local0:crit clstrmgrES[348242]: Thu Jul 10 17:46:04 Removing 2 from ml_idx Jul 10 17:46:04 uamdb1 user:notice HACMP for AIX: EVENT START: node_down uamdb2 Jul 10 17:46:05 uamdb1 user:notice HACMP for AIX: EVENT COMPLETED: node_down uamdb2 0 Jul 10 17:46:05 uamdb1 user:notice HACMP for AIX: EVENT START: node_down_complete uamdb2 Jul 10 17:46:05 uamdb1 user:notice HACMP for AIX: EVENT COMPLETED: node_down_complete uamdb2 0 Jul 10 17:46:26 uamdb1 daemon:notice topsvcs[1007668]: (Recorded using libct_ffdc.a cv 2):::Error ID: 6zV5DL.m1ajH/KHF/A2k09....................:::Reference ID: :::Template ID: 173c787f:::Details File: :::Location: rsct,nim_control.C,1.39.1.34,5796 :::TS_LOC_DOWN_ST Possible malfunction on local adapter Adapter interface name tty0 Adapter offset 1 Adapter IP address 255.255.0.0 Jul 10 17:49:28 uamdb1 local0:crit clstrmgrES[348242]: Thu Jul 10 17:49:28 config_too_long: Timer type is 0 Jul 10 17:49:28 uamdb1 local0:crit clstrmgrES[348242]: Thu Jul 10 17:49:28 config_too_long: Submitted event config_too_long, PID=6660320 Jul 10 18:16:31 uamdb1 user:err|error root: Oracle CRSD 6119628 set to stop Jul 10 18:16:31 uamdb1 user:err|error root: Oracle CRSD 6119628 shutdown completed Jul 10 18:16:31 uamdb1 user:err|error root: Oracle EVMD set to stop Jul 10 18:16:31 uamdb1 user:err|error root: Oracle CSSD being stopped Jul 10 18:16:46 uamdb1 user:err|error root: Oracle Cluster Ready Services starting up automatically. Jul 10 18:16:48 uamdb1 daemon:notice RMCdaemon[254096]: (Recorded using libct_ffdc.a cv 2):::Error ID: 6eKora0EUajH/pFQ/A2k09....................:::Reference ID: :::Template ID: a6df45aa:::Details File: :::Location: RSCT,rmcd.c,1.67,221 :::RMCD_INFO_0_ST The daemon is started.