P550当机问题

两台550做HA，系统为5303-03-00-0000
HA版本为5.2
上周五节点2当机，上面的资源切换到了1节点上。下面是报错信息，请专家分析下。DENTIFIER TIMESTAMP  T C RESOURCE_NAME  DESCRIPTION
C86ACB7E   0524193713 I H dac0           ARRAY CONFIGURATION CHANGED
C86ACB7E   0524193713 I H dac0           ARRAY CONFIGURATION CHANGED
C86ACB7E   0524193713 I H dac0           ARRAY CONFIGURATION CHANGED
C86ACB7E   0524193713 I H dac0           ARRAY CONFIGURATION CHANGED
C86ACB7E   0524193713 I H dac0           ARRAY CONFIGURATION CHANGED
A6DF45AA   0524193613 I O RMCdaemon      The daemon is started.
EC0BCCD4   0524193613 T H ent2           ETHERNET DOWN
C86ACB7E   0524193613 I H dac0           ARRAY CONFIGURATION CHANGED
2BFA76F6   0524161613 T S SYSPROC        SYSTEM SHUTDOWN BY USER
9DBCFDEE   0524193513 T O errdemon       ERROR LOGGING TURNED ON
BA431EB7   0524161613 P S SRC            SOFTWARE PROGRAM ERROR
AA8AB241   0524161613 T O OPERATOR       OPERATOR NOTIFICATION
BC3BE5A3   0524161613 P S SRC            SOFTWARE PROGRAM ERROR
BC3BE5A3   0524161613 P S SRC            SOFTWARE PROGRAM ERROR
12081DC6   0524161613 P S haemd          SOFTWARE PROGRAM ERROR
AA8AB241   0524161613 T O clstrmgrES     OPERATOR NOTIFICATION
BC3BE5A3   0524161613 P S SRC            SOFTWARE PROGRAM ERROR
64368504   0524161613 P O grpsvcs        Connection failure between Group Service
A63BEB70   0524161613 P S SYSPROC        SOFTWARE PROGRAM ABNORMALLY TERMINATED
4BD1A134   0524161613 P S topsvcs        Using too much CPU: exiting
813FE820   0524151913 U S MQSeries       SOFTWARE PROGRAM ERROR
813FE820   0524081613 U S MQSeries       SOFTWARE PROGRAM ERROR
813FE820   0524080213 U S MQSeries       SOFTWARE PROGRAM ERROR
[:root:/]errpt -aj 64368504
---------------------------------------------------------------------------
LABEL:          GS_TS_RETCODE_ER
IDENTIFIER:     64368504
Date/Time:       Fri May 24 16:16:31 BEIDT 2013
Sequence Number: 215426
Machine Id:      00CE9EDE4C00
Node Id:         huhetd2
Class:           O
Type:            PERM
Resource Name:   grpsvcs         
Description
Connection failure between Group Services and Topology Services
Probable Causes
Topology Services daemon is not running
Topology Services daemon has died
Topology Services library has detected an error
Failure Causes
Group Services detects an error condition of Topology Services
        Recommended Actions
        Check the Topology Services daemon
Verify that Group Services daemon has been restarted
Call IBM Service if problem persists
Detail Data
DETECTING MODULE
RSCT,PMClient.C,1.72,1049                     
ERROR ID
62IcBY/DDlbF/egI.q7UL8....................
REFERENCE CODE
                                          
DIAGNOSTIC EXPLANATION
topsvcs subsystem died with hb_errno = 16, grpsvcs will also exit.
root:/]errpt -aj 64368504
---------------------------------------------------------------------------
LABEL:          GS_TS_RETCODE_ER
IDENTIFIER:     64368504
Date/Time:       Fri May 24 16:16:31 BEIDT 2013
Sequence Number: 215426
Machine Id:      00CE9EDE4C00
Node Id:         huhetd2
Class:           O
Type:            PERM
Resource Name:   grpsvcs         
Description
Connection failure between Group Services and Topology Services
Probable Causes
Topology Services daemon is not running
Topology Services daemon has died
Topology Services library has detected an error
Failure Causes
Group Services detects an error condition of Topology Services
        Recommended Actions
        Check the Topology Services daemon
Verify that Group Services daemon has been restarted
Call IBM Service if problem persists
Detail Data
DETECTING MODULE
RSCT,PMClient.C,1.72,1049                     
ERROR ID
62IcBY/DDlbF/egI.q7UL8....................
REFERENCE CODE
                                          
DIAGNOSTIC EXPLANATION
topsvcs subsystem died with hb_errno = 16, grpsvcs will also exit.收起