自己顶!!! 节选部分日志内容,详细的看看附件。 求助~~~
server1/SystemErr.log have log info:
。。。。。。。。
[12/12/11 10:48:54:183 GMT+08:00] 00000058 SystemErr R at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:457)
[12/12/11 10:48:54:183 GMT+08:00] 00000058 SystemErr R at java.net.ServerSocket.implAccept(ServerSocket.java:473)
[12/12/11 10:48:54:183 GMT+08:00] 00000058 SystemErr R at com.ibm.jsse2.hc.accept(hc.java:72)
[12/12/11 10:48:54:183 GMT+08:00] 00000058 SystemErr R at com.ibm.rmi.transport.ListenerThread.run(ListenerThread.java:170)
[12/12/11 10:51:09:574 GMT+08:00] 0000005a SystemErr R Exception in thread "[SSL: ServerSocket[addr=0.0.0.0/0.0.0.0,port=0,localport=8880]]" Exception in thread "LT=0:P=416860:O=0:port=49838" java.lang.OutOfMemoryError
[12/12/11 10:59:12:991 GMT+08:00] 0000005d SystemErr R Exception in thread "AIO Timer Thread 1" java.lang.OutOfMemoryError
[12/12/11 10:59:13:023 GMT+08:00] 0000005b SystemErr R java.lang.OutOfMemoryError
[12/12/11 10:59:13:047 GMT+08:00] 0000005a SystemErr R at java.net.PlainSocketImpl.socketAccept(Native Method)
[12/12/11 10:59:13:047 GMT+08:00] 0000005a SystemErr R at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:457)
[12/12/11 10:59:13:047 GMT+08:00] 0000005d SystemErr R at com.ibm.io.async.TimeSlot.(TimeSlot.java:39)
[12/12/11 10:59:13:047 GMT+08:00] 0000005a SystemErr R at java.net.ServerSocket.implAccept(ServerSocket.java:473)
[12/12/11 10:48:54:183 GMT+08:00] 00000058 SystemErr R at java.net.ServerSocket.implAccept(ServerSocket.java:473)
[12/12/11 10:48:54:183 GMT+08:00] 00000058 SystemErr R at com.ibm.jsse2.hc.accept(hc.java:72)
[12/12/11 10:48:54:183 GMT+08:00] 00000058 SystemErr R at com.ibm.rmi.transport.ListenerThread.run(ListenerThread.java:170)
[12/12/11 10:51:09:574 GMT+08:00] 0000005a SystemErr R Exception in thread "[SSL: ServerSocket[addr=0.0.0.0/0.0.0.0,port=0,localport=8880]]" Exception in thread "LT=0:P=416860:O=0:port=49838" java.lang.OutOfMemoryError
[12/12/11 10:59:12:991 GMT+08:00] 0000005d SystemErr R Exception in thread "AIO Timer Thread 1" java.lang.OutOfMemoryError
[12/12/11 10:59:13:023 GMT+08:00] 0000005b SystemErr R java.lang.OutOfMemoryError
[12/12/11 10:59:13:047 GMT+08:00] 0000005a SystemErr R at java.net.PlainSocketImpl.socketAccept(Native Method)
[12/12/11 10:59:13:047 GMT+08:00] 0000005a SystemErr R at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:457)
[12/12/11 10:59:13:047 GMT+08:00] 0000005d SystemErr R at com.ibm.io.async.TimeSlot.(TimeSlot.java:39)
[12/12/11 10:59:13:047 GMT+08:00] 0000005a SystemErr R at java.net.ServerSocket.implAccept(ServerSocket.java:473)
[12/12/11 10:59:13:047 GMT+08:00] 0000005d SystemErr R at com.ibm.io.async.Timer.insertSlotAtEnd(Timer.java:362)
。。。。。。。。
[12/12/11 10:59:14:459 GMT+08:00] 00000013 SystemErr R Caused by: at java.security.AccessController.getProtectionDomains(Native Method)
[12/12/11 10:59:14:459 GMT+08:00] 00000011 SystemErr R at java.security.AccessController.getContext(AccessController.java:136)
[12/12/11 10:59:14:459 GMT+08:00] 00000013 SystemErr R java.lang.OutOfMemoryError
at java.security.AccessController.getProtectionDomains(Native Method)
at java.security.AccessController.getContext(AccessController.java:136)
at java.lang.Thread.initialize(Thread.java:354)
at java.lang.Thread.(Thread.java:285)
at java.lang.Thread.(Thread.java:193)
[12/12/11 10:59:14:460 GMT+08:00] 00000011 SystemErr R at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:570)
[12/12/11 10:59:14:461 GMT+08:00] 00000013 SystemErr R at com.ibm.io.async.ResultHandler.startHandler(ResultHandler.java:248)
[12/12/11 10:59:14:461 GMT+08:00] 00000011 SystemErr R ... 2 more
[12/12/11 10:59:14:461 GMT+08:00] 00000013 SystemErr R at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:570)
[12/12/11 10:59:14:461 GMT+08:00] 00000013 SystemErr R ... 2 more
[12/12/11 10:59:14:620 GMT+08:00] 00000045 SystemErr R Exception in thread "WebContainer : 17" java.lang.RuntimeException: java.lang.OutOfMemoryError
[12/12/11 10:59:14:673 GMT+08:00] 00000045 SystemErr R at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:801)
[12/12/11 10:59:14:673 GMT+08:00] 00000045 SystemErr R at com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:881)
[12/12/11 10:59:14:673 GMT+08:00] 00000045 SystemErr R at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1497)
[12/12/11 10:59:14:673 GMT+08:00] 00000045 SystemErr R Caused by: java.lang.OutOfMemoryError
at java.security.AccessController.getProtectionDomains(Native Method)
[12/12/11 10:59:14:461 GMT+08:00] 00000013 SystemErr R ... 2 more
[12/12/11 10:59:14:620 GMT+08:00] 00000045 SystemErr R Exception in thread "WebContainer : 17" java.lang.RuntimeException: java.lang.OutOfMemoryError
[12/12/11 10:59:14:673 GMT+08:00] 00000045 SystemErr R at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:801)
[12/12/11 10:59:14:673 GMT+08:00] 00000045 SystemErr R at com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:881)
[12/12/11 10:59:14:673 GMT+08:00] 00000045 SystemErr R at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1497)
[12/12/11 10:59:14:673 GMT+08:00] 00000045 SystemErr R Caused by: java.lang.OutOfMemoryError
at java.security.AccessController.getProtectionDomains(Native Method)
at java.security.AccessController.getContext(AccessController.java:136)
at java.lang.Thread.initialize(Thread.java:354)
at java.lang.Thread.(Thread.java:285)
at java.lang.Thread.(Thread.java:193)
server1/SystemOut.log have log info:
。。。。。。。
[12/12/11 10:59:14:619 GMT+08:00] 00000064 AlarmThreadPo W Encountered a failure in the fireAlarm method java.lang.OutOfMemoryError
at java.security.AccessController.getProtectionDomains(Native Method)
at java.security.AccessController.getContext(AccessController.java:136)
at java.lang.Thread.initialize(Thread.java:354)
at java.lang.Thread.(Thread.java:285)
at java.lang.Thread.(Thread.java:193)
[12/12/11 10:59:20:998 GMT+08:00] 0000002f SystemOut O DAOhandle finalized
[12/12/11 10:59:21:036 GMT+08:00] 0000002f SystemOut O DAOhandle finalized
[12/12/11 10:59:21:037 GMT+08:00] 0000002f SystemOut O DAOhandle finalized
[12/12/11 10:59:21:039 GMT+08:00] 0000002f SystemOut O DAOhandle finalized
[12/12/11 10:59:21:039 GMT+08:00] 0000002f SystemOut O DAOhandle finalized
[12/12/11 10:59:21:139 GMT+08:00] 00000038 WebApp E [Servlet Error]-[com.bank.kjys.pz.servlet.Pzcxjg]: java.lang.OutOfMemoryError
at org.apache.xml.utils.SuballocatedIntVector.addElement(SuballocatedIntVector.java:171)
at org.apache.xml.dtm.ref.sax2dtm.SAX2DTM.addNode(SAX2DTM.java:878)
at org.apache.xml.dtm.ref.sax2dtm.SAX2DTM.startElement(SAX2DTM.java:1881)
at org.apache.xerces.parsers.AbstractSAXParser.startElement(Unknown Source)
at org.apache.xerces.impl.XMLNSDocumentScannerImpl.scanStartElement(Unknown Source)
at com.ibm.io.async.ResultHandler.complete(ResultHandler.java:196)
at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:751)
at com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:881)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1497)
[12/12/11 10:59:21:180 GMT+08:00] 00000034 ThreadMonitor W WSVR0605W: Thread "WebContainer : 4" (00000031) has been active for 976628 milliseconds and may be hung. There is/are 1 thread(s) in total in the server that may be hung.
[12/12/11 10:59:21:221 GMT+08:00] 00000042 ApplicationMo W DCSV0004W: DCS Stack DefaultCoreGroup at Member kjys1Cell01\kjys1Node01\kjys-server1: Did not receive adequate CPU time slice. Last known CPU usage time at 10:47:43:341 GMT+08:00. Inactivity duration was 606 seconds.
[12/12/11 10:59:21:234 GMT+08:00] 00000046 WebApp E [Servlet Error]-[com.bank.kjys.servlet.KjysMenu]: java.lang.OutOfMemoryError
at java.lang.Throwable.fillInStackTrace(Native Method)
at java.lang.Throwable.(Throwable.java:56)
at java.lang.Throwable.(Throwable.java:67)
at com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:881)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1497)
。。。。。。
[11-12-12 9:59:30:984 GMT+08:00] 00000707 ServletWrappe E SRVE0068E: 未捕获到 servlet com.bank.kjys.pz.servlet.Pzcxjg 的其中一个服务方法中抛出的异常。抛出的异常:java.lang.OutOfMemoryError
at org.jdom.Element.(Element.java:105)
at org.jdom.Element.(Element.java:152)
at com.bank.kjys.pz.jcxx.PzGys.toJdomElement(PzGys.java:59)
at com.bank.kjys.pz.jcxx.PzGys$$FastClassByCGLIB$$b74e5ca6.invoke()
at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:149)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1497)
[11-12-12 9:59:41:572 GMT+08:00] 00000798 ServiceLogger I com.ibm.ws.ffdc.IncidentStreamImpl initialize FFDC0009I: FFDC 已打开附带的流文件 /was/IBM/WebSphere/AppServer/profiles/AppSrv01/logs/ffdc/kjys-server1_00000798_11.12.12_09.59.41_0.txt
[11-12-12 9:59:41:680 GMT+08:00] 000007a2 DiscoveryRcv W DCSV1115W: 在成员 kjys1Cell01\kjys1Node01\kjys-server1 处的 DCS 堆栈 DefaultCoreGroup:成员 kjys1Cell01\kjys1CellManager01\dmgr 连接已关闭。将从视图中除去成员。DCS 连接状态为 Discovery|Ptp, receiver closed。
[11-12-12 9:59:41:720 GMT+08:00] 00000016 RmmPtpGroup W DCSV1115W: 在成员 kjys1Cell01\kjys1Node01\kjys-server1 处的 DCS 堆栈 DefaultCoreGroup:成员 kjys1Cell01\kjys1CellManager01\dmgr 连接已关闭。将从视图中除去成员。DCS 连接状态为 View|Ptp, receiver closed。
[11-12-12 9:59:42:136 GMT+08:00] 00000703 WebApp E [Servlet Error]-[/sso_sign_in.jsp]: java.lang.OutOfMemoryError
at com.informix.jdbc.IfxPreparedStatement.(IfxPreparedStatement.java:91)
at com.informix.jdbc.IfxSqliConnect.h(IfxSqliConnect.java:5918)
at com.informix.jdbc.IfxSqliConnect.prepareStatement(IfxSqliConnect.java:1999)
at com.bank.yhqxwh.Util.getJgid(Util.java:296)
at com.bank.zhyhtx.User.getBm2(User.java:233)
at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:751)
at com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:881)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1497)
[11-12-12 9:59:42:241 GMT+08:00] 000006cc ServiceLogger I com.ibm.ws.ffdc.IncidentStreamImpl initialize FFDC0009I: FFDC 已打开附带的流文件 /was/IBM/WebSphere/AppServer/profiles/AppSrv01/logs/ffdc/kjys-server1_000006cc_11.12.12_09.59.42_0.txt
[11-12-12 9:59:42:466 GMT+08:00] 00000665 ThreadMonitor W WSVR0606W: 线程“WebContainer : 828”(00000665)先前被报告要挂起,但是已完成。它保持活动状态大约 1056055 毫秒。服务器中可能仍总共挂起了 0 个线程。
[11-12-12 9:59:42:486 GMT+08:00] 000007a4 ServiceLogger I com.ibm.ws.ffdc.IncidentStreamImpl initialize FFDC0009I: FFDC 已打开附带的流文件 /was/IBM/WebSphere/AppServer/profiles/AppSrv01/logs/ffdc/kjys-server1_000007a4_11.12.12_09.59.42_0.txt
[11-12-12 9:59:42:504 GMT+08:00] 00000707 WebApp E [Servlet Error]-[com.bank.kjys.pz.servlet.Pzcxjg]: java.lang.OutOfMemoryError
at org.jdom.Element.(Element.java:105)
at org.jdom.Element.(Element.java:152)
at com.bank.kjys.pz.jcxx.PzGys.toJdomElement(PzGys.java:59)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1497)
[11-12-12 9:59:42:241 GMT+08:00] 000006cc ServiceLogger I com.ibm.ws.ffdc.IncidentStreamImpl initialize FFDC0009I: FFDC 已打开附带的流文件 /was/IBM/WebSphere/AppServer/profiles/AppSrv01/logs/ffdc/kjys-server1_000006cc_11.12.12_09.59.42_0.txt
[11-12-12 9:59:42:466 GMT+08:00] 00000665 ThreadMonitor W WSVR0606W: 线程“WebContainer : 828”(00000665)先前被报告要挂起,但是已完成。它保持活动状态大约 1056055 毫秒。服务器中可能仍总共挂起了 0 个线程。
[11-12-12 9:59:42:486 GMT+08:00] 000007a4 ServiceLogger I com.ibm.ws.ffdc.IncidentStreamImpl initialize FFDC0009I: FFDC 已打开附带的流文件 /was/IBM/WebSphere/AppServer/profiles/AppSrv01/logs/ffdc/kjys-server1_000007a4_11.12.12_09.59.42_0.txt
[11-12-12 9:59:42:504 GMT+08:00] 00000707 WebApp E [Servlet Error]-[com.bank.kjys.pz.servlet.Pzcxjg]: java.lang.OutOfMemoryError
at org.jdom.Element.(Element.java:105)
at org.jdom.Element.(Element.java:152)
at com.bank.kjys.pz.jcxx.PzGys.toJdomElement(PzGys.java:59)
at com.bank.kjys.pz.jcxx.PzGys$$FastClassByCGLIB$$b74e5ca6.invoke()
at net.sf.cglib.proxy.MethodProxy.invoke(MethodProxy.java:149)
[11-12-12 9:59:42:846 GMT+08:00] 00000798 ServiceLogger I com.ibm.ws.ffdc.IncidentStreamImpl resetIncidentStream FFDC0010I: FFDC 已关闭附带的流文件 /was/IBM/WebSphere/AppServer/profiles/AppSrv01/logs/ffdc/kjys-server1_00000798_11.12.12_09.59.41_0.txt
[11-12-12 9:59:43:144 GMT+08:00] 00000016 RmmPtpGroup W DCSV1115W: 在成员 kjys1Cell01\kjys1Node01\kjys-server1 处的 DCS 堆栈 DefaultCoreGroup:成员 kjys1Cell01\kjys1Node01\kjys-server2 连接已关闭。将从视图中除去成员。DCS 连接状态为 View|Ptp, receiver closed。
[11-12-12 9:59:43:495 GMT+08:00] 000006cc ServiceLogger I com.ibm.ws.ffdc.IncidentStreamImpl resetIncidentStream FFDC0010I: FFDC 已关闭附带的流文件 /was/IBM/WebSphere/AppServer/profiles/AppSrv01/logs/ffdc/kjys-server1_000006cc_11.12.12_09.59.42_0.txt
[11-12-12 9:59:43:572 GMT+08:00] 000007a2 DiscoveryRcv W DCSV1115W: 在成员 kjys1Cell01\kjys1Node01\kjys-server1 处的 DCS 堆栈 DefaultCoreGroup:成员 kjys1Cell01\kjys1Node01\nodeagent 连接已关闭。将从视图中除去成员。DCS 连接状态为 Discovery|Ptp, receiver closed。
[11-12-12 9:59:43:740 GMT+08:00] 00000016 RmmPtpGroup W DCSV1115W: 在成员 kjys1Cell01\kjys1Node01\kjys-server1 处的 DCS 堆栈 DefaultCoreGroup:成员 kjys1Cell01\kjys1Node01\nodeagent 连接已关闭。将从视图中除去成员。DCS 连接状态为 View|Ptp, receiver closed。
[11-12-12 9:59:44:142 GMT+08:00] 000006cc WebApp E [Servlet Error]-[com.bank.kjys.yz.servlet.JjdAddDo]: java.lang.OutOfMemoryError
at com.informix.jdbc.IfxSqli.b(IfxSqli.java:379)
at com.informix.jdbc.IfxSqli.clear(IfxSqli.java:360)
at com.informix.jdbc.IfxSqli.executeClose(IfxSqli.java:1870)
at com.informix.jdbc.IfxResultSet.close(IfxResultSet.java:1589)
at com.bank.yhqxwh.Util.getJgid(Util.java:307)
[11-12-12 10:00:08:820 GMT+08:00] 00000016 VSyncAlgo1 I DCSV2004I: 在成员 kjys1Cell01\kjys1Node01\kjys-server1 处的 DCS 堆栈 DefaultCoreGroup:已成功完成视图同步。视图标识为 (22:0.kjys1Cell01\kjys1Node01\kjys-server1)。内部详细信息为 None。
[11-12-12 10:00:09:096 GMT+08:00] 00000018 CoordinatorIm I HMGR0207I: 协调程序先前是核心组 DefaultCoreGroup 的活动的协调程序,但已丢失了控制权。
[11-12-12 10:00:09:180 GMT+08:00] 00000798 ViewReceiver I DCSV1033I: 在成员 kjys1Cell01\kjys1Node01\kjys-server1 处的 DCS 堆栈 DefaultCoreGroup:已凭视图标识 (23:0.kjys1Cell01\kjys1CellManager01\dmgr) 确认了所有的新视图成员。视图通道类型为 View|Ptp。
[11-12-12 10:00:09:275 GMT+08:00] 00000018 CoordinatorIm I HMGR0218I: 已安装新的核心组视图。核心组是 DefaultCoreGroup。视图标识为 (23:0.kjys1Cell01\kjys1CellManager01\dmgr)。新的视图中的成员数为 4。
[11-12-12 10:00:09:293 GMT+08:00] 00000018 CoreGroupMemb I DCSV8050I: 在成员 kjys1Cell01\kjys1Node01\kjys-server1 处的 DCS 堆栈 DefaultCoreGroup:已安装新视图,标识 (23:0.kjys1Cell01\kjys1CellManager01\dmgr),视图大小为 4 (AV=4, CD=4, CN=4, DF=4)
[11-12-12 10:00:11:574 GMT+08:00] 000001f6 CoordinatorCo W HMGR0152W: 检测到 CPU 饥饿。当前线程调度延迟是 835 秒。
[11-12-12 10:00:55:620 GMT+08:00] 000007c4 ServletWrappe I SRVE0253I: [hxbank_war] [/bank] [com.bank.kjys.pz.sgcl.GykcCxDo]:毁坏成功。
[11-12-12 10:00:55:639 GMT+08:00] 000007c4 ServletWrappe I SRVE0253I: [bank_war] [/bank] [com.bank.kjys.pz.gy.servlet.GyTjdUpdateDo]:毁坏成功。
[11-12-12 10:00:55:663 GMT+08:00] 000007c4 ServletWrappe I SRVE0253I: [bank_war] [/bank] [com.bank.kjys.yz.servlet.YddHzDo]:毁坏成功。
[11-12-12 10:00:55:676 GMT+08:00] 000007c4 ServletWrappe I SRVE0253I: [bank_war] [/bank] [com.bank.kjys.pz.fh.servlet.PzXhdAdd]:毁坏成功。
[11-12-12 10:00:55:684 GMT+08:00] 000007c4 ServletWrappe I SRVE0253I: [bank_war] [/bank] [com.bank.kjys.yz.servlet.YmcxDo]:毁坏成功。
抽取 cells/kjys1Cell01/nodes/kjys1Node01/perftuners.xml 时发生异常。
[11-12-12 10:01:44:134 GMT+08:00] 00000023 WorkSpaceMast E Unable to create temp file for document: cells/kjys1Cell01/nodes/kjys1Node01/perftuners.xml
[11-12-12 10:01:44:142 GMT+08:00] 00000023 ServerRuleDri E perfalert.Exception.errorjava.security.PrivilegedActionException: com.ibm.ws.sm.workspace.WorkSpaceException: WKSP0012E Exception when while extracting cells/kjys1Cell01/nodes/kjys1Node01/perftuners.xml from Config Repository--com.ibm.websphere.management.exception.DocumentIOException: Unable to create temp file for document: cells/kjys1Cell01/nodes/kjys1Node01/perftuners.xml
[11-12-12 10:01:44:360 GMT+08:00] 00000023 ServerRuleDri E perfalert.Exception.error
[11-12-12 10:02:00:135 GMT+08:00] 000007c4 FilterInstanc A SRVE0248I: 当前正在处理请求。最多等待 60 秒,然后强制执行过滤器破坏。
[11-12-12 10:02:42:489 GMT+08:00] 00000037 ThreadMonitor W WSVR0605W: 线程“WebContainer : 851”(00000697)已保持活动状态 1251358 毫秒,可能被挂起了。服务器中可能总共挂起了 1 个线程。
[11-12-12 10:03:00:873 GMT+08:00] 000007c4 ApplicationMg A WSVR0220I: 应用程序已停止:bank_war
[11-12-12 10:03:00:890 GMT+08:00] 000007c4 ApplicationMg A WSVR0217I: 正在停止应用程序:DefaultApplication.ear
[11-12-12 10:03:00:916 GMT+08:00] 000007c4 ServletWrappe I SRVE0253I: [DefaultApplication.ear] [/] [Hit Count Servlet]:毁坏成功。
[11-12-12 10:03:00:930 GMT+08:00] 000007c4 ServletWrappe I SRVE0253I: [DefaultApplication.ear] [/] [Snoop Servlet]:毁坏成功。
[11-12-12 10:03:00:943 GMT+08:00] 000007c4 ServletWrappe I SRVE0253I: [DefaultApplication.ear] [/] [Hello Pervasive Servlet]:毁坏成功。
收起