wepshere 内存溢出与线存挂起

我websphere做的集群，一搞其中某台机器就内存溢出，还有线程挂起现像，然后就必需把死掉的那个集群结点重启一下，就好了
我拿了某天的javacore用工具分析了一下，我看不懂，贴出来，请大家帮我看看：Cause of thread dump : Dump Event "user" (00004000) receivedDate: 2011/02/16 at 15:38:24Process ID : 1270220Operating System : AIX 5.3Processor Architecture : ppc64Number of Processors : 8Java version : J2RE 5.0 IBM J9 2.3 AIX ppc64-64 build j9vmap6423-20060504Virtual machine version : VM build 20060501_06428_BHdSMrJust-In-Time(JIT) compiler switch, Ahead-Of-Time (AOT) compiler switch, Compiler version : JIT enabled - 20060428_1800_r8Java Heap InformationMaximum Java heap size : 2560mInitial Java heap size : 1024m
Java Home Directory : /usr/IBM/WebSphere/AppServer/java/jreJava DLL Directory : /usr/IBM/WebSphere/AppServer/java/jre/binSystem Classpath : /usr/IBM/WebSphere/AppServer/java/jre/lib/ext/ibmorb.jar;/usr/IBM/WebSphere/AppServer/java/jre/lib/ext/ibmext.jar;/usr/IBM/WebSphere/AppServer/java/jre/lib/vm.jar;/usr/IBM/WebSphere/AppServer/java/jre/lib/core.jar;/usr/IBM/WebSphere/AppServer/java/jre/lib/charsets.jar;/usr/IBM/WebSphere/AppServer/java/jre/lib/graphics.jar;/usr/IBM/WebSphere/AppServer/java/jre/lib/security.jar;/usr/IBM/WebSphere/AppServer/java/jre/lib/ibmpkcs.jar;/usr/IBM/WebSphere/AppServer/java/jre/lib/ibmorb.jar;/usr/IBM/WebSphere/AppServer/java/jre/lib/ibmcfw.jar;/usr/IBM/WebSphere/AppServer/java/jre/lib/ibmorbapi.jar;/usr/IBM/WebSphere/AppServer/java/jre/lib/ibmjcefw.jar;/usr/IBM/WebSphere/AppServer/java/jre/lib/ibmjgssprovider.jar;/usr/IBM/WebSphere/AppServer/java/jre/lib/ibmjsseprovider2.jar;/usr/IBM/WebSphere/AppServer/java/jre/lib/ibmjaaslm.jar;/usr/IBM/WebSphere/AppServer/java/jre/lib/ibmcertpathprovider.jar;/usr/IBM/WebSphere/AppServer/java/jre/lib/server.jar;/usr/IBM/WebSphere/AppServer/java/jre/lib/xml.jar;User Arguments :
-Xjcl:jclscar_23
-Dcom.ibm.oti.vm.bootstrap.library.path=/usr/IBM/WebSphere/AppServer/java/jre/bin
-Dsun.boot.library.path=/usr/IBM/WebSphere/AppServer/java/jre/bin
-Djava.library.path=/usr/IBM/WebSphere/AppServer/java/jre/bin:/usr/IBM/WebSphere/AppServer/java/jre/bin/j9vm:/usr/IBM/WebSphere/AppServer/java/jre/bin:/usr/IBM/WebSphere/AppServer/bin:/home/cognos/c8/bin64:/usr/IBM/WebSphere/AppServer/java/bin:/home/cognos/sqllib/lib32:/usr/IBM/WebSphere/AppServer/java/lib/ext:/home/cognos/sqllib/lib64::/usr/lib
-Djava.home=/usr/IBM/WebSphere/AppServer/java/jre
-Djava.ext.dirs=/usr/IBM/WebSphere/AppServer/java/jre/lib/ext
-Duser.dir=/usr/IBM/WebSphere/AppServer/profiles/appserv4
_j2se_j9
vfprintf 0x0000000110001840
-Declipse.security
-Dwas.status.socket=36122
-Dosgi.install.area=/usr/IBM/WebSphere/AppServer
-Dosgi.configuration.area=/usr/IBM/WebSphere/AppServer/profiles/appserv4/configuration
-Djava.awt.headless=true
-Dosgi.framework.extensions=com.ibm.cds
-Xshareclasses:name=webspherev61_%g,groupAccess,nonFatal
-Xscmx50M
-Xbootclasspath/p:/usr/IBM/WebSphere/AppServer/java/jre/lib/ext/ibmorb.jar:/usr/IBM/WebSphere/AppServer/java/jre/lib/ext/ibmext.jar
-Dibm.websphere.internalClassAccessMode=allow
-Xms1024m
-Xmx2560m
-Dws.ext.dirs=/usr/IBM/WebSphere/AppServer/java/lib:/usr/IBM/WebSphere/AppServer/profiles/appserv4/classes:/usr/IBM/WebSphere/AppServer/classes:/usr/IBM/WebSphere/AppServer/lib:/usr/IBM/WebSphere/AppServer/installedChannels:/usr/IBM/WebSphere/AppServer/lib/ext:/usr/IBM/WebSphere/AppServer/web/help:/usr/IBM/WebSphere/AppServer/deploytool/itp/plugins/com.ibm.etools.ejbdeploy/runtime
-Dderby.system.home=/usr/IBM/WebSphere/AppServer/derby
-Dcom.ibm.itp.location=/usr/IBM/WebSphere/AppServer/bin
-Djava.util.logging.configureByServer=true
-Duser.install.root=/usr/IBM/WebSphere/AppServer/profiles/appserv4
-Djavax.management.builder.initial=com.ibm.ws.management.PlatformMBeanServerBuilder
-Dwas.install.root=/usr/IBM/WebSphere/AppServer
-Dpython.cachedir=/usr/IBM/WebSphere/AppServer/profiles/appserv4/temp/cachedir
-Djava.util.logging.manager=com.ibm.ws.bootstrap.WsLogManager
-Dserver.root=/usr/IBM/WebSphere/AppServer/profiles/appserv4
-Dfile.encoding=GBK
-Djava.security.auth.login.config=/usr/IBM/WebSphere/AppServer/profiles/appserv4/properties/wsjaas.conf
-Djava.security.policy=/usr/IBM/WebSphere/AppServer/profiles/appserv4/properties/server.policy
-Dinvokedviajava
-Djava.class.path=/usr/IBM/WebSphere/AppServer/profiles/appserv4/properties:/usr/IBM/WebSphere/AppServer/properties:/usr/IBM/WebSphere/AppServer/lib/startup.jar:/usr/IBM/WebSphere/AppServer/lib/bootstrap.jar:/usr/IBM/WebSphere/AppServer/lib/j2ee.jar:/usr/IBM/WebSphere/AppServer/lib/lmproxy.jar:/usr/IBM/WebSphere/AppServer/lib/urlprotocols.jar:/usr/IBM/WebSphere/AppServer/deploytool/itp/batchboot.jar:/usr/IBM/WebSphere/AppServer/deploytool/itp/batch2.jar:/usr/IBM/WebSphere/AppServer/java/lib/tools.jar
vfprintf
_port_library 0x09001000A06DFD60
-XdumpFree Java heap size: 1,570,240,776 bytesAllocated Java heap size: 2,550,137,856 bytesMemory Segment Analysis


Memory Segment Analysis

Memory Type	# of Segments	Used Memory(bytes)	Used Memory(%)	Free Memory(bytes)	Free Memory(%)	Total Memory(bytes)
Internal	357	23,840,628	99.78	51,948	0.22	23,892,576
Object(reserved)	1	2,550,137,856	100	0	0	2,550,137,856
Class	5,259	114,670,576	84.68	20,742,028	15.32	135,412,604
JIT Code Cache	5	0	0	41,943,040	100	41,943,040
JIT Data Cache	5	37,833,116	90.2	4,109,924	9.8	41,943,040
Overall	5,627	2,726,482,176	97.61	66,846,940	2.39	2,793,329,116

Number of loaded classes in Java heap : 18,648Number of classloaders in Java heap : 1,973


NOTE: Only for Java 5.0 Service Refresh 4 (build date:February 1st, 2007) and older. When you use delegated class loaders, the JVM can create a large number of ClassLoader objects. On IBM Java 5.0 Service Refresh 4 and older, the number of class loaders that are permitted is limited to 8192 by default and an OutOfMemoryError exception is thrown when this limit is exceeded. Use the -Xmxcl parameter to increase the number of class loaders allowed to avoid this problem, for example to 25000, by setting -Xmxcl25000, until the problem is resolved.

Please examine the current thread stack trace to check whether a class loader is being loaded if there is an OutOfMemoryError. For example, the following stack trace indicates that a class loader is being loaded:

at com/ibm/oti/vm/VM.initializeClassLoader(Native Method)
at java/lang/ClassLoader.(ClassLoader.java:120)Command line :
/usr/IBM/WebSphere/AppServer/java/bin/java -Declipse.security -Dwas.status.socket=36122 -Dosgi.install.area=/usr/IBM/WebSphere/AppServer -Dosgi.configuration.area=/usr/IBM/WebSphere/AppServer/profiles/appserv4/configuration -Djava.awt.headless=true -Dosgi.framework.extensions=com.ibm.cds -Xshareclasses:name=webspherev61_%g,groupAccess,nonFatal -Xscmx50M -Xbootclasspath/p:/usr/IBM/WebSphere/AppServer/java/jre/lib/ext/ibmorb.jar:/usr/IBM/WebSphere/AppServer/java/jre/lib/ext/ibmext.jar -classpath /usr/IBM/WebSphere/AppServer/profiles/appserv4/properties:/usr/IBM/WebSphere/AppServer/properties:/usr/IBM/WebSphere/AppServer/lib/startup.jar:/usr/IBM/WebSphere/AppServer/lib/bootstrap.jar:/usr/IBM/WebSphere/AppServer/lib/j2ee.jar:/usr/IBM/WebSphere/AppServer/lib/lmproxy.jar:/usr/IBM/WebSphere/AppServer/lib/urlprotocols.jar:/usr/IBM/WebSphere/AppServer/deploytool/itp/batchboot.jar:/usr/IBM/WebSphere/AppServer/deploytool/itp/batch2.jar:/usr/IBM/WebSphere/AppServer/java/lib/tools.jar -Dibm.websphere.internalClassAccessMode=allow -Xms1024m -Xmx2560m -Dws.ext.dirs=/usr/IBM/WebSphere/AppServer/java/lib:/usr/IBM/WebSphere/AppServer/profiles/appserv4/classes:/usr/IBM/WebSphere/AppServer/classes:/usr/IBM/WebSphere/AppServer/lib:/usr/IBM/WebSphere/AppServer/installedChannels:/usr/IBM/WebSphere/AppServer/lib/ext:/usr/IBM/WebSphere/AppServer/web/help:/usr/IBM/WebSphere/AppServer/deploytool/itp/plugins/com.ibm.etools.ejbdeploy/runtime -Dderby.system.home=/usr/IBM/WebSphere/AppServer/derby -Dcom.ibm.itp.location=/usr/IBM/WebSphere/AppServer/bin -Djava.util.logging.configureByServer=true -Duser.install.root=/usr/IBM/WebSphere/AppServer/profiles/appserv4 -Djavax.management.builder.initial=com.ibm.ws.management.PlatformMBeanServerBuilder -Dwas.install.root=/usr/IBM/WebSphere/AppServer -Dpython.cachedir=/usr/IBM/WebSphere/AppServer/profiles/appserv4/temp/cachedir -Djava.util.logging.manager=com.ibm.ws.bootstrap.WsLogManager -Dserver.root=/usr/IBM/WebSphere/AppServer/profiles/appserv4 -Dfile.encoding=GBK -Djava.security.auth.login.config=/usr/IBM/WebSphere/AppServer/profiles/appserv4/properties/wsjaas.conf -Djava.security.policy=/usr/IBM/WebSphere/AppServer/profiles/appserv4/properties/server.policy com.ibm.wsspi.bootstrap.WSPreLauncher -nosplash -application com.ibm.ws.bootstrap.WSLauncher com.ibm.ws.runtime.WsServer /usr/IBM/WebSphere/AppServer/profiles/appserv4/config Cell01 Node4 amlserv4Thread Status Analysis

Status	Number of Threads : 86	Percentage
Deadlock	0	0 (%)
Runnable	15	17 (%)
Waiting on condition	71	83 (%)
Waiting on monitor	0	0 (%)
Suspended	0	0 (%)
Object.wait()	0	0 (%)
Blocked	0	0 (%)
Parked	0	0 (%)

Thread Method Analysis

Method Name	Number of Threads : 86	Percentage
java/lang/Object.wait(Native Method)	52	60 (%)
com/ibm/io/async/AsyncLibrary.aio_getioev2(Native Method)	10	12 (%)
java/lang/Thread.sleep(Native Method)	9	10 (%)
NO JAVA STACK	9	10 (%)
java/net/SocketInputStream.socketRead0(Native Method)	2	2 (%)
sun/nio/ch/PollArrayWrapper.poll0(Native Method)	1	1 (%)
com/ibm/misc/SignalDispatcher.waitForSignal(Native Method)	1	1 (%)
java/net/PlainSocketImpl.socketAccept(Native Method)	1	1 (%)
java/net/PlainDatagramSocketImpl.receive0(Native Method)	1	1 (%)

Thread Aggregation Analysis

Thread Type	Number of Threads : 86	Percentage
Thread	19	22 (%)
WebContainer	10	12 (%)
Alarm	5	6 (%)
Deferrable Alarm	4	5 (%)
SoapConnectorThreadPool	2	2 (%)
HAManager.thread.pool	2	2 (%)
ThreadManager.JobsProcessorThread.InternalThread	1	1 (%)
WLMMonitorSleeper	1	1 (%)
ServerSocket	1	1 (%)

Last Garbage Collection Detail

Nursery Area Free : 0 bytes Total : 0 bytes
Tenured Area Free : 2,405,287,584 bytes Total : 2,550,137,856 bytes 94% free
Global Garbage Collector Counter : 1,285Garbage Collection History

01:29:33:553147000 GMT j9mm.53 - GlobalGC end: workstackoverflow=0 overflowcount=0 weakrefs=43785 soft=2484 phantom=2354 finalizers=805 newspace=0/0 oldspace=2405287584/2550137856 loa=0/0
01:29:33:552874000 GMT j9mm.59 - Compact end
01:29:33:336312000 GMT j9mm.58 - Compact start
01:29:33:336309000 GMT j9mm.57 - Sweep end
01:29:33:325728000 GMT j9mm.56 - Sweep start
01:29:33:325724000 GMT j9mm.55 - Mark end
01:29:33:205581000 GMT j9mm.54 - Mark start
01:29:33:205452000 GMT j9mm.52 - GlobalGC start: weakrefs=44036 soft=2529 phantom=2377 finalizers=878 globalcount=1285 scavengecount=0
01:29:32:614449000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 32 bytes requested for object of class 0000000014376E78
01:29:32:608429000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 32 bytes requested for object of class 0000000014376E78
01:29:32:602665000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 32 bytes requested for object of class 0000000014376E78
01:29:32:599924000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 32 bytes requested for object of class 0000000014376E78
01:29:32:588343000 GMT j9mm.80 - J9AllocateObject() returning NULL! 64 bytes requested for object of class 00000000144002E8
01:29:32:587813000 GMT j9mm.80 - J9AllocateObject() returning NULL! 64 bytes requested for object of class 00000000144002E8
01:29:32:581165000 GMT j9mm.80 - J9AllocateObject() returning NULL! 64 bytes requested for object of class 00000000144002E8
01:29:32:580998000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 32 bytes requested for object of class 0000000014376E78
01:29:32:577196000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 32 bytes requested for object of class 0000000014376E78
01:29:32:573433000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 32 bytes requested for object of class 0000000014376E78
01:29:32:569113000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 32 bytes requested for object of class 0000000014376E78
01:29:32:565779000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 32 bytes requested for object of class 0000000014376E78
01:29:32:552407000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 32 bytes requested for object of class 0000000014376E78
01:29:32:546400000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 32 bytes requested for object of class 0000000014376E78
01:29:32:544354000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 2072 bytes requested for object of class 0000000014349320
01:29:32:544310000 GMT j9mm.80 - J9AllocateObject() returning NULL! 56 bytes requested for object of class 00000000143FF370
01:29:32:536431000 GMT j9mm.80 - J9AllocateObject() returning NULL! 64 bytes requested for object of class 00000000144002E8
01:29:32:531793000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 40 bytes requested for object of class 00000000144185D8
01:29:32:531482000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 40 bytes requested for object of class 00000000144185D8
01:29:32:530853000 GMT j9mm.80 - J9AllocateObject() returning NULL! 48 bytes requested for object of class 000000001434A6A8
01:29:32:528663000 GMT j9mm.80 - J9AllocateObject() returning NULL! 48 bytes requested for object of class 000000001434A6A8
01:29:32:524239000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 32904 bytes requested for object of class 0000000014349A10
01:29:32:523714000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 40 bytes requested for object of class 00000000144185D8
01:29:32:523383000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 384 bytes requested for object of class 000000001434A100
01:29:32:522991000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 4568 bytes requested for object of class 0000000018A0D048
01:29:32:521520000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 24 bytes requested for object of class 0000000014376E78
01:29:32:521193000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 32928 bytes requested for object of class 0000000014349A10
01:29:32:521177000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 32 bytes requested for object of class 0000000015631F90
01:29:32:521046000 GMT j9mm.80 - J9AllocateObject() returning NULL! 48 bytes requested for object of class 0000000015630BF0
01:29:32:521020000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 424 bytes requested for object of class 000000001434A100
01:29:32:520926000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 12288 bytes requested for object of class 0000000014349320
01:29:32:520918000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 2072 bytes requested for object of class 0000000014349320
01:29:32:520912000 GMT j9mm.80 - J9AllocateObject() returning NULL! 48 bytes requested for object of class 000000001434A6A8
01:29:32:520839000 GMT j9mm.80 - J9AllocateObject() returning NULL! 48 bytes requested for object of class 000000001434A6A8
01:29:32:520747000 GMT j9mm.81 - J9AllocateIndexableObject() returning NULL! 2072 bytes requested for object of class 0000000014349320
01:29:32:520365000 GMT j9mm.53 - GlobalGC end: workstackoverflow=0 overflowcount=0 weakrefs=43681 soft=2301 phantom=2353 finalizers=858 newspace=0/0 oldspace=10282936/2684354560 loa=0/0
01:29:32:519999000 GMT j9mm.59 - Compact end
01:29:28:106108000 GMT j9mm.58 - Compact start
01:29:28:106103000 GMT j9mm.57 - Sweep end
01:29:28:93576000 GMT j9mm.56 - Sweep start
01:29:28:93570000 GMT j9mm.55 - Mark end
01:29:21:549733000 GMT j9mm.54 - Mark start
01:29:21:549510000 GMT j9mm.52 - GlobalGC start: weakrefs=43815 soft=2313 phantom=2421 finalizers=891 globalcount=1284 scavengecount=0
01:29:21:539167000 GMT j9mm.53 - GlobalGC end: workstackoverflow=0 overflowcount=0 weakrefs=43723 soft=2205 phantom=2421 finalizers=871 newspace=0/0 oldspace=10885176/2684354560 loa=0/0
01:29:21:538898000 GMT j9mm.59 - Compact end
01:29:17:585959000 GMT j9mm.58 - Compact start
01:29:17:585956000 GMT j9mm.57 - Sweep end
01:29:17:573137000 GMT j9mm.56 - Sweep start
01:29:17:573133000 GMT j9mm.55 - Mark end
01:29:11:504920000 GMT j9mm.54 - Mark start
01:29:11:504815000 GMT j9mm.52 - GlobalGC start: weakrefs=43770 soft=2210 phantom=2439 finalizers=883 globalcount=1283 scavengecount=0
01:29:11:499953000 GMT j9mm.53 - GlobalGC end: workstackoverflow=0 overflowcount=0 weakrefs=43758 soft=2202 phantom=2435 finalizers=871 newspace=0/0 oldspace=10827160/2684354560 loa=0/0
01:29:11:499681000 GMT j9mm.59 - Compact end
01:29:07:129144000 GMT j9mm.58 - Compact start
01:29:07:129139000 GMT j9mm.57 - Sweep end
01:29:07:114863000 GMT j9mm.56 - Sweep start
01:29:07:114859000 GMT j9mm.55 - Mark end
01:29:00:639840000 GMT j9mm.54 - Mark start
01:29:00:639728000 GMT j9mm.52 - GlobalGC start: weakrefs=43792 soft=2203 phantom=2440 finalizers=888 globalcount=1282 scavengecount=0
01:29:00:634259000 GMT j9mm.53 - GlobalGC end: workstackoverflow=0 overflowcount=0 weakrefs=43760 soft=2195 phantom=2368 finalizers=848 newspace=0/0 oldspace=10246760/2684354560 loa=0/0
01:29:00:634006000 GMT j9mm.59 - Compact end
01:28:58:774014000 GMT j9mm.58 - Compact start
01:28:58:774009000 GMT j9mm.57 - Sweep end
01:28:58:760143000 GMT j9mm.56 - Sweep start
01:28:58:760138000 GMT j9mm.55 - Mark end
01:28:52:192937000 GMT j9mm.54 - Mark start
01:28:52:192833000 GMT j9mm.52 - GlobalGC start: weakrefs=43770 soft=2200 phantom=2370 finalizers=867 globalcount=1281 scavengecount=0
01:28:52:187009000 GMT j9mm.53 - GlobalGC end: workstackoverflow=0 overflowcount=0 weakrefs=43738 soft=2192 phantom=2366 finalizers=847 newspace=0/0 oldspace=10523488/2684354560 loa=0/0
01:28:52:186779000 GMT j9mm.59 - Compact end
01:28:50:308639000 GMT j9mm.58 - Compact start
01:28:50:308636000 GMT j9mm.57 - Sweep end
01:28:50:295002000 GMT j9mm.56 - Sweep start
01:28:50:294998000 GMT j9mm.55 - Mark end
01:28:43:777218000 GMT j9mm.54 - Mark start
01:28:43:777114000 GMT j9mm.52 - GlobalGC start: weakrefs=43739 soft=2192 phantom=2366 finalizers=859 globalcount=1280 scavengecount=0
01:28:43:775291000 GMT j9mm.53 - GlobalGC end: workstackoverflow=0 overflowcount=0 weakrefs=43735 soft=2192 phantom=2366 finalizers=847 newspace=0/0 oldspace=860112/2684354560 loa=0/0
01:28:43:775038000 GMT j9mm.59 - Compact end
01:28:41:808188000 GMT j9mm.58 - Compact start
01:28:41:808185000 GMT j9mm.57 - Sweep end
01:28:41:795110000 GMT j9mm.56 - Sweep start
01:28:41:795105000 GMT j9mm.55 - Mark end
01:28:35:248332000 GMT j9mm.54 - Mark start
01:28:35:248207000 GMT j9mm.52 - GlobalGC start: weakrefs=43781 soft=2198 phantom=2367 finalizers=858 globalcount=1279 scavengecount=0
01:28:35:245152000 GMT j9mm.53 - GlobalGC end: workstackoverflow=0 overflowcount=0 weakrefs=43737 soft=2182 phantom=2363 finalizers=846 newspace=0/0 oldspace=862160/2684354560 loa=0/0
01:28:35:244871000 GMT j9mm.61 - Class unloading end
01:28:35:233037000 GMT j9mm.66 - Classloader unload
01:28:35:232977000 GMT j9mm.66 - Classloader unload
01:28:35:232917000 GMT j9mm.66 - Classloader unload
01:28:35:232860000 GMT j9mm.66 - Classloader unload
01:28:35:232801000 GMT j9mm.66 - Classloader unload
01:28:35:232741000 GMT j9mm.66 - Classloader unload
01:28:35:232682000 GMT j9mm.66 - Classloader unload
01:28:35:232625000 GMT j9mm.66 - Classloader unload
01:28:35:232566000 GMT j9mm.66 - Classloader unload
01:28:35:232506000 GMT j9mm.66 - Classloader unload





别附sysout里面的错误
[11-2-16 9:29:34:068 GMT+08:00] 00001813 ServletWrappe E   SRVE0068E: 未捕获到 servlet action 的其中一个服务方法中抛出的异常。抛出的异常：javax.servlet.ServletException
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1264)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1087)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:118)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain._doFilter(WebAppFilterChain.java:87)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:837)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:680)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:588)
at com.ibm.ws.wswebcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:524)
at com.ibm.ws.webcontainer.webapp.WebAppRequestDispatcher.forward(WebAppRequestDispatcher.java:321)
at org.apache.struts.action.RequestProcessor.doForward(RequestProcessor.java:1062)
at org.apache.struts.action.RequestProcessor.processForwardConfig(RequestProcessor.java:386)
at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:229)
at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1196)
at org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:432)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:763)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:856)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1146)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1087)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:145)
at com.ist.common.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:150)
at com.ibm.ws.webcontainer.filter.FilterInstanceWrapper.doFilter(FilterInstanceWrapper.java:190)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:130)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain._doFilter(WebAppFilterChain.java:87)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:837)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:680)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:588)
at com.ibm.ws.wswebcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:524)
at com.ibm.ws.webcontainer.servlet.CacheServletWrapper.handleRequest(CacheServletWrapper.java:90)
at com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:751)
at com.ibm.ws.wswebcontainer.WebContainer.handleRequest(WebContainer.java:1478)
at com.ibm.ws.webcontainer.channel.WCChannelLink.ready(WCChannelLink.java:125)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleDiscrimination(HttpInboundLink.java:458)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleNewInformation(HttpInboundLink.java:387)
at com.ibm.ws.http.channel.inbound.impl.HttpICLReadCallback.complete(HttpICLReadCallback.java:102)
at com.ibm.ws.tcp.channel.impl.AioReadCompletionListener.futureCompleted(AioReadCompletionListener.java:165)
at com.ibm.io.async.AbstractAsyncFuture.invokeCallback(AbstractAsyncFuture.java:217)
at com.ibm.io.async.AsyncChannelFuture.fireCompletionActions(AsyncChannelFuture.java:161)
at com.ibm.io.async.AsyncFuture.completed(AsyncFuture.java:136)
at com.ibm.io.async.ResultHandler.complete(ResultHandler.java:196)
at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:751)
at com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:881)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1497)
---- Begin backtrace for Nested Throwables
java.lang.OutOfMemoryError
at java.lang.Object.clone(Native Method)
at java.lang.reflect.Method.getParameterTypes(Method.java:276)
at java.beans.Introspector.internalFindMethod(Introspector.java:1336)
at java.beans.Introspector.findMethod(Introspector.java:1399)
at java.beans.Introspector.findMethod(Introspector.java:1379)
at java.beans.PropertyDescriptor.getReadMethod(PropertyDescriptor.java:194)
at org.apache.commons.beanutils.PropertyUtilsBean.isReadable(PropertyUtilsBean.java:1185)
at org.apache.commons.beanutils.PropertyUtils.isReadable(PropertyUtils.java:440)
at com.ist.common.MyBeanUtils.convert(MyBeanUtils.java:191)
at com.ist.common.MyBeanUtils.copyBean2Bean(MyBeanUtils.java:131)
at com.ist.aml.report.controller.T07_flowAction.performGetT07_flowList(T07_flowAction.java:490)
at com.ist.aml.report.controller.T07_flowAction.execute(T07_flowAction.java:70)
at org.apache.struts.action.RequestProcessor.processActionPerform(RequestProcessor.java:419)
at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:224)
at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1196)
at org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:432)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:763)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:856)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1146)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1087)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:118)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain._doFilter(WebAppFilterChain.java:87)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:837)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:680)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:588)
at com.ibm.ws.wswebcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:524)
at com.ibm.ws.webcontainer.webapp.WebAppRequestDispatcher.forward(WebAppRequestDispatcher.java:321)
at org.apache.struts.action.RequestProcessor.doForward(RequestProcessor.java:1062)
at org.apache.struts.action.RequestProcessor.processForwardConfig(RequestProcessor.java:386)
at org.apache.struts.action.RequestProcessor.process(RequestProcessor.java:229)
at org.apache.struts.action.ActionServlet.process(ActionServlet.java:1196)
at org.apache.struts.action.ActionServlet.doPost(ActionServlet.java:432)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:763)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:856)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1146)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1087)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:145)
at com.ist.common.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:150)
at com.ibm.ws.webcontainer.filter.FilterInstanceWrapper.doFilter(FilterInstanceWrapper.java:190)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:130)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain._doFilter(WebAppFilterChain.java:87)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:837)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:680)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:588)
at com.ibm.ws.wswebcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:524)
at com.ibm.ws.webcontainer.servlet.CacheServletWrapper.handleRequest(CacheServletWrapper.java:90)
at com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:751)
at com.ibm.ws.wswebcontainer.WebContainer.handleRequest(WebContainer.java:1478)
at com.ibm.ws.webcontainer.channel.WCChannelLink.ready(WCChannelLink.java:125)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleDiscrimination(HttpInboundLink.java:458)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleNewInformation(HttpInboundLink.java:387)
at com.ibm.ws.http.channel.inbound.impl.HttpICLReadCallback.complete(HttpICLReadCallback.java:102)
at com.ibm.ws.tcp.channel.impl.AioReadCompletionListener.futureCompleted(AioReadCompletionListener.java:165)
at com.ibm.io.async.AbstractAsyncFuture.invokeCallback(AbstractAsyncFuture.java:217)
at com.ibm.io.async.AsyncChannelFuture.fireCompletionActions(AsyncChannelFuture.java:161)
at com.ibm.io.async.AsyncFuture.completed(AsyncFuture.java:136)
at com.ibm.io.async.ResultHandler.complete(ResultHandler.java:196)
at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:751)
at com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:881)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1497)
[11-2-16 9:29:34:095 GMT+08:00] 0000182e SystemOut     O 上报
[11-2-16 9:29:34:096 GMT+08:00] 0000182e SystemOut     O 0
[11-2-16 9:29:34:096 GMT+08:00] 0000182e SystemOut     O 排除
[11-2-16 9:29:34:096 GMT+08:00] 0000182e SystemOut     O 1
[11-2-16 9:29:34:096 GMT+08:00] 0000182e SystemOut     O roots:/aml
[11-2-16 9:29:34:135 GMT+08:00] 00000026 ServiceLogger I com.ibm.ws.ffdc.IncidentStreamImpl resetIncidentStream FFDC0010I: FFDC 已关闭附带的流文件 /usr/IBM/WebSphere/AppServer/profiles/appserv4/logs/ffdc/amlserv4_00000026_11.02.16_09.29.32_0.txt
[11-2-16 9:29:34:149 GMT+08:00] 00001831 ThreadMonitor W   WSVR0606W: 线程“WebContainer : 5790”（00001831）先前被报告要挂起，但是已完成。它保持活动状态大约 680800 毫秒。服务器中可能仍总共挂起了 0 个线程。
[11-2-16 9:29:34:192 GMT+08:00] 0000181f WebApp        E   [Servlet Error]-[action]: java.lang.IllegalStateException
at com.ibm.ws.webcontainer.httpsession.SessionData.invalidate(SessionData.java:603)
at com.ibm.ws.webcontainer.httpsession.HttpSessionFacade.invalidate(HttpSessionFacade.java:181)
at com.ist.common.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:159)
at com.ibm.ws.webcontainer.filter.FilterInstanceWrapper.doFilter(FilterInstanceWrapper.java:190)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:130)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain._doFilter(WebAppFilterChain.java:87)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:837)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:680)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:588)
at com.ibm.ws.wswebcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:524)
at com.ibm.ws.webcontainer.servlet.CacheServletWrapper.handleRequest(CacheServletWrapper.java:90)
at com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:751)
at com.ibm.ws.wswebcontainer.WebContainer.handleRequest(WebContainer.java:1478)
at com.ibm.ws.webcontainer.channel.WCChannelLink.ready(WCChannelLink.java:125)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleDiscrimination(HttpInboundLink.java:458)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleNewInformation(HttpInboundLink.java:387)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.ready(HttpInboundLink.java:267)
at com.ibm.ws.tcp.channel.impl.NewConnectionInitialReadCallback.sendToDiscriminators(NewConnectionInitialReadCallback.java:214)
at com.ibm.ws.tcp.channel.impl.NewConnectionInitialReadCallback.complete(NewConnectionInitialReadCallback.java:113)
at com.ibm.ws.tcp.channel.impl.AioReadCompletionListener.futureCompleted(AioReadCompletionListener.java:165)
at com.ibm.io.async.AbstractAsyncFuture.invokeCallback(AbstractAsyncFuture.java:217)
at com.ibm.io.async.AsyncChannelFuture.fireCompletionActions(AsyncChannelFuture.java:161)
at com.ibm.io.async.AsyncFuture.completed(AsyncFuture.java:136)
at com.ibm.io.async.ResultHandler.complete(ResultHandler.java:196)
at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:751)
at com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:881)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1497)
[11-2-16 9:29:34:204 GMT+08:00] 00001813 WebApp        E   [Servlet Error]-[action]: java.lang.IllegalStateException
at com.ibm.ws.webcontainer.httpsession.SessionData.invalidate(SessionData.java:603)
at com.ibm.ws.webcontainer.httpsession.HttpSessionFacade.invalidate(HttpSessionFacade.java:181)
at com.ist.common.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:159)
at com.ibm.ws.webcontainer.filter.FilterInstanceWrapper.doFilter(FilterInstanceWrapper.java:190)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:130)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain._doFilter(WebAppFilterChain.java:87)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:837)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:680)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:588)
at com.ibm.ws.wswebcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:524)
at com.ibm.ws.webcontainer.servlet.CacheServletWrapper.handleRequest(CacheServletWrapper.java:90)
at com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:751)
at com.ibm.ws.wswebcontainer.WebContainer.handleRequest(WebContainer.java:1478)
at com.ibm.ws.webcontainer.channel.WCChannelLink.ready(WCChannelLink.java:125)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleDiscrimination(HttpInboundLink.java:458)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleNewInformation(HttpInboundLink.java:387)
at com.ibm.ws.http.channel.inbound.impl.HttpICLReadCallback.complete(HttpICLReadCallback.java:102)
at com.ibm.ws.tcp.channel.impl.AioReadCompletionListener.futureCompleted(AioReadCompletionListener.java:165)
at com.ibm.io.async.AbstractAsyncFuture.invokeCallback(AbstractAsyncFuture.java:217)
at com.ibm.io.async.AsyncChannelFuture.fireCompletionActions(AsyncChannelFuture.java:161)
at com.ibm.io.async.AsyncFuture.completed(AsyncFuture.java:136)
at com.ibm.io.async.ResultHandler.complete(ResultHandler.java:196)
at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:751)
at com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:881)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1497)
[11-2-16 9:29:34:216 GMT+08:00] 0000184b SystemOut     O 上报
[11-2-16 9:29:34:216 GMT+08:00] 0000184b SystemOut     O 0
[11-2-16 9:29:34:216 GMT+08:00] 0000184b SystemOut     O 排除
[11-2-16 9:29:34:216 GMT+08:00] 0000184b SystemOut     O 1
[11-2-16 9:29:34:222 GMT+08:00] 0000184b SystemOut     O roots:/aml
[11-2-16 9:29:34:230 GMT+08:00] 00001810 SystemOut     O 2011-02-16 09:29:34,229 WebContainer : 5757 DEBUG (CodeTable.java:125) - code_table.xml:installedApps/Cell01/aml_war.ear/aml.war/WEB-INF/code_table_catch_common.xml
[11-2-16 9:29:34:232 GMT+08:00] 00001810 SystemOut     O 2011-02-16 09:29:34,232 WebContainer : 5757 DEBUG (CodeTable.java:125) - code_table.xml:installedApps/Cell01/aml_war.ear/aml.war/WEB-INF/code_table_catch_risk_common.xml
[11-2-16 9:29:34:235 GMT+08:00] 00001810 SystemOut     O 2011-02-16 09:29:34,235 WebContainer : 5757 DEBUG (CodeTable.java:125) - code_table.xml:installedApps/Cell01/aml_war.ear/aml.war/WEB-INF/code_table_catch_aml.xml
[11-2-16 9:29:34:255 GMT+08:00] 00001810 SystemOut     O 2011-02-16 09:29:34,254 WebContainer : 5757 DEBUG (CodeTable.java:150) - SELECT A.CRTPKEY AS KEY1,A.CRTPNAME AS VAL FROM T87_PBC_CRTP  A
[11-2-16 9:29:34:267 GMT+08:00] 00001810 SystemOut     O 2011-02-16 09:29:34,267 WebContainer : 5757 DEBUG (CodeTable.java:270) - get result size:197
[11-2-16 9:29:34:268 GMT+08:00] 00001810 SystemOut     O 2011-02-16 09:29:34,268 WebContainer : 5757 DEBUG (CodeTable.java:290) - 共放入：197
[11-2-16 9:29:34:269 GMT+08:00] 00001810 SystemOut     O 2011-02-16 09:29:34,268 WebContainer : 5757 DEBUG (CodeTable.java:291) - map size：197
[11-2-16 9:29:34:298 GMT+08:00] 00001859 ServiceLogger I com.ibm.ws.ffdc.IncidentStreamImpl resetIncidentStream FFDC0010I: FFDC 已关闭附带的流文件 /usr/IBM/WebSphere/AppServer/profiles/appserv4/logs/ffdc/amlserv4_00001859_11.02.16_09.29.32_0.txt
[11-2-16 9:29:34:308 GMT+08:00] 00001859 WebApp        E   [Servlet Error]-[action]: java.lang.IllegalStateException
at com.ibm.ws.webcontainer.httpsession.SessionData.invalidate(SessionData.java:603)
at com.ibm.ws.webcontainer.httpsession.HttpSessionFacade.invalidate(HttpSessionFacade.java:181)
at com.ist.common.SetCharacterEncodingFilter.doFilter(SetCharacterEncodingFilter.java:159)
at com.ibm.ws.webcontainer.filter.FilterInstanceWrapper.doFilter(FilterInstanceWrapper.java:190)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:130)
at com.ibm.ws.webcontainer.filter.WebAppFilterChain._doFilter(WebAppFilterChain.java:87)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:837)
at com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:680)
at com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:588)
at com.ibm.ws.wswebcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:524)
at com.ibm.ws.webcontainer.servlet.CacheServletWrapper.handleRequest(CacheServletWrapper.java:90)
at com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:751)
at com.ibm.ws.wswebcontainer.WebContainer.handleRequest(WebContainer.java:1478)
at com.ibm.ws.webcontainer.channel.WCChannelLink.ready(WCChannelLink.java:125)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleDiscrimination(HttpInboundLink.java:458)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleNewInformation(HttpInboundLink.java:387)
at com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.ready(HttpInboundLink.java:267)
at com.ibm.ws.tcp.channel.impl.NewConnectionInitialReadCallback.sendToDiscriminators(NewConnectionInitialReadCallback.java:214)
at com.ibm.ws.tcp.channel.impl.NewConnectionInitialReadCallback.complete(NewConnectionInitialReadCallback.java:113)
at com.ibm.ws.tcp.channel.impl.AioReadCompletionListener.futureCompleted(AioReadCompletionListener.java:165)
at com.ibm.io.async.AbstractAsyncFuture.invokeCallback(AbstractAsyncFuture.java:217)
at com.ibm.io.async.AsyncChannelFuture.fireCompletionActions(AsyncChannelFuture.java:161)
at com.ibm.io.async.AsyncFuture.completed(AsyncFuture.java:136)
at com.ibm.io.async.ResultHandler.complete(ResultHandler.java:196)
at com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:792)
at com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:881)
at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1497)
[11-2-16 9:29:34:357 GMT+08:00] 00001842 SystemOut     O 102
[11-2-16 9:29:34:360 GMT+08:00] 00001842 SystemOut     O =========================flag:1
[11-2-16 9:29:34:483 GMT+08:00] 0000185c SystemOut     O 98
[11-2-16 9:29:34:486 GMT+08:00] 0000185c SystemOut     O =========================flag:1
[11-2-16 9:29:34:767 GMT+08:00] 00001844 SystemOut     O 99
[11-2-16 9:29:34:768 GMT+08:00] 00001844 SystemOut     O =========================flag:1
[11-2-16 9:29:41:355 GMT+08:00] 0000185a SystemOut     O node_id=N2001
[11-2-16 9:29:46:472 GMT+08:00] 00001835 SystemOut     O node_id=N2001
[11-2-16 9:29:49:875 GMT+08:00] 00001855 SystemOut     O node_id=N2001
[11-2-16 9:29:51:548 GMT+08:00] 0000184d CoordinatorCo W   HMGR0152W: 检测到 CPU 饥饿。当前线程调度延迟是 46 秒。
[11-2-16 9:29:53:001 GMT+08:00] 0000185a SystemOut     O node_id=N2001
[11-2-16 9:29:55:639 GMT+08:00] 0000182f SystemOut     O node_id=N2001
[11-2-16 9:29:58:537 GMT+08:00] 0000185a SystemOut     O node_id=N2001
[11-2-16 9:30:01:330 GMT+08:00] 0000182f SystemOut     O node_id=N2001
[11-2-16 9:30:05:542 GMT+08:00] 0000185a SystemOut     O node_id=N2001
[11-2-16 9:30:08:218 GMT+08:00] 0000184a SystemOut     O node_id=N2001
[11-2-16 9:30:12:667 GMT+08:00] 0000182e SystemOut     O organList.size()================6
[11-2-16 9:30:12:982 GMT+08:00] 00001835 SystemOut     O 102
[11-2-16 9:30:12:983 GMT+08:00] 00001835 SystemOut     O =========================flag:1
[11-2-16 9:30:15:679 GMT+08:00] 00001856 SystemOut     O node_id=N2001
[11-2-16 9:30:17:050 GMT+08:00] 0000182f SystemOut     O organList.size()================6
[11-2-16 9:30:18:863 GMT+08:00] 0000184a SystemOut     O node_id=N2001
[11-2-16 9:30:19:900 GMT+08:00] 00001854 ActionMapping W org.apache.commons.logging.impl.Jdk14Logger warn Unable to find 'success' forward.
[11-2-16 9:30:20:002 GMT+08:00] 0000182e SystemOut     O node_id=null 收起