8台应用服务器，系统为 Linux x64( Redhat5.7) 每台服务器16G内存，每台服务器WAS部署为4节点集群，每节点JVM内存分配1024-2048.
web服务器使用负载均衡RAIDWARE代替。近期频繁随机出现内存溢出，随机性某一台服务器会产生javacore,headdump文件。
分析了多天的JAVACORE和heapdump日志，报错信息基本都一样，但是却看不出问题出在哪里
JAVACORE信息
***WARNING*** Java heap is almost exhausted : 12% free Java heap Please enable verbosegc trace and use IBM Pattern Modeling and Analysis Tool(
http://www.alphaworks.ibm.com/tech/pmat) to analyze garbage collection activities. If heapdumps are generated at the same time, please use IBM HeapAnalyzer(
http://www.alphaworks.ibm.com/tech/heapanalyzer) to analyze Java heap.
File name : G:error235JAVAjavacore.20140128.111440.18991.0005.txt
Cause of thread dump : Dump Event "systhrow" (00040000) Detail "java/lang/OutOfMemoryError" "Java heap space" received
Date: 2014/01/28 at 11:15:16
Process ID : Not available
Operating System : Linux 2.6.18-274.el5
Processor Architecture : amd64
Number of Processors : 8
Java version : JRE 1.6.0 Linux amd64-64 build jvmxa6460sr15-20131016_170922 (pxa6460sr15ifix-20131203_01(SR15+IX90131+IX90132+IV52621))
Virtual machine version : VM build 20131016_170922
Just-In-Time(JIT) compiler switch, Ahead-Of-Time (AOT) compiler switch, Compiler version : r9_20130920_46510ifx2
Garbage collector version : GC - GA24_Java6_SR15_20131016_1337_B170922_CMPRSS
Java Heap Information
Maximum Java heap size : 3076m
Initial Java heap size : 1024m
Free Java heap size: 376.61 MB
Allocated Java heap size: 3 GB
Number of loaded classes in Java heap : 25,874
Number of classloaders in Java heap : 1,861
Last Garbage Collection Detail Nursery Area Free : 0 bytes Total : 0 bytes Tenured Area Free : 398,143,152 bytes Total : 3,225,419,776 bytes 12% free Global Garbage Collector Counter : 215
heapdump显示信息
附件中有完整的javacore文件
附件：
javacore.20140128.111440.18991.0005.zip (472.44 KB)
javacore.20140128.111440.18991.0005.zip (472.44 KB)
收起