IDS9.30宕机求助，信息详尽，不断更新
RS6000小机，操作系统AIX53，数据库和应用在一台服务器上，数据库链接方式是共享内存
有批量和联机应用，数据库每晚都会重启。 请各位帮忙诊断下,谢谢各位
online.log:
09:58:53 Maximum server connections 95
10:03:06 Logical Log 305974 Complete.
10:03:09 Process exited with return code 142: /bin/sh /bin/sh -c /informix/etc/log_full.sh 2 23 "Logical Log 305974 Complete." "Logical Log 305974 Complete."
10:03:53 Fuzzy Checkpoint Completed: duration was 0 seconds, 433 buffers not flushed.
10:03:53 Checkpoint loguniq 305975, logpos 0xf4dd4
10:03:53 Maximum server connections 100
10:08:54 Fuzzy Checkpoint Completed: duration was 0 seconds, 428 buffers not flushed.
10:08:54 Checkpoint loguniq 305975, logpos 0x856dac
10:08:54 Maximum server connections 100
10:10:01 Logical Log 305975 Complete.
10:10:04 Process exited with return code 142: /bin/sh /bin/sh -c /informix/etc/log_full.sh 2 23 "Logical Log 305975 Complete." "Logical Log 305975 Complete."
10:13:54 Fuzzy Checkpoint Completed: duration was 0 seconds, 418 buffers not flushed.
10:13:54 Checkpoint loguniq 305976, logpos 0x55dd4c
10:13:54 Maximum server connections 100
10:16:57 Logical Log 305976 Complete.
10:17:00 Process exited with return code 142: /bin/sh /bin/sh -c /informix/etc/log_full.sh 2 23 "Logical Log 305976 Complete." "Logical Log 305976 Complete."
10:17:13 Assert Failed: No Exception Handler
10:17:13 Informix Dynamic Server Version 9.30.FC2R1
10:17:13 Who: Session(102, agent2@BRCC_MAIN_P650, 1344510, -2143274408)
Thread(125, sqlexec, 7000000803d0288, 5)
File: mtex.c Line: 415
10:17:13 Results: Exception Caught. Type: MT_EX_OS, Context: mem
10:17:13 Action: Please notify Informix Technical Support.
10:17:13 stack trace for pid 1541092 written to /informix/tmp/af.465c1a8
10:17:13 See Also: /informix/tmp/af.465c1a8, shmem.465c1a8.0
10:18:54 Fuzzy Checkpoint Completed: duration was 0 seconds, 273 buffers not flushed.
10:18:54 Checkpoint loguniq 305977, logpos 0x2758d4
10:18:54 Maximum server connections 100
10:19:44 mtex.c, line 415, thread 125, proc id 1541092, No Exception Handler.
10:19:44 Fatal error in ADM VP at mt.c:11890
10:19:44 Unexpected virtual processor termination, pid = 1541092, exit = 0x100
10:19:44 PANIC: Attempting to bring system down
10:24:41 Informix Dynamic Server Started.
帖写我认为有用的信息：
LAST SQL的锁等待时间是20S 太长
Sess SQL Current Iso Lock SQL ISAM F.E.
Id Stmt type Database Lvl Mode ERR ERR Vers
102 - agentdb CR Wait 20 0 0 9.03
onstat -g ath
*125 7000000d06e6900 7000000803d0288 2 running 5cpu sqlexec
onstat -u
7000000803d0288 *---P--- 102 agent2 - 0 0 1 76 922
有批量和联机应用，数据库每晚都会重启。 请各位帮忙诊断下,谢谢各位
online.log:
09:58:53 Maximum server connections 95
10:03:06 Logical Log 305974 Complete.
10:03:09 Process exited with return code 142: /bin/sh /bin/sh -c /informix/etc/log_full.sh 2 23 "Logical Log 305974 Complete." "Logical Log 305974 Complete."
10:03:53 Fuzzy Checkpoint Completed: duration was 0 seconds, 433 buffers not flushed.
10:03:53 Checkpoint loguniq 305975, logpos 0xf4dd4
10:03:53 Maximum server connections 100
10:08:54 Fuzzy Checkpoint Completed: duration was 0 seconds, 428 buffers not flushed.
10:08:54 Checkpoint loguniq 305975, logpos 0x856dac
10:08:54 Maximum server connections 100
10:10:01 Logical Log 305975 Complete.
10:10:04 Process exited with return code 142: /bin/sh /bin/sh -c /informix/etc/log_full.sh 2 23 "Logical Log 305975 Complete." "Logical Log 305975 Complete."
10:13:54 Fuzzy Checkpoint Completed: duration was 0 seconds, 418 buffers not flushed.
10:13:54 Checkpoint loguniq 305976, logpos 0x55dd4c
10:13:54 Maximum server connections 100
10:16:57 Logical Log 305976 Complete.
10:17:00 Process exited with return code 142: /bin/sh /bin/sh -c /informix/etc/log_full.sh 2 23 "Logical Log 305976 Complete." "Logical Log 305976 Complete."
10:17:13 Assert Failed: No Exception Handler
10:17:13 Informix Dynamic Server Version 9.30.FC2R1
10:17:13 Who: Session(102, agent2@BRCC_MAIN_P650, 1344510, -2143274408)
Thread(125, sqlexec, 7000000803d0288, 5)
File: mtex.c Line: 415
10:17:13 Results: Exception Caught. Type: MT_EX_OS, Context: mem
10:17:13 Action: Please notify Informix Technical Support.
10:17:13 stack trace for pid 1541092 written to /informix/tmp/af.465c1a8
10:17:13 See Also: /informix/tmp/af.465c1a8, shmem.465c1a8.0
10:18:54 Fuzzy Checkpoint Completed: duration was 0 seconds, 273 buffers not flushed.
10:18:54 Checkpoint loguniq 305977, logpos 0x2758d4
10:18:54 Maximum server connections 100
10:19:44 mtex.c, line 415, thread 125, proc id 1541092, No Exception Handler.
10:19:44 Fatal error in ADM VP at mt.c:11890
10:19:44 Unexpected virtual processor termination, pid = 1541092, exit = 0x100
10:19:44 PANIC: Attempting to bring system down
10:24:41 Informix Dynamic Server Started.
帖写我认为有用的信息：
LAST SQL的锁等待时间是20S 太长
Sess SQL Current Iso Lock SQL ISAM F.E.
Id Stmt type Database Lvl Mode ERR ERR Vers
102 - agentdb CR Wait 20 0 0 9.03
onstat -g ath
*125 7000000d06e6900 7000000803d0288 2 running 5cpu sqlexec
onstat -u
7000000803d0288 *---P--- 102 agent2 - 0 0 1 76 922
附件：
af.rar (188.83 KB)
af20140214.rar (190.55 KB)