online日志,之后重启数据库正常:
05:50:02 Maximum server connections 4321
05:50:02 Checkpoint Statistics - Avg. Txn Block Time 0.005, # Txns blocked 2, Plog used 61568, Llog used 9823
05:50:21 Assert Warning: Memory free block header corruption detected in mt_shm_malloc_segid 8
05:50:21 IBM Informix Dynamic Server Version 11.70.FC8
05:50:21 Who: Session(6087676, informix@::ffff:10.209.14.75, -1, 7000012095cdb08)
Thread(414982965, sqlexec, 7000011d32026e8, 18)
File: mtshpool.c Line: 1882
05:50:21 Results: Pool repaired
05:50:21 Action: Please notify IBM Informix Technical Support.
05:50:21 stack trace for pid 5701716 written to /informix/tmp/af.271de41d
05:50:21 See Also: /informix/tmp/af.271de41d
05:50:21 Memory free block header corruption detected in mt_shm_malloc_segid 8
05:50:22 stack trace for pid 5439720 written to /informix/tmp/af.271de41d
05:50:22 Assert Failed: No Exception Handler
05:50:22 IBM Informix Dynamic Server Version 11.70.FC8
05:50:22 Who: Session(6087676, informix@::ffff:10.209.14.75, -1, 7000012095cdb08)
Thread(414982965, sqlexec, 7000011d32026e8, 31)
File: mtex.c Line: 490
05:50:22 Results: Exception Caught. Type: MT_EX_OS, Context: mem
05:50:22 Action: Please notify IBM Informix Technical Support.
05:50:22 See Also: /informix/tmp/af.271de41d
05:50:49 Logical Log 85834 Complete, timestamp: 0xdb7c17eb.
05:51:05 Checkpoint Completed: duration was 3 seconds.
05:51:05 Sat Jul 7 - loguniq 85835, logpos 0x72dcf8, timestamp: 0xdb7e1633 Interval: 820687
05:51:05 Maximum server connections 4321
05:51:05 Checkpoint Statistics - Avg. Txn Block Time 0.002, # Txns blocked 7, Plog used 62204, Llog used 8036
05:51:34 mtex.c, line 490, thread 414982965, proc id 5439720, No Exception Handler.
05:51:34 Fatal error in ADM VP at mt.c:14055
05:51:34 Unexpected virtual processor termination, pid = 5439720, exit = 0x100
05:51:34 PANIC: Attempting to bring system down
07:25:42 IBM Informix Dynamic Server Started.
07:25:42 Requested shared memory segment size rounded from 12976481KB to 12976496KB
内存调度失败, 先排查硬件是否有异常抛出,然后检查informix的配置文件
收起附件中是af的前100多行。
+++++++++++++++++
一共有2000多连接,下面是截取出的正在执行的连接。
onstat -g sql
6087701 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6087700 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6087676 xxxxdb LC Wait 10 0 0 9.28 Off
6087668 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6087542 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6087507 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6087504 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6087503 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6086939 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6086868 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6086726 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6086482 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6086415 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6086379 SELECT xxxxdb DR Wait 10 0 0 9.28 Off
6085513 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6085430 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6085360 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085345 UPDATE xxxxdb DR Wait 10 0 0 9.28 Off
6085329 INSERT xxxxdb DR Wait 10 0 0 9.28 Off
6085324 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085322 UPDATE xxxxdb DR Wait 10 0 0 9.28 Off
6085317 DELETE xxxxdb DR Wait 10 0 0 9.28 Off
6085297 DELETE xxxxdb DR Wait 10 0 0 9.28 Off
6085287 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085280 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085277 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085275 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085273 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085272 INSERT xxxxdb DR Wait 10 0 0 9.28 Off
6085268 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085261 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085260 INSERT xxxxdb DR Wait 10 0 0 9.28 Off
6084907 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6083959 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6083824 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083819 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083764 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083735 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083705 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083691 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083650 DELETE xxxxdb DR Wait 10 0 0 9.28 Off
6083593 INSERT xxxxdb DR Wait 10 0 0 9.28 Off
6083490 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083471 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6083459 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6083425 UPDATE xxxxdb DR Wait 10 0 0 9.28 Off
6083412 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083369 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083306 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083295 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6082909 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6082908 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6082907 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6082756 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6082422 DELETE sysmaster LC Wait 10 0 0 9.28 Off
6082282 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6082248 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6080404 INSERT xxxxdb DR Wait 10 0 0 9.28 Off
6080152 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6080151 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6080141 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6080139 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6079183 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6074747 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6071680 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6067892 UPDATE xxxxdb DR Wait 10 0 0 9.28 Off
6065933 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6064908 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6063245 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6063222 UPDATE xxxxdb DR Wait 10 0 0 9.28 Off
6062022 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6061987 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6057499 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6057271 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6057248 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6056869 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6055817 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6055650 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6055455 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6050919 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6050048 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6050032 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6050021 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6049639 DELETE xxxxdb LC Wait 10 0 0 9.28 Off
6049191 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6049083 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6047740 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6047320 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6046795 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6046006 DELETE (all) xxxxdb LC Wait 10 0 0 9.28 Off
6045847 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6042456 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6020885 SELECT xxxxdb DR Not Wait 0 0 9.28 Off
6019242 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
5974183 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
附件:
af.txt (6.3 KB)
收起af文件中的onstat -g sql 拉出来看下;af文件前200行也可以贴出来看下。
收起