informix 11.7数据库宕机,能否看出什么原因导致的?

online日志,之后重启数据库正常:
05:50:02 Maximum server connections 4321
05:50:02 Checkpoint Statistics - Avg. Txn Block Time 0.005, # Txns blocked 2, Plog used 61568, Llog used 9823

05:50:21 Assert Warning: Memory free block header corruption detected in mt_shm_malloc_segid 8
05:50:21 IBM Informix Dynamic Server Version 11.70.FC8
05:50:21 Who: Session(6087676, informix@::ffff:10.209.14.75, -1, 7000012095cdb08)

    Thread(414982965, sqlexec, 7000011d32026e8, 18)
    File: mtshpool.c Line: 1882

05:50:21 Results: Pool repaired
05:50:21 Action: Please notify IBM Informix Technical Support.
05:50:21 stack trace for pid 5701716 written to /informix/tmp/af.271de41d
05:50:21 See Also: /informix/tmp/af.271de41d
05:50:21 Memory free block header corruption detected in mt_shm_malloc_segid 8
05:50:22 stack trace for pid 5439720 written to /informix/tmp/af.271de41d
05:50:22 Assert Failed: No Exception Handler
05:50:22 IBM Informix Dynamic Server Version 11.70.FC8
05:50:22 Who: Session(6087676, informix@::ffff:10.209.14.75, -1, 7000012095cdb08)

    Thread(414982965, sqlexec, 7000011d32026e8, 31)
    File: mtex.c Line: 490

05:50:22 Results: Exception Caught. Type: MT_EX_OS, Context: mem
05:50:22 Action: Please notify IBM Informix Technical Support.
05:50:22 See Also: /informix/tmp/af.271de41d
05:50:49 Logical Log 85834 Complete, timestamp: 0xdb7c17eb.
05:51:05 Checkpoint Completed: duration was 3 seconds.
05:51:05 Sat Jul 7 - loguniq 85835, logpos 0x72dcf8, timestamp: 0xdb7e1633 Interval: 820687

05:51:05 Maximum server connections 4321
05:51:05 Checkpoint Statistics - Avg. Txn Block Time 0.002, # Txns blocked 7, Plog used 62204, Llog used 8036

05:51:34 mtex.c, line 490, thread 414982965, proc id 5439720, No Exception Handler.
05:51:34 Fatal error in ADM VP at mt.c:14055
05:51:34 Unexpected virtual processor termination, pid = 5439720, exit = 0x100

05:51:34 PANIC: Attempting to bring system down
07:25:42 IBM Informix Dynamic Server Started.
07:25:42 Requested shared memory segment size rounded from 12976481KB to 12976496KB

参与31

4同行回答

informix123informix123产品总监huatech
内存调度失败, 先排查硬件是否有异常抛出,然后检查informix的配置文件显示全部

内存调度失败, 先排查硬件是否有异常抛出,然后检查informix的配置文件

收起
系统集成 · 2018-07-09
浏览5203
zyi74zyi74dbadigital china
附件中是af的前100多行。+++++++++++++++++一共有2000多连接,下面是截取出的正在执行的连接。onstat -g sql6087701 SELECT xxxxdb LC Wait 10 0 0 9.28 Off6087700 SELECT xxxxdb LC Wait 10 0 0 9.28...显示全部

附件中是af的前100多行。
+++++++++++++++++
一共有2000多连接,下面是截取出的正在执行的连接。
onstat -g sql
6087701 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6087700 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6087676 xxxxdb LC Wait 10 0 0 9.28 Off
6087668 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6087542 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6087507 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6087504 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6087503 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6086939 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6086868 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6086726 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6086482 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6086415 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6086379 SELECT xxxxdb DR Wait 10 0 0 9.28 Off
6085513 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6085430 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6085360 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085345 UPDATE xxxxdb DR Wait 10 0 0 9.28 Off
6085329 INSERT xxxxdb DR Wait 10 0 0 9.28 Off
6085324 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085322 UPDATE xxxxdb DR Wait 10 0 0 9.28 Off
6085317 DELETE xxxxdb DR Wait 10 0 0 9.28 Off
6085297 DELETE xxxxdb DR Wait 10 0 0 9.28 Off
6085287 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085280 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085277 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085275 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085273 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085272 INSERT xxxxdb DR Wait 10 0 0 9.28 Off
6085268 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085261 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6085260 INSERT xxxxdb DR Wait 10 0 0 9.28 Off
6084907 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6083959 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6083824 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083819 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083764 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083735 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083705 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083691 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083650 DELETE xxxxdb DR Wait 10 0 0 9.28 Off
6083593 INSERT xxxxdb DR Wait 10 0 0 9.28 Off
6083490 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083471 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6083459 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6083425 UPDATE xxxxdb DR Wait 10 0 0 9.28 Off
6083412 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083369 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083306 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6083295 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6082909 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6082908 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6082907 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6082756 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6082422 DELETE sysmaster LC Wait 10 0 0 9.28 Off
6082282 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6082248 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6080404 INSERT xxxxdb DR Wait 10 0 0 9.28 Off
6080152 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6080151 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6080141 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6080139 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6079183 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6074747 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6071680 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6067892 UPDATE xxxxdb DR Wait 10 0 0 9.28 Off
6065933 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6064908 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6063245 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6063222 UPDATE xxxxdb DR Wait 10 0 0 9.28 Off
6062022 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6061987 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6057499 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6057271 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6057248 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6056869 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6055817 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6055650 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6055455 INSERT xxxxdb LC Wait 10 0 0 9.28 Off
6050919 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6050048 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6050032 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6050021 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6049639 DELETE xxxxdb LC Wait 10 0 0 9.28 Off
6049191 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6049083 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6047740 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6047320 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6046795 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6046006 DELETE (all) xxxxdb LC Wait 10 0 0 9.28 Off
6045847 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
6042456 SELECT xxxxdb LC Not Wait 0 0 9.28 Off
6020885 SELECT xxxxdb DR Not Wait 0 0 9.28 Off
6019242 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
5974183 SELECT xxxxdb LC Wait 10 0 0 9.28 Off

附件:

附件图标af.txt (6.3 KB)

收起
IT咨询服务 · 2018-07-13
浏览5118
  • [此评论已删除]
    2018-07-13
  • onstat -g sql 6087676在af文件看下有没有这个相关的内容。提示是Bad free block,要分析宕机时是否有正在执行业务语句。另外本次宕机是突然发送的还是怎么发生的,是否可以描述一下?宕机前有没有异常关闭过数据库?
    2018-07-19
  • [此评论已删除]
    2018-07-24
  • zyi74  zyi74回复 chenjx583
    宕机是突然发生的,宕机前没有异常关闭数据库。 --下面是6087676信息,6087676 这个session执行的是个select语句,平时一直在执行: session #RSAM total used dynamic id user tty pid hostname threads memory memory explain 6087676 informix - -1 ::ffff:1 1 393216 228552 off tid name rstcb flags curstk status 414982965 sqlexec 7000011d32026e8 ---P--- 9248 running- Memory pools count 2 name class addr totalsize freesize #allocfrag #freefrag 6087676 V 7000012b2ae7040 389120 163856 261 85 6087676*O0 V 7000011ff55e040 4096 808 1 1 name free used name free used overhead 0 6576 scb 0 144 opentable 0 19504 filetable 0 5680 log 0 16536 temprec 0 104608 keys 0 3104 ralloc 0 15456 gentcb 0 1592 ostcb 0 3424 sqscb 0 30744 sql 0 72 sqlparser 0 8336 hashfiletab 0 552 osenv 0 2840 sqtcb 0 8632 fragman 0 336 udr 0 416 sqscb info scb sqscb optofc pdqpriority optcompind directives 7000011c5e321c0 7000012ca3e7028 0 0 0 1 Sess SQL Current Iso Lock SQL ISAM F.E. Id Stmt type Database Lvl Mode ERR ERR Vers Explain 6087676 tnmsdb2 LC Wait 10 0 0 9.28 Off Current SQL statement (8) : select t.ObjectId ObjectId ,
    2018-07-24
chenjx583chenjx583软件开发工程师星火
af文件中的onstat -g sql 拉出来看下;af文件前200行也可以贴出来看下。显示全部

af文件中的onstat -g sql 拉出来看下;af文件前200行也可以贴出来看下。

收起
互联网服务 · 2018-07-12
浏览4963
  • [此评论已删除]
    2018-07-13
  • [此评论已删除]
    2018-07-13
  • [此评论已删除]
    2018-07-13
  • [此评论已删除]
    2018-07-13
  • [此评论已删除]
    2018-07-13
  • [此评论已删除]
    2018-07-13
  • [此评论已删除]
    2018-07-13
  • 一共有2000多连接,下面是截取出的正在执行的连接。 onstat -g sql 6087701 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6087700 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6087676 xxxxdb LC Wait 10 0 0 9.28 Off 6087668 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6087542 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6087507 SELECT xxxxdb LC Not Wait 0 0 9.28 Off 6087504 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6087503 SELECT xxxxdb LC Not Wait 0 0 9.28 Off 6086939 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6086868 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6086726 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6086482 SELECT xxxxdb LC Not Wait 0 0 9.28 Off 6086415 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6086379 SELECT xxxxdb DR Wait 10 0 0 9.28 Off 6085513 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6085430 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6085360 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6085345 UPDATE xxxxdb DR Wait 10 0 0 9.28 Off 6085329 INSERT xxxxdb DR Wait 10 0 0 9.28 Off 6085324 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6085322 UPDATE xxxxdb DR Wait 10 0 0 9.28 Off 6085317 DELETE xxxxdb DR Wait 10 0 0 9.28 Off 6085297 DELETE xxxxdb DR Wait 10 0 0 9.28 Off 6085287 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6085280 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6085277 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6085275 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6085273 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6085272 INSERT xxxxdb DR Wait 10 0 0 9.28 Off 6085268 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6085261 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6085260 INSERT xxxxdb DR Wait 10 0 0 9.28 Off 6084907 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6083959 SELECT xxxxdb LC Not Wait 0 0 9.28 Off 6083824 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6083819 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6083764 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6083735 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6083705 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6083691 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6083650 DELETE xxxxdb DR Wait 10 0 0 9.28 Off 6083593 INSERT xxxxdb DR Wait 10 0 0 9.28 Off 6083490 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6083471 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6083459 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6083425 UPDATE xxxxdb DR Wait 10 0 0 9.28 Off 6083412 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6083369 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6083306 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6083295 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6082909 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6082908 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6082907 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6082756 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6082422 DELETE sysmaster LC Wait 10 0 0 9.28 Off 6082282 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6082248 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6080404 INSERT xxxxdb DR Wait 10 0 0 9.28 Off 6080152 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6080151 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6080141 SELECT xxxxdb LC Not Wait 0 0 9.28 Off 6080139 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6079183 SELECT xxxxdb LC Not Wait 0 0 9.28 Off 6074747 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6071680 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6067892 UPDATE xxxxdb DR Wait 10 0 0 9.28 Off 6065933 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6064908 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6063245 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6063222 UPDATE xxxxdb DR Wait 10 0 0 9.28 Off 6062022 SELECT xxxxdb LC Not Wait 0 0 9.28 Off 6061987 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6057499 SELECT xxxxdb LC Not Wait 0 0 9.28 Off 6057271 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6057248 SELECT xxxxdb LC Not Wait 0 0 9.28 Off 6056869 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6055817 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6055650 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6055455 INSERT xxxxdb LC Wait 10 0 0 9.28 Off 6050919 SELECT xxxxdb LC Not Wait 0 0 9.28 Off 6050048 SELECT xxxxdb LC Not Wait 0 0 9.28 Off 6050032 SELECT xxxxdb LC Not Wait 0 0 9.28 Off 6050021 SELECT xxxxdb LC Not Wait 0 0 9.28 Off 6049639 DELETE xxxxdb LC Wait 10 0 0 9.28 Off 6049191 SELECT xxxxdb LC Not Wait 0 0 9.28 Off 6049083 SELECT xxxxdb LC Not Wait 0 0 9.28 Off 6047740 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6047320 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6046795 SELECT xxxxdb LC Not Wait 0 0 9.28 Off 6046006 DELETE (all) xxxxdb LC Wait 10 0 0 9.28 Off 6045847 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 6042456 SELECT xxxxdb LC Not Wait 0 0 9.28 Off 6020885 SELECT xxxxdb DR Not Wait 0 0 9.28 Off 6019242 SELECT xxxxdb LC Wait 10 0 0 9.28 Off 5974183 SELECT xxxxdb LC Wait 10 0 0 9.28 Off
    2018-07-13
  • 评论里的格式不好,放在回答问题里面了。
    2018-07-13
fatpigfatpig数据库管理员无业
看看 /informix/tmp/af.271de41d文件显示全部

看看 /informix/tmp/af.271de41d文件

收起
畜牧业/渔业 · 2018-07-12
浏览5108
  • 初步看过,但也没找到具体的原因,文件2G大,有什么关键字可以辅助判断吗?多谢!!
    2018-07-12

提问者

zyi74
dbadigital china

相关问题

问题状态

  • 发布时间:2018-07-09
  • 关注会员:4 人
  • 问题浏览:8085
  • 最近回答:2018-07-13
  • X社区推广