AIX 6100-09-09-1717宕机重启如何分析kdump?

(37)> status
CPU INTR TID TSLOT PID PSLOT PROC_NAME
0 27E00D9 638 19E0068 414 mediation
1 37007B 55 F002A 15 wait
2 38007D 56 10002C 16 wait
3 39007F 57 11002E 17 wait
4 3450099 837 12500F0 293 cdr_rating
5 1F500E9 501 580052 88 billsum
6 3D0087 61 140034 20 wait
7 3E0089 62 150036 21 wait
8 3F008B 63 160038 22 wait
9 1A601B9 2470 1AF016C 1455 cdr_rating
10 41008F 65 18003C 24 wait
11 420091 66 19003E 25 wait
12 430093 67 1A0040 26 wait
13 440095 68 1B0042 27 wait
14 450097 69 1C0044 28 wait
15 460099 70 1D0046 29 wait
16 47009B 71 1E0048 30 wait
17 48009D 72 1F004A 31 wait
18 49009F 73 20004C 32 wait
19 4A00A1 74 21004E 33 wait
20 4B00A3 75 220050 34 wait
21 4C00A5 76 230052 35 wait
22 4D00A7 77 240054 36 wait
23 4E00A9 78 250056 37 wait
24 4F00AB 79 260058 38 wait
25 5000AD 80 27005A 39 wait
26 5100AF 81 28005C 40 wait
27 5200B1 82 29005E 41 wait
28 1A300EB 419 6002F4 2144 recycle
29 5400B5 84 2B0062 43 wait
30 5500B7 85 2C0064 44 wait
31 5600B9 86 2D0066 45 wait
32 1900193 2448 16303B4 3427 cdrfilter
33 301BD 2051 3016A 1027 wait
34 401BF 2052 4016C 1028 wait
35 501C1 2053 5016E 1029 wait
36 601C3 2054 60170 1030 wait
37 CE0241 4302 2D02FA 2093 inetd
38 801C7 2056 80174 1032 wait

(37)> stat
SYSTEM_CONFIGURATION:
CHRP_SMP_PCI POWER_PC POWER_7 machine with 128 available CPU(s) (64-bit registers)

SYSTEM STATUS:
sysname... AIX
release... 1
version... 6
build date Mar 20 2017
build time 15:50:44
label..... 1712A_61k
nid....... F80ACA4C
time of crash: Sat Nov 24 12:46:26 2018
age of system: 66 day, 20 hr., 31 min., 14 sec.
xmalloc debug: enabled
FRRs active... 0
FRRs started.. 0

CRASH INFORMATION:
CPU 37 CSA F00000002FF47600 at time of crash, error code for LEDs: 30000000
pvthread+10CE00 STACK:
[0465FB2C]isTerminated__7ProcessFv+00000C (0100000000000000)
[0469C99C]GetOrphanedProcesses__13ProcessCommonFPvP11_LIST_ENTRYT2+00009C (F00000002FF47070, F1000A002953FB20,
F00000002FF47078)
[0469CBE4]DeleteOrphanedProcesses__13ProcessCommonFv+000084 ()
[0469CD6C]DeleteOrphanedProcesses+00000C ()
[046905FC]hook_fork+00005C (0000000001790384)
[046906A4]afproc_callback+000044 (00000000046B1908, 0000000200000002,
0000000001790384)
[000E9F88]prochcall+000268 (??, ??, ??, ??)
[00250174]fork_common+000B74 (??, ??, ??)
[0024F55C]kforkx+00001C ()
[00497A40]kfork+000088 ()
[kdb_get_virtual_memory] no real storage @ FFFFFFFF3FFFE60
[kdb_read_mem] no real storage @ FFFFFFFFFFF6190

(37)> vmstat

VMM Statistics:

page faults (pgexct)........ 05D99741 page reclaims(pgrclm)........ 00000000
lockmisses (lockexct)........ 00000000 backtracks (backtrks)........ D61CB203
pages paged in............... 7334F556 pages paged out.............. 2A39E55C
paging space page ins........ 00000000 paging space page out........ 00000000
start I/Os (numsios)........ 9D76A34C iodones (numiodone)........ 7311DC65
zero filled pages............ D9A2B190 executable filled pgs........ 000A1064
pager pages examined......... E79EADAC pager clock hand cyc......... 00000000
pager page steals............ 917166F1 free frame waits............. 02654732
extend XPT waits............. 00000000 pending I/O waits............ 06C90455

VMM Statistics:

total virtual pgs (vm_nvirt) : 0000000005F883D6 382.1GB
total paging space used (vm_npgsp) : 000000000003E9E1 1001.9MB

'system' pages (vm_syspgs) : 00000000018FECEC 100.0GB

non-'system' pages (vm_nonsys) : 0000000004EC4307 315.1GB

in use working seg pages (vm_w_use) : 0000000005F883D6 382.1GB
in use persistent pages (vm_p_use) : 0000000000000000 0.0MB
in use client pages (vm_c_use) : 0000000000BA48ED 46.6GB
pinned working seg pages (vm_w_pin) : 0000000001B087CA 108.1GB
pinned persistent pages (vm_p_pin) : 0000000000000000 0.0MB
pinned client pages (vm_c_pin) : 000000000000083B 8.2MB
soft working seg pages (vm_w_soft) : 0000000002952530 165.3GB
total # klock'd pages (vm_klk_tot) : 0000000000000000 0.0MB

pinned klock'd pages (vm_klk_pin) : 0000000000000000 0.0MB

hardware large page size (lgpg_size) : 0000000001000000 16.0MB
total perm frames (4K units) : 0000000000B9DD31 46.5GB
total lru frames (4K units) : 0000000007452330 465.3GB
global system numperm% : 9.9%
numperm_global tunable : 1

total num large pages 0000000000000000 num free large pages. 0000000000000000
lgpg high water cnt.. 0000000000000000 lgpg in-use count.... 0000000000000000

reserved sids...... 0000000000000000 # free rsvd sids..... 0000000000000000

rsvd sids hi-water... 0000000000000000
successful mem guards........ 00000000 failed mem guards............ 00000000

VMM Compressed Memory Information:

true_memsizepgs...... 00000000077C0000 479.0GB
ame_memsizepgs....... 0000000000000000 0.0MB
cmem_cpool_size...... 0000000000000000 0.0MB
cmem_cpool_free...... 0000000000000000 0.0MB
cmem_tot_ncpgs....... 0000000000000000 0.0MB
cmem_tot_csize....... 0000000000000000 0.0MB
cur compression ratio........ 00000000 0.00
cmem_ncomp_ops....... 0000000000000000 cmem_ndecomp_ops... 0000000000000000

VMM Memory Limits:

Total available memory (4K frames) : 077C0000 479.0GB
Total unmanaged mem (wlm_hw_pages): 003697E0 13.6GB

4K number of frames : 0562ACD0 344.7GB
4K frames pinned : 00106775 4.1GB
4K system pinnable frames remaining: 043E8932 271.6GB
4K user pinnable frames remaining : 04332C8C 268.8GB

64K number of frames : 001E2BB5 120.7GB
64K frames pinned : 0016990B 90.4GB
64K system pinnable frames remaining: 000189ED 6.2GB
64K user pinnable frames remaining : 00178455 94.1GB

16M number of frames : 00000000 0.0MB
16M frames pinned : 00000000 0.0MB
16M system pinnable frames remaining: 00000000 0.0MB
16M user pinnable frames remaining : 00000000 0.0MB

16G number of frames : 00000000 0.0MB
16G frames pinned : 00000000 0.0MB
16G system pinnable frames remaining: 00000000 0.0MB
16G user pinnable frames remaining : 00000000 0.0MB

Free paging space (in 4K blocks) : 009C161E 39.0GB
Paging space SIGDANGER level : 00050000 1.3GB
Paging space SIGKILL level : 00014000 320.0MB

(37)> f
pvthread+10CE00 STACK:
[0465FB2C]isTerminated__7ProcessFv+00000C (0100000000000000)
[0469C99C]GetOrphanedProcesses__13ProcessCommonFPvP11_LIST_ENTRYT2+00009C (F00000002FF47070, F1000A002953FB20,
F00000002FF47078)
[0469CBE4]DeleteOrphanedProcesses__13ProcessCommonFv+000084 ()
[0469CD6C]DeleteOrphanedProcesses+00000C ()
[046905FC]hook_fork+00005C (0000000001790384)
[046906A4]afproc_callback+000044 (00000000046B1908, 0000000200000002,
0000000001790384)
[000E9F88]prochcall+000268 (??, ??, ??, ??)
[00250174]fork_common+000B74 (??, ??, ??)
[0024F55C]kforkx+00001C ()
[00497A40]kfork+000088 ()
[kdb_get_virtual_memory] no real storage @ FFFFFFFF3FFFE60
[kdb_read_mem] no real storage @ FFFFFFFFFFF9370

各位大牛,麻烦帮忙看看,kdump看到这里后再怎么分析?

参与6

1同行回答

匿名用户匿名用户
好久不分析了,不知道以下步骤是否还合适?1、打开dump文件2、使用where命令确定导致crash的进程位置3、运行th子命令来确定具体的进程信息4、运行dr子命令确定IAR的值:dr iar5、运行lke子命令来确定具体到哪一个相关的模块:lke iar值6、使用lslpp确定模块所在的软件包:lslpp –...显示全部

好久不分析了,不知道以下步骤是否还合适?
1、打开dump文件
2、使用where命令确定导致crash的进程位置
3、运行th子命令来确定具体的进程信息
4、运行dr子命令确定IAR的值:dr iar
5、运行lke子命令来确定具体到哪一个相关的模块:lke iar值
6、使用lslpp确定模块所在的软件包:lslpp –w 模块名

然后就是根据这个软件包去确认是否存在缺陷,到IBM网站下载相应的补丁进行升级

试试吧,只能帮到这里了^_^

收起
IT咨询服务 · 2018-12-25
浏览2154

提问者

jim
jim006
其它anpuli
擅长领域: 服务器云计算AIX

相关问题

相关资料

相关文章

问题状态

  • 发布时间:2018-11-26
  • 关注会员:3 人
  • 问题浏览:2546
  • 最近回答:2018-12-25
  • X社区推广