请教：C5C09FFA报错，页面空间不足，但物理内存还有剩余
这几天小机频繁报错C5C09FFA，导致业务经常中断。通过errpt -aj C5C09FFA提示pg不足，看了下pg使用率将近50%，但是物理内存只用了70%左右，不知道是什么情况？
/home/dbcheck@smc$errpt
IDENTIFIER TIMESTAMP T C RESOURCE_NAME DESCRIPTION
C5C09FFA 1219020012 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1219020012 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1219020012 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1219020012 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1219020012 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
AA8AB241 1219015812 T O clstrmgrDANGER OPERATOR NOTIFICATION
AA8AB241 1219001412 T O clstrmgrDANGER OPERATOR NOTIFICATION
C5C09FFA 1218234812 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234812 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234812 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234712 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234712 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234712 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234712 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234412 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234412 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234412 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
AA8AB241 1218234212 T O clstrmgrDANGER OPERATOR NOTIFICATION
/home/dbcheck@smc$errpt -aj C5C09FFA |pg
---------------------------------------------------------------------------
LABEL: PGSP_KILL
IDENTIFIER: C5C09FFA
Date/Time: Wed Dec 19 02:00:34 BEIST 2012
Sequence Number: 62573
Machine Id: 00C92EB24C00
Node Id: zzcms
Class: S
Type: PERM
Resource Name: SYSVMM
Description
SOFTWARE PROGRAM ABNORMALLY TERMINATED
Probable Causes
SYSTEM RUNNING OUT OF PAGING SPACE
Failure Causes
INSUFFICIENT PAGING SPACE DEFINED FOR THE SYSTEM
PROGRAM USING EXCESSIVE AMOUNT OF PAGING SPACE
Recommended Actions
DEFINE ADDITIONAL PAGING SPACE
REDUCE PAGING SPACE REQUIREMENTS OF PROGRAM(S)
Detail Data
PROGRAM
oracle
USER'S PROCESS ID:
488252
PROGRAM'S PAGING SPACE USE IN 1KB BLOCKS
3312
---------------------------------------------------------------------------
LABEL: PGSP_KILL
IDENTIFIER: C5C09FFA
Date/Time: Wed Dec 19 02:00:34 BEIST 2012
Sequence Number: 62572
Machine Id: 00C92EB24C00
Node Id: zzcms
Class: S
Type: PERM
Resource Name: SYSVMM
Description
SOFTWARE PROGRAM ABNORMALLY TERMINATED
Probable Causes
SYSTEM RUNNING OUT OF PAGING SPACE
Failure Causes
INSUFFICIENT PAGING SPACE DEFINED FOR THE SYSTEM
PROGRAM USING EXCESSIVE AMOUNT OF PAGING SPACE
Recommended Actions
DEFINE ADDITIONAL PAGING SPACE
REDUCE PAGING SPACE REQUIREMENTS OF PROGRAM(S)
Detail Data
PROGRAM
oracle
USER'S PROCESS ID:
922356
PROGRAM'S PAGING SPACE USE IN 1KB BLOCKS
4288
/home/dbcheck@smc$lsps -a
Page Space Physical Volume Volume Group Size %Used Active Auto Type
hd6 hdisk1 rootvg 8192MB 53 yes yes lv
/home/dbcheck@smc$errpt
IDENTIFIER TIMESTAMP T C RESOURCE_NAME DESCRIPTION
C5C09FFA 1219020012 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1219020012 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1219020012 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1219020012 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1219020012 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
AA8AB241 1219015812 T O clstrmgrDANGER OPERATOR NOTIFICATION
AA8AB241 1219001412 T O clstrmgrDANGER OPERATOR NOTIFICATION
C5C09FFA 1218234812 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234812 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234812 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234712 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234712 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234712 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234712 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234412 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234412 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
C5C09FFA 1218234412 P S SYSVMM SOFTWARE PROGRAM ABNORMALLY TERMINATED
AA8AB241 1218234212 T O clstrmgrDANGER OPERATOR NOTIFICATION
/home/dbcheck@smc$errpt -aj C5C09FFA |pg
---------------------------------------------------------------------------
LABEL: PGSP_KILL
IDENTIFIER: C5C09FFA
Date/Time: Wed Dec 19 02:00:34 BEIST 2012
Sequence Number: 62573
Machine Id: 00C92EB24C00
Node Id: zzcms
Class: S
Type: PERM
Resource Name: SYSVMM
Description
SOFTWARE PROGRAM ABNORMALLY TERMINATED
Probable Causes
SYSTEM RUNNING OUT OF PAGING SPACE
Failure Causes
INSUFFICIENT PAGING SPACE DEFINED FOR THE SYSTEM
PROGRAM USING EXCESSIVE AMOUNT OF PAGING SPACE
Recommended Actions
DEFINE ADDITIONAL PAGING SPACE
REDUCE PAGING SPACE REQUIREMENTS OF PROGRAM(S)
Detail Data
PROGRAM
oracle
USER'S PROCESS ID:
488252
PROGRAM'S PAGING SPACE USE IN 1KB BLOCKS
3312
---------------------------------------------------------------------------
LABEL: PGSP_KILL
IDENTIFIER: C5C09FFA
Date/Time: Wed Dec 19 02:00:34 BEIST 2012
Sequence Number: 62572
Machine Id: 00C92EB24C00
Node Id: zzcms
Class: S
Type: PERM
Resource Name: SYSVMM
Description
SOFTWARE PROGRAM ABNORMALLY TERMINATED
Probable Causes
SYSTEM RUNNING OUT OF PAGING SPACE
Failure Causes
INSUFFICIENT PAGING SPACE DEFINED FOR THE SYSTEM
PROGRAM USING EXCESSIVE AMOUNT OF PAGING SPACE
Recommended Actions
DEFINE ADDITIONAL PAGING SPACE
REDUCE PAGING SPACE REQUIREMENTS OF PROGRAM(S)
Detail Data
PROGRAM
oracle
USER'S PROCESS ID:
922356
PROGRAM'S PAGING SPACE USE IN 1KB BLOCKS
4288
/home/dbcheck@smc$lsps -a
Page Space Physical Volume Volume Group Size %Used Active Auto Type
hd6 hdisk1 rootvg 8192MB 53 yes yes lv
8同行回答
需要更多的数据。
如果没有数据库，需要检查哪些进程在持续累积的使用内存，而不释放；
如果有数据库，分几种情况。
一、oracle，
AIX是什么版本？在6.1下，
#vmo -p -o minperm%=10
#vmo -p -o maxperm%=90
#vmo -p -o maxclient%=90
#vmo -p -o lru_file_repage=0
#vmo -p -o numperm_global=0
#vmo -p -o v_pinshm=1
同时，需要确认oracle的参数：
LOCK_SGA=true；
不能设置 SGA 超过如下 2 个公式的范围：
1、SGA < 总内存*(maxpin%-10%)，如果 maxpin%是 80%的默认值，也就是
maxpin%=80%，则 SGA不能超过总内存的 70%
2、OS 的 pin 住 Oracle 稳定运行的内存总量 < 总内存*(maxpin%-5%)，如
maxpin%是80%的默认值，则 pin住的内存总量，不能超过总内存的 75%
二、其他类型数据库，如DB2，
需要确认：
#vmo -p -o minperm%=10
#vmo -p -o maxperm%=90
#vmo -p -o maxclient%=90
#vmo -p -o lru_file_repage=0
#vmo -p -o numperm_global=0
希望能有帮助。收起
如果没有数据库，需要检查哪些进程在持续累积的使用内存，而不释放；
如果有数据库，分几种情况。
一、oracle，
AIX是什么版本？在6.1下，
#vmo -p -o minperm%=10
#vmo -p -o maxperm%=90
#vmo -p -o maxclient%=90
#vmo -p -o lru_file_repage=0
#vmo -p -o numperm_global=0
#vmo -p -o v_pinshm=1
同时，需要确认oracle的参数：
LOCK_SGA=true；
不能设置 SGA 超过如下 2 个公式的范围：
1、SGA < 总内存*(maxpin%-10%)，如果 maxpin%是 80%的默认值，也就是
maxpin%=80%，则 SGA不能超过总内存的 70%
2、OS 的 pin 住 Oracle 稳定运行的内存总量 < 总内存*(maxpin%-5%)，如
maxpin%是80%的默认值，则 pin住的内存总量，不能超过总内存的 75%
二、其他类型数据库，如DB2，
需要确认：
#vmo -p -o minperm%=10
#vmo -p -o maxperm%=90
#vmo -p -o maxclient%=90
#vmo -p -o lru_file_repage=0
#vmo -p -o numperm_global=0
希望能有帮助。收起
刚刚遇到此问题，重启解决。本想扩容pg 但是客户没让扩。
收起浏览5074