TSM level 1级备份时报ANS1235E错误-案例分享
TSM level 1级备份时报ANS1235E错误
问题描述:
因生产库的数据量急剧增大,完全备份耗时,故将原有的每日完全备份修改为工作日做增量备份(level 1)及周末做完全备份(level 0)的方式,运行level0级备份和完全备份时,备份正常,但在运行level 1级备份时则会报错,错误如下:
Recovery Manager: Release 10.2.0.3.0 - Production on Sun Jan 20 23:58:40 2008
Copyright (c) 1982, 2005, Oracle. All rights reserved.
RMAN> connect catalog *
2> connect target *
3> run {
4> allocate channel t1 type sbt;
5> allocate channel t2 type sbt;
6> send 'ENV=(TDPO_OPTFILE=/usr/tivoli/tsm/client/oracle/bin64/tdpo.opt)';
7> backup incremental level 1 cumulative
8> format 'qzpoais_full_%T_%t_%U'database;
9> sql 'alter system archive log current';
10> backup format 'qzpoais_arhc_%T_%t_%U' archivelog all delete all input;
11> release channel t1;
12> release channel t2;
13> }
14>
15>
16>
connected to recovery catalog database
connected to target database: QZPOAIS (DBID=1075906752)
starting full resync of recovery catalog
full resync complete
allocated channel: t1
channel t1: sid=1035 instance=qzpoais1 devtype=SBT_TAPE
channel t1: Data Protection for Oracle: version 5.4.1.0
allocated channel: t2
channel t2: sid=1070 instance=qzpoais1 devtype=SBT_TAPE
channel t2: Data Protection for Oracle: version 5.4.1.0
sent command to channel: t1
sent command to channel: t2
Starting backup at 01/20/2008 23:58:51
channel t1: starting incremental level 1 datafile backupset
channel t1: specifying datafile(s) in backupset
input datafile fno=00216 name=+DATA/qzpoais/datafile/sm2100001.dbf
input datafile fno=00217 name=+DATA/qzpoais/datafile/sm2100002.dbf
input datafile fno=00220 name=+DATA/qzpoais/datafile/sm2100005.dbf
input datafile fno=00223 name=+DATA/qzpoais/datafile/sm2100008.dbf
input datafile fno=00226 name=+DATA/qzpoais/datafile/sm2100011.dbf
input datafile fno=00229 name=+DATA/qzpoais/datafile/sm2100014.dbf
input datafile fno=00232 name=+DATA/qzpoais/datafile/sm2100017.dbf
input datafile fno=00236 name=+DATA/qzpoais/datafile/sm2100021.dbf
input datafile fno=00240 name=+DATA/qzpoais/datafile/sm2100025.dbf
input datafile fno=00244 name=+DATA/qzpoais/datafile/sm2100029.dbf
input datafile fno=00009 name=+DATA/qzpoais/datafile/index_data001.dbf
input datafile fno=00185 name=+DATA/qzpoais/datafile/sjzh_data052.dbf
input datafile fno=00041 name=+DATA/qzpoais/datafile/index_data004.dbf
input datafile fno=00212 name=+DATA/qzpoais/datafile/sjzh_data079.dbf
input datafile fno=00013 name=+DATA/qzpoais/datafile/sjzh_data001.dbf
input datafile fno=00017 name=+DATA/qzpoais/datafile/rk_data003.dbf
input datafile fno=00021 name=+DATA/qzpoais/datafile/rk_data007.dbf
input datafile fno=00025 name=+DATA/qzpoais/datafile/rk_data011.dbf
input datafile fno=00029 name=+DATA/qzpoais/datafile/rk_data015.dbf
input datafile fno=00033 name=+DATA/qzpoais/datafile/rk_data019.dbf
input datafile fno=00037 name=+DATA/qzpoais/datafile/jcyw_data004.dbf
input datafile fno=00045 name=+DATA/qzpoais/datafile/zfba_data004.dbf
input datafile fno=00049 name=+DATA/qzpoais/datafile/sjzh_data004.dbf
input datafile fno=00053 name=+DATA/qzpoais/datafile/sjzh_data008.dbf
input datafile fno=00057 name=+DATA/qzpoais/datafile/sjzh_data012.dbf
input datafile fno=00061 name=+DATA/qzpoais/datafile/sjzh_data016.dbf
input datafile fno=00065 name=+DATA/qzpoais/datafile/sjzh_data020.dbf
input datafile fno=00069 name=+DATA/qzpoais/datafile/rk_photo005.dbf
input datafile fno=00073 name=+DATA/qzpoais/datafile/rk_photo009.dbf
input datafile fno=00077 name=+DATA/qzpoais/datafile/rk_photo013.dbf
input datafile fno=00081 name=+DATA/qzpoais/datafile/rk_photo017.dbf
input datafile fno=00085 name=+DATA/qzpoais/datafile/rk_photo021.dbf
input datafile fno=00089 name=+DATA/qzpoais/datafile/rk_photo025.dbf
input datafile fno=00093 name=+DATA/qzpoais/datafile/rk_photo029.dbf
input datafile fno=00097 name=+DATA/qzpoais/datafile/rk_photo033.dbf
input datafile fno=00101 name=+DATA/qzpoais/datafile/rk_photo037.dbf
input datafile fno=00105 name=+DATA/qzpoais/datafile/rk_photo041.dbf
input datafile fno=00109 name=+DATA/qzpoais/datafile/rk_photo045.dbf
input datafile fno=00113 name=+DATA/qzpoais/datafile/rk_photo049.dbf
input datafile fno=00117 name=+DATA/qzpoais/datafile/rk_photo053.dbf
input datafile fno=00121 name=+DATA/qzpoais/datafile/rk_photo057.dbf
input datafile fno=00125 name=+DATA/qzpoais/datafile/rk_photo061.dbf
input datafile fno=00129 name=+DATA/qzpoais/datafile/rk_photo065.dbf
input datafile fno=00133 name=+DATA/qzpoais/datafile/rk_photo069.dbf
input datafile fno=00137 name=+DATA/qzpoais/datafile/sjzh_data023.dbf
input datafile fno=00141 name=+DATA/qzpoais/datafile/sjzh_data027.dbf
input datafile fno=00146 name=+DATA/qzpoais/datafile/rk_data022.dbf
input datafile fno=00150 name=+DATA/qzpoais/datafile/rk_data026.dbf
input datafile fno=00154 name=+DATA/qzpoais/datafile/rk_data030.dbf
input datafile fno=00158 name=+DATA/qzpoais/datafile/rk_photo073.dbf
input datafile fno=00165 name=+DATA/qzpoais/datafile/sjzh_data032.dbf
input datafile fno=00169 name=+DATA/qzpoais/datafile/sjzh_data036.dbf
input datafile fno=00173 name=+DATA/qzpoais/datafile/sjzh_data040.dbf
input datafile fno=00177 name=+DATA/qzpoais/datafile/sjzh_data044.dbf
input datafile fno=00181 name=+DATA/qzpoais/datafile/sjzh_data048.dbf
input datafile fno=00187 name=+DATA/qzpoais/datafile/sjzh_data054.dbf
input datafile fno=00192 name=+DATA/qzpoais/datafile/sjzh_data059.dbf
input datafile fno=00198 name=+DATA/qzpoais/datafile/sjzh_data065.dbf
input datafile fno=00202 name=+DATA/qzpoais/datafile/sjzh_data069.dbf
input datafile fno=00206 name=+DATA/qzpoais/datafile/sjzh_data073.dbf
input datafile fno=00211 name=+DATA/qzpoais/datafile/sjzh_data078.dbf
input datafile fno=00214 name=+DATA/qzpoais/datafile/index_data006.dbf
input datafile fno=00005 name=+DATA/qzpoais/datafile/users.267.636130077
input datafile fno=00215 name=+DATA/qzpoais/datafile/index_data007.dbf
channel t1: starting piece 1 at 01/20/2008 23:58:54
channel t2: starting incremental level 1 datafile backupset
channel t2: specifying datafile(s) in backupset
input datafile fno=00002 name=+DATA/qzpoais/datafile/undotbs1.263.636130069
input datafile fno=00234 name=+DATA/qzpoais/datafile/sm2100019.dbf
input datafile fno=00238 name=+DATA/qzpoais/datafile/sm2100023.dbf
input datafile fno=00242 name=+DATA/qzpoais/datafile/sm2100027.dbf
input datafile fno=00246 name=+DATA/qzpoais/datafile/sm2100031.dbf
input datafile fno=00040 name=+DATA/qzpoais/datafile/index_data003.dbf
input datafile fno=00188 name=+DATA/qzpoais/datafile/sjzh_data055.dbf
input datafile fno=00208 name=+DATA/qzpoais/datafile/sjzh_data075.dbf
input datafile fno=00007 name=+DATA/qzpoais/datafile/rk_photo001.dbf
input datafile fno=00011 name=+DATA/qzpoais/datafile/pub_data001.dbf
input datafile fno=00015 name=+DATA/qzpoais/datafile/jcyw_data001.dbf
input datafile fno=00019 name=+DATA/qzpoais/datafile/rk_data005.dbf
input datafile fno=00023 name=+DATA/qzpoais/datafile/rk_data009.dbf
input datafile fno=00027 name=+DATA/qzpoais/datafile/rk_data013.dbf
input datafile fno=00031 name=+DATA/qzpoais/datafile/rk_data017.dbf
input datafile fno=00035 name=+DATA/qzpoais/datafile/jcyw_data002.dbf
input datafile fno=00043 name=+DATA/qzpoais/datafile/zfba_data002.dbf
input datafile fno=00047 name=+DATA/qzpoais/datafile/sjzh_data002.dbf
input datafile fno=00051 name=+DATA/qzpoais/datafile/sjzh_data006.dbf
input datafile fno=00055 name=+DATA/qzpoais/datafile/sjzh_data010.dbf
input datafile fno=00059 name=+DATA/qzpoais/datafile/sjzh_data014.dbf
input datafile fno=00063 name=+DATA/qzpoais/datafile/sjzh_data018.dbf
input datafile fno=00067 name=+DATA/qzpoais/datafile/rk_photo003.dbf
input datafile fno=00071 name=+DATA/qzpoais/datafile/rk_photo007.dbf
input datafile fno=00075 name=+DATA/qzpoais/datafile/rk_photo011.dbf
input datafile fno=00079 name=+DATA/qzpoais/datafile/rk_photo015.dbf
input datafile fno=00083 name=+DATA/qzpoais/datafile/rk_photo019.dbf
input datafile fno=00087 name=+DATA/qzpoais/datafile/rk_photo023.dbf
input datafile fno=00091 name=+DATA/qzpoais/datafile/rk_photo027.dbf
input datafile fno=00095 name=+DATA/qzpoais/datafile/rk_photo031.dbf
input datafile fno=00099 name=+DATA/qzpoais/datafile/rk_photo035.dbf
input datafile fno=00103 name=+DATA/qzpoais/datafile/rk_photo039.dbf
input datafile fno=00107 name=+DATA/qzpoais/datafile/rk_photo043.dbf
input datafile fno=00111 name=+DATA/qzpoais/datafile/rk_photo047.dbf
input datafile fno=00115 name=+DATA/qzpoais/datafile/rk_photo051.dbf
input datafile fno=00119 name=+DATA/qzpoais/datafile/rk_photo055.dbf
input datafile fno=00123 name=+DATA/qzpoais/datafile/rk_photo059.dbf
input datafile fno=00127 name=+DATA/qzpoais/datafile/rk_photo063.dbf
input datafile fno=00131 name=+DATA/qzpoais/datafile/rk_photo067.dbf
input datafile fno=00135 name=+DATA/qzpoais/datafile/sjzh_data021.dbf
input datafile fno=00139 name=+DATA/qzpoais/datafile/sjzh_data025.dbf
input datafile fno=00144 name=+DATA/qzpoais/datafile/sjzh_data030.dbf
input datafile fno=00148 name=+DATA/qzpoais/datafile/rk_data024.dbf
input datafile fno=00152 name=+DATA/qzpoais/datafile/rk_data028.dbf
input datafile fno=00156 name=+DATA/qzpoais/datafile/rk_photo071.dbf
input datafile fno=00160 name=+DATA/qzpoais/datafile/rk_photo075.dbf
input datafile fno=00167 name=+DATA/qzpoais/datafile/sjzh_data034.dbf
input datafile fno=00171 name=+DATA/qzpoais/datafile/sjzh_data038.dbf
input datafile fno=00175 name=+DATA/qzpoais/datafile/sjzh_data042.dbf
input datafile fno=00179 name=+DATA/qzpoais/datafile/sjzh_data046.dbf
input datafile fno=00183 name=+DATA/qzpoais/datafile/sjzh_data050.dbf
input datafile fno=00190 name=+DATA/qzpoais/datafile/sjzh_data057.dbf
input datafile fno=00194 name=+DATA/qzpoais/datafile/sjzh_data061.dbf
input datafile fno=00200 name=+DATA/qzpoais/datafile/sjzh_data067.dbf
input datafile fno=00204 name=+DATA/qzpoais/datafile/sjzh_data071.dbf
input datafile fno=00209 name=+DATA/qzpoais/datafile/sjzh_data076.dbf
input datafile fno=00162 name=+DATA/qzpoais/datafile/pub_data003.dbf
input datafile fno=00001 name=+DATA/qzpoais/datafile/system.262.636130061
channel t2: starting piece 1 at 01/20/2008 23:58:54
RMAN-03009: failure of backup command on t1 channel at 01/21/2008 00:06:50
ORA-19502: write error on file "qzpoais_full_20080120_644543934_mjj6ltdu_1_1", blockno 271873 (blocksize=512)
ORA-27030: skgfwrt: sbtwrite2 returned error
ORA-19511: Error received from media manager layer, error text:
ANS1235E (RC-72) An unknown system error has occurred from which TSM cannot recover.
channel t1 disabled, job failed on it will be run on another channel
released channel: t1
released channel: t2
RMAN-00571: ===========================================================
RMAN-00569: =============== ERROR MESSAGE STACK FOLLOWS ===============
RMAN-00571: ===========================================================
RMAN-03009: failure of backup command on t2 channel at 01/21/2008 00:09:15
ORA-19502: write error on file "qzpoais_full_20080120_644543934_mkj6ltdu_1_1", blockno 1083393 (blocksize=512)
ORA-27030: skgfwrt: sbtwrite2 returned error
ORA-19511: Error received from media manager layer, error text:
ANS1235E (RC-72) An unknown system error has occurred from which TSM cannot recover.
Recovery Manager complete.
问题原因:
根据日志,错误在T1和T2通道上均会出现,且同一时间在其它两个数据库做Level 1级备份都能成功,此数据库与其它两数据库的差别在于数据库不在同一量级,查询如下:
1.报错数据库的使用空间计算:
SQL> SELECT A.DF "Data Files Size in MB"
2 ,B.TF "Temp Files Size in MB"
3 ,C.LF "Log Files Size in MB"
4 ,A.DF+B.TF+C.LF "Total Size"
5 FROM (SELECT SUM(BYTES/(1024*1024)) DF
6 FROM DBA_DATA_FILES ) A,
7 (SELECT SUM(BYTES/(1024*1024)) TF
8 FROM DBA_TEMP_FILES ) B,
9 (SELECT SUM(BYTES/(1024*1024)) LF
10 FROM V$LOG ) C;
Data Files Size in MB Temp Files Size in MB Log Files Size in MB Total Size
--------------------- --------------------- -------------------- ----------
601913 22528 600 625041
2.其余两个数据库的使用空间计算:
SQL> SELECT A.DF "Data Files Size in MB"
2 ,B.TF "Temp Files Size in MB"
3 ,C.LF "Log Files Size in MB"
4 ,A.DF+B.TF+C.LF "Total Size"
5 FROM (SELECT SUM(BYTES/(1024*1024)) DF
6 FROM DBA_DATA_FILES ) A,
7 (SELECT SUM(BYTES/(1024*1024)) TF
8 FROM DBA_TEMP_FILES ) B,
9 (SELECT SUM(BYTES/(1024*1024)) LF
10 FROM V$LOG ) C;
Data Files Size in MB Temp Files Size in MB Log Files Size in MB Total Size
--------------------- --------------------- -------------------- ----------
2741.25 131 600 3472.25
SQL> SELECT A.DF "Data Files Size in MB"
2 ,B.TF "Temp Files Size in MB"
3 ,C.LF "Log Files Size in MB"
4 ,A.DF+B.TF+C.LF "Total Size"
5 FROM (SELECT SUM(BYTES/(1024*1024)) DF
6 FROM DBA_DATA_FILES ) A,
7 (SELECT SUM(BYTES/(1024*1024)) TF
8 FROM DBA_TEMP_FILES ) B,
9 (SELECT SUM(BYTES/(1024*1024)) LF
10 FROM V$LOG ) C;
Data Files Size in MB Temp Files Size in MB Log Files Size in MB Total Size
--------------------- --------------------- -------------------- ----------
103435 549 600 104584
经反复确认,问题应是LEVEL 1备份时会对数据文件进行检查(在数据库较大时也更为耗时),而导致TSM Session超时.
解决方法:
影响TSM Session超时时间的是dsmserv.opt文件中的commtimeout参数,其默认值为60秒,通过增加该参数值,可解决问题(如设置为600秒),最后还需重启TSM Server才会生效.
