环境描述:
window双机 操作系统Windows Server 2003 R2,Oracle10.2.0.1 双机软件RoseHA-8.9
当前双机资源是跑在哪台机器上,共享存储就是在哪台上。
故障描述
1.软件Oracle数据库层面的报错日志
Fri Nov 04 11:35:57 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\udump\oradb_ora_2200.trc:
ORA-00600: ??????, ??: [2662], [276], [1429915056], [276], [1429922193], [8388649], [], []
Fri Nov 04 11:35:58 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\udump\oradb_ora_2200.trc:
ORA-00600: ??????, ??: [2662], [276], [1429915056], [276], [1429922193], [8388649], [], []
Fri Nov 04 11:35:58 2016
Error 600 happened during db open, shutting down database
USER: terminating instance due to error 600
Fri Nov 04 11:35:58 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_pmon_2324.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Fri Nov 04 11:35:58 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_p006_6112.trc:
ORA-00600: internal error code, arguments: [15784], [600], [], [], [], [], [], []
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Fri Nov 04 11:35:58 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_psp0_4924.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Fri Nov 04 11:35:58 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_mman_5572.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Fri Nov 04 11:35:58 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_dbw0_4040.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Fri Nov 04 11:35:58 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_lgwr_6096.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Fri Nov 04 11:35:58 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_ckpt_2428.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Fri Nov 04 11:35:58 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_p005_5924.trc:
ORA-00600: internal error code, arguments: [15784], [600], [], [], [], [], [], []
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Fri Nov 04 11:35:58 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_p000_3888.trc:
ORA-00600: internal error code, arguments: [15784], [600], [], [], [], [], [], []
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Fri Nov 04 11:35:58 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_p004_5796.trc:
ORA-00600: internal error code, arguments: [15784], [600], [], [], [], [], [], []
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Fri Nov 04 11:35:58 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_p001_4268.trc:
ORA-00600: internal error code, arguments: [15784], [600], [], [], [], [], [], []
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Fri Nov 04 11:35:58 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_p002_5656.trc:
ORA-00600: internal error code, arguments: [15784], [600], [], [], [], [], [], []
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Fri Nov 04 11:35:58 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_p003_5156.trc:
ORA-00600: internal error code, arguments: [15784], [600], [], [], [], [], [], []
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Fri Nov 04 11:36:07 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_reco_4568.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Fri Nov 04 11:36:16 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_smon_5436.trc:
ORA-00600: internal error code, arguments: [], [], [], [], [], [], [], []
Fri Nov 04 11:36:17 2016
Instance terminated by USER, pid = 2200
ORA-1092 signalled during: alter database open...
Fri Nov 04 11:41:17 2016
USER: terminating instance due to error 1092
Instance terminated by USER, pid = 2200
Sat Nov 05 14:57:23 2016
alter database recover datafile list clear
Sat Nov 05 14:57:23 2016
Completed: alter database recover datafile list clear
Sat Nov 05 14:57:23 2016
alter database recover if needed
datafile 3
Media Recovery Start
parallel recovery started with 7 processes
Sat Nov 05 14:57:24 2016
Recovery of Online Redo Log: Thread 1 Group 1 Seq 131318 Reading mem 0
Mem# 0 errs 0: E:\ORACLE\PRODUCT\10.2.0\ORADATA\ORADB\REDO01.LOG
Completed: alter database recover if needed
datafile 3
Sat Nov 05 14:57:59 2016
alter database recover datafile list clear
Sat Nov 05 14:57:59 2016
Completed: alter database recover datafile list clear
Sat Nov 05 14:57:59 2016
alter database recover datafile list
1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 , 16 , 17 , 18 , 19 , 20
Completed: alter database recover datafile list
1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 , 16 , 17 , 18 , 19 , 20
Sat Nov 05 14:57:59 2016
alter database recover datafile list
21 , 22 , 23 , 24 , 25 , 26
Completed: alter database recover datafile list
21 , 22 , 23 , 24 , 25 , 26
Sat Nov 05 14:57:59 2016
alter database recover if needed
start
Media Recovery Start
parallel recovery started with 7 processes
Sat Nov 05 14:58:00 2016
Recovery of Online Redo Log: Thread 1 Group 1 Seq 131318 Reading mem 0
Mem# 0 errs 0: E:\ORACLE\PRODUCT\10.2.0\ORADATA\ORADB\REDO01.LOG
Completed: alter database recover if needed
start
Sat Nov 05 15:01:24 2016
alter database open
Sat Nov 05 15:01:24 2016
Beginning crash recovery of 1 threads
parallel recovery started with 7 processes
Sat Nov 05 15:01:24 2016
Started redo scan
Sat Nov 05 15:01:24 2016
Completed redo scan
5 redo blocks read, 0 data blocks need recovery
Sat Nov 05 15:01:24 2016
Started redo application at
Thread 1: logseq 131318, block 2, scn 1186840888744
Sat Nov 05 15:01:24 2016
Recovery of Online Redo Log: Thread 1 Group 1 Seq 131318 Reading mem 0
Mem# 0 errs 0: E:\ORACLE\PRODUCT\10.2.0\ORADATA\ORADB\REDO01.LOG
Sat Nov 05 15:01:24 2016
Completed redo application
Sat Nov 05 15:01:24 2016
Completed crash recovery at
Thread 1: logseq 131318, block 7, scn 1186840908751
0 data blocks read, 0 data blocks written, 5 redo blocks read
Sat Nov 05 15:01:24 2016
LGWR: STARTING ARCH PROCESSES
ARC0 started with pid=26, OS id=164
Sat Nov 05 15:01:25 2016
ARC0: Archival started
ARC1 started with pid=27, OS id=5056
Sat Nov 05 15:01:25 2016
ARC1: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
Thread 1 advanced to log sequence 131319
Thread 1 opened at log sequence 131319
Current log# 2 seq# 131319 mem# 0: E:\ORACLE\PRODUCT\10.2.0\ORADATA\ORADB\REDO02.LOG
Successful open of redo thread 1
Sat Nov 05 15:01:25 2016
ARC0: STARTING ARCH PROCESSES
Sat Nov 05 15:01:25 2016
MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
Sat Nov 05 15:01:25 2016
ARC1: Becoming the 'no FAL' ARCH
ARC1: Becoming the 'no SRL' ARCH
Sat Nov 05 15:01:25 2016
ARC2: Archival started
ARC0: STARTING ARCH PROCESSES COMPLETE
ARC0: Becoming the heartbeat ARCH
ARC2 started with pid=28, OS id=4092
Sat Nov 05 15:01:25 2016
SMON: enabling cache recovery
Sat Nov 05 15:01:25 2016
ARC1: Warning. Log sequence in archive filename wrapped
to fix length as indicated by %S in LOG_ARCHIVE_FORMAT.
Old log archive with same name might be overwritten.
Sat Nov 05 15:01:25 2016
Successfully onlined Undo Tablespace 1.
Sat Nov 05 15:01:25 2016
SMON: enabling tx recovery
Sat Nov 05 15:01:26 2016
Database Characterset is ZHS16GBK
Sat Nov 05 15:01:26 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_p013_292.trc:
ORA-00600: internal error code, arguments: [ktugru2], [], [], [], [], [], [], []
Sat Nov 05 15:01:26 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\udump\oradb_ora_4532.trc:
ORA-00600: 内部错误代码, 参数: [4193], [961], [22341], [], [], [], [], []
Doing block recovery for file 2 block 259
Block recovery from logseq 131319, block 54 to scn 1186840908810
Sat Nov 05 15:01:32 2016
Recovery of Online Redo Log: Thread 1 Group 2 Seq 131319 Reading mem 0
Mem# 0 errs 0: E:\ORACLE\PRODUCT\10.2.0\ORADATA\ORADB\REDO02.LOG
Block recovery stopped at EOT rba 131319.168.16
Block recovery completed at rba 131319.168.16, scn 276.1429935112
Doing block recovery for file 2 block 137
Block recovery from logseq 131319, block 54 to scn 1186840908807
Sat Nov 05 15:01:32 2016
Recovery of Online Redo Log: Thread 1 Group 2 Seq 131319 Reading mem 0
Mem# 0 errs 0: E:\ORACLE\PRODUCT\10.2.0\ORADATA\ORADB\REDO02.LOG
Block recovery completed at rba 131319.168.16, scn 276.1429935112
Sat Nov 05 15:01:32 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\udump\oradb_ora_4532.trc:
ORA-00600: 内部错误代码, 参数: [4193], [961], [22341], [], [], [], [], []
DEBUG: Replaying xcb 0x4e1c2404, pmd 0x4e3259f8 for failed op 8
Doing block recovery for file 2 block 259
Block recovery from logseq 131319, block 54 to scn 1186840908810
Sat Nov 05 15:01:37 2016
Recovery of Online Redo Log: Thread 1 Group 2 Seq 131319 Reading mem 0
Mem# 0 errs 0: E:\ORACLE\PRODUCT\10.2.0\ORADATA\ORADB\REDO02.LOG
Block recovery stopped at EOT rba 131319.168.16
Block recovery completed at rba 131319.168.16, scn 276.1429935112
Sat Nov 05 15:02:55 2016
SMON: Restarting fast_start parallel rollback
Sat Nov 05 15:03:08 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\udump\oradb_ora_4532.trc:
ORA-00600: 内部错误代码, 参数: [4193], [961], [22341], [], [], [], [], []
ORA-00600: 内部错误代码, 参数: [4193], [961], [22341], [], [], [], [], []
Sat Nov 05 15:03:10 2016
DEBUG: Replaying xcb 0x4e1c2404, pmd 0x4e3259f8 for failed op 8
Doing block recovery for file 2 block 259
Block recovery from logseq 131319, block 54 to scn 1186840908810
Sat Nov 05 15:03:10 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\udump\oradb_ora_4532.trc:
ORA-00600: 内部错误代码, 参数: [4193], [961], [22341], [], [], [], [], []
ORA-00600: 内部错误代码, 参数: [4193], [961], [22341], [], [], [], [], []
Sat Nov 05 15:03:10 2016
Recovery of Online Redo Log: Thread 1 Group 2 Seq 131319 Reading mem 0
Mem# 0 errs 0: E:\ORACLE\PRODUCT\10.2.0\ORADATA\ORADB\REDO02.LOG
Block recovery stopped at EOT rba 131319.168.16
Block recovery completed at rba 131319.168.16, scn 276.1429935112
Sat Nov 05 15:03:14 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\udump\oradb_ora_4532.trc:
ORA-00603: ORACLE server session terminated by fatal error
ORA-00600: internal error code, arguments: [4193], [961], [22341], [], [], [], [], []
ORA-00600: internal error code, arguments: [4193], [961], [22341], [], [], [], [], []
Sat Nov 05 15:04:14 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_smon_5360.trc:
ORA-00600: internal error code, arguments: [4193], [961], [22341], [], [], [], [], []
Sat Nov 05 15:04:17 2016
DEBUG: Replaying xcb 0x4e1c2404, pmd 0x4e3259f8 for failed op 8
Doing block recovery for file 2 block 259
Sat Nov 05 15:04:17 2016
Fatal internal error happened while SMON was doing active transaction recovery.
Sat Nov 05 15:04:17 2016
Block recovery from logseq 131319, block 54 to scn 1186840908810
Sat Nov 05 15:04:17 2016
Recovery of Online Redo Log: Thread 1 Group 2 Seq 131319 Reading mem 0
Mem# 0 errs 0: E:\ORACLE\PRODUCT\10.2.0\ORADATA\ORADB\REDO02.LOG
Sat Nov 05 15:04:17 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_smon_5360.trc:
ORA-00600: internal error code, arguments: [4193], [961], [22341], [], [], [], [], []
Sat Nov 05 15:04:17 2016
SMON: terminating instance due to error 474
Sat Nov 05 15:04:18 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_ckpt_2248.trc:
ORA-00474: SMON process terminated with error
Sat Nov 05 15:04:19 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_lgwr_6048.trc:
ORA-00474: SMON process terminated with error
Sat Nov 05 15:04:19 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_psp0_4804.trc:
ORA-00474: SMON process terminated with error
Sat Nov 05 15:04:19 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_mman_4640.trc:
ORA-00474: SMON process terminated with error
Sat Nov 05 15:04:19 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_dbw0_600.trc:
ORA-00474: SMON process terminated with error
Sat Nov 05 15:04:25 2016
Errors in file e:\oracle\product\10.2.0\admin\oradb\bdump\oradb_reco_4208.trc:
ORA-00474: SMON process terminated with error
Sat Nov 05 15:04:41 2016
Instance terminated by SMON, pid = 5360
2.操作系统报错
3.存储情况
10块盘做Raid5,目前有3块盘损坏,已经更换一块,热备盘数量不明。
目前情况
目前数据库只能启动到加载状态,通过rman检查逻辑坏块没有发现坏块,使用DBV命令查看物理坏块没有发现坏块。但是启动数据库共享存储就自己掉了。
请问如何解决。