联系：手机/微信(+86 17813235971) QQ(107644445)
作者：惜分飞©版权所有[未经本人同意,不得以任何形式转载,否则有进一步追究法律责任的权利.]
数据库版本10.2.0.3 32位
SQL> select * from v$version; BANNER ---------------------------------------------------------------- Oracle Database 10g Enterprise Edition Release 10.2.0.3.0 - Prod PL/SQL Release 10.2.0.3.0 - Production CORE 10.2.0.3.0 Production TNS for 32-bit Windows: Version 10.2.0.3.0 - Production NLSRTL Version 10.2.0.3.0 - Production
数据库启动alert日志报大量ORA-600和ORA-07445错误
Tue Jul 31 09:56:45 2018 Started redo application at Thread 1: logseq 7593, block 46691 Tue Jul 31 09:56:45 2018 Recovery of Online Redo Log: Thread 1 Group 2 Seq 7593 Reading mem 0 Mem# 0: E:\ORACLE\PRODUCT\10.2.0\ORADATA\ORCL\REDO02.LOG Tue Jul 31 09:56:45 2018 RECOVERY OF THREAD 1 STUCK AT BLOCK 779 OF FILE 2 Tue Jul 31 09:56:45 2018 RECOVERY OF THREAD 1 STUCK AT BLOCK 4430 OF FILE 2 Tue Jul 31 09:56:45 2018 Hex dump of (file 3, block 23704) in trace file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_p002_248.trc Corrupt block relative dba: 0x00c05c98 (file 3, block 23704) Fractured block found during crash/instance recovery Data in bad block: type: 6 format: 2 rdba: 0x00c05c98 last change scn: 0x0000.05c3cad2 seq: 0x16 flg: 0x06 spare1: 0x0 spare2: 0x0 spare3: 0x0 consistency value in tail: 0xe4be0601 check value in block header: 0x5c03 computed block checksum: 0x2e7b Tue Jul 31 09:56:45 2018 Completed redo application Tue Jul 31 09:56:46 2018 Reread of rdba: 0x00c05c98 (file 3, block 23704) found same corrupted data RECOVERY OF THREAD 1 STUCK AT BLOCK 40841 OF FILE 8 Tue Jul 31 09:56:46 2018 RECOVERY OF THREAD 1 STUCK AT BLOCK 297 OF FILE 2 Tue Jul 31 09:56:46 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_p002_248.trc: ORA-00600: internal error code, arguments: [kssadpm1], [], [], [], [], [], [], [] Tue Jul 31 09:56:46 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_p001_2320.trc: ORA-00600: internal error code, arguments: [545], [0xCA15AE84], [3], [16], [], [], [], [] ORA-00600: internal error code, arguments: [545], [0xCA15AE84], [3], [16], [], [], [], [] ORA-00600: internal error code, arguments: [545], [0xCA15AE84], [3], [16], [], [], [], [] ORA-00600: internal error code, arguments: [545], [0xCA15AE84], [3], [8], [], [], [], [] Tue Jul 31 09:56:46 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_p004_2116.trc: ORA-00600: internal error code, arguments: [kssdmc: null so], [], [], [], [], [], [], [] ORA-00600: internal error code, arguments: [kssdmc: null so], [], [], [], [], [], [], [] ORA-00600: internal error code, arguments: [kssdmc: null so], [], [], [], [], [], [], [] ORA-00600: internal error code, arguments: [kssdmc: null so], [], [], [], [], [], [], [] ORA-07445: exception encountered: core dump [ACCESS_VIOLATION] [unable_to_trans_pc] [PC:0x7C3429C1] [ADDR:0xCA800000] [UNABLE_TO_READ] [] Tue Jul 31 09:56:46 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_p000_220.trc: ORA-00600: internal error code, arguments: [ksfdchkfobrerr1], [0xBB9852DC], [0xA7EC530C], [], [], [], [], [] Tue Jul 31 09:56:46 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_p003_252.trc: ORA-00600: internal error code, arguments: [kssrc_test_cleanup:popall], [0xCA000304], [], [], [], [], [], [] Tue Jul 31 09:56:46 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_p001_228.trc: ORA-07445: exception encountered: core dump [ACCESS_VIOLATION] [_kghalf+895] [PC:0x603BEBF3] [ADDR:0xFFFFFFF8] [UNABLE_TO_READ] [] Tue Jul 31 09:56:46 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_lgwr_1848.trc: ORA-07445: exception encountered: core dump [ACCESS_VIOLATION] [_ksarcv+243] [PC:0x5B2223] [ADDR:0x206C000C] [UNABLE_TO_READ] [] Tue Jul 31 09:56:47 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_p000_220.trc: ORA-07445: exception encountered: core dump [ACCESS_VIOLATION] [_kslwlmod+166] [PC:0x46946A] [ADDR:0x54F8] [UNABLE_TO_WRITE] [] ORA-00081: address range [0x75C80047, 0x75C8004B) is not readable ORA-00600: internal error code, arguments: [ksfdchkfobrerr1], [0xBB9852DC], [0xA7EC530C], [], [], [], [], [] Tue Jul 31 09:56:47 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_ckpt_1852.trc: ORA-07445: exception encountered: core dump [ACCESS_VIOLATION] [_kcbs_dump_adv_state+471] [PC:0x59B403] [ADDR:0xCC60CBAD] [UNABLE_TO_READ] [] ORA-00600: internal error code, arguments: [kssrc_test_cleanup:popall], [0xCA000304], [], [], [], [], [], [] Tue Jul 31 09:56:47 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_pmon_1828.trc: ORA-07445: exception encountered: core dump [ACCESS_VIOLATION] [_kews_idle_wait+378] [PC:0x60BE2E] [ADDR:0x1820D468] [UNABLE_TO_WRITE] [] Tue Jul 31 09:56:47 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_p004_236.trc: ORA-00081: address range [0x75C80041, 0x75C80045) is not readable ORA-07445: exception encountered: core dump [ACCESS_VIOLATION] [unable_to_trans_pc] [PC:0x7C3429C1] [ADDR:0xCA800000] [UNABLE_TO_READ] []
检查主要坏块
主要影响数据库恢复的坏块,system不言而喻,block 2也比较敏感
E:\>dbv file=E:\ORACLE\PRODUCT\10.2.0\DB_1\DATABASE\TTTS.DAT DBVERIFY: Release 10.2.0.3.0 - Production on 星期三 8月 1 00:24:52 2018 Copyright (c) 1982, 2005, Oracle. All rights reserved. DBVERIFY - 开始验证: FILE = E:\ORACLE\PRODUCT\10.2.0\DB_1\DATABASE\TTTS.DAT 页 2 流入 - 很可能是介质损坏 Corrupt block relative dba: 0x02000002 (file 8, block 2) Fractured block found during dbv: Data in bad block: type: 29 format: 2 rdba: 0x02000002 last change scn: 0x0000.05c45a54 seq: 0x2 flg: 0x04 spare1: 0x0 spare2: 0x0 spare3: 0x0 consistency value in tail: 0x9e601d02 check value in block header: 0xea86 computed block checksum: 0xc434 DBVERIFY - 验证完成 检查的页总数: 121600 处理的页总数 (数据): 58606 失败的页总数 (数据): 0 处理的页总数 (索引): 45192 失败的页总数 (索引): 0 处理的页总数 (其它): 4453 处理的总页数 (段) : 0 失败的总页数 (段) : 0 空的页总数: 13348 标记为损坏的总页数: 1 流入的页总数: 1 最高块 SCN : 96716847 (0.96716847) E:\>dbv FILE = E:\ORACLE\PRODUCT\10.2.0\ORADATA\ORCL\SYSTEM01.DBF DBVERIFY: Release 10.2.0.3.0 - Production on 星期三 8月 1 00:28:28 2018 Copyright (c) 1982, 2005, Oracle. All rights reserved. DBVERIFY - 开始验证: FILE = E:\ORACLE\PRODUCT\10.2.0\ORADATA\ORCL\SYSTEM01.DBF 页 68377 流入 - 很可能是介质损坏 Corrupt block relative dba: 0x00410b19 (file 1, block 68377) Fractured block found during dbv: Data in bad block: type: 6 format: 2 rdba: 0x00410b19 last change scn: 0x0000.05c45bdf seq: 0x1 flg: 0x06 spare1: 0x0 spare2: 0x0 spare3: 0x0 consistency value in tail: 0x4f3b0601 check value in block header: 0x465b computed block checksum: 0x11c7 DBV-00200: 块 dba 4262777 已标记为损坏 DBVERIFY - 验证完成 检查的页总数: 74240 处理的页总数 (数据): 46209 失败的页总数 (数据): 0 处理的页总数 (索引): 9729 失败的页总数 (索引): 0 处理的页总数 (其它): 1923 处理的总页数 (段) : 0 失败的总页数 (段) : 0 空的页总数: 16378 标记为损坏的总页数: 2 流入的页总数: 1 最高块 SCN : 96757289 (0.96757289)
尝试recover数据库,open数据库
E:\>sqlplus / as sysdba SQL*Plus: Release 10.2.0.3.0 - Production on 星期二 7月 31 15:40:05 2018 Copyright (c) 1982, 2006, Oracle. All Rights Reserved. 连接到: Oracle Database 10g Enterprise Edition Release 10.2.0.3.0 - Production With the Partitioning, OLAP and Data Mining options SQL> recover database; 完成介质恢复。 SQL> alter database open; 数据库已更改。
数据库报ORA-600 2662错误
该数据库没有增加隐含隐含参数(屏蔽一致性,屏蔽事务),数据库直接启动之后报ORA-600 2662
Tue Jul 31 15:40:15 2018 SMON: enabling cache recovery Tue Jul 31 15:40:16 2018 Successfully onlined Undo Tablespace 1. Tue Jul 31 15:40:16 2018 SMON: enabling tx recovery Tue Jul 31 15:40:16 2018 Database Characterset is ZHS16GBK replication_dependency_tracking turned off (no async multimaster replication found) Starting background process QMNC QMNC started with pid=32, OS id=1152 Tue Jul 31 15:40:17 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_smon_1288.trc: ORA-00600: internal error code, arguments: [2662], [0], [96736891], [0], [96752794], [4264138], [], [] Tue Jul 31 15:40:18 2018 Non-fatal internal error happenned while SMON was doing logging scn->time mapping. SMON encountered 1 out of maximum 100 non-fatal internal errors. Tue Jul 31 15:40:18 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_smon_1288.trc: ORA-00600: internal error code, arguments: [2662], [0], [96736892], [0], [96752794], [4264138], [], [] Non-fatal internal error happenned while SMON was doing extent coalescing. SMON encountered 3 out of maximum 100 non-fatal internal errors. Tue Jul 31 15:40:19 2018 db_recovery_file_dest_size of 2048 MB is 0.00% used. This is a user-specified limit on the amount of space that will be used by this database for recovery-related files, and does not reflect the amount of space available in the underlying filesystem or ASM diskgroup. Hex dump of (file 8, block 2) in trace file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_mmon_1740.trc Corrupt block relative dba: 0x02000002 (file 8, block 2) Fractured block found during buffer read Data in bad block: type: 29 format: 2 rdba: 0x02000002 last change scn: 0x0000.05c45a54 seq: 0x2 flg: 0x04 spare1: 0x0 spare2: 0x0 spare3: 0x0 consistency value in tail: 0x9e601d02 check value in block header: 0xea86 computed block checksum: 0xc434 Reread of rdba: 0x02000002 (file 8, block 2) found same corrupted data Tue Jul 31 15:40:20 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_smon_1288.trc: ORA-00600: internal error code, arguments: [2662], [0], [96736902], [0], [96752794], [4264138], [], [] Tue Jul 31 15:40:20 2018 Completed: alter database open Tue Jul 31 15:40:20 2018 Non-fatal internal error happenned while SMON was doing extent coalescing. SMON encountered 4 out of maximum 100 non-fatal internal errors. Tue Jul 31 15:40:21 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_smon_1288.trc: ORA-00600: internal error code, arguments: [2662], [0], [96736922], [0], [96752794], [4264138], [], [] Non-fatal internal error happenned while SMON was doing extent coalescing. SMON encountered 5 out of maximum 100 non-fatal internal errors. Tue Jul 31 15:40:22 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_j000_1076.trc: ORA-00600: 内部错误代码, 参数: [2662], [0], [96736954], [0], [96754130], [12615382], [], [] Tue Jul 31 15:40:22 2018 DEBUG: Replaying xcb 0xbba2d2e4, pmd 0xab1920fc for failed op 8 Reconstructing Uhdr 0x800019 for xcb 0xbba2d2e4, pmd 0xab1920fc Doing block recovery for file 2 block 25 Block recovery from logseq 7594, block 63 to scn 96736910 Tue Jul 31 15:40:22 2018 Recovery of Online Redo Log: Thread 1 Group 3 Seq 7594 Reading mem 0 Mem# 0: E:\ORACLE\PRODUCT\10.2.0\ORADATA\ORCL\REDO03.LOG Block recovery completed at rba 7594.82.16, scn 0.96736911 DEBUG: Restoring block headers for xcb 0xbba2d2e4, pmd 0xab1920fc DEBUG: Finished replay for xcb 0xbba2d2e4, pmd 0xab1920fc for failed op 8 Tue Jul 31 15:40:22 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_j000_1076.trc: ORA-00603: ORACLE 服务器会话因致命错误而终止 ORA-00600: 内部错误代码, 参数: [2662], [0], [96736955], [0], [96754130], [12615382], [], [] ORA-00600: 内部错误代码, 参数: [2662], [0], [96736954], [0], [96754130], [12615382], [], [] Tue Jul 31 15:40:31 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_smon_1288.trc: ORA-00600: internal error code, arguments: [2662], [0], [96736963], [0], [96752794], [4264138], [], [] Tue Jul 31 15:40:31 2018 Non-fatal internal error happenned while SMON was doing extent coalescing. SMON encountered 6 out of maximum 100 non-fatal internal errors. Tue Jul 31 15:40:41 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_smon_1288.trc: ORA-00600: internal error code, arguments: [2662], [0], [96736967], [0], [96752794], [4264138], [], [] Tue Jul 31 15:41:03 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_pmon_1448.trc: ORA-00474: SMON process terminated with error Tue Jul 31 15:41:03 2018 PMON: terminating instance due to error 474 Tue Jul 31 15:41:03 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_j004_1344.trc: ORA-00474: SMON process terminated with error Tue Jul 31 15:41:03 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_j003_2104.trc: ORA-00474: SMON process terminated with error Tue Jul 31 15:41:03 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_j002_932.trc: ORA-00474: SMON process terminated with error Tue Jul 31 15:41:04 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_j001_1680.trc: ORA-00474: SMON process terminated with error Tue Jul 31 15:41:04 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_q000_2336.trc: ORA-00474: SMON process terminated with error Tue Jul 31 15:41:05 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_lgwr_552.trc: ORA-00474: SMON process terminated with error Tue Jul 31 15:41:05 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_dbw0_1420.trc: ORA-00474: SMON process terminated with error Tue Jul 31 15:41:05 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_dbw1_2556.trc: ORA-00474: SMON process terminated with error Tue Jul 31 15:41:05 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_psp0_1812.trc: ORA-00474: SMON process terminated with error Tue Jul 31 15:41:05 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_mman_1924.trc: ORA-00474: SMON process terminated with error Tue Jul 31 15:41:05 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_ckpt_2940.trc: ORA-00474: SMON process terminated with error Tue Jul 31 15:41:10 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\bdump\orcl_reco_660.trc: ORA-00474: SMON process terminated with error Instance terminated by PMON, pid = 1448 Tue Jul 31 15:41:57 2018
这是一个不常见的错误,没有使用隐含参数强制拉库,数据库正常open成功,但是由于system坏块,导致数据库启动之后报ORA-600 2662错误(再次证明2662不一定只有强制拉库发生,正常open的库也有可能,主要取决block scn和datafile scn,如果不是open过程必须要访问的block,那可能在open之后由于访问需要再报出来该错误).这个问题比较简单,因为open成功之后再crash,而且该坏块引起smon报错但是并没有ora-600 4xxx相关错误,因此根据经验,直接在数据库open之后,处理掉system异常报错对象和坏块对象即可.另外block 2 比较特殊,需要对其上面的对象进行处理
Tue Jul 31 15:55:54 2018 Hex dump of (file 8, block 2) in trace file e:\oracle\product\10.2.0\admin\orcl\udump\orcl_ora_3664.trc Corrupt block relative dba: 0x02000002 (file 8, block 2) Completely zero block found during reading space header Reread of blocknum=2, file=E:\ORACLE\PRODUCT\10.2.0\DB_1\DATABASE\TTTS.DAT. found same corrupt data Reread of blocknum=2, file=E:\ORACLE\PRODUCT\10.2.0\DB_1\DATABASE\TTTS.DAT. found same corrupt data Reread of blocknum=2, file=E:\ORACLE\PRODUCT\10.2.0\DB_1\DATABASE\TTTS.DAT. found same corrupt data Reread of blocknum=2, file=E:\ORACLE\PRODUCT\10.2.0\DB_1\DATABASE\TTTS.DAT. found same corrupt data Reread of blocknum=2, file=E:\ORACLE\PRODUCT\10.2.0\DB_1\DATABASE\TTTS.DAT. found same corrupt data Tue Jul 31 15:55:54 2018 Errors in file e:\oracle\product\10.2.0\admin\orcl\udump\orcl_ora_3664.trc: ORA-07445: 出现异常错误: 核心转储 [ACCESS_VIOLATION] [_krbodmpcx+243] [PC:0x2317857] [ADDR:0x8] [UNABLE_TO_READ] [] ORA-19880: 数据文件 E:\ORACLE\PRODUCT\10.2.0\DB_1\DATABASE\TTTS.DAT 的空间标头已损坏, 块 2 备份已中止
补充ora-600 2662 block记录
----------------------------------------
SO: BB97A97C, type: 24, owner: BB882B10, flag: INIT/-/-/0x00
(buffer) (CR) PR: BB8029D8 FLG: 0x100000
class bit: 00000000
kcbbfbp: [BH: B9FCF268, LINK: BB97A9A0]
where: kdswh06: kdscgr, why: 0
BH (B9FCF268) file#: 1 rdba: 0x004110ca (1/69834) class: 1 ba: B9832000
set: 9 blksize: 8192 bsi: 0 set-flg: 2 pwbcnt: 0
dbwrid: 0 obj: 573 objn: 575 tsn: 0 afn: 1
hash: [bb9151ec,bb9151ec] lru: [b9fcf378,b9fcf200]
ckptq: [NULL] fileq: [NULL] objq: [b9fcf3d0,aa776524]
use: [bb97a9a0,bb97a9a0] wait: [NULL]
st: XCURRENT md: SHR tch: 0
flags:
LRBA: [0x0.0.0] HSCN: [0xffff.ffffffff] HSUB: [65535]
Using State Objects
----------------------------------------
SO: BB97A97C, type: 24, owner: BB882B10, flag: INIT/-/-/0x00
(buffer) (CR) PR: BB8029D8 FLG: 0x100000
class bit: 00000000
kcbbfbp: [BH: B9FCF268, LINK: BB97A9A0]
where: kdswh06: kdscgr, why: 0
buffer tsn: 0 rdba: 0x004110ca (1/69834)
scn: 0x0000.05c4549a seq: 0x01 flg: 0x06 tail: 0x549a0601
frmt: 0x02 chkval: 0xc60a type: 0x06=trans data