联系：手机/微信(+86 17813235971) QQ(107644445)
标题：.[decrypt20@firemail.cc].eking 数据库勒索恢复
作者：惜分飞©版权所有[未经本人同意,不得以任何形式转载,否则有进一步追究法律责任的权利.]
前段时间,有客户多套库被勒索病毒加密（扩展名类似：.[decrypt20@firemail.cc].eking），包含oracle和sql server数据库
E-Mail:dba@xifenfei.com
联系：手机/微信(+86 17813235971) QQ(107644445)
标题：ocr磁盘组掉盘故障处理
作者：惜分飞©版权所有[未经本人同意,不得以任何形式转载,否则有进一步追究法律责任的权利.]
由于某种故障导致crs的OCR_0001盘掉线，votedisk从3个变为了2个
WARNING: Write Failed. group:3 disk:1 AU:1 offset:4190208 size:4096 WARNING: Hbeat write to PST disk 1.3915948466 in group 3 failed. [4] Mon Jun 14 15:31:11 2021 NOTE: process _b000_+asm1 (21889) initiating offline of disk 1.3915948466 (OCR_0001) with mask 0x7e in group 3 NOTE: checking PST: grp = 3 GMON checking disk modes for group 3 at 14 for pid 28, osid 21889 NOTE: group OCR: updated PST location: disk 0000 (PST copy 0) NOTE: group OCR: updated PST location: disk 0002 (PST copy 1) NOTE: checking PST for grp 3 done. NOTE: sending set offline flag message 1047812201 to 1 disk(s) in group 3 WARNING: Disk OCR_0001 in mode 0x7f is now being offlined INFO: Instance #2 could not find disk 1 in group 3 NOTE: initiating PST update: grp = 3, dsk = 1/0xe968a1b2, mask = 0x6a, op = clear GMON updating disk modes for group 3 at 15 for pid 28, osid 21889 NOTE: group OCR: updated PST location: disk 0000 (PST copy 0) NOTE: group OCR: updated PST location: disk 0002 (PST copy 1) NOTE: group OCR: updated PST location: disk 0000 (PST copy 0) NOTE: group OCR: updated PST location: disk 0002 (PST copy 1) NOTE: PST update grp = 3 completed successfully NOTE: initiating PST update: grp = 3, dsk = 1/0xe968a1b2, mask = 0x7e, op = clear GMON updating disk modes for group 3 at 16 for pid 28, osid 21889 NOTE: group OCR: updated PST location: disk 0000 (PST copy 0) NOTE: group OCR: updated PST location: disk 0002 (PST copy 1) NOTE: group OCR: updated PST location: disk 0000 (PST copy 0) NOTE: group OCR: updated PST location: disk 0002 (PST copy 1) NOTE: cache closing disk 1 of grp 3: OCR_0001 NOTE: PST update grp = 3 completed successfully Mon Jun 14 15:31:13 2021 NOTE: Attempting voting file refresh on diskgroup OCR NOTE: Refresh completed on diskgroup OCR . Found 3 voting file(s). NOTE: Voting file relocation is required in diskgroup OCR NOTE: Attempting voting file relocation on diskgroup OCR NOTE: Successful voting file relocation on diskgroup OCR NOTE: Attempting voting file refresh on diskgroup OCR NOTE: Refresh completed on diskgroup OCR . Found 2 voting file(s). NOTE: Voting file relocation is required in diskgroup OCR NOTE: Attempting voting file relocation on diskgroup OCR NOTE: Successful voting file relocation on diskgroup OCR Mon Jun 14 15:34:08 2021 WARNING: PST-initiated drop of 1 disk(s) in group 3(.1918390620)) SQL> alter diskgroup OCR drop disk OCR_0001 force /* ASM SERVER */ NOTE: GroupBlock outside rolling migration privileged region NOTE: requesting all-instance membership refresh for group=3 Mon Jun 14 15:34:10 2021 GMON updating for reconfiguration, group 3 at 17 for pid 28, osid 21889 NOTE: group OCR: updated PST location: disk 0000 (PST copy 0) NOTE: group OCR: updated PST location: disk 0002 (PST copy 1) NOTE: cache closing disk 1 of grp 3: (not open) OCR_0001 NOTE: group OCR: updated PST location: disk 0000 (PST copy 0) NOTE: group OCR: updated PST location: disk 0002 (PST copy 1) NOTE: group 3 PST updated. Mon Jun 14 15:34:10 2021 NOTE: membership refresh pending for group 3/0x7258515c (OCR) NOTE: Attempting voting file refresh on diskgroup OCR NOTE: Refresh completed on diskgroup OCR . Found 2 voting file(s). NOTE: Voting file relocation is required in diskgroup OCR NOTE: Attempting voting file relocation on diskgroup OCR NOTE: Successful voting file relocation on diskgroup OCR GMON querying group 3 at 18 for pid 18, osid 8900 NOTE: group OCR: updated PST location: disk 0000 (PST copy 0) NOTE: group OCR: updated PST location: disk 0002 (PST copy 1) NOTE: cache closing disk 1 of grp 3: (not open) _DROPPED_0001_OCR SUCCESS: refreshed membership for 3/0x7258515c (OCR) SUCCESS: alter diskgroup OCR drop disk OCR_0001 force /* ASM SERVER */
在第一次掉盘之后rebalance完成之后，又掉一块盘,ocr磁盘组正常,表决盘因为就只有一个磁盘,无法在ocr磁盘组中refresh到其他磁盘上
Tue Jun 15 04:41:42 2021 WARNING: Waited 15 secs for write IO to PST disk 0 in group 3. WARNING: Waited 15 secs for write IO to PST disk 0 in group 3. Tue Jun 15 04:41:42 2021 NOTE: process _b000_+asm1 (58548) initiating offline of disk 0.3915948465 (OCR_0000) with mask 0x7e in group 3 NOTE: checking PST: grp = 3 GMON checking disk modes for group 3 at 23 for pid 28, osid 58548 NOTE: group OCR: updated PST location: disk 0002 (PST copy 0) NOTE: checking PST for grp 3 done. NOTE: sending set offline flag message 3615961191 to 1 disk(s) in group 3 WARNING: Disk OCR_0000 in mode 0x7f is now being offlined INFO: Instance #2 could not find disk 1 in group 3 NOTE: initiating PST update: grp = 3, dsk = 0/0xe968a1b1, mask = 0x6a, op = clear GMON updating disk modes for group 3 at 24 for pid 28, osid 58548 NOTE: group OCR: updated PST location: disk 0002 (PST copy 0) NOTE: group OCR: updated PST location: disk 0002 (PST copy 0) NOTE: PST update grp = 3 completed successfully NOTE: initiating PST update: grp = 3, dsk = 0/0xe968a1b1, mask = 0x7e, op = clear GMON updating disk modes for group 3 at 25 for pid 28, osid 58548 NOTE: group OCR: updated PST location: disk 0002 (PST copy 0) NOTE: group OCR: updated PST location: disk 0002 (PST copy 0) NOTE: cache closing disk 0 of grp 3: OCR_0000 NOTE: PST update grp = 3 completed successfully Tue Jun 15 04:41:44 2021 NOTE: Attempting voting file refresh on diskgroup OCR NOTE: Refresh completed on diskgroup OCR . Found 2 voting file(s). NOTE: Voting file relocation is required in diskgroup OCR NOTE: Attempting voting file relocation on diskgroup OCR NOTE: Failed voting file relocation on diskgroup OCR WARNING: Waited 18 secs for write IO to PST disk 0 in group 3. WARNING: Waited 18 secs for write IO to PST disk 0 in group 3. NOTE: Attempting voting file relocation on diskgroup OCR NOTE: Failed voting file relocation on diskgroup OCR NOTE: Attempting voting file relocation on diskgroup OCR NOTE: Failed voting file relocation on diskgroup OCR NOTE: Attempting voting file relocation on diskgroup OCR NOTE: Failed voting file relocation on diskgroup OCR Tue Jun 15 04:44:21 2021 NOTE: Attempting voting file relocation on diskgroup OCR NOTE: Failed voting file relocation on diskgroup OCR Tue Jun 15 04:44:21 2021 WARNING: PST-initiated drop of 1 disk(s) in group 3(.1918390620)) SQL> alter diskgroup OCR drop disk OCR_0000 force /* ASM SERVER */ NOTE: GroupBlock outside rolling migration privileged region NOTE: requesting all-instance membership refresh for group=3 NOTE: Attempting voting file relocation on diskgroup OCR NOTE: Failed voting file relocation on diskgroup OCR Tue Jun 15 04:44:24 2021 GMON updating for reconfiguration, group 3 at 26 for pid 28, osid 58548 NOTE: cache closing disk 0 of grp 3: (not open) OCR_0000 NOTE: group OCR: updated PST location: disk 0002 (PST copy 0) NOTE: group 3 PST updated. NOTE: membership refresh pending for group 3/0x7258515c (OCR) NOTE: Attempting voting file relocation on diskgroup OCR NOTE: Failed voting file relocation on diskgroup OCR GMON querying group 3 at 27 for pid 18, osid 8900 NOTE: cache closing disk 0 of grp 3: (not open) _DROPPED_0000_OCR SUCCESS: refreshed membership for 3/0x7258515c (OCR) NOTE: starting rebalance of group 3/0x7258515c (OCR) at power 1 SUCCESS: alter diskgroup OCR drop disk OCR_0000 force /* ASM SERVER */
查询这个时候的ocr磁盘组相关信息
node1-> crsctl query css votedisk ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 3619aee7c3b04fc1bfa5c4ce659acbf7 (/dev/emcpowerc) [OCR] 2. ONLINE 00bc3e79f7404ff2bf60925a7b8a5a6d (/dev/emcpowere) [OCR] Located 2 voting disk(s).
可以发现表决盘中的两个disk一个属于ocr磁盘组，一个是被ocr磁盘组drop掉的磁盘，尝试增加以前离线的磁盘到ocr磁盘组
SQL> alter diskgroup OCR add disk '/dev/emcpowerc'; alter diskgroup OCR add disk '/dev/emcpowerc' * ERROR at line 1: ORA-15032: not all alterations performed ORA-15033: disk '/dev/emcpowerc' belongs to diskgroup "OCR" SQL> alter diskgroup OCR add disk '/dev/emcpowerc' force 2 ; alter diskgroup OCR add disk '/dev/emcpowerc' force * ERROR at line 1: ORA-03113: end-of-file on communication channel Process ID: 15191 Session ID: 1613 Serial number: 7
查看alert日志
SQL> alter diskgroup OCR add disk '/dev/emcpowerc' force NOTE: GroupBlock outside rolling migration privileged region NOTE: Assigning number (3,4) to disk (/dev/emcpowerc) NOTE: requesting all-instance membership refresh for group=3 WARNING: ignoring disk /dev/emcpowerd in deep discovery NOTE: initializing header on grp 3 disk OCR_0004 WARNING: ignoring disk /dev/emcpowerd in deep discovery NOTE: requesting all-instance disk validation for group=3 NOTE: skipping rediscovery for group 3/0x725d2390 (OCR) on local instance. NOTE: requesting all-instance disk validation for group=3 NOTE: skipping rediscovery for group 3/0x725d2390 (OCR) on local instance. NOTE: Attempting voting file relocation on diskgroup OCR Errors in file /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_rbal_12207.trc (incident=311185): ORA-00600: internal error code, arguments: [kfdvfGetCurrent_baddsk], [], [], [], [], [], [], [], [], [], [], [] Incident details in: /u01/app/grid/diag/asm/+asm/+ASM1/incident/incdir_311185/+ASM1_rbal_12207_i311185.trc Use ADRCI or Support Workbench to package the incident. See Note 411.1 at My Oracle Support for error and packaging details. ERROR: ORA-600 thrown in RBAL for group number 3 Errors in file /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_rbal_12207.trc: ORA-00600: internal error code, arguments: [kfdvfGetCurrent_baddsk], [], [], [], [], [], [], [], [], [], [], [] Errors in file /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_rbal_12207.trc: ORA-00600: internal error code, arguments: [kfdvfGetCurrent_baddsk], [], [], [], [], [], [], [], [], [], [], [] RBAL (ospid: 12207): terminating the instance due to error 488
由于ORA-600 kfdvfGetCurrent_baddsk错误导致增加磁盘失败,通过上面查询的votedisk的信息,可以发现emcpowerc这个盘虽然ocr中离线,但是依旧还是votedisk盘,因此无法增加到该磁盘组中,采用变通方法,先加另外一块盘
SQL> alter diskgroup OCR add failgroup OCR_0001 disk '/dev/emcpowerd' force; Diskgroup altered. SQL> exit Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options node1-> crsctl query css votedisk ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 00bc3e79f7404ff2bf60925a7b8a5a6d (/dev/emcpowere) [OCR] 2. ONLINE 0eef8152df5d4f41bf973ad5dc5a6cb1 (/dev/emcpowerd) [OCR] Located 2 voting disk(s).
增加成功emcpowerd之后,emcpowerc已经不再是表决盘，变为了emcpowerd,再次增加emcpowerc
SQL> alter diskgroup OCR add failgroup OCR_0000 disk '/dev/emcpowerc' force; Diskgroup altered. SQL> exit Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production With the Real Application Clusters and Automatic Storage Management options node1-> crsctl query css votedisk ## STATE File Universal Id File Name Disk group -- ----- ----------------- --------- --------- 1. ONLINE 00bc3e79f7404ff2bf60925a7b8a5a6d (/dev/emcpowere) [OCR] 2. ONLINE 0eef8152df5d4f41bf973ad5dc5a6cb1 (/dev/emcpowerd) [OCR] 3. ONLINE 4f6201f808dc4ff3bf928b14eae0d4a6 (/dev/emcpowerc) [OCR] Located 3 voting disk(s). ASMCMD> lsdsk -G ocr Path /dev/emcpowerc /dev/emcpowerd /dev/emcpowere
SQL> alter diskgroup OCR add failgroup OCR_0000 disk '/dev/emcpowerc' force NOTE: GroupBlock outside rolling migration privileged region NOTE: Assigning number (3,0) to disk (/dev/emcpowerc) NOTE: requesting all-instance membership refresh for group=3 NOTE: initializing header on grp 3 disk OCR_0000 NOTE: requesting all-instance disk validation for group=3 Mon Jan 24 17:47:42 2022 NOTE: skipping rediscovery for group 3/0x725dccb9 (OCR) on local instance. NOTE: requesting all-instance disk validation for group=3 NOTE: skipping rediscovery for group 3/0x725dccb9 (OCR) on local instance. Mon Jan 24 17:47:48 2022 GMON updating for reconfiguration, group 3 at 20 for pid 30, osid 16978 NOTE: group 3 PST updated. NOTE: initiating PST update: grp = 3 GMON updating group 3 at 21 for pid 30, osid 16978 NOTE: group OCR: updated PST location: disk 0002 (PST copy 0) NOTE: group OCR: updated PST location: disk 0005 (PST copy 1) NOTE: group OCR: updated PST location: disk 0000 (PST copy 2) NOTE: PST update grp = 3 completed successfully NOTE: membership refresh pending for group 3/0x725dccb9 (OCR) NOTE: Attempting voting file refresh on diskgroup OCR NOTE: Refresh completed on diskgroup OCR . Found 2 voting file(s). NOTE: Voting file relocation is required in diskgroup OCR NOTE: Attempting voting file relocation on diskgroup OCR NOTE: Failed voting file relocation on diskgroup OCR GMON querying group 3 at 22 for pid 18, osid 15952 NOTE: cache opening disk 0 of grp 3: OCR_0000 path:/dev/emcpowerc Mon Jan 24 17:47:53 2022 NOTE: Attempting voting file refresh on diskgroup OCR NOTE: Refresh completed on diskgroup OCR . Found 2 voting file(s). NOTE: Voting file relocation is required in diskgroup OCR NOTE: Attempting voting file relocation on diskgroup OCR NOTE: Failed voting file relocation on diskgroup OCR GMON querying group 3 at 23 for pid 18, osid 15952 SUCCESS: refreshed membership for 3/0x725dccb9 (OCR) Mon Jan 24 17:47:53 2022 SUCCESS: alter diskgroup OCR add failgroup OCR_0000 disk '/dev/emcpowerc' force NOTE: starting rebalance of group 3/0x725dccb9 (OCR) at power 1 Starting background process ARB0 Mon Jan 24 17:47:53 2022 ARB0 started with pid=31, OS id=17092 NOTE: assigning ARB0 to group 3/0x725dccb9 (OCR) with 1 parallel I/O cellip.ora not found. NOTE: F1X0 copy 3 relocating from 65534:4294967294 to 0:2 for diskgroup 3 (OCR) NOTE: stopping process ARB0 SUCCESS: rebalance completed for group 3/0x725dccb9 (OCR) NOTE: Attempting voting file refresh on diskgroup OCR NOTE: Refresh completed on diskgroup OCR . Found 2 voting file(s). NOTE: Voting file relocation is required in diskgroup OCR NOTE: Attempting voting file relocation on diskgroup OCR NOTE: voting file allocation on grp 3 disk OCR_0000 NOTE: Successful voting file relocation on diskgroup OCR Mon Jan 24 17:47:57 2022 NOTE: GroupBlock outside rolling migration privileged region NOTE: requesting all-instance membership refresh for group=3 NOTE: membership refresh pending for group 3/0x725dccb9 (OCR) Mon Jan 24 17:48:03 2022 GMON querying group 3 at 24 for pid 18, osid 15952 SUCCESS: refreshed membership for 3/0x725dccb9 (OCR) Mon Jan 24 17:48:06 2022 NOTE: Attempting voting file refresh on diskgroup OCR NOTE: Refresh completed on diskgroup OCR . Found 3 voting file(s).
表决磁盘组从2个变为了3个,ocr磁盘组也恢复了正常的3个,至此OCR掉盘的故障处理完成
联系：手机/微信(+86 17813235971) QQ(107644445)
标题：ORA-600 3600恢复—-resetlogs scn异常
作者：惜分飞©版权所有[未经本人同意,不得以任何形式转载,否则有进一步追究法律责任的权利.]
由于客户误操作,在有文件offline的情况下进行resetlogs操作,导致有文件resetlogs scn不对
---直接offline Wed Jan 26 11:08:15 2022 ALTER DATABASE RECOVER database until cancel Media Recovery Start started logmerger process Wed Jan 26 11:08:17 2022 Datafile 8 (ckpscn 731239901) is orphaned on incarnation#=2 Media Recovery failed with error 19909 Slave exiting with ORA-283 exception Errors in file d:\app\administrator\diag\rdbms\orcl\orcl\trace\orcl_pr00_133504.trc: ORA-00283: recovery session canceled due to errors ORA-19909: datafile 8 belongs to an orphan incarnation ORA-01110: data file 8: 'D:\APP\ADMINISTRATOR\PRODUCT\11.2.0\DBHOME_1\DATABASE\XIFENFEI.DBF' Recovery Slave PR00 previously exited with exception 283 ORA-283 signalled during: ALTER DATABASE RECOVER database until cancel ... Wed Jan 26 11:08:31 2022 alter database datafile 8 offline Wed Jan 26 11:08:31 2022 Errors in file d:\app\administrator\diag\rdbms\orcl\orcl\trace\orcl_dbw0_133948.trc (incident=134637): ORA-00600: internal error code, arguments: [3600], [8], [14], [], [], [], [], [], [], [], [], [] Incident details in: d:\app\administrator\diag\rdbms\orcl\orcl\incident\incdir_134637\orcl_dbw0_133948_i134637.trc Errors in file d:\app\administrator\diag\rdbms\orcl\orcl\trace\orcl_dbw0_133948.trc: ORA-00600: internal error code, arguments: [3600], [8], [14], [], [], [], [], [], [], [], [], [] DBW0 (ospid: 133948): terminating the instance due to error 471 Instance terminated by DBW0, pid = 133948 ---offline drop Wed Jan 26 11:09:20 2022 alter database datafile 8 offline drop Errors in file d:\app\administrator\diag\rdbms\orcl\orcl\trace\orcl_dbw0_133932.trc (incident=135837): ORA-00600: internal error code, arguments: [3600], [8], [14], [], [], [], [], [], [], [], [], [] Incident details in: d:\app\administrator\diag\rdbms\orcl\orcl\incident\incdir_135837\orcl_dbw0_133932_i135837.trc Errors in file d:\app\administrator\diag\rdbms\orcl\orcl\trace\orcl_dbw0_133932.trc: ORA-00600: internal error code, arguments: [3600], [8], [14], [], [], [], [], [], [], [], [], [] DBW0 (ospid: 133932): terminating the instance due to error 471 Wed Jan 26 11:09:22 2022 Instance terminated by DBW0, pid = 133932
因为resetlogs scn不对,也无法正常重建控制文件,对于这样的case,可以Oracle Recovery Tools进行修复resetlogs scn,然后直接open库
Wed Jan 26 11:15:12 2022 SMON: enabling cache recovery Dictionary check beginning Archived Log entry 3 added for thread 1 sequence 381 ID 0x60b930a1 dest 1: Dictionary check complete Verifying file header compatibility for 11g tablespace encryption.. Verifying 11g file header compatibility for tablespace encryption completed SMON: enabling tx recovery Starting background process QMNC Wed Jan 26 11:15:15 2022 QMNC started with pid=25, OS id=131784 LOGSTDBY: Validating controlfile with logical metadata LOGSTDBY: Validation complete Completed: alter database open
软件下载:OraRecovery下载
使用说明:使用说明
联系：手机/微信(+86 17813235971) QQ(107644445)
标题：redo异常强制拉库报ORA-600 kcbzib_kcrsds_1修复
作者：惜分飞©版权所有[未经本人同意,不得以任何形式转载,否则有进一步追究法律责任的权利.]
节点2 asm dismount导致redo写报错(ORA-00340,ORA-00345)，经过分析asm和系统日志,确认是由于多路径异常导致io异常
2022-01-24T23:44:39.966602+08:00 WARNING: group 4 is being dismounted. WARNING: ASMB force dismounting group 4 (REDO) due to ASM server dismount SUCCESS: diskgroup REDO was dismounted 2022-01-24T23:44:41.103783+08:00 Errors in file /u01/app/oracle/diag/rdbms/xff/XFF2/trace/XFF2_lgwr_228507.trc: ORA-00345: redo log write error block 11961764 count 6 ORA-00312: online log 10 thread 2: '+REDO/XFF/ONLINELOG/group_10.261.1074690685' 2022-01-24T23:44:41.156809+08:00 Errors in file /u01/app/oracle/diag/rdbms/xff/XFF2/trace/XFF2_lgwr_228507.trc: ORA-00340: IO error processing online log 10 of thread 2 ORA-00345: redo log write error block 11961764 count 6 ORA-00312: online log 10 thread 2: '+REDO/XFF/ONLINELOG/group_10.261.1074690685' Errors in file /u01/app/oracle/diag/rdbms/xff/XFF2/trace/XFF2_lgwr_228507.trc (incident=1341402): ORA-340 [] [] [] [] [] [] [] [] [] [] [] [] Incident details in: /u01/app/oracle/diag/rdbms/xff/XFF2/incident/incdir_1341402/XFF2_lgwr_228507_i1341402.trc 2022-01-24T23:44:41.505251+08:00 USER (ospid: 133928): terminating the instance due to error 340
由于节点2是突然crash，节点1做实例恢复失败，由于节点2的redo发生了写丢失,导致节点1实例恢复后库crash,进而是的该集群的相关数据库节点全部crash
2022-01-24T23:46:08.440519+08:00
Slave encountered ORA-10388 exception during crash recovery
2022-01-24T23:46:08.442854+08:00
Slave encountered ORA-10388 exception during crash recovery
Abort recovery for domain 0, flags 4
2022-01-24T23:46:08.444531+08:00
Aborting crash recovery due to error 742
2022-01-24T23:46:08.444695+08:00
Errors in file /u01/app/oracle/diag/rdbms/xff/XFF1/trace/XFF1_ora_450481.trc:
ORA-00742: Log read detects lost write in thread 2 sequence 63507 block 11941482
ORA-00312: online log 10 thread 2: '+REDO/XFF/ONLINELOG/group_10.261.1074690685'
Abort recovery for domain 0, flags 4
2022-01-24T23:46:08.771108+08:00
Errors in file /u01/app/oracle/diag/rdbms/xff/XFF1/trace/XFF1_ora_450481.trc:
ORA-00742: Log read detects lost write inthread 2 sequence 63507 block 11941482
ORA-00312: online log 10 thread 2: '+REDO/XFF/ONLINELOG/group_10.261.1074690685'
ORA-742 signalled during: ALTER DATABASE OPEN /* db agent *//* {0:17:165} */...
2022-01-24T23:46:10.143155+08:00
License high water mark = 33
2022-01-24T23:46:10.143752+08:00
USER (ospid: 451049): terminating the instance
2022-01-24T23:46:11.167337+08:00
Instance terminated by USER, pid = 451049
经过第三方强制拉库之后,数据库报ORA-600 kcbzib_kcrsds_1
2022-01-25T10:13:37.922332+08:00 Completed crash recovery at Thread 2: RBA 5.3.16, nab 3, scn 0x00000a348a032122 0 data blocks read, 0 data blocks written, 0 redo k-bytes read 2022-01-25T10:13:38.071326+08:00 Thread 2 advanced to log sequence 6 (thread recovery) validate pdb 0, flags x4, valid 0, pdb flags x204 * validated domain 0, flags = 0x200 CRASH recovery complete: pdb 0 valid 1 (flags x4, pdb flags x200) Picked broadcast on commit scheme to generate SCNs Endian type of dictionary set to little 2022-01-25T10:13:38.389741+08:00 TT00: Gap Manager starting (PID:220505) 2022-01-25T10:13:38.646484+08:00 Thread 1 opened at log sequence 1 Current log# 1 seq# 1 mem# 0: +DATA/XFF/ONLINELOG/group_1.536.1094875107 Successful open of redo thread 1 2022-01-25T10:13:38.647243+08:00 MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set Errors in file /u01/app/oracle/diag/rdbms/xff/XFF1/trace/XFF1_ora_216590.trc (incident=1879556): ORA-00600: internal error code, arguments: [kcbzib_kcrsds_1], [], [], [], [], [], [], [], [], [], [], [] Incident details in: /u01/app/oracle/diag/rdbms/xff/XFF1/incident/incdir_1879556/XFF1_ora_216590_i1879556.trc Use ADRCI or Support Workbench to package the incident. See Note 411.1 at My Oracle Support for error and packaging details. ***************************************************************** An internal routine has requested a dump of selected redo. This usually happens following a specific internal error, when analysis of the redo logs will help Oracle Support with the diagnosis. It is recommended that you retain all the redo logs generated (by all the instances) during the past 12 hours, in case additional redo dumps are required to help with the diagnosis. ***************************************************************** 2022-01-25T10:13:39.734366+08:00 Errors in file /u01/app/oracle/diag/rdbms/xff/XFF1/trace/XFF1_ora_216590.trc: ORA-00704: bootstrap process failure ORA-00600: internal error code, arguments: [kcbzib_kcrsds_1], [], [], [], [], [], [], [], [], [], [], [] 2022-01-25T10:13:39.734424+08:00 Errors in file /u01/app/oracle/diag/rdbms/xff/XFF1/trace/XFF1_ora_216590.trc: ORA-00704: bootstrap process failure ORA-00704: bootstrap process failure ORA-00600: internal error code, arguments: [kcbzib_kcrsds_1], [], [], [], [], [], [], [], [], [], [], [] 2022-01-25T10:13:39.734499+08:00 Errors in file /u01/app/oracle/diag/rdbms/xff/XFF1/trace/XFF1_ora_216590.trc: ORA-00704: bootstrap process failure ORA-00704: bootstrap process failure ORA-00600: internal error code, arguments: [kcbzib_kcrsds_1], [], [], [], [], [], [], [], [], [], [], [] 2022-01-25T10:13:39.734536+08:00 Error 704 happened during db open, shutting down database Errors in file /u01/app/oracle/diag/rdbms/xff/XFF1/trace/XFF1_ora_216590.trc (incident=1879557): ORA-00603: ORACLE server session terminated by fatal error ORA-01092: ORACLE instance terminated. Disconnection forced ORA-00704: bootstrap process failure ORA-00704: bootstrap process failure ORA-00600: internal error code, arguments: [kcbzib_kcrsds_1], [], [], [], [], [], [], [], [], [], [], [] Incident details in: /u01/app/oracle/diag/rdbms/xff/XFF1/incident/incdir_1879557/XFF1_ora_216590_i1879557.trc 2022-01-25T10:13:39.894464+08:00 2022-01-25T10:13:40.446888+08:00 opiodr aborting process unknown ospid (216590) as a result of ORA-603 2022-01-25T10:13:40.470643+08:00 ORA-603 : opitsk aborting process License high water mark = 36 2022-01-25T10:13:40.471453+08:00 USER (ospid: 216590): terminating the instance due to error 704 2022-01-25T10:13:41.436133+08:00 opiodr aborting process unknown ospid (189796) as a result of ORA-1092 2022-01-25T10:13:41.439011+08:00 ORA-1092 : opitsk aborting process 2022-01-25T10:13:41.472060+08:00 PMON (ospid: 189585): terminating the instance due to error 704
该错误是12c之后才有的报错,由于文件异常导致,通过以前的解决经验,接手这个问题之后快速调整数据库文件头信息,顺利open库
参考以前相关blog内容：
Oracle 12c redo 丢失恢复
模拟19c数据库redo异常恢复
ORA-600 kcbzib_kcrsds_1报错
12C数据库报ORA-600 kcbzib_kcrsds_1故障处理
ORA-00603 ORA-01092 ORA-600 kcbzib_kcrsds_1
[oracle@xifenfei02 ~]$ sqlplus / as sysdba SQL*Plus: Release 12.2.0.1.0 Production on Wed Jan 26 00:31:50 2022 Copyright (c) 1982, 2016, Oracle. All rights reserved. Connected to an idle instance. SQL> startup mount pfile='/tmp/pfile' ORACLE instance started. Total System Global Area 3.2320E+11 bytes Fixed Size 29879248 bytes Variable Size 4.5634E+10 bytes Database Buffers 1.9059E+11 bytes Redo Buffers 1043861504 bytes In-Memory Area 8.5899E+10 bytes Database mounted. SQL> alter database open ; Database altered.
联系：手机/微信(+86 17813235971) QQ(107644445)
作者：惜分飞©版权所有[未经本人同意,不得以任何形式转载,否则有进一步追究法律责任的权利.]
有朋友找到我们,oracle数据库所在机器文件被加密（扩展名为:.babyk）,咨询我们是否可以恢复
What Happened to My Computer? Your important files are encrypted. Many of your documents, photos, videos, databases and other files are no longer accessible because they have been encrypted. Maybe you are busy looking for a way to recover your files, but do not waste your time. Nobody can recover your files without Can I Recover My Files? Sure. We guarantee that you can recover all your files safely and easily. But you have not so enough time.if you want to decrypt all your files, you need to pay. You only have 3 days to submit the payment. After that the price will be doubled. Also, if you don't pay in 7 days, you won't be able to recover your files forever. How Do I Pay? Payment is accepted in Monero only. If you don’t know what Monero is, please Google for information on how to buy and pay for Monero. Send $10000 worth of monero to this address: 88D7gE1jUbmPBjdFsvR8FugHA4ZZY9H6NHy9ZkWec7c4iYiATW5cpuAYoRbBq2ePoFeBgpzZunGLXgCTPmAfDU8V1qZmgUv ID:xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx After the payment is completed, please send the payment picture and ID to sdfca4s654asd@protonmail.com. After we confirm your payment amount, we will reply to the decryption program to your email address. Warning: Don't try to decrypt by yourself, you may permanently damage your files.
通过检测文件损坏情况
E-Mail:dba@xifenfei.com
联系：手机/微信(+86 17813235971) QQ(107644445)
作者：惜分飞©版权所有[未经本人同意,不得以任何形式转载,否则有进一步追究法律责任的权利.]
有客户数据库被加密,扩展名为:.mallox，对应的RECOVERY INFORMATION.txt文件信息
联系：手机/微信(+86 17813235971) QQ(107644445)
作者：惜分飞©版权所有[未经本人同意,不得以任何形式转载,否则有进一步追究法律责任的权利.]
有朋友找到我,反馈说数据库登录报ORA-600 6807错误,希望我们给予解决
DUL> rdba 4195465
rdba : 0x00400489=4195465
rfile# : 1
block# : 1161
DUL> desc sys.seq$
Object ID:100
Storage(Obj#=100 DataObj#=100 TS#=0 File#=1 Block#=1160 Cluster=0)
NO. SEG INT Column Name Null? Type
--- --- --- ------------------------------ --------- ------------------------------
1 1 1 OBJ# NOT NULL NUMBER
2 2 2 INCREMENT$ NOT NULL NUMBER
3 3 3 MINVALUE NUMBER
4 4 4 MAXVALUE NUMBER
5 5 5 CYCLE# NOT NULL NUMBER
6 6 6 ORDER$ NOT NULL NUMBER
7 7 7 CACHE NOT NULL NUMBER
8 8 8 HIGHWATER NOT NULL NUMBER
9 9 9 AUDIT$ NOT NULL VARCHAR2(38)
10 10 10 FLAGS NUMBER
11 11 11 PARTCOUNT NUMBER
DUL> dump datafile 1 block 1160
Block Header:
block type=0x10 (data segment header block (unlimited extents))
block format=0xa2 (oracle 10+)
block rdba=0x00400488 (file#=1, block#=1160)
scn=0x0000.001a3fcd, seq=2, tail=0x3fcd1002
block checksum value=0xe280=57984, flag=4
Data Segment Header:
Extent Control Header
-------------------------------------------------------------
Extent Header:: extents: 1 blocks: 7
last map: 0x00000000 #maps: 0 offset: 4128
Highwater:: 0x0040048d (rfile#=1,block#=1165)
ext#: 0 blk#: 4 ext size:7
#blocks in seg. hdr's freelists: 1
#blocks below: 4
mapblk: 0x00000000 offset: 0
Map Header:: next: 0x00000000 #extents: 1 obj#: 100 flag: 0x40000000
Extent Control Header
-------------------------------------------------------------
0x00400489 length: 7
nfl = 1, nfb = 1, typ = 1, nxf = 0, ccnt = 4
SEG LST:: flg: USED lhd: 0x0040048c ltl: 0x0040048c
DUL> rdba 0x00400489
rdba : 0x00400489=4195465
rfile# : 1
block# : 1161
DUL>
通过修复使用我们的Oracle recovery tools小工具，或者参考:校验代码为 6054 坏块故障修复进行修复,然后数据库用户可以正常登录
联系：手机/微信(+86 17813235971) QQ(107644445)
作者：惜分飞©版权所有[未经本人同意,不得以任何形式转载,否则有进一步追究法律责任的权利.]
2022年第一个数据库恢复请求,数据库启动报ORA-00600 kokasgi1错误
联系：手机/微信(+86 17813235971) QQ(107644445)
作者：惜分飞©版权所有[未经本人同意,不得以任何形式转载,否则有进一步追究法律责任的权利.]
有一客户emr库文件被勒索加密
LockBit 2.0 Ransomware Your data are stolen and encrypted The data will be published on TOR website http://lockbitapt6vx57t3eeqjofwgcglmutr3a35nygvokja5uuccip4ykyd.onion and https://bigblog.at if you do not pay the ransom You can contact us and decrypt one file for free on these TOR sites http://lockbitsup4yezcd5enk5unncx3zcy7kw6wllyqmiyhvanjj352jayid.onion http://lockbitsap2oaqhcun3syvbqt6n5nzt7fqosc6jdlmsfleu3ka4k2did.onion OR https://decoding.at Decryption ID: 6AECC4637C3D17FC6197EEE5B6D3BDF5
通过工具检查破坏情况,发现该病毒是间隔加密破坏
联系：手机/微信(+86 17813235971) QQ(107644445)
标题：ORA-15130: diskgroup “ORADATA” is being dismounted
作者：惜分飞©版权所有[未经本人同意,不得以任何形式转载,否则有进一步追究法律责任的权利.]
磁盘组mount之后,立马又dismount
Sat Dec 25 17:48:45 2021 SQL> alter diskgroup ORADATA mount NOTE: cache registered group ORADATA number=5 incarn=0xd4b7ac6a NOTE: cache began mount (first) of group ORADATA number=5 incarn=0xd4b7ac6a NOTE: Assigning number (5,24) to disk (/dev/mapper/data31) NOTE: Assigning number (5,26) to disk (/dev/mapper/data33) NOTE: Assigning number (5,21) to disk (/dev/mapper/data29) NOTE: Assigning number (5,23) to disk (/dev/mapper/data30) NOTE: Assigning number (5,25) to disk (/dev/mapper/data32) NOTE: Assigning number (5,19) to disk (/dev/mapper/data27) NOTE: Assigning number (5,20) to disk (/dev/mapper/data28) NOTE: Assigning number (5,18) to disk (/dev/mapper/data26) NOTE: Assigning number (5,14) to disk (/dev/mapper/data22) NOTE: Assigning number (5,17) to disk (/dev/mapper/data25) NOTE: Assigning number (5,16) to disk (/dev/mapper/data24) NOTE: Assigning number (5,15) to disk (/dev/mapper/data23) NOTE: Assigning number (5,13) to disk (/dev/mapper/data21) NOTE: Assigning number (5,12) to disk (/dev/mapper/data20) NOTE: Assigning number (5,10) to disk (/dev/mapper/data19) NOTE: Assigning number (5,9) to disk (/dev/mapper/data18) NOTE: Assigning number (5,8) to disk (/dev/mapper/data17) NOTE: Assigning number (5,3) to disk (/dev/mapper/data12) NOTE: Assigning number (5,22) to disk (/dev/mapper/data3) NOTE: Assigning number (5,2) to disk (/dev/mapper/data11) NOTE: Assigning number (5,7) to disk (/dev/mapper/data16) NOTE: Assigning number (5,28) to disk (/dev/mapper/data5) NOTE: Assigning number (5,32) to disk (/dev/mapper/data9) NOTE: Assigning number (5,6) to disk (/dev/mapper/data15) NOTE: Assigning number (5,5) to disk (/dev/mapper/data14) NOTE: Assigning number (5,4) to disk (/dev/mapper/data13) NOTE: Assigning number (5,1) to disk (/dev/mapper/data10) NOTE: Assigning number (5,30) to disk (/dev/mapper/data7) NOTE: Assigning number (5,29) to disk (/dev/mapper/data6) NOTE: Assigning number (5,31) to disk (/dev/mapper/data8) NOTE: Assigning number (5,11) to disk (/dev/mapper/data2) NOTE: Assigning number (5,27) to disk (/dev/mapper/data4) NOTE: Assigning number (5,0) to disk (/dev/mapper/data1) Sat Dec 25 17:48:52 2021 NOTE: GMON heartbeating for grp 5 GMON querying group 5 at 153 for pid 32, osid 68608 NOTE: cache opening disk 0 of grp 5: ORADATA_0000 path:/dev/mapper/data1 NOTE: F1X0 found on disk 0 au 2 fcn 0.0 NOTE: cache opening disk 1 of grp 5: ORADATA_0001 path:/dev/mapper/data10 NOTE: cache opening disk 2 of grp 5: ORADATA_0002 path:/dev/mapper/data11 NOTE: cache opening disk 3 of grp 5: ORADATA_0003 path:/dev/mapper/data12 NOTE: cache opening disk 4 of grp 5: ORADATA_0004 path:/dev/mapper/data13 NOTE: cache opening disk 5 of grp 5: ORADATA_0005 path:/dev/mapper/data14 NOTE: cache opening disk 6 of grp 5: ORADATA_0006 path:/dev/mapper/data15 NOTE: cache opening disk 7 of grp 5: ORADATA_0007 path:/dev/mapper/data16 NOTE: cache opening disk 8 of grp 5: ORADATA_0008 path:/dev/mapper/data17 NOTE: cache opening disk 9 of grp 5: ORADATA_0009 path:/dev/mapper/data18 NOTE: cache opening disk 10 of grp 5: ORADATA_0010 path:/dev/mapper/data19 NOTE: cache opening disk 11 of grp 5: ORADATA_0011 path:/dev/mapper/data2 NOTE: cache opening disk 12 of grp 5: ORADATA_0012 path:/dev/mapper/data20 NOTE: cache opening disk 13 of grp 5: ORADATA_0013 path:/dev/mapper/data21 NOTE: cache opening disk 14 of grp 5: ORADATA_0014 path:/dev/mapper/data22 NOTE: cache opening disk 15 of grp 5: ORADATA_0015 path:/dev/mapper/data23 NOTE: cache opening disk 16 of grp 5: ORADATA_0016 path:/dev/mapper/data24 NOTE: cache opening disk 17 of grp 5: ORADATA_0017 path:/dev/mapper/data25 NOTE: cache opening disk 18 of grp 5: ORADATA_0018 path:/dev/mapper/data26 NOTE: cache opening disk 19 of grp 5: ORADATA_0019 path:/dev/mapper/data27 NOTE: cache opening disk 20 of grp 5: ORADATA_0020 path:/dev/mapper/data28 NOTE: cache opening disk 21 of grp 5: ORADATA_0021 path:/dev/mapper/data29 NOTE: cache opening disk 22 of grp 5: ORADATA_0022 path:/dev/mapper/data3 NOTE: cache opening disk 23 of grp 5: ORADATA_0023 path:/dev/mapper/data30 NOTE: cache opening disk 24 of grp 5: ORADATA_0024 path:/dev/mapper/data31 NOTE: cache opening disk 25 of grp 5: ORADATA_0025 path:/dev/mapper/data32 NOTE: cache opening disk 26 of grp 5: ORADATA_0026 path:/dev/mapper/data33 NOTE: cache opening disk 27 of grp 5: ORADATA_0027 path:/dev/mapper/data4 NOTE: cache opening disk 28 of grp 5: ORADATA_0028 path:/dev/mapper/data5 NOTE: cache opening disk 29 of grp 5: ORADATA_0029 path:/dev/mapper/data6 NOTE: cache opening disk 30 of grp 5: ORADATA_0030 path:/dev/mapper/data7 NOTE: cache opening disk 31 of grp 5: ORADATA_0031 path:/dev/mapper/data8 NOTE: cache opening disk 32 of grp 5: ORADATA_0032 path:/dev/mapper/data9 NOTE: cache mounting (first) external redundancy group 5/0xD4B7AC6A (ORADATA) Sat Dec 25 17:48:52 2021 * allocate domain 5, invalid = TRUE kjbdomatt send to inst 2 Sat Dec 25 17:48:52 2021 NOTE: attached to recovery domain 5 NOTE: starting recovery of thread=1 ckpt=92.6417 group=5 (ORADATA) NOTE: advancing ckpt for group 5 (ORADATA) thread=1 ckpt=92.6418 NOTE: cache recovered group 5 to fcn 0.9502919 NOTE: redo buffer size is 256 blocks (1053184 bytes) Sat Dec 25 17:48:52 2021 NOTE: LGWR attempting to mount thread 1 for diskgroup 5 (ORADATA) NOTE: LGWR found thread 1 closed at ABA 92.6417 NOTE: LGWR mounted thread 1 for diskgroup 5 (ORADATA) NOTE: LGWR opening thread 1 at fcn 0.9502919 ABA 93.6418 NOTE: cache mounting group 5/0xD4B7AC6A (ORADATA) succeeded NOTE: cache ending mount (success) of group ORADATA number=5 incarn=0xd4b7ac6a Sat Dec 25 17:48:53 2021 NOTE: Instance updated compatible.asm to 11.2.0.0.0 for grp 5 SUCCESS: diskgroup ORADATA was mounted SUCCESS: alter diskgroup ORADATA mount Sat Dec 25 17:48:53 2021 NOTE: diskgroup resource ora.ORADATA.dg is online WARNING:cache read a corrupt block: group=5(ORADATA)dsk=5 blk=2 disk=5(ORADATA_0005)incarn=2406 au=0 blk=2 count=1 Errors in file /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_rbal_48956.trc: ORA-15196: invalid ASM block header [kfc.c:26368] [endian_kfbh] [2147483653] [2] [0 != 1] NOTE: a corrupted block from group ORADATA was dumped to /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_rbal_48956.trc WARNING:cache read(retry)a corrupt block:group=5(ORADATA)dsk=5 blk=2 disk=5(ORADATA_0005)incarn=2406 au=0 blk=2 count=1 Errors in file /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_rbal_48956.trc: ORA-15196: invalid ASM block header [kfc.c:26368] [endian_kfbh] [2147483653] [2] [0 != 1] ORA-15196: invalid ASM block header [kfc.c:26368] [endian_kfbh] [2147483653] [2] [0 != 1] ERROR: cache failed to read group=5(ORADATA) dsk=5 blk=2 from disk(s): 5(ORADATA_0005) ORA-15196: invalid ASM block header [kfc.c:26368] [endian_kfbh] [2147483653] [2] [0 != 1] ORA-15196: invalid ASM block header [kfc.c:26368] [endian_kfbh] [2147483653] [2] [0 != 1] NOTE: cache initiating offline of disk 5 group ORADATA NOTE: process _rbal_+asm1 (48956) initiating offline of disk 5.240607694 (ORADATA_0005) with mask 0x7e in group 5 NOTE: initiating PST update: grp = 5, dsk = 5/0xe5761ce, mask = 0x6a, op = clear GMON updating disk modes for group 5 at 155 for pid 18, osid 48956 ERROR: Disk 5 cannot be offlined, since diskgroup has external redundancy. ERROR: too many offline disks in PST (grp 5) Sat Dec 25 17:48:55 2021 NOTE: cache dismounting (not clean) group 5/0xD4B7AC6A (ORADATA) WARNING: Offline for disk ORADATA_0005 in mode 0x7f failed. Sat Dec 25 17:48:55 2021 NOTE: halting all I/Os to diskgroup 5 (ORADATA) NOTE: messaging CKPT to quiesce pins Unix process pid: 22744, image: oracle@wxzldb1 (B000) Errors in file /u01/app/grid/diag/asm/+asm/+ASM1/trace/+ASM1_rbal_48956.trc (incident=1289754): ORA-15335: ASM metadata corruption detected in disk group 'ORADATA' ORA-15130: diskgroup "ORADATA" is being dismounted ORA-15066: offlining disk "ORADATA_0005" in group "ORADATA" may result in a data loss ORA-15196: invalid ASM block header [kfc.c:26368] [endian_kfbh] [2147483653] [2] [0 != 1] ORA-15196: invalid ASM block header [kfc.c:26368] [endian_kfbh] [2147483653] [2] [0 != 1] Incident details in: /u01/app/grid/diag/asm/+asm/+ASM1/incident/incdir_1289754/+ASM1_rbal_48956_i1289754.trc NOTE: LGWR doing non-clean dismount of group 5 (ORADATA) NOTE: LGWR sync ABA=93.6418 last written ABA 93.6418 kjbdomdet send to inst 2 detach from dom 5, sending detach message to inst 2 Sat Dec 25 17:48:56 2021 List of instances: 1 2 Dirty detach reconfiguration started (new ddet inc 1, cluster inc 4) Sat Dec 25 17:48:56 2021 Sweep [inc][1289754]: completed Global Resource Directory partially frozen for dirty detach * dirty detach - domain 5 invalid = TRUE 41 GCS resources traversed, 0 cancelled Dirty Detach Reconfiguration complete freeing rdom 5 System State dumped to trace file /u01/app/grid/diag/asm/+asm/+ASM1/incident/incdir_1289754/+ASM1_rbal_48956_i1289754.trc WARNING: dirty detached from domain 5 NOTE: cache dismounted group 5/0xD4B7AC6A (ORADATA)
问题比较明显是由于disk=5 au=0 blk=2有问题导致磁盘组mount之后立马异常.通过kfed分析对应block情况
C:\Users\XFF>kfed read h:\temp\asmdisk\data14.dd|more kfbh.endian: 1 ; 0x000: 0x01 kfbh.hard: 130 ; 0x001: 0x82 kfbh.type: 1 ; 0x002: KFBTYP_DISKHEAD kfbh.datfmt: 1 ; 0x003: 0x01 kfbh.block.blk: 0 ; 0x004: blk=0 kfbh.block.obj: 2147483653 ; 0x008: disk=5 kfbh.check: 314993330 ; 0x00c: 0x12c66ab2 kfbh.fcn.base: 0 ; 0x010: 0x00000000 kfbh.fcn.wrap: 0 ; 0x014: 0x00000000 kfbh.spare1: 0 ; 0x018: 0x00000000 kfbh.spare2: 0 ; 0x01c: 0x00000000 kfdhdb.driver.provstr: ORCLDISK ; 0x000: length=8 kfdhdb.driver.reserved[0]: 0 ; 0x008: 0x00000000 kfdhdb.driver.reserved[1]: 0 ; 0x00c: 0x00000000 kfdhdb.driver.reserved[2]: 0 ; 0x010: 0x00000000 kfdhdb.driver.reserved[3]: 0 ; 0x014: 0x00000000 kfdhdb.driver.reserved[4]: 0 ; 0x018: 0x00000000 kfdhdb.driver.reserved[5]: 0 ; 0x01c: 0x00000000 kfdhdb.compat: 186646528 ; 0x020: 0x0b200000 kfdhdb.dsknum: 5 ; 0x024: 0x0005 kfdhdb.grptyp: 1 ; 0x026: KFDGTP_EXTERNAL kfdhdb.hdrsts: 3 ; 0x027: KFDHDR_MEMBER kfdhdb.dskname: ORADATA_0005 ; 0x028: length=12 kfdhdb.grpname: ORADATA ; 0x048: length=7 kfdhdb.fgname: ORADATA_0005 ; 0x068: length=12 C:\Users\XFF>kfed read h:\temp\asmdisk\data14.dd aun=0 blkn=2|more kfbh.endian: 0 ; 0x000: 0x00 kfbh.hard: 0 ; 0x001: 0x00 kfbh.type: 0 ; 0x002: KFBTYP_INVALID kfbh.datfmt: 0 ; 0x003: 0x00 kfbh.block.blk: 0 ; 0x004: blk=0 kfbh.block.obj: 0 ; 0x008: file=0 kfbh.check: 0 ; 0x00c: 0x00000000 kfbh.fcn.base: 0 ; 0x010: 0x00000000 kfbh.fcn.wrap: 0 ; 0x014: 0x00000000 kfbh.spare1: 0 ; 0x018: 0x00000000 kfbh.spare2: 0 ; 0x01c: 0x00000000 0066D8200 00000000 00000000 00000000 00000000 [................] Repeat 255 times KFED-00322: Invalid content encountered during block traversal: [kfbtTraverseBlock][Invalid OSM block type][][0]
通过kfed分析,该block确实异常,该block主要记录au的分配信息,如果asm 磁盘组的空间不变化,不执行rebalance,一般不会主动访问该block,不访问该block磁盘组也就不会dismount,按照这个解决思路,通过patch解决,让oradata磁盘组不再执行rebalance和分配/回收空间即可一直稳定的mount
