有客户联系我,数据库强制关闭之后无法正常启动,通过他们一系列尝试,数据库报open 报ORA-01555错误

通过分析确认是由于客户屏蔽一致性强制拉库失败导致

Wed Nov 01 19:49:03 2023
alter database open resetlogs
RESETLOGS is being done without consistancy checks. This may result
in a corrupted database. The database should be recreated.
RESETLOGS after incomplete recovery UNTIL CHANGE 1199697777
Archived Log entry 68106 added for thread 1 sequence 3829 ID 0x761a769a dest 1:
Archived Log entry 68107 added for thread 1 sequence 3830 ID 0x761a769a dest 1:
Archived Log entry 68108 added for thread 1 sequence 3828 ID 0x761a769a dest 1:
Clearing online redo logfile 1 /u01/app/oracle/oradata/ORACLE/redo01.log
Clearing online log 1 of thread 1 sequence number 3829
Clearing online redo logfile 1 complete
Clearing online redo logfile 2 /u01/app/oracle/oradata/ORACLE/redo02.log
Clearing online log 2 of thread 1 sequence number 3830
Clearing online redo logfile 2 complete
Clearing online redo logfile 3 /u01/app/oracle/oradata/ORACLE/redo03.log
Clearing online log 3 of thread 1 sequence number 3828
Clearing online redo logfile 3 complete
Resetting resetlogs activation ID 1981445786 (0x761a769a)
Online log /u01/app/oracle/oradata/ORACLE/redo01.log: Thread 1 Group 1 was previously cleared
Online log /u01/app/oracle/oradata/ORACLE/redo02.log: Thread 1 Group 2 was previously cleared
Online log /u01/app/oracle/oradata/ORACLE/redo03.log: Thread 1 Group 3 was previously cleared
Wed Nov 01 19:49:09 2023
Setting recovery target incarnation to 3
Wed Nov 01 19:49:09 2023
Assigning activation ID 2024817472 (0x78b04340)
LGWR: STARTING ARCH PROCESSES
Wed Nov 01 19:49:09 2023
ARC0 started with pid=21, OS id=2078 
ARC0: Archival started
LGWR: STARTING ARCH PROCESSES COMPLETE
ARC0: STARTING ARCH PROCESSES
Wed Nov 01 19:49:10 2023
ARC1 started with pid=22, OS id=2080 
Thread 1 advanced to log sequence 2 (thread open)
Wed Nov 01 19:49:10 2023
ARC2 started with pid=23, OS id=2082 
Wed Nov 01 19:49:10 2023
ARC3 started with pid=24, OS id=2084 
ARC1: Archival started
ARC2: Archival started
ARC1: Becoming the 'no FAL' ARCH
ARC1: Becoming the 'no SRL' ARCH
ARC2: Becoming the heartbeat ARCH
Thread 1 opened at log sequence 2
  Current log# 2 seq# 2 mem# 0: /u01/app/oracle/oradata/ORACLE/redo02.log
Successful open of redo thread 1
MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
Wed Nov 01 19:49:10 2023
SMON: enabling cache recovery
ARC2: LGWR is scheduled to archive destination LOG_ARCHIVE_DEST_2 after log switch
Wed Nov 01 19:49:10 2023
NSA2 started with pid=25, OS id=2086 
ORA-01555 caused by SQL statement below (SQL ID: 4krwuz0ctqxdt, SCN: 0x0000.4781ef78):
select ctime, mtime, stime from obj$ where obj# = :1
Errors in file /u01/app/oracle/diag/rdbms/oracle_pd/ORACLE/trace/ORACLE_ora_2076.trc:
ORA-00704: bootstrap process failure
ORA-00704: bootstrap process failure
ORA-00604: error occurred at recursive SQL level 1
ORA-01555: snapshot too old: rollback segment number 11 with name "_SYSSMU11_467363169$" too small
Errors in file /u01/app/oracle/diag/rdbms/oracle_pd/ORACLE/trace/ORACLE_ora_2076.trc:
ORA-00704: bootstrap process failure
ORA-00704: bootstrap process failure
ORA-00604: error occurred at recursive SQL level 1
ORA-01555: snapshot too old: rollback segment number 11 with name "_SYSSMU11_467363169$" too small
Error 704 happened during db open, shutting down database
USER (ospid: 2076): terminating the instance due to error 704
Instance terminated by USER, pid = 2076
ORA-1092 signalled during: alter database open resetlogs...
opiodr aborting process unknown ospid (2076) as a result of ORA-1092

这种错误比较常见恢复简单,以前有过类似的文章:
在数据库open过程中常遇到ORA-01555汇总
 数据库open过程遭遇ORA-1555对应sql语句补充
 重建control遗漏数据文件,reseltogs报ORA-1555错误处理
 Oracle Recovery Tools恢复—ORA-00704 ORA-01555故障
这个错误恢复本身不难,只是在数据库的恢复过程中需要重建文件,在这次的重建文件中由于ctl语句错误【语句是通过sql查询拼接而成】,导致重建文件报了两个错误,供参考:
ORA-01163 ORA-01110错误

SQL> CREATE CONTROLFILE REUSE DATABASE "ORACLE" NORESETLOGS  NOARCHIVELOG
        MAXLOGFILES 50
       MAXLOGMEMBERS 5
       MAXDATAFILES 1000
       MAXINSTANCES 8
       MAXLOGHISTORY 2920
LOGFILE
       group 1   '/u01/app/oracle/oradata/ORACLE/redo01.log' size 200M,
  2         group 3   '/u01/app/oracle/oradata/ORACLE/redo03.log' size 200M,
       group 2   '/u01/app/oracle/oradata/ORACLE/redo02.log' size 200M,
DATAFILE
        '/u01/app/oracle/oradata/ORACLE/system01.dbf',
        …………
        '/u01/app/oracle/oradata/ORACLE/xifenfei06.dbf',
CHARACTER SET  ZHS16GBK ;
 23   24   25   26   27  CREATE CONTROLFILE REUSE DATABASE "ORACLE" NORESETLOGS	NOARCHIVELOG
*
ERROR at line 1:
ORA-01503: CREATE CONTROLFILE failed
ORA-01163: SIZE clause indicates 12800 (blocks), but should match header
1564672
ORA-01110: data file 15: '/u01/app/oracle/oradata/ORACLE/xifenfei06.dbf'

出现该错误是由于我写路径的时候在最后一个数据文件路径后面多了一个【,】导致

ORA-600 kccccfl_1错误

SQL> CREATE CONTROLFILE REUSE DATABASE "ORACLE" NORESETLOGS  NOARCHIVELOG
        MAXLOGFILES 50
       MAXLOGMEMBERS 5
       MAXDATAFILES 1000
       MAXINSTANCES 8
       MAXLOGHISTORY 2920
LOGFILE
       group 1   '/u01/app/oracle/oradata/ORACLE/redo01.log'  size 200M,
       group 3   '/u01/app/oracle/oradata/ORACLE/redo03.log' size 200M,
       group 2   '/u01/app/oracle/oradata/ORACLE/redo02.log' size 200M,
DATAFILE
        '/u01/app/oracle/oradata/ORACLE/system01.dbf',
        ………… 
        '/u01/app/oracle/oradata/ORACLE/xifenfei06.dbf'
CHARACTER SET  ZHS16GBK ;
 23   24   25   26   27  CREATE CONTROLFILE REUSE DATABASE "ORACLE" NORESETLOGS	NOARCHIVELOG
*
ERROR at line 1:
ORA-01503: CREATE CONTROLFILE failed
ORA-00600: internal error code, arguments: [kccccfl_1], [], [], [], [], [], [],
[], [], [], [], []

出现该错误是由于在最后redo文件路径后面多了【,】导致

RFS[22349]: Database mount ID mismatch

联系：手机/微信(+86 17813235971) QQ(107644445)

标题：RFS[22349]: Database mount ID mismatch

今天检查数据库发现一套主库上面报大量RFS[22349]: Database mount ID mismatch之类的错误

[oracle@hisdb2 trace]$ tail -f alert_hisdb2.log 
LNS: Standby redo logfile selected for thread 2 sequence 133319 for destination LOG_ARCHIVE_DEST_2
Mon Nov 06 20:56:09 2023
RFS[27080]: Assigned to RFS process 15518
RFS[27080]: Database mount ID mismatch [0x7afb8c50:0x70b2cf7b] (2063305808:1890766715)
Mon Nov 06 20:57:09 2023
RFS[27081]: Assigned to RFS process 16299
RFS[27081]: Database mount ID mismatch [0x7afb8c50:0x70b2cf7b] (2063305808:1890766715)
Mon Nov 06 20:57:09 2023
RFS[27082]: Assigned to RFS process 16319
RFS[27082]: Database mount ID mismatch [0x7afb8c50:0x70b2cf7b] (2063305808:1890766715)

这种错误表示rfs进程在传输的时候检测到database mount id不匹配(也就是认为这个库不是主库该传输或者接受日志的),出现类似这样的错误,大概率是由于这个dg成员(主库和备库)中应该有不匹配的库,回想这个库近期的操作,突然想到对这个主库在虚拟化平台的备库做了一次克隆,然后吧克隆库激活作为测试库的操作.基于此种情况,先判断该库是否和上次克隆的库之间创建有会话连接

--主库
[oracle@hisdb2 trace]$ netstat -natp|grep 192.168.106.63
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
tcp        0      0 192.168.115.12:52785        192.168.106.63:1521         ESTABLISHED -                   
tcp        0      0 192.168.115.14:1521         192.168.106.63:21598        TIME_WAIT   - 

--克隆库
[oracle@HIS_DG ~]$ netstat -atpn|grep 192.168.115.12
(Not all processes could be identified, non-owned process info
 will not be shown, you would have to be root to see it all.)
tcp        0      0 ::ffff:192.168.106.63:1521  ::ffff:192.168.115.12:52785 ESTABLISHED 6126/oraclehisdb

两个库之间确实存在会话,检查克隆库相关的dg配置

[oracle@HIS_DG ~]$ sqlplus / as sysdba

SQL*Plus: Release 11.2.0.4.0 Production on Mon Nov 6 21:01:05 2023

Copyright (c) 1982, 2013, Oracle.  All rights reserved.


Connected to:
Oracle Database 11g Enterprise Edition Release 11.2.0.4.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options

SQL> show parameter fal;

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
fal_client                           string      HISDBDG
fal_server                           string      HISDB
SQL> select open_mode,database_role from v$database;

OPEN_MODE            DATABASE_ROLE
-------------------- ----------------
READ WRITE           PRIMARY

SQL> show parameter archive;

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
archive_lag_target                   integer     1800
log_archive_config                   string
log_archive_dest                     string
log_archive_dest_1                   string      LOCATION=USE_DB_RECOVERY_FILE_
                                                 DEST valid_for=(all_logfiles,a
                                                 ll_roles) db_unique_name=hisdb
                                                 dg
log_archive_dest_10                  string
log_archive_dest_11                  string
log_archive_dest_12                  string
log_archive_dest_13                  string

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
log_archive_dest_14                  string
log_archive_dest_15                  string
log_archive_dest_16                  string
log_archive_dest_17                  string
log_archive_dest_18                  string
log_archive_dest_19                  string
log_archive_dest_2                   string      service=hisdb lgwr async valid
                                                 _for=(online_logfiles,primary_
                                                 role) db_unique_name=hisdb

该库的dg配置没有清除,当该库变为主库时,log_archive_dest_2刚好指向主库,从而使得主库上出现了类似RFS[22349]: Database mount ID mismatch的错误.处理方法是清除掉克隆库上面dg备库相关配置

SQL> alter system set log_archive_dest_2='';

System altered.

SQL> alter system set fal_server='';

System altered.

主库日志中未再出现类似错误

Mon Nov 06 20:48:08 2023
RFS[22349]: Assigned to RFS process 7383
RFS[22349]: Database mount ID mismatch [0x7afb8c50:0x70b2cf7b] (2063305808:1890766715)
[oracle@hisdb1 trace]$ tail -f alert_hisdb1.log 
RFS[22352]: Database mount ID mismatch [0x7afb8c50:0x70b2cf7b] (2063305808:1890766715)
Mon Nov 06 20:58:09 2023
RFS[22353]: Assigned to RFS process 14958
RFS[22353]: Database mount ID mismatch [0x7afb8c50:0x70b2cf7b] (2063305808:1890766715)
Mon Nov 06 21:01:09 2023
RFS[22354]: Assigned to RFS process 18580
RFS[22354]: Database mount ID mismatch [0x7afb8c50:0x70b2cf7b] (2063305808:1890766715)
Mon Nov 06 21:01:09 2023
RFS[22355]: Assigned to RFS process 18598
RFS[22355]: Database mount ID mismatch [0x7afb8c50:0x70b2cf7b] (2063305808:1890766715)
Mon Nov 06 21:03:28 2023
Thread 1 advanced to log sequence 129769 (LGWR switch)
  Current log# 9 seq# 129769 mem# 0: +DATA/hisdb/onlinelog/group_9.276.976991877
  Current log# 9 seq# 129769 mem# 1: +FRA/hisdb/onlinelog/group_9.2334.976991877
Mon Nov 06 21:03:28 2023
Archived Log entry 524082 added for thread 1 sequence 129768 ID 0x70864b41 dest 1:
Mon Nov 06 21:03:28 2023
LNS: Standby redo logfile selected for thread 1 sequence 129769 for destination LOG_ARCHIVE_DEST_2

事后在MOS上有一篇文档供参考:Database mount ID mismatch ORA-16009: invalid redo transport destination (Doc ID 1450132.1)

触发器找出密码错误应用

联系：手机/微信(+86 17813235971) QQ(107644445)

标题：触发器找出密码错误应用

经常会遇到修改oracle业务用户密码之后,由于部分应用密码没有被正确修改(忘记修改,或者修改错误了),导致数据库被hang或者用户被锁的情况,对于这样的情况,通过一个logon触发器可以快速找到

create or replace trigger logon_denied_to_alert
after servererror on database
declare
 message   varchar2(120);
 IP        varchar2(15);
 v_os_user varchar2(80);
 v_module  varchar2(50);
 v_action  varchar2(50);
 v_pid     varchar2(10);
 v_sid     number;
 v_username  varchar2(50);
 v_suser      varchar2(50);
begin
 IF (ora_is_servererror(1017)) THEN
   if sys_context('userenv', 'network_protocol') = 'tcp' then
     IP := sys_context('userenv', 'ip_address');
   else
     select distinct sid into v_sid from sys.v_$mystat;
     SELECT p.SPID
       into v_pid
       FROM V$PROCESS p, V$SESSION v
      WHERE p.ADDR = v.PADDR
        AND v.sid = v_sid;
   end if;
   v_os_user := sys_context('userenv', 'os_user');
   v_username := sys_context('userenv', 'CURRENT_USER');
   v_suser := SYS_CONTEXT('USERENV','SESSION_USER');
   dbms_application_info.READ_MODULE(v_module, v_action);
   message := to_char(sysdate, 'Dy Mon dd HH24:MI:SS YYYY') ||
              ' logon denied from '||v_username||' '||v_suser||' '|| nvl(IP, v_pid) || ' ' || v_os_user ||
              ' with ' || v_module || ' ' || v_action;
   sys.dbms_system.ksdwrt(2, message);
 end if;
end;
/

测试

SQL> create user test identified by oracle;

User created.

SQL> grant dba to test;

Grant succeeded.

直接本地登录

SQL> conn test/test
ERROR:
ORA-01017: invalid username/password; logon denied


Warning: You are no longer connected to ORACLE.

---alert日志记录
Wed Nov 01 23:15:04 2023 logon denied from SYS  12886 oracle with sqlplus@iZbp1hx0enix3hix1kvyrxZ (TNS V1-V3)

通过tns登录

SQL> conn  test/oracl1@172.27.54.81:1522/orcl
ERROR:
ORA-01017: invalid username/password; logon denied


Warning: You are no longer connected to ORACLE.

---alert日志报错
Wed Nov 01 23:31:51 2023 logon denied from SYS  172.27.54.81 oracle with sqlplus@iZbp1hx0enix3hix1kvyrxZ (TNS V1-V3)

redhat和oracle linux kernel对应关系—202310

联系：手机/微信(+86 17813235971) QQ(107644445)

标题：redhat和oracle linux kernel对应关系—202310

补充说明：

Oracle Linux RHCK kernels correspond to Red Hat Enterprise Linux Server Edition kernels only
From Oracle Linux 4.8, 5.3, 6.0, 7.0, 8.0, 9.0 onward, /etc/redhat-release file content mirrors that of corresponding RHEL 4/5/6/7/8/9 versions
From Oracle Linux 5.6 onward, UEK is the default boot kernel
* default boot kernel
^ default installed kernel
# available only via ULN / Oracle YUM Server update
UEKR7 (5.15.0) available from Oracle Linux 8.7 (x86_64, aarch64), 9.0 (x86_64, aarch64)
UEKR6 (5.4.17) available from Oracle Linux 7.9 (x86_64, aarch64), 8.2 (x86_64, aarch64)
UEKR5 (4.1.14) available from Oracle Linux 7.5 (aarch64), 7.6 (x86_64), 8.1 (x86_64)
UEKR4 (4.1.12) available from Oracle Linux 6.8 (x86, x86_64), 7.3 (x86_64)
UEKR3 (3.8.13) available from Oracle Linux 6.4 (x86, x86_64), 7.0 (x86_64)
UEKR2 (2.6.39) available from Oracle Linux 5.9 (x86, x86_64), 6.3 (x86, x86_64)
UEK[R1] (2.6.32) available from Oracle Linux 5.5 (x86, x86_64), 6.0 (x86, x86_64)

参考：Oracle Linux: Comparison of Oracle Linux and Red Hat Enterprise Linux Kernel Versions (Doc ID 560992.1)

11.2.0.4最新patch信息（扩展补丁）–202310

联系：手机/微信(+86 17813235971) QQ(107644445)

标题：11.2.0.4最新patch信息（扩展补丁）–202310

11.2.0.4 Database Patch Set Update

Release Date	Version	Download link	Included in Windows Bundle
17-Oct-2023	11.2.0.4.231017 (Oct 2023) Database Patch Set Update (DB PSU)	Patch 35574075	* Out of Error Correction
18-Jul-2023	11.2.0.4.230718 (Jul 2023) Database Patch Set Update (DB PSU)	Patch 35269283	* Out of Error Correction
18-Apr-2023	11.2.0.4.230418 (Apr 2023) Database Patch Set Update (DB PSU)	Patch 34998337	* Out of Error Correction
17-Jan-2023	11.2.0.4.230117 (Jan 2023) Database Patch Set Update (DB PSU)	Patch 34677698	* Out of Error Correction
18-Oct-2022	11.2.0.4.221018 (Oct 2022) Database Patch Set Update (DB PSU)	Patch 34386237	* Patch 34474433
19-Jul-2022	11.2.0.4.220719 (Jul 2022) Database Patch Set Update (DB PSU)	Patch 34057724	* Patch 33883353
19-Apr-2022	11.2.0.4.220419 (Apr 2022) Database Patch Set Update (DB PSU)	Patch 33711103	* Patch 33776715
18-Jan-2022	11.2.0.4.220118 (Jan 2022) Database Patch Set Update (DB PSU)	Patch 33477185	* Patch 33488457
19-Oct-2021	11.2.0.4.211019 (Oct 2021) Database Patch Set Update (DB PSU)	Patch 33128584	* Patch 33174351
20-Jul-2021	11.2.0.4.210720 (Jul 2021) Database Patch Set Update (DB PSU)	Patch 32758711	* Patch 32775108
20-Apr-2021	11.2.0.4.210420 (Apr 2021) Database Patch Set Update (DB PSU)	Patch 32328626	* Patch 32392141

11.2.0.4 Grid Infrastructure Patch Set Update

Release Date	Version	Download link
17-Oct-2023	11.2.0.4.231017 (Oct 2023) Grid Infrastructure Patch Set Update (GI PSU)	* Patch 35685688
18-Jul-2023	11.2.0.4.230718 (Jul 2023) Grid Infrastructure Patch Set Update (GI PSU)	* Patch 35369867
18-Apr-2023	11.2.0.4.230418 (Apr 2023) Grid Infrastructure Patch Set Update (GI PSU)	* Patch 35058300
17-Jan-2023	11.2.0.4.230117 (Jan 2023) Grid Infrastructure Patch Set Update (GI PSU)	* Patch 34774506
18-Oct-2022	11.2.0.4.221018 (Oct 2022) Grid Infrastructure Patch Set Update (GI PSU)	* Patch 34536853
19-Jul-2022	11.2.0.4.220719 (Jul 2022) Grid Infrastructure Patch Set Update (GI PSU)	* Patch 34204533
19-Apr-2022	11.2.0.4.220419 (Apr 2022) Grid Infrastructure Patch Set Update (GI PSU)	* Patch 33829709
18-Jan-2022	11.2.0.4.220118 (Jan 2022) Grid Infrastructure Patch Set Update (GI PSU)	* Patch 33575261
19-Oct-2021	11.2.0.4.211019 (Oct 2021) Grid Infrastructure Patch Set Update (GI PSU)	* Patch 33248354
20-Jul-2021	11.2.0.4.210720 (Jul 2021) Grid Infrastructure Patch Set Update (GI PSU)	* Patch 32917428
20-Apr-2021	11.2.0.4.210420 (Apr 2021) Grid Infrastructure Patch Set Update (GI PSU)	* Patch 32495145

11.2.0.4 OJVM Patch Set Update

Release Date	Version	Unix PSU Patch	Windows Bundle Patch
17-Oct-2023	11.2.0.4.231017 (Oct 2023) OJVM Component Patch Set Update	Patch 35685663	* Out of Error Correction
18-Jul-2023	11.2.0.4.230718 (Jul 2023) OJVM Component Patch Set Update	Patch 35349843	* Out of Error Correction
18-Apr-2023	11.2.0.4.230418 (Apr 2023) OJVM Component Patch Set Update	Patch 35039831	* Out of Error Correction
17-Jan-2023	11.2.0.4.230117 (Jan 2023) OJVM Component Patch Set Update	Patch 34763334	* Out of Error Correction
18-Oct-2022	11.2.0.4.221018 (Oct 2022) OJVM Component Patch Set Update	Patch 34412266	* Patch 34513867
19-Jul-2022	11.2.0.4.220719 (Jul 2022) OJVM Component Patch Set Update	Patch 34085652	* Patch 34185082
19-Apr-2022	11.2.0.4.220419 (Apr 2022) OJVM Component Patch Set Update	Patch 33829826	* Patch 33881335
18-Jan-2022	11.2.0.4.220118 (Jan 2022) OJVM Component Patch Set Update	Patch 33561250	* Patch 33577510
19-Oct-2021	11.2.0.4.211019 (Oct 2021) OJVM Component Patch Set Update	Patch 33192642	* Patch 33248711
20-Jul-2021	11.2.0.4.210720 (Jul 2021) OJVM Component Patch Set Update	Patch 32876451	* Patch 32905855
20-Apr-2021	11.2.0.4.210420 (Apr 2021) OJVM Component Patch Set Update	Patch 32671980	* Patch 32428494

再现ORA-600 4000故障处理

联系：手机/微信(+86 17813235971) QQ(107644445)

标题：再现ORA-600 4000故障处理

有一个10g的库，由于redo损坏导致无法正常recover成功
20231018111911

正常途径无法open成功,尝试强制打开库

Wed Oct 18 11:23:25 2023
alter database open resetlogs
Wed Oct 18 11:23:25 2023
RESETLOGS is being done without consistancy checks. This may result
in a corrupted database. The database should be recreated.
RESETLOGS after incomplete recovery UNTIL CHANGE 236715370
Resetting resetlogs activation ID 4009817354 (0xef00f50a)
Wed Oct 18 11:23:26 2023
Setting recovery target incarnation to 3
Wed Oct 18 11:23:26 2023
Assigning activation ID 4271120987 (0xfe94225b)
Thread 1 opened at log sequence 1
  Current log# 1 seq# 1 mem# 0: D:\ORADATA\EAIS\REDO01.LOG
Successful open of redo thread 1
Wed Oct 18 11:23:26 2023
MTTR advisory is disabled because FAST_START_MTTR_TARGET is not set
Wed Oct 18 11:23:26 2023
SMON: enabling cache recovery
Wed Oct 18 11:23:27 2023
Errors in file d:\hys_db\admin\eais\udump\eais_ora_10916.trc:
ORA-00600: 内部错误代码, 参数: [4000], [9], [], [], [], [], [], []

Wed Oct 18 11:23:28 2023
Errors in file d:\hys_db\admin\eais\udump\eais_ora_10916.trc:
ORA-00704: 引导程序进程失败
ORA-00704: 引导程序进程失败
ORA-00600: 内部错误代码, 参数: [4000], [9], [], [], [], [], [], []

Wed Oct 18 11:23:28 2023
Error 704 happened during db open, shutting down database
USER: terminating instance due to error 704
Wed Oct 18 11:23:28 2023
Errors in file d:\hys_db\admin\eais\bdump\eais_pmon_1764.trc:
ORA-00704: bootstrap process failure

Wed Oct 18 11:23:29 2023
Errors in file d:\hys_db\admin\eais\bdump\eais_reco_9628.trc:
ORA-00704: bootstrap process failure

Wed Oct 18 11:23:29 2023
Errors in file d:\hys_db\admin\eais\bdump\eais_smon_9884.trc:
ORA-00704: bootstrap process failure

Wed Oct 18 11:23:29 2023
Errors in file d:\hys_db\admin\eais\bdump\eais_ckpt_10096.trc:
ORA-00704: bootstrap process failure

Wed Oct 18 11:23:29 2023
Errors in file d:\hys_db\admin\eais\bdump\eais_lgwr_8932.trc:
ORA-00704: bootstrap process failure

Wed Oct 18 11:23:29 2023
Errors in file d:\hys_db\admin\eais\bdump\eais_dbw0_9892.trc:
ORA-00704: bootstrap process failure

Wed Oct 18 11:23:29 2023
Errors in file d:\hys_db\admin\eais\bdump\eais_mman_9472.trc:
ORA-00704: bootstrap process failure

Wed Oct 18 11:23:29 2023
Errors in file d:\hys_db\admin\eais\bdump\eais_psp0_7692.trc:
ORA-00704: bootstrap process failure

Instance terminated by USER, pid = 10916
ORA-1092 signalled during: alter database open resetlogs...

resetlogs失败,报ora-600 4000错误,查看相关trace文件

*** 2023-10-18 11:23:27.103
ksedmp: internal or fatal error
ORA-00600: 内部错误代码, 参数: [4000], [9], [], [], [], [], [], []
Current SQL statement for this session:
select ctime, mtime, stime from obj$ where obj# = :1
----- Call Stack Trace -----
calling              call     entry                argument values in hex      
location             type     point                (? means dubious value)     
-------------------- -------- -------------------- ----------------------------
_ksedst+38           CALLrel  _ksedst1+0           0 1
_ksedmp+898          CALLrel  _ksedst+0            0
_ksfdmp+14           CALLrel  _ksedmp+0            3
603A816A             CALLreg  00000000             6AE8258 3
603A8550             CALLrel  603A80D8             6AE8258 4FB1090 FA0 1 8C886B0
__VInfreq__ktudba+1  CALLrel  _kgeasi+0            6AE8258 4FB1090 FA0 2 1 0 9 0
26                                                 
_ktrgcm+851          CALLrel  _ktudba+0            9 8C88B68 0 0
_ktrgtc+526          CALLrel  _ktrgcm+0            4FC753C
_kdsgrp+937          CALLrel  _ktrgtc+0            4FC753C 4FC74E0 1F1FB00
                                                   8C88CB4 240 2AED19C 1F1F71C
_kdsfbrcb+432        CALLrel  _kdsgrp+0            4FC7538 0 4FC7538
_qertbFetchByRowID+  CALLrel  _kdsfbrcb+0          4FC7538 4FDF004 0 1 0 0
4344                                               4FC74E0 22E8078 8C88E14 0
_opifch2+3104        CALL???  00000000             8DA05838 20135FC 8C890AC 1
_opifch+51           CALLrel  _opifch2+0           89 5 8C891F0
_opiodr+1099         CALLreg  00000000             5 2 8C89938
_rpidrus+178         CALLrel  _opiodr+0            5 2 8C89938 5
_rpidru+88           CALLrel  _rpidrus+0           8C894C4
_rpiswu2+426         CALLreg  00000000             8C8988C
_rpidrv+1461         CALLrel  _rpiswu2+0           90F3CCB4 0 8C89860 2 8C89880
                                                   0 8C89860 0 84DF58 84E018
                                                   8C8988C 8
_rpifch+44           CALLrel  _rpidrv+0            5 5 8C89938 8
_kqdpts+166          CALLrel  _rpifch+0            5 5 5 3 90AE2383 7 C 0 0 0 0
                                                   0 0 0 5 2 90AE237C 7 C 0 0 0
                                                   0 0 0 0
_kqrlfc+478          CALLrel  _kqdpts+0            90AE21F4
_kqlbplc+102         CALLrel  _kqrlfc+0            
_kqlblfc+240         CALLrel  _kqlbplc+0           0
_adbdrv+12911        CALLrel  _kqlblfc+0           0 8C8D034
_opiexe+11778        CALLrel  _adbdrv+0            
_opiosq0+6088        CALLrel  _opiexe+0            4 0 8C8D894
_kpooprx+232         CALLrel  _opiosq0+0           3 E 8C8D9AC A4
_kpoal8+775          CALLrel  _kpooprx+0           8C8F6CC 8C8E248 1D 1 0 A4
_opiodr+1099         CALLreg  00000000             5E 17 8C8F6C8
60FEFF8D             CALLreg  00000000             5E 17 8C8F6C8 0
_opitsk+1017         CALL???  00000000             
_opiino+1087         CALLrel  _opitsk+0            0 0
_opiodr+1099         CALLreg  00000000             3C 4 8C8FC60
_opidrv+819          CALLrel  _opiodr+0            3C 4 8C8FC60 0
_sou2o+45            CALLrel  _opidrv+0            3C 4 8C8FC60
_opimai_real+112     CALLrel  _sou2o+0             8C8FC54 3C 4 8C8FC60
_opimai+92           CALLrel  _opimai_real+0       2 8C8FC8C
_OracleThreadStart@  CALLrel  _opimai+0            
4+708                                              
74A93438             CALLptr  00000000             
76F09830             CALLreg  00000000             
76F09800             CALLrel  76F0980B             
 
--------------------- Binary Stack Dump ---------------------

通过一些技巧处理数据库正常open,导出数据完成本次恢复，参考以前恢复类似case:

重现ORA-600 4000异常
 通过bbed解决ORA-00600[4000]案例
 记录一次ORA-600 4000数据库故障恢复
 ORACLE 8.1.7 数据库ORA-600 4000故障恢复

ORA-600 12807（CON$.CON#达到最大值）处理

联系：手机/微信(+86 17813235971) QQ(107644445)

标题：ORA-600 12807（CON$.CON#达到最大值）处理

这次阳了有点严重，客户现场打patch无法去，在家里远程值守,在电脑前面闲着就查询和重现了最近朋友和我说的他们的客户遇到ORA-600 12807的故障.查询了下mos,基本上可以确认是由于CON$.CON#达到理论最大值无法继续增加从而报该错误,参考文档:
Mechanism to Recycle Database Constraint Identifiers (Doc ID 2925056.1)
Bug 13781691 – ORA-600 [12807] if CON$.CON# very high due to bug 13784384 (Doc ID 13781691.8)
Bug 25343563 – Mechanism to Implement Constraint Identifier (con#) Recycling (Doc ID 25343563.8)
在12及其之后的版本中oracle发布了patch 25343563 并设置event启用该patch进行解决.但是如果是12c之前版本,官方没有提供直接的解决方案.最基本的解决方法就是进行数据逻辑迁移,以及避免频繁创建约束导致con$.con#消耗太大

通过试验重现该错误

SQL> create table t_xff  (id number not null,name varchar2(100) not null);
create table t_xff  (id number not null,name varchar2(100) not null)
*
ERROR at line 1:
ORA-00600: internal error code, arguments: [12807], [], [], [], [], [], [], [],
[], [], [], []

SQL>  create table t_xff  (id number,name varchar2(100));

Table created.

SQL> alter table t_xff add primary key(id);
alter table t_xff add primary key(id)
*
ERROR at line 1:
ORA-00600: internal error code, arguments: [12807], [], [], [], [], [], [], [],
[], [], [], []


SQL> select con# from sys.con$ where name='_NEXT_CONSTRAINT';

      CON#
----------
4294967294

通过一些底层分析,并对部分底层基表进行patch实现数据库可以继续创建约束

SQL>  alter table t_xff add primary key(id);

Table altered.

使用临时的patch方法,可以快速的恢复业务,后续找适当时间点安排迁移.
在此提醒:对于一些创建中间对象或者临时对象频繁的系统(特别是大量主键,not null等)注意检查该值距离天花板距离,如果比较接近了最好安排一次逻辑迁移和找出来原因(是oracle bug还是应用触发)

非tns方式登录pdb方法

联系：手机/微信(+86 17813235971) QQ(107644445)

标题：非tns方式登录pdb方法

非tns方式登录pdb方法之—-alter session set container

[oracle@db01 ~]$ env|grep ORA
ORACLE_SID=DCXFF
ORACLE_BASE=/u01/app/oracle
ORACLE_HOME=/u01/app/oracle/product/19c/db_1
[oracle@db01 ~]$ sqlplus / as sysdba

SQL*Plus: Release 19.0.0.0.0 - Production on Mon Oct 9 22:10:34 2023
Version 19.20.0.0.0

Copyright (c) 1982, 2022, Oracle.  All rights reserved.


Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.20.0.0.0

SQL> show pdbs;

    CON_ID CON_NAME                       OPEN MODE  RESTRICTED
---------- ------------------------------ ---------- ----------
         2 PDB$SEED                       READ ONLY  NO
         3 XFFPDB1                        READ WRITE NO
SQL> show con_name;

CON_NAME
------------------------------
CDB$ROOT
SQL> alter session set container=XFFPDB1;

Session altered.

SQL> show con_name;

CON_NAME
------------------------------
XFFPDB1
SQL> exit
Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.20.0.0.0

非tns方式登录pdb方法之—-ORACLE_PDB_SID

[oracle@db01 ~]$ export ORACLE_PDB_SID=XFFPDB1
[oracle@db01 ~]$ sqlplus / as sysdba

SQL*Plus: Release 19.0.0.0.0 - Production on Mon Oct 9 22:11:30 2023
Version 19.20.0.0.0

Copyright (c) 1982, 2022, Oracle.  All rights reserved.


Connected to:
Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.20.0.0.0

SQL> SHOW pdbs;

    CON_ID CON_NAME                       OPEN MODE  RESTRICTED
---------- ------------------------------ ---------- ----------
         3 XFFPDB1                        READ WRITE NO
SQL> show con_name;

CON_NAME
------------------------------
XFFPDB1
SQL> exit
Disconnected from Oracle Database 19c Enterprise Edition Release 19.0.0.0.0 - Production
Version 19.20.0.0.0

参考:How To Connect to PDB By OS Authentication In 19c Container Database Environment (Doc ID 2729416.1)

ORA-07445: exception encountered: core dump [kdxlin()+4088]处理

联系：手机/微信(+86 17813235971) QQ(107644445)

标题：ORA-07445: exception encountered: core dump [kdxlin()+4088]处理

abort方式关闭数据库，启动报错

Tue Sep 19 21:52:56 2023
NOTE: dependency between database orcl and diskgroup resource ora.DATA.dg is established
Tue Sep 19 21:52:57 2023
Reconfiguration started (old inc 4, new inc 6)
List of instances:
 1 (myinst: 1) 
 Global Resource Directory frozen
 * dead instance detected - domain 0 invalid = TRUE 
 Communication channels reestablished
 Master broadcasted resource hash value bitmaps
 Non-local Process blocks cleaned out
Tue Sep 19 21:52:57 2023
Tue Sep 19 21:52:57 2023
 LMS 3: 0 GCS shadows cancelled, 0 closed, 0 Xw survived
Tue Sep 19 21:52:57 2023
 LMS 0: 0 GCS shadows cancelled, 0 closed, 0 Xw survived
 LMS 1: 0 GCS shadows cancelled, 0 closed, 0 Xw survived
Tue Sep 19 21:52:57 2023
 LMS 2: 0 GCS shadows cancelled, 0 closed, 0 Xw survived
 Set master node info 
 Submitted all remote-enqueue requests
 Dwn-cvts replayed, VALBLKs dubious
 All grantable enqueues granted
 Post SMON to start 1st pass IR
 Submitted all GCS remote-cache requests
 Post SMON to start 1st pass IR
 Fix write in gcs resources
Reconfiguration complete
Tue Sep 19 21:53:05 2023
Errors in file /u01/app/oracle/diag/rdbms/orcl/orcl1/trace/orcl1_ora_28917.trc  (incident=492333):
ORA-00600: internal error code, arguments: [2131], [33], [32], [], [], [], [], [], [], [], [], []
Incident details in:/u01/app/oracle/diag/rdbms/orcl/orcl1/incident/incdir_492333/orcl1_ora_28917_i492333.trc
Use ADRCI or Support Workbench to package the incident.
See Note 411.1 at My Oracle Support for error and packaging details.
ORA-600 signalled during: ALTER DATABASE MOUNT /* db agent *//* {1:34652:2} */...

重建ctl之后，尝试recover数据库报错ORA-600 3020和ORA-07445 kdxlin等错误

SQL> recover database;
ORA-00600: internal error code, arguments: [3020], [41], [3142531],
[175108995], [], [], [], [], [], [], [], []
ORA-10567: Redo is inconsistent with data block (file# 41, block# 3142531, file
offset is 4268777472 bytes)
ORA-10564: tablespace XIFENFEI
ORA-01110: data file 41: '+DATA/orcl/datafile/xifenfei07.dbf'
ORA-10560: block type 'FIRST LEVEL BITMAP BLOCK'

Wed Sep 20 00:15:00 2023
ALTER DATABASE RECOVER  database  
Media Recovery Start
 started logmerger process
Parallel Media Recovery started with 64 slaves
Wed Sep 20 00:15:02 2023
Recovery of Online Redo Log: Thread 2 Group 6 Seq 67008 Reading mem 0
  Mem# 0: +DATA/orcl/onlinelog/group_6.268.942097791
Recovery of Online Redo Log: Thread 1 Group 2 Seq 81767 Reading mem 0
  Mem# 0: +DATA/orcl/onlinelog/group_2.262.942097651
Recovery of Online Redo Log: Thread 1 Group 5 Seq 81768 Reading mem 0
  Mem# 0: +DATA/orcl/onlinelog/group_5.263.942097651
Wed Sep 20 00:15:08 2023
Hex dump of (file 41, block 3142531) in trace file /u01/app/oracle/diag/rdbms/orcl/orcl1/trace/orcl1_pr1m_45463.trc
Reading datafile '+DATA/orcl/datafile/ts_his3bz07.dbf' for corruption at rdba: 0x0a6ff383 (file 41, block 3142531)
Reread (file 41, block 3142531) found different corrupt data (logically corrupt)
Hex dump of (file 41, block 3142531) in trace file /u01/app/oracle/diag/rdbms/orcl/orcl1/trace/orcl1_pr1m_45463.trc
Wed Sep 20 00:15:08 2023
Exception [type: SIGSEGV, Address not mapped to object][ADDR:0xC] [PC:0x95FB582, kdxlin()+4088][flags: 0x0,count:1]
Wed Sep 20 00:15:08 2023
Exception [type: SIGSEGV, Address not mapped to object][ADDR:0xC] [PC:0x95FB582, kdxlin()+4088][flags: 0x0,count:1]
Errors in file /u01/app/oracle/diag/rdbms/orcl/orcl1/trace/orcl1_pr10_45419.trc  (incident=564584):
ORA-07445: exception encountered:core dump [kdxlin()+4088][SIGSEGV][ADDR:0xC][PC:0x95FB582][Address not mapped to object]
Incident details in: /u01/app/oracle/diag/rdbms/orcl/orcl1/incident/incdir_564640/orcl1_pr17_45433_i564640.trc

尝试随机恢复文件，也遭遇ORA-07445 kdxlin异常

SQL> recover datafile 34;
ORA-00283: recovery session canceled due to errors
ORA-10562: Error occurred while applying redo to data block (file# 34, block#
1999809)
ORA-10564: tablespace XIFENFEI
ORA-01110: data file 34: '+DATA/orcl/datafile/xifeifenfei06'
ORA-10561: block type 'TRANSACTION MANAGED INDEX BLOCK', data object# 97961
ORA-00607: Internal error occurred while making a change to a data block
ORA-00602: internal programming exception
ORA-07445: exception encountered: core dump [kdxlin()+4088] [SIGSEGV]
[ADDR:0xC] [PC:0x95FB582] [Address not mapped to object] []

出现这种情况是由于redo和数据文件块不一致导致无法正常应用日志,人工对于异常的block进行处理,数据库open成功,然后遭遇undo回滚段异常,对其进行规避,数据库open并且稳定运行

bbed解决ORA-01578

联系：手机/微信(+86 17813235971) QQ(107644445)

标题：bbed解决ORA-01578

业务报ORA-01578坏块,无法正常使用,alert日志报错如下

Reading datafile '/data/u01/ZLDOCXML01.DBF' for corruption at rdba: 0x02efdc97 (file 11, block 3136663)
Reread (file 11, block 3136663) found same corrupt data
Wed Sep 13 19:02:04 2023
Corrupt Block Found
         TSN = 10, TSNAME = ZLDOCXML
         RFN = 11, BLK = 3136663, RDBA = 49274007
         OBJN = 73646, OBJD = 73646, OBJECT = SYS_LOB0000073645C00029$$, SUBOBJECT =
         SEGMENT OWNER = ZLDOC, SEGMENT TYPE = Lob Segment
DDE: Problem Key 'ORA 1578' was completely flood controlled (0x6)
Further messages for this problem key will be suppressed for up to 10 minutes

通过dbv检查数据文件,发现只有这一个坏块

[oracle@zlemr ~]$ dbv file=/data/u01/ZLDOCXML01.DBF

DBVERIFY: Release 11.2.0.1.0 - Production on Wed Sep 13 17:51:03 2023

Copyright (c) 1982, 2009, Oracle and/or its affiliates.  All rights reserved.


DBVERIFY - Verification starting : FILE = /data/u01/ZLDOCXML01.DBF
Page 3136663 is influx - most likely media corrupt
Corrupt block relative dba: 0x02efdc97 (file 11, block 3136663)
Fractured block found during dbv: 
Data in bad block:
 type: 40 format: 2 rdba: 0x02efdc97
 last change scn: 0x0002.1065d622 seq: 0x2 flg: 0x04
 spare1: 0x0 spare2: 0x0 spare3: 0x0
 consistency value in tail: 0x00000001
 check value in block header: 0x48cf
 computed block checksum: 0xfe21


DBVERIFY - Verification complete

Total Pages Examined         : 3289600
Total Pages Processed (Data) : 0
Total Pages Failing   (Data) : 0
Total Pages Processed (Index): 21037
Total Pages Failing   (Index): 0
Total Pages Processed (Lob)  : 2051270
Total Pages Failing   (Lob)  : 0
Total Pages Processed (Other): 1068900
Total Pages Processed (Seg)  : 0
Total Pages Failing   (Seg)  : 0
Total Pages Empty            : 148392
Total Pages Marked Corrupt   : 1
Total Pages Influx           : 1
Total Pages Encrypted        : 0
Highest block SCN            : 278716397 (2.278716397)

通过bbed进入进行修复

[oracle@zlemr ~]$ bbed 
Password: 

BBED: Release 2.0.0.0.0 - Limited Production on Wed Sep 13 19:05:53 2023

Copyright (c) 1982, 2009, Oracle and/or its affiliates.  All rights reserved.

************* !!! For Oracle Internal Use only !!! ***************

BBED> set filename '/data/u01/ZLDOCXML01.DBF'
        FILENAME        /data/u01/ZLDOCXML01.DBF

BBED> set block 3136663
        BLOCK#          3136663

BBED> verify
DBVERIFY - Verification starting
FILE = /data/u01/ZLDOCXML01.DBF
BLOCK = 3136663

Block 3136663 is corrupt
Corrupt block relative dba: 0x02efdc97 (file 0, block 3136663)
Fractured block found during verification
Data in bad block:
 type: 40 format: 2 rdba: 0x02efdc97
 last change scn: 0x0002.1065d622 seq: 0x2 flg: 0x04
 spare1: 0x0 spare2: 0x0 spare3: 0x0
 consistency value in tail: 0x00000001
 check value in block header: 0x48cf
 computed block checksum: 0xfe21


DBVERIFY - Verification complete

Total Blocks Examined         : 1
Total Blocks Processed (Data) : 0
Total Blocks Failing   (Data) : 0
Total Blocks Processed (Index): 0
Total Blocks Failing   (Index): 0
Total Blocks Empty            : 0
Total Blocks Marked Corrupt   : 1
Total Blocks Influx           : 2
Message 531 not found;  product=RDBMS; facility=BBED


BBED> map
 File: /data/u01/ZLDOCXML01.DBF (0)
 Block: 3136663                                Dba:0x00000000
------------------------------------------------------------
BBED-00400: invalid blocktype (40)


BBED> d
 File: /data/u01/ZLDOCXML01.DBF (0)
 Block: 3136663           Offsets:    0 to  511           Dba:0x00000000
------------------------------------------------------------------------
 28a20000 97dcef02 22d66510 02000204 cf480000 ae1f0100 00000001 00000280 
 93840000 00000000 00000000 00000000 80dcef02 00000000 000d000a 005b4e3b 
 6cbb533b 5e0867e5 623f8bb0 5f55005d 000d000a 4e3b6cbb 533b5e08 67e5623f 
 8bb05f55 00320030 00320033 002d0030 0039002d 00310033 00200030 0039003a 
 00310036 000d000a 4eca65e5 968f9ec4 4e1d51e4 4e3b6cbb 533b5e08 67e5623f 
 002c60a3 80058bc9 65e08179 75dbff0c 65e053d1 70ed3001 754f5bd2 ff0c65e0 
 59346655 30015934 75db3001 773c82b1 ff0c65e0 9f3b585e 30016d41 6d953001 
 54bd75db 300154b3 55fd3001 54b375f0 ff0c65e0 60765fc3 30015455 5410ff0c 
 65e080f8 95f73001 5fc360b8 3001547c 543856f0 96beff0c 65e05c3f 98913001 
 5c3f6025 30015c3f 75dbff0c 65e08179 6cfb7b49 4e0d9002 ff0c7cbe 795e3001 
 98df6b32 30017761 772053ef ff0c5927 5c0f4fbf 6b635e38 300267e5 4f53ff1a 
 751f547d 5f816b63 5e38ff0c 54bd65e0 51458840 ff0c6241 68434f53 65e080bf 
 5927ff0c 53cc4fa7 4e73623f 4e0d80c0 ff0c4e73 6c415206 6ccc591a ff0c672a 
 89e653ca 786c7ed3 ff0c5fc3 80ba672a 89c1660e 663e5f02 5e38ff0c 81798f6f 
 ff0c8179 90e8538b 75dbff0c 65e053cd 8df375db ff0c80a0 9e2397f3 6b635e38 
 30028f85 52a968c0 67e5ff1a 767d5e26 5e3889c4 ff1a767d 7ec680de 0020002b 

 <32 bytes per line>


BBED> set offset 8188
        OFFSET          8188

BBED> d
 File: /data/u01/ZLDOCXML01.DBF (0)
 Block: 3136663           Offsets: 8188 to 8191           Dba:0x00000000
------------------------------------------------------------------------
 01000000 

 <32 bytes per line>

BBED> set count 32
        COUNT           32

BBED> set mode edit
        MODE            Edit

BBED> d
 File: /data/u01/ZLDOCXML01.DBF (0)
 Block: 3136663           Offsets:   14 to   45           Dba:0x00000000
------------------------------------------------------------------------
 0204cf48 0000ae1f 01000000 00010000 02809384 00000000 00000000 00000000 

 <32 bytes per line>

BBED> set offset 8188
        OFFSET          8188

BBED> m /x 022822d6
 File: /data/u01/ZLDOCXML01.DBF (0)
 Block: 3136663           Offsets: 8188 to 8191           Dba:0x00000000
------------------------------------------------------------------------
 022822d6 

 <32 bytes per line>

BBED> sum apply
Check value for File 0, Block 3136663:
current = 0x48cf, required = 0x48cf

BBED> verify
DBVERIFY - Verification starting
FILE = /data/u01/ZLDOCXML01.DBF
BLOCK = 3136663


DBVERIFY - Verification complete

Total Blocks Examined         : 1
Total Blocks Processed (Data) : 0
Total Blocks Failing   (Data) : 0
Total Blocks Processed (Index): 0
Total Blocks Failing   (Index): 0
Total Blocks Empty            : 0
Total Blocks Marked Corrupt   : 0
Total Blocks Influx           : 0
Message 531 not found;  product=RDBMS; facility=BBED

dbv检测文件正常

[oracle@zlemr ~]$ dbv file=/data/u01/ZLDOCXML01.DBF

DBVERIFY: Release 11.2.0.1.0 - Production on Wed Sep 13 19:17:21 2023

Copyright (c) 1982, 2009, Oracle and/or its affiliates.  All rights reserved.

DBVERIFY - Verification starting : FILE = /data/u01/ZLDOCXML01.DBF


DBVERIFY - Verification complete

Total Pages Examined         : 3289600
Total Pages Processed (Data) : 0
Total Pages Failing   (Data) : 0
Total Pages Processed (Index): 21037
Total Pages Failing   (Index): 0
Total Pages Processed (Lob)  : 2051586
Total Pages Failing   (Lob)  : 0
Total Pages Processed (Other): 1069031
Total Pages Processed (Seg)  : 0
Total Pages Failing   (Seg)  : 0
Total Pages Empty            : 147946
Total Pages Marked Corrupt   : 0
Total Pages Influx           : 0
Total Pages Encrypted        : 0
Highest block SCN            : 278849105 (2.278849105)

业务测试正常,数据完美恢复

Oracle Linux	Oracle Linux Release Date	Oracle Linux Kernel / Architecture / Release String	Red Hat Enterprise Linux	Red Hat Enterprise Linux Kernel / Release String
*Oracle Linux 9*			*Red Hat Enterprise Linux 9*
Oracle Linux 9.1	11 Nov 2022	UEKR7 5.15.0-3.60.5.1.el9uek ^ * (x86_64, aarch64) RHCK 5.14.0-162.6.1.el9_1 (x86_64, aarch64) redhat-release: Red Hat Enterprise Linux release 9.1 (Ootpa) system-release: Oracle Linux Server release 9.1 oracle-release: Oracle Linux Server release 9.1	Red Hat Enterprise Linux 9.1	5.14.0-162.6.1.el9_1 redhat-release: Red Hat Enterprise Linux release 9.1 (Ootpa)
Oracle Linux 9.0 (GA)	01 Jul 2022	UEKR7 5.15.0-0.30.19.el9uek ^ * (x86_64, aarch64) RHCK 5.14.0-70.13.1.0.3.el9_0 ^ (x86_64, aarch64) redhat-release: Red Hat Enterprise Linux release 9.0 (Ootpa) system-release: Oracle Linux Server release 9.0 oracle-release: Oracle Linux Server release 9.0	Red Hat Enterprise Linux 9.0 (GA)	5.14.0-70.13.1.el9_0 redhat-release: Red Hat Enterprise Linux release 9.0 (Ootpa)
*Oracle Linux 8*			*Red Hat Enterprise Linux 8*
Oracle Linux 8.7	16 Nov 2022	UEKR7 5.15.0-3.60.5.1.el8uek ^ * (x86_64, aarch64) RHCK 4.18.0-425.3.1.el8 ^ (x86_64, aarch64) redhat-release: Red Hat Enterprise Linux release 8.7 (Ootpa) system-release: Oracle Linux Server release 8.7 oracle-release: Oracle Linux Server release 8.7	Red Hat Enterprise Linux 8.7	4.18.0-425.3.1.el8 redhat-release: Red Hat Enterprise Linux release 8.7 (Ootpa)
Oracle Linux 8.6	17 May 2022	UEKR6 5.4.17-2136.307.3.1.el8uek ^ * (x86_64, aarch64) RHCK 4.18.0-372.9.1.el8 ^ (x86_64, aarch64) redhat-release: Red Hat Enterprise Linux release 8.6 (Ootpa) system-release: Oracle Linux Server release 8.6 oracle-release: Oracle Linux Server release 8.6	Red Hat Enterprise Linux 8.6	4.18.0-372.9.1.el8 redhat-release: Red Hat Enterprise Linux release 8.6 (Ootpa)
Oracle Linux 8.5	16 Nov 2021	UEKR6 5.4.17-2136.300.7.el8uek ^ * (x86_64, aarch64) RHCK 4.18.0-348.el8 ^ (x86_64, aarch64) redhat-release: Red Hat Enterprise Linux release 8.5 (Ootpa) system-release: Oracle Linux Server release 8.5 oracle-release: Oracle Linux Server release 8.5	Red Hat Enterprise Linux 8.5	4.18.0-348.el8 redhat-release: Red Hat Enterprise Linux release 8.5 (Ootpa)
Oracle Linux 8.4	26 May 2021	UEKR6 5.4.17-2102.201.3.6.2.el8uek ^ * (x86_64, aarch64) RHCK 4.18.0-305.el8 ^ (x86_64, aarch64) redhat-release: Red Hat Enterprise Linux release 8.4 (Ootpa) system-release: Oracle Linux Server release 8.4 oracle-release: Oracle Linux Server release 8.4	Red Hat Enterprise Linux 8.4	4.18.0-305.el8 redhat-release: Red Hat Enterprise Linux release 8.4 (Ootpa)
Oracle Linux 8.3	13 Nov 2020	UEKR6 5.4.17-2011.7.4.el8uek ^ * (x86_64, aarch64) RHCK 4.18.0-240.el8 ^ (x86_64, aarch64) redhat-release: Red Hat Enterprise Linux release 8.3 (Ootpa) system-release: Oracle Linux Server release 8.3 oracle-release: Oracle Linux Server release 8.3	Red Hat Enterprise Linux 8.3	4.18.0-240.el8 redhat-release: Red Hat Enterprise Linux release 8.3 (Ootpa)
Oracle Linux 8.2	06 May 2020	UEKR6 5.4.17-2011.6.2.el8uek ^ * (x86_64) UEKR6 5.4.17-2011.1.2.el8uek ^ * (aarch64) RHCK 4.18.0-193.el8 ^ (x86_64) redhat-release: Red Hat Enterprise Linux release 8.2 (Ootpa) system-release: Oracle Linux Server release 8.2 oracle-release: Oracle Linux Server release 8.2	Red Hat Enterprise Linux 8.2	4.18.0-193.el8 redhat-release: Red Hat Enterprise Linux release 8.2 (Ootpa)
Oracle Linux 8.1	15 Nov 2019	RHCK 4.18.0-147.el8 ^ * (x86_64, aarch64: Developer Preview) UEK unavailable redhat-release: Red Hat Enterprise Linux release 8.1 (Ootpa) system-release: Oracle Linux Server release 8.1 oracle-release: Oracle Linux Server release 8.1	Red Hat Enterprise Linux 8.1	4.18.0-147.el8 redhat-release: Red Hat Enterprise Linux release 8.1 (Ootpa)
Oracle Linux 8.0 (GA)	18 Jul 2019	RHCK 4.18.0-80.el8 ^ * (x86_64, aarch64: Developer Preview) UEK unavailable redhat-release: Red Hat Enterprise Linux release 8.0 (Ootpa) system-release: Oracle Linux Server release 8.0 oracle-release: Oracle Linux Server release 8.0	Red Hat Enterprise Linux 8.0 (GA)	4.18.0-80.el8 redhat-release: Red Hat Enterprise Linux release 8.0 (Ootpa)
*Oracle Linux 7*			*Red Hat Enterprise Linux 7*
Oracle Linux 7.9	07 Oct 2020	UEKR6 5.4.17-2011.6.2.el7uek ^ * (x86_64, aarch64) RHCK 3.10.0-1160.el7 ^ (x86_64) redhat-release: Red Hat Enterprise Linux Server release 7.9 (Maipo) system-release: Oracle Linux Server release 7.9 oracle-release: Oracle Linux Server release 7.9	Red Hat Enterprise Linux 7.9	3.10.0-1160.el7 redhat-release: Red Hat Enterprise Linux Server release 7.9 (Maipo)
Oracle Linux 7.8	08 Apr 2020	UEKR5 4.14.35-1902.300.11.el7uek ^ * (x86_64, aarch64) RHCK 3.10.0-1127.el7 ^ (x86_64) redhat-release: Red Hat Enterprise Linux Server release 7.8 (Maipo) system-release: Oracle Linux Server release 7.8 oracle-release: Oracle Linux Server release 7.8	Red Hat Enterprise Linux 7.8	3.10.0-1127.el7 redhat-release: Red Hat Enterprise Linux Server release 7.8 (Maipo)
Oracle Linux 7.7	15 Aug 2019	UEKR5 4.14.35-1902.3.2.el7uek ^ * (x86_64, aarch64) RHCK 3.10.0-1062.el7 ^ (x86_64) redhat-release: Red Hat Enterprise Linux Server release 7.7 (Maipo) system-release: Oracle Linux Server release 7.7 oracle-release: Oracle Linux Server release 7.7	Red Hat Enterprise Linux 7.7	3.10.0-1062.el7 redhat-release: Red Hat Enterprise Linux Server release 7.7 (Maipo)
Oracle Linux 7.6	07 Nov 2018	UEKR5 4.14.35-1818.3.3.el7uek ^ * (x86_64, aarch64) RHCK 3.10.0-957.el7 ^ (x86_64) redhat-release: Red Hat Enterprise Linux Server release 7.6 (Maipo) system-release: Oracle Linux Server release 7.6 oracle-release: Oracle Linux Server release 7.6	Red Hat Enterprise Linux 7.6	3.10.0-957.el7 redhat-release: Red Hat Enterprise Linux Server release 7.6 (Maipo)
Oracle Linux 7.5	17 Apr 2018	UEKR5 4.14.35-1818.0.9.el7uek ^ * (aarch64) UEKR4 4.1.12-112.16.4.el7uek ^ * (x86_64) RHCK 3.10.0-862.el7 ^ (x86_64) redhat-release: Red Hat Enterprise Linux Server release 7.5 (Maipo) system-release: Oracle Linux Server release 7.5 oracle-release: Oracle Linux Server release 7.5	Red Hat Enterprise Linux 7.5	3.10.0-862.el7 redhat-release: Red Hat Enterprise Linux Server release 7.5 (Maipo)
Oracle Linux 7.4	08 Aug 2017	UEKR4 4.1.12-94.3.9.el7uek ^ * (x86_64) RHCK 3.10.0-693.el7 ^ (x86_64) redhat-release: Red Hat Enterprise Linux Server release 7.4 (Maipo) system-release: Oracle Linux Server release 7.4 oracle-release: Oracle Linux Server release 7.4	Red Hat Enterprise Linux 7.4	3.10.0-514.el7 redhat-release: Red Hat Enterprise Linux Server release 7.3 (Maipo)
Oracle Linux 7.3	10 Nov 2016	UEKR4 4.1.12-61.1.18.el7uek ^ * (x86_64) RHCK 3.10.0-514.el7 ^ (x86_64) redhat-release: Red Hat Enterprise Linux Server release 7.3 (Maipo) system-release: Oracle Linux Server release 7.3 oracle-release: Oracle Linux Server release 7.3	Red Hat Enterprise Linux 7.3	3.10.0-514.el7 redhat-release: Red Hat Enterprise Linux Server release 7.3 (Maipo)
Oracle Linux 7.2	25 Nov 2015	UEKR3 3.8.13-98.6.1.el7uek ^ * (x86_64) RHCK 3.10.0-327.el7 ^ (x86_64) redhat-release: Red Hat Enterprise Linux Server release 7.2 (Maipo) system-release: Oracle Linux Server release 7.2 oracle-release: Oracle Linux Server release 7.2	Red Hat Enterprise Linux 7.2	3.10.0-327.el7 redhat-release: Red Hat Enterprise Linux Server release 7.2 (Maipo)
Oracle Linux 7.1	12 Mar 2015	UEKR3 3.8.13-55.1.6.el7uek ^ * (x86_64) RHCK 3.10.0-229.el7 ^ (x86_64) redhat-release:Red Hat Enterprise Linux Server release 7.1 (Maipo) system-release:Oracle Linux Server release 7.1 oracle-release: Oracle Linux Server release 7.1	Red Hat Enterprise Linux 7.1	3.10.0-229.el7 redhat-release: Red Hat Enterprise Linux Server release 7.1 (Maipo)
Oracle Linux 7.0 (GA)	23 Jul 2014	UEKR3 3.8.13-35.3.1.el7uek ^ * (x86_64) RHCK 3.10.0-123.el7 ^ (x86_64) redhat-release:Red Hat Enterprise Linux Server release 7.0 (Maipo) system-release:Oracle Linux Server release 7.0 oracle-release: Oracle Linux Server release 7.0	Red Hat Enterprise Linux 7.0 (GA)	3.10.0-123.el7 redhat-release: Red Hat Enterprise Linux Server release 7.0 (Maipo)
*Oracle Linux 6*			*Red Hat Enterprise Linux 6*
Oracle Linux 6.10	02 Jul 2018	UEKR4 4.1.12-124.16.4.el6uek ^ * (x86_64 only) UEKR2 2.6.39-400.299.3.el6uek ^ * (x86 only) RHCK 2.6.32-754.el6 ^ (x86, x86_64) redhat-release: Red Hat Enterprise Linux Server release 6.10 (Santiago) system-release: Oracle Linux Server release 6.10 oracle-release: Oracle Linux Server release 6.10	Red Hat Enterprise Linux 6.10	2.6.32-754.el6 redhat-release: Red Hat Enterprise Linux Server release 6.10 (Santiago)
Oracle Linux 6.9	28 Mar 2017	UEKR4 4.1.12-61.1.28.el6uek ^ * (x86_64 only) UEKR2 2.6.39-400.294.3.el6uek ^ * (x86 only) RHCK 2.6.32-696.el6 ^ (x86, x86_64) redhat-release: Red Hat Enterprise Linux Server release 6.9 (Santiago) system-release: Oracle Linux Server release 6.9 oracle-release: Oracle Linux Server release 6.9	Red Hat Enterprise Linux Server 6.9	2.6.32-696.el6 redhat-release: Red Hat Enterprise Linux Server release 6.9 (Santiago)
Oracle Linux 6.8	20 May 2016	UEKR4 4.1.12-37.3.1.el6uek ^ * (x86_64 only) UEKR2 2.6.39-400.278.2.el6uek ^ * (x86 only) RHCK 2.6.32-642.el6 ^ (x86, x86_64) redhat-release: Red Hat Enterprise Linux Server release 6.8 (Santiago) system-release: Oracle Linux Server release 6.8 oracle-release: Oracle Linux Server release 6.8	Red Hat Enterprise Linux Server 6.8	2.6.32-642.el6 redhat-release: Red Hat Enterprise Linux Server release 6.8 (Santiago)
Oracle Linux 6.7	29 Jul 2015	UEKR3 3.8.13-68.3.4.el6uek ^ * (x86_64 only) UEKR2 2.6.39-400.250.7.el6uek ^ * (x86 only) RHCK 2.6.32-573.el6 ^ (x86, x86_64) redhat-release: Red Hat Enterprise Linux Server release 6.7 (Santiago) system-release: Oracle Linux Server release 6.7 oracle-release: Oracle Linux Server release 6.7	Red Hat Enterprise Linux Server 6.7	2.6.32-573.el6 redhat-release: Red Hat Enterprise Linux Server release 6.7 (Santiago)
Oracle Linux 6.6	21 Oct 2014	UEKR3 3.8.13-44.1.1.el6uek ^ * (x86_64 only) UEKR2 2.6.39-400.215.10.el6uek ^ * (x86 only) RHCK 2.6.32-504.el6 ^ (x86, x86_64) redhat-release: Red Hat Enterprise Linux Server release 6.6 (Santiago) system-release: Oracle Linux Server release 6.6 oracle-release: Oracle Linux Server release 6.6	Red Hat Enterprise Linux Server 6.6	2.6.32-504.el6 edhat-release: Red Hat Enterprise Linux Server release 6.6 (Santiago)
Oracle Linux 6.5	27 Nov 2013	UEKR3 3.8.13-16.121.el6uek ^ * (x86_64 only) UEKR2 2.6.39-400.211.1.el6uek ^ * (x86 only) RHCK 2.6.32-431.el6 ^ (x86, x86_64) redhat-release: Red Hat Enterprise Linux Server release 6.5 (Santiago) system-release: Oracle Linux Server release 6.5 oracle-release: Oracle Linux Server release 6.5	Red Hat Enterprise Linux Server 6.5	2.6.32-431.el6 redhat-release: Red Hat Enterprise Linux Server release 6.5 (Santiago)
Oracle Linux 6.4	28 Feb 2013	UEKR2 2.6.39-400.17.1.el6uek ^ * (x86, x86_64) RHCK 2.6.32-358.el6 ^ (x86, x86_64) redhat-release: Red Hat Enterprise Linux Server release 6.4 (Santiago) system-release: Oracle Linux Server release 6.4 oracle-release: Oracle Linux Server release 6.4	Red Hat Enterprise Linux Server 6.4	2.6.32-358.el6 redhat-release: Red Hat Enterprise Linux Server release 6.4 (Santiago)
Oracle Linux 6.3	28 Jun 2012	UEKR2 2.6.39-200.24.1.el6uek ^ * (x86, x86_64) RHCK 2.6.32-279.el6 ^ (x86, x86_64) redhat-release: Red Hat Enterprise Linux Server release 6.3 (Santiago) system-release: Oracle Linux Server release 6.3 oracle-release: Oracle Linux Server release 6.3	Red Hat Enterprise Linux Server 6.3	2.6.32-279.el6 redhat-release: Red Hat Enterprise Linux Server release 6.3 (Santiago)
Oracle Linux 6.2	15 Dec 2011	UEKR1 2.6.32-100.34.1.el6uek ^ * (x86, x86_64) RHCK 2.6.32-220.el6 ^ (x86, x86_64) redhat-release: Red Hat Enterprise Linux Server release 6.2 (Santiago) system-release: Oracle Linux Server release 6.2 oracle-release: Oracle Linux Server release 6.2	Red Hat Enterprise Linux Server 6.2	2.6.32-220.el6 redhat-release: Red Hat Enterprise Linux Server release 6.2 (Santiago)
Oracle Linux 6.1	01 Jun 2011	UEKR1 2.6.32-100.34.1.el6uek ^ * (x86, x86_64) RHCK 2.6.32-131.0.15.el6 ^ (x86, x86_64) redhat-release: Red Hat Enterprise Linux Server release 6.1 (Santiago) system-release: Oracle Linux Server release 6.1 oracle-release: Oracle Linux Server release 6.1	Red Hat Enterprise Linux Server 6.1	2.6.32-131.el6 redhat-release: Red Hat Enterprise Linux Server release 6.1 (Santiago)
Oracle Linux 6.0 (GA)	11 Feb 2011	UEKR1 2.6.32-100.28.5.el6uek ^ * (x86, x86_64) RHCK 2.6.32-71.el6 ^ (x86, x86_64) redhat-release: Red Hat Enterprise Linux Server release 6.0 (Santiago) system-release: Oracle Linux Server release 6.0 oracle-release: Oracle Linux Server release 6.0	Red Hat Enterprise Linux Server 6.0 (GA)	2.6.32-71.el6 redhat-release: Red Hat Enterprise Linux Server release 6.0 (Santiago)
*Oracle Linux 5*			*Red Hat Enterprise Linux 5*
Oracle Linux 5.11	26 Sep 2014	UEKR2 2.6.39-400.215.10.el5uek ^ * (x86, x86_64, ia64) RHCK 2.6.18-398.el5 ^ (x86, x86_64, ia64) RHCK 2.6.18-398.0.0.0.1.el5 (x86, x86_64, ia64) redhat-release: Red Hat Enterprise Linux Server release 5.11 (Tikanga) enterprise-release: Enterprise Linux Enterprise Linux Server release 5.11 (Carthage) oracle-release: Oracle Linux Server release 5.11	Red Hat Enterprise Linux Server 5.11	2.6.18-398.el5 redhat-release: Red Hat Enterprise Linux Server release 5.11 (Tikanga)
Oracle Linux 5.10	08 Oct 2013	UEKR2 2.6.39-400.209.1.el5uek ^ * (x86, x86_64, ia64) RHCK 2.6.18-371.el5 ^ (x86, x86_64) RHCKMOD 2.6.18-371.0.0.0.1.el5 (x86, x86_64, ia64) redhat-release: Red Hat Enterprise Linux Server release 5.10 (Tikanga) enterprise-release: Enterprise Linux Enterprise Linux Server release 5.10 (Carthage) oracle-release: Oracle Linux Server release 5.10	Red Hat Enterprise Linux Server 5.10	2.6.18-371.el5 redhat-release: Red Hat Enterprise Linux Server release 5.10 (Tikanga)
Oracle Linux 5.9	16 Jan 2013	UEKR2 2.6.39-300.26.1.el5uek ^ * (x86, x86_64, ia64) RHCK 2.6.18-348.el5 ^ (x86, x86_64) RHCKMOD 2.6.18-348.0.0.0.1.el5 (x86, x86_64, ia64) redhat-release: Red Hat Enterprise Linux Server release 5.9 (Tikanga) enterprise-release: Enterprise Linux Enterprise Linux Server release 5.9 (Carthage) oracle-release: Oracle Linux Server release 5.9	Red Hat Enterprise Linux Server 5.9	2.6.18-348.el5 redhat-release: Red Hat Enterprise Linux Server release 5.9 (Tikanga)

重建ctl遭遇ORA-01163 ORA-01110和ORA-600 kccccfl_1错误

11.2.0.4 Database Patch Set Update

11.2.0.4 Grid Infrastructure Patch Set Update

11.2.0.4 OJVM Patch Set Update