Bad check value found during backing up datafileBad check value found during backing up datafile

问题背景：

客户反馈alert日志有异常，协助排查原因

1> alert日志如下

  1 Thu Jan 09 01:11:13 2020
  2 Hex dump of (file 15, block 2236158) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99750.trc
  3 Thu Jan 09 01:11:13 2020
  4 Thu Jan 09 01:11:13 2020
  5 Hex dump of (file 15, block 2236158) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99756.trcHex dump of (file 15, block 2236158) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99757.trc
  6 
  7 Corrupt block relative dba: 0x03e21efe (file 15, block 2236158)
  8 Corrupt block relative dba: 0x03e21efe (file 15, block 2236158)
  9 Bad check value found during backing up datafile
 10 Bad check value found during backing up datafile
 11 Data in bad block:
 12 Data in bad block:
 13 type: 0 format: 2 rdba: 0x03e21efe
 14 type: 0 format: 2 rdba: 0x03e21efe
 15 last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05
 16 last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05
 17 spare1: 0x0 spare2: 0x0 spare3: 0x0
 18 spare1: 0x0 spare2: 0x0 spare3: 0x0 consistency value in tail: 0x00000001
 19 
 20 check value in block header: 0xba1c
 21 consistency value in tail: 0x00000001
 22 computed block checksum: 0x7577
 23 check value in block header: 0xba1c
 24 computed block checksum: 0x7577
 25 Reread of blocknum=2236158, file=/home/oracle/oadata/orcl09.dbf. found valid data
 26 Reread of blocknum=2236158, file=/home/oracle/oadata/orcl09.dbf. found valid data
 27 Corrupt block relative dba: 0x03e21efe (file 15, block 2236158)
 28 Bad check value found during backing up datafile
 29 Data in bad block:
 30 type: 0 format: 2 rdba: 0x03e21efe
 31 last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05
 32 spare1: 0x0 spare2: 0x0 spare3: 0x0
 33 consistency value in tail: 0x00000001
 34 check value in block header: 0xba1c
 35 computed block checksum: 0x7577
 36 Reread of blocknum=2236158, file=/home/oracle/oadata/orcl09.dbf. found valid data
 37 Thu Jan 09 01:12:00 2020
 38 Thu Jan 09 01:12:00 2020
 39 Hex dump of (file 14, block 2402782) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99757.trcHex dump of (file 14, block 2402782) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99750.trc
 40 
 41 Corrupt block relative dba: 0x03a4a9de (file 14, block 2402782)Corrupt block relative dba: 0x03a4a9de (file 14, block 2402782)
 42 
 43 Bad check value found during backing up datafileBad check value found during backing up datafile
 44 
 45 Data in bad block:
 46 Data in bad block:
 47 type: 0 format: 2 rdba: 0x03a4a9de
 48 type: 0 format: 2 rdba: 0x03a4a9de
 49 last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05
 50 last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05
 51 spare1: 0x0 spare2: 0x0 spare3: 0x0
 52 spare1: 0x0 spare2: 0x0 spare3: 0x0
 53 consistency value in tail: 0x00000001
 54 consistency value in tail: 0x00000001
 55 check value in block header: 0xd7a
 56 check value in block header: 0xd7a
 57 computed block checksum: 0x4a00
 58 computed block checksum: 0x4a00
 59 Reread of blocknum=2402782, file=/home/oracle/oadata/orcl08.dbf. found valid data
 60 Reread of blocknum=2402782, file=/home/oracle/oadata/orcl08.dbf. found valid data
 61 Thu Jan 09 02:00:00 2020
 62 Clearing Resource Manager plan via parameter
 63 Thu Jan 09 02:16:06 2020
 64 Thu Jan 09 02:16:06 2020
 65 Hex dump of (file 5, block 3823522) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_163742.trcHex dump of (file 5, block 3823522) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_157959.trc
 66 
 67 Thu Jan 09 02:16:06 2020
 68 Thu Jan 09 02:16:06 2020
 69 Hex dump of (file 5, block 3823522) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_162096.trcHex dump of (file 5, block 3823522) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_159129.trc
 70 
 71 Corrupt block relative dba: 0x017a57a2 (file 5, block 3823522)
 72 Corrupt block relative dba: 0x017a57a2 (file 5, block 3823522)
 73 Corrupt block relative dba: 0x017a57a2 (file 5, block 3823522)
 74 Bad check value found during backing up datafile
 75 Data in bad block:
 76 Bad check value found during backing up datafile
 77 type: 6 format: 2 rdba: 0x017a57a2
 78 Data in bad block:
 79 last change scn: 0x0000.fb365bf1 seq: 0x1 flg: 0x04
 80 type: 6 format: 2 rdba: 0x017a57a2
 81 spare1: 0x0 spare2: 0x0 spare3: 0x0
 82 last change scn: 0x0000.fb365bf1 seq: 0x1 flg: 0x04
 83 consistency value in tail: 0x5bf10601
 84 spare1: 0x0 spare2: 0x0 spare3: 0x0
 85 check value in block header: 0xa735
 86 consistency value in tail: 0x5bf10601
 87 computed block checksum: 0x38ea
 88 check value in block header: 0xa735
 89 Corrupt block relative dba: 0x017a57a2 (file 5, block 3823522)
 90 Bad check value found during backing up datafile computed block checksum: 0xdcae
 91 
 92 Data in bad block:
 93 Bad check value found during backing up datafile
 94 type: 6 format: 2 rdba: 0x017a57a2
 95 Data in bad block:
 96 last change scn: 0x0000.fb365bf1 seq: 0x1 flg: 0x04
 97 type: 6 format: 2 rdba: 0x017a57a2
 98 spare1: 0x0 spare2: 0x0 spare3: 0x0
 99 last change scn: 0x0000.fb365bf1 seq: 0x1 flg: 0x04 consistency value in tail: 0x5bf10601
100 spare1: 0x0 spare2: 0x0 spare3: 0x0 check value in block header: 0xa735
101 consistency value in tail: 0x5bf10601 computed block checksum: 0x38ea
102 
103 check value in block header: 0xa735
104 computed block checksum: 0xdcae
105 Reread of blocknum=3823522, file=/opt/app/oracle/oradata/orcl/system01.dbf. found valid dataReread of blocknum=3823522, file=/opt/app/oracle/oradata/orcl/system01.dbf. found valid data
106 Reread of blocknum=3823522, file=/opt/app/oracle/oradata/orcl/system01.dbf. found valid data
107 
108 Reread of blocknum=3823522, file=/opt/app/oracle/oradata/orcl/system01.dbf. found valid data
109 Thu Jan 09 02:17:21 2020
110 Hex dump of (file 10, block 1328161) in trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_21502.trc
111 Corrupt block relative dba: 0x02944421 (file 10, block 1328161)
112 Bad check value found during backing up datafile
113 Data in bad block:
114 type: 6 format: 2 rdba: 0x02944421
115 last change scn: 0x0002.1d713b80 seq: 0x1 flg: 0x06
116 spare1: 0x0 spare2: 0x0 spare3: 0x0
117 consistency value in tail: 0x3b800601
118 check value in block header: 0x49bc
119 computed block checksum: 0x1fde
120 Reread of blocknum=1328161, file=/home/oracle/oadata/orcl04.dbf. found valid data
121 Thu Jan 09 02:21:24 2020
122 Thread 1 advanced to log sequence 1276 (LGWR switch)
123 Current log# 4 seq# 1276 mem# 0: /opt/app/oracle/oradata/orcl/redo04.log

2> 查看trc文件

[oracle@OAapp02 trace]$ more /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99750.trc
Trace file /opt/app/oracle/diag/rdbms/orcl/orcl/trace/orcl_ora_99750.trc
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
ORACLE_HOME = /opt/app/oracle/product/11.2.0/dbhome_1
System name: Linux
Node name: OAapp02
Release: 2.6.32-642.el6.x86_64
Version: #1 SMP Tue May 10 17:27:01 UTC 2016
Machine: x86_64
Instance name: orcl
Redo thread mounted by this instance: 1
Oracle process number: 335
Unix process pid: 99750, image: oracle@OAapp02 (TNS V1-V3)


*** 2020-01-09 01:11:13.237
*** SESSION ID:(1897.31151) 2020-01-09 01:11:13.237
*** CLIENT ID:() 2020-01-09 01:11:13.237
*** SERVICE NAME:(SYS$USERS) 2020-01-09 01:11:13.237
*** MODULE NAME:(backup incr datafile) 2020-01-09 01:11:13.237
*** ACTION NAME:(0000020 STARTED16) 2020-01-09 01:11:13.237

Hex dump of (file 15, block 2236158)
Dump of memory from 0x00007F8196521000 to 0x00007F8196523000
7F8196521000 0000A200 03E21EFE 00000000 05010000 [................]
7F8196521010 0000BA1C 00000000 00000000 00000000 [................]
7F8196521020 00000000 00000000 00000000 00000000 [................]
Repeat 253 times
7F8196522000 0000A23A 00CADEF3 3C094F76 04010002 [:.......vO.<....]
7F8196522010 00007E08 00000000 00000000 00000000 [.~..............]
7F8196522020 00000000 00000000 00000000 00000000 [................]
Repeat 252 times
7F8196522FF0 00000000 00000000 00000000 00000001 [................]
Corrupt block relative dba: 0x03e21efe (file 15, block 2236158)
Bad check value found during backing up datafile
Data in bad block:
type: 0 format: 2 rdba: 0x03e21efe
last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05
spare1: 0x0 spare2: 0x0 spare3: 0x0
consistency value in tail: 0x00000001
check value in block header: 0xba1c
computed block checksum: 0x7577
Reread of blocknum=2236158, file=/home/oracle/oadata/orcl09.dbf. found valid data

*** 2020-01-09 01:12:00.412
Hex dump of (file 14, block 2402782)
Dump of memory from 0x00007F81962C1000 to 0x00007F81962C3000
7F81962C1000 0000A200 03A4A9DE 00000000 05010000 [................]
7F81962C1010 00000D7A 00000000 00000000 00000000 [z...............]
7F81962C1020 00000000 00000000 00000000 00000000 [................]
Repeat 261 times
7F81962C2080 00000000 34540100 0B959D5B 01FF2C00 [......T4[....,..]
7F81962C2090 002EFF80 02010054 0000800C 00000002 [....T...........]
7F81962C20A0 10000001 00CE2B2E 0000091A 00000000 [.....+..........]
7F81962C20B0 0000000A 00010000 00330032 00320033 [........2.3.3.2.]
7F81962C20C0 00000000 00000000 00000000 00000000 [................]
Repeat 19 times
7F81962C2200 00000009 06000000 00000000 4E670100 [..............gN]
7F81962C2210 2C00E151 FF8001FF 00540030 800C0201 [Q..,....0.T.....]
7F81962C2220 00020000 00010000 6A2E1000 091C0044 [...........jD...]
7F81962C2230 00000000 000C0000 00000000 00310001 [..............1.]
7F81962C2240 00000000 00000000 00000000 00000000 [................]
Repeat 218 times
7F81962C2FF0 00000000 00000000 00000000 00000001 [................]
Corrupt block relative dba: 0x03a4a9de (file 14, block 2402782)
Bad check value found during backing up datafile
Data in bad block:
type: 0 format: 2 rdba: 0x03a4a9de
last change scn: 0x0000.00000000 seq: 0x1 flg: 0x05
spare1: 0x0 spare2: 0x0 spare3: 0x0
consistency value in tail: 0x00000001
check value in block header: 0xd7a
computed block checksum: 0x4a00
Reread of blocknum=2402782, file=/home/oracle/oadata/orcl08.dbf. found valid data

上述日志为数据库rman备份时检查数据文件是否有坏块所产生的日志，无需担心