oracle ORA-07445: exception encountered: core dump [UNABLE_TO_READ] 故障处理

背景：

该报错是业务部门准生产环境在反馈给我的，最开始这个数据库运行的很好，但是业务突然也就是今天凌晨（2020-1-08 02:24:10）左右，业务突然不能够进行。

环境配置：

操作系统：windows 2012 x86-64

数据库版本：oracle 11.2.0.1

内存：32GB

分析思路：

老实说，一提到windows的oracle,而且还是11.2.0.1的版本，我第一直觉就是BUG引起的突发性的数据库抽风,业务程序重新启停再次连接数据库又可以了，但是业务的手工接数，处理中间的数据。

首先业务部门给我的抛出的ORACLE 报错如下：

FetchHandler: 2020-01-08 11:08:02.9136135 Merge 发生异常[ORA-12614: Network Session: Transport not connected to server],开始回滚事务
->ExecJob: 自动接数 发生异常: ORA-12614: Network Session: Transport not connected to server

事务回滚发出的报错，导致业务连不上数据库了。

查看报警日志：

Wed Jan 08 01:27:54 2020
Thread 1 advanced to log sequence 72749 (LGWR switch)
Current log# 2 seq# 72749 mem# 0: F:APPADMINISTRATORORADATATTFCREDO02.LOG
Wed Jan 08 01:32:52 2020
Thread 1 advanced to log sequence 72750 (LGWR switch)
Current log# 3 seq# 72750 mem# 0: F:APPADMINISTRATORORADATATTFCREDO03.LOG
Wed Jan 08 01:39:29 2020
Thread 1 advanced to log sequence 72751 (LGWR switch)
Current log# 1 seq# 72751 mem# 0: F:APPADMINISTRATORORADATATTFCREDO01.LOG
Wed Jan 08 01:44:18 2020
Thread 1 advanced to log sequence 72752 (LGWR switch)
Current log# 2 seq# 72752 mem# 0: F:APPADMINISTRATORORADATATTFCREDO02.LOG
Wed Jan 08 01:49:31 2020
Thread 1 advanced to log sequence 72753 (LGWR switch)
Current log# 3 seq# 72753 mem# 0: F:APPADMINISTRATORORADATATTFCREDO03.LOG
Wed Jan 08 01:56:11 2020
Thread 1 advanced to log sequence 72754 (LGWR switch)
Current log# 1 seq# 72754 mem# 0: F:APPADMINISTRATORORADATATTFCREDO01.LOG
Wed Jan 08 02:00:00 2020
Clearing Resource Manager plan via parameter
Wed Jan 08 02:01:09 2020
Thread 1 advanced to log sequence 72755 (LGWR switch)
Current log# 2 seq# 72755 mem# 0: F:APPADMINISTRATORORADATATTFCREDO02.LOG
Wed Jan 08 02:06:10 2020
Thread 1 advanced to log sequence 72756 (LGWR switch)
Current log# 3 seq# 72756 mem# 0: F:APPADMINISTRATORORADATATTFCREDO03.LOG
Wed Jan 08 02:12:38 2020
Thread 1 advanced to log sequence 72757 (LGWR switch)
Current log# 1 seq# 72757 mem# 0: F:APPADMINISTRATORORADATATTFCREDO01.LOG
Wed Jan 08 02:17:54 2020
Thread 1 advanced to log sequence 72758 (LGWR switch)
Current log# 2 seq# 72758 mem# 0: F:APPADMINISTRATORORADATATTFCREDO02.LOG
Wed Jan 08 02:22:46 2020
Thread 1 advanced to log sequence 72759 (LGWR switch)
Current log# 3 seq# 72759 mem# 0: F:APPADMINISTRATORORADATATTFCREDO03.LOG
Wed Jan 08 02:24:10 2020
Exception [type: ACCESS_VIOLATION, UNABLE_TO_READ] [ADDR:0x216D0000] [PC:0x5EF96F68, 000000005EF96F68]
ERROR: Unable to normalize symbol name for the following short stack (at offset 199):
dbgexProcessError()+193<-dbgeExecuteForError()+65<-dbgePostErrorKGE()+1726<-dbkePostKGE_kgsf()+75<-kgeade()+560<-kgerev()+125<-kgerec5()+60<-sss_xcpt_EvalFilterEx()+1869<-sss_xcpt_EvalFilter()+174<-.1.6_8+59<-00007FFC82401E26<-00007FFC8241349D<-00007FFC823D48D7<-00007FFC8241262A<-000000005EF96F68<-kpxtGetCol()+220<-kpxtInitColInfo()+789<-kpxtTableInit()+973<-kpxsInit()+2230<-kpxsOpen()+527<-PGOSF419_qxxqOpen()+196<-spefcpfa()+1126<-spefmccallstd()+653<-pextproc()+47<-pgmcetc_execute_trusted_c()+345<-pgmccc_call_c()+255<-pciccc_call_c()+382<-kkxmcexe()+864<-PGOSF501_kgmexcb()+59<-PGOSF107_kkxmswu()+111<-kgmexwi()+1101<-kgmexec()+1229<-evapls()+1396<-evaopn2()+1156<-qximeop_fbk()+697<-qximeop()+81<-qxxmeop()+231<-qerxtAgentOpen()+446<-qerxtFetch()+300<-qerwnFetch()+12709<-qervwFetch()+177<-qersqFetch()+183<-rwsfcd()+136<-qerltcFetch()+1447<-insexe()+923<-opiexe()+6188<-kpoal8()+2482<-opiodr()+1662<-ttcpip()+1325<-opitsk()+2040
Errors in file f:appadministratordiag dbms tfc tfc race tfc_ora_4804.trc (incident=255981):
ORA-07445: exception encountered: core dump [PC:0x5EF96F68] [ACCESS_VIOLATION] [ADDR:0x216D0000] [PC:0x5EF96F68] [UNABLE_TO_READ] []
Incident details in: f:appadministratordiag dbms tfc tfcincidentincdir_255981 tfc_ora_4804_i255981.trc
Wed Jan 08 02:24:12 2020
Sweep [inc][255981]: completed
Sweep [inc2][255981]: completed
Wed Jan 08 02:24:12 2020
Trace dumping is performing id=[cdmp_20200108022412]
Wed Jan 08 02:29:30 2020
Thread 1 advanced to log sequence 72760 (LGWR switch)
Current log# 1 seq# 72760 mem# 0: F:APPADMINISTRATORORADATATTFCREDO01.LOG
Wed Jan 08 02:35:28 2020
Thread 1 advanced to log sequence 72761 (LGWR switch)
Current log# 2 seq# 72761 mem# 0: F:APPADMINISTRATORORADATATTFCREDO02.LOG
Wed Jan 08 02:40:50 2020
Thread 1 advanced to log sequence 72762 (LGWR switch)
Current log# 3 seq# 72762 mem# 0: F:APPADMINISTRATORORADATATTFCREDO03.LOG
Wed Jan 08 02:46:45 2020
Thread 1 advanced to log sequence 72763 (LGWR switch)
Current log# 1 seq# 72763 mem# 0: F:APPADMINISTRATORORADATATTFCREDO01.LOG
Wed Jan 08 02:53:22 2020
Thread 1 advanced to log sequence 72764 (LGWR switch)
Current log# 2 seq# 72764 mem# 0: F:APPADMINISTRATORORADATATTFCREDO02.LOG
Wed Jan 08 02:59:47 2020
Thread 1 advanced to log sequence 72765 (LGWR switch)
Current log# 3 seq# 72765 mem# 0: F:APPADMINISTRATORORADATATTFCREDO03.LOG
Wed Jan 08 03:06:15 2020
Thread 1 advanced to log sequence 72766 (LGWR switch)
Current log# 1 seq# 72766 mem# 0: F:APPADMINISTRATORORADATATTFCREDO01.LOG
Wed Jan 08 03:13:16 2020
Thread 1 advanced to log sequence 72767 (LGWR switch)
Current log# 2 seq# 72767 mem# 0: F:APPADMINISTRATORORADATATTFCREDO02.LOG
Wed Jan 08 03:21:51 2020
Thread 1 cannot allocate new log, sequence 72768
Private strand flush not complete

报警日志提示的是：

ORA-07445: exception encountered: core dump [PC:0x5EF96F68] [ACCESS_VIOLATION] [ADDR:0x216D0000] [PC:0x5EF96F68] [UNABLE_TO_READ] []

查看响应的trace文件ttfc_ora_4804.trc： 

Dump file f:appadministratordiag dbms tfc tfcincidentincdir_255981 tfc_ora_4804_i255981.trc
Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
Windows NT Version V6.2
CPU : 16 - type 8664, 8 Physical Cores
Process Affinity : 0x0x0000000000000000
Memory (Avail/Total): Ph:17905M/30719M, Ph+PgF:25844M/38911M
Instance name: ttfc
Redo thread mounted by this instance: 1
Oracle process number: 29
Windows thread id: 4804, image: ORACLE.EXE (SHAD)

*** 2020-01-08 02:24:10.412
*** SESSION ID:(1848.379) 2020-01-08 02:24:10.412
*** CLIENT ID:() 2020-01-08 02:24:10.412
*** SERVICE NAME:(ttfc) 2020-01-08 02:24:10.412
*** MODULE NAME:(NP.Live.DataProces.dll) 2020-01-08 02:24:10.412
*** ACTION NAME:() 2020-01-08 02:24:10.412

Dump continued from file: f:appadministratordiag dbms tfc tfc race tfc_ora_4804.trc
ORA-07445: exception encountered: core dump [PC:0x5EF96F68] [ACCESS_VIOLATION] [ADDR:0x216D0000] [PC:0x5EF96F68] [UNABLE_TO_READ] []

========= Dump for incident 255981 (ORA 7445 [PC:0x5EF96F68]) ========
----- Beginning of Customized Incident Dump(s) -----
Exception [type: ACCESS_VIOLATION, UNABLE_TO_READ] [ADDR:0x216D0000] [PC:0x5EF96F68, 000000005EF96F68]

Oracle Database 11g Enterprise Edition Release 11.2.0.1.0 - 64bit Production
Process Id: 0x000009b4 Thread Id : 0x000012c4 Time : Wed Jan 08 02:24:10
Excp. Code: 0xc0000005 Excp. Type: ACCESS_VIO Flags: 0x00000000

------------------- Registers ----------------------------
ip=000000005EF96F68 sp=0000000021565F98 rp=0000000000000017
r1=455441445F545052 r2=FFFFFFFFFED690A8 r3=00000000216D0000
r4=0000000020A7DAD8 r5=0000000021565F98 r6=0000000000000017 r7=0000000020392968
r8=0000000020A7DAD8 r9=0000000000000000 r10=8101010101010100 r11=7EF8FEF8FEF8E0FC
r12=00000000204390A0 r13=00000000203B06E0 r14=0000000021566070 r15=000000001F2CACC0
------------------- End of Registers ---------------------

*** 2020-01-08 02:24:10.412
dbkedDefDump(): Starting a non-incident diagnostic dump (flags=0x3, level=3, mask=0x0)
----- Current SQL Statement for this session (sql_id=3hdms3zs7bc07) -----

INSERT INTO INT_BET_BATCH (ID,

PLATFORM_IDENT,

BATCH_NO,

GAMETYPE

) SELECT SEQ_INT_BET_BATCH.NEXTVAL,

PLATFORM_IDENT,

BATCH_NO,

CODE

FROM (

SELECT T.*,

ROW_NUMBER() OVER(PARTITION BY PLATFORM_IDENT,BATCH_NO,CODE ORDER BY BATCH_NO DESC) AS RN

FROM t_r7463743 T

WHERE BATCH_NO IS NOT NULL

)

WHERE RN = 1

----- Call Stack Trace -----
calling call entry argument values in hex
location type point (? means dubious value)
-------------------- -------- -------------------- ----------------------------
000000005EF96F68 0000000000000000 4F4E205349204F4E
A0D4C4C554E2054
50205942204E4F00
5F4D524F4654414C
kpxtGetCol()+220 CALL??? 000000005EF96F68 000000017 020392968 020A7DAD8
0203B06E0
kpxtInitColInfo()+7 CALL??? kpxtGetCol() 020A7E1B0 020A7DAD8 020A7D988
89 02156000A
kpxtTableInit()+973 CALL??? kpxtInitColInfo() 0215663F0 180414274 0203F5234
020430022
kpxsInit()+2230 CALL??? kpxtTableInit() 020A7E1B0 020A7DAD8 0215664F0
000000002
kpxsOpen()+527 CALL??? kpxsInit() 000000050 0099EABCC 000000070
000000058
__PGOSF419_qxxqOpen CALL??? kpxsOpen() 01F33D449 021566DB0 0203BFEB8
()+196 008CF0000
spefcpfa()+1126 CALL??? __PGOSF419_qxxqOpen 000000000 000000000 0203F5508
() 000003000
spefmccallstd()+653 CALL??? spefcpfa() 000000000 0203E0118 0203C0788
021566D00
pextproc()+47 CALL??? spefmccallstd() 01F336D90 00D8468E0 021566DE0
020A84240
pgmcetc_execute_tru CALL??? pextproc() 0000000FF 008D6D3CD 0099C6D20
sted_c()+345 0203BFA38
pgmccc_call_c()+255 CALL??? pgmcetc_execute_tru 0215673B8 01F2DAFA8 000000000
sted_c() 00A539D00
pciccc_call_c()+382 CALL??? pgmccc_call_c() 7FFE00000000 000000000
000000000 000000000
kkxmcexe()+864 CALL??? pciccc_call_c() 0215673B8 7FFECD758158
01F2DB060 01F2DAFA8
__PGOSF501_kgmexcb( CALL??? kkxmcexe() 012068BA0 7FFECD758158
)+59 01F2DB000 01F2DAFA8
__PGOSF107_kkxmswu( CALL??? __PGOSF501_kgmexcb( 012068BA0 0203F5AE0 000000000
)+111 ) 7FFE00000008
kgmexwi()+1101 CALL??? __PGOSF107_kkxmswu( 021567BB0 00D8468E0 0120685E0
) 000000040
kgmexec()+1229 CALL??? kgmexwi() 012068BA0 000000001 021568168
7FFECD758158
evapls()+1396 CALL??? kgmexec() 012068BA0 000000001 021568168
7FFEFBBBF568
evaopn2()+1156 CALL??? evapls() 7FFECA5CA428 0216CB590
0216C0D50 000000000
qximeop_fbk()+697 CALL??? evaopn2() 7FFECA5CA428 3000000000000
000000001 021568908
qximeop()+81 CALL??? qximeop_fbk() 7FFECA5CA428 000000000
012060080 021568A84
qxxmeop()+231 CALL??? qximeop() 000000000 008D539CC 000000000
000000000
qerxtAgentOpen()+44 CALL??? qxxmeop() 7FFECA5CA428 0072295C4
6 000000000 000000001
qerxtFetch()+300 CALL??? qerxtAgentOpen() 000000000 C54B236C318C
000000002 012068BA0
qerwnFetch()+12709 CALL??? qerxtFetch() 7FFECAB0ED10 01F2CDAB8
004E2422A 021569020
qervwFetch()+177 CALL??? qerwnFetch() 020AAC720 000000000 000000000
020AAC720
qersqFetch()+183 CALL??? qervwFetch() 000000000 020AAC7F0 020AAC7F0
000001FF0
rwsfcd()+136 CALL??? qersqFetch() 000000001 00911BE0E 000001FF0
000000000
qerltcFetch()+1447 CALL??? rwsfcd() 000000000 000000000 012068BA0
020AAC720
insexe()+923 CALL??? qerltcFetch() 7FFECA80DDA0 01F2C6E98
004188DEE 021569980
opiexe()+6188 CALL??? insexe() 7FFECAB10E60 02156A910
7FFE00000102 000000000
kpoal8()+2482 CALL??? opiexe()+5169 000000049 000000003 02156AF18
000000001
opiodr()+1662 CALL??? kpoal8() 00000005E 00000001C 02156E100
00ABBF224
ttcpip()+1325 CALL??? opiodr() 00000005E 00000001C 02156E100
4100200000000000
opitsk()+2040 CALL??? ttcpip() 0120828C0 000000000 000000000
000000000
opiino()+1258 CALL??? opitsk() 000000000 000000000 000000000
02156F9F8
opiodr()+1662 CALL??? opiino() 00000003C 000000004 02156FAB0
000000000
opidrv()+864 CALL??? opiodr() 00000003C 000000004 02156FAB0
615C3A6600000000
sou2o()+98 CALL??? opidrv()+150 00000003C 000000004 02156FAB0
000000000
opimai_real()+158 CALL??? sou2o() 05E14CBD6 000000000 000000000
02156FBA4
opimai()+191 CALL??? opimai_real() 7FFC7F8F8B90 7FFC7F8F8D19
000000000 00D8468E0
OracleThreadStart() CALL??? opimai() 000401452 000000002 0085DFE20
+724 0000012C4
00007FFC80BE13D2 CALL??? OracleThreadStart() 020C6FF18 000000000 000000000
000000000
00007FFC823954F4 CALL??? 00007FFC80BE13B0 7FFC80BE13B0 000000000
000000000 000000000

000000000 000000000

--------------------- Binary Stack Dump ---------------------

========== FRAME [1] (000000005EF96F68 -> 0000000000000000) ==========
defined by frame pointers 0x21565f90 and 0x4e52204552000a0d
CALL TYPE: ERROR SIGNALED: no COMPONENT: (null)
Dump of memory from 0x0000000021565F90 to 0x0000000021566390
021565F90 20A7E1B0 00000000 8034C69A 00000001 [... ......4.....]
021565FA0 00000017 00000000 20392968 00000000 [........h)9 ....]
021565FB0 20A7DAD8 00000000 203B06E0 00000000 [... ......; ....]
021565FC0 00000009 00000000 00000001 00000000 [................]
021565FD0 216CFFF8 00000000 216B07B8 00000000 [..l!......k!....]
021565FE0 00000008 00000000 80020000 00000000 [................]
021565FF0 203C0F60 00000000 21566070 00000000 [`.< ....p`V!....]
021566000 216CCA80 00000000 20AD5BF0 00000000 [..l!.....[. ....]
021566010 1F2CACC0 00000000 8034B66D 00000001 [..,.....m.4.....]
021566020 20A7E1B0 00000000 20A7DAD8 00000000 [... ....... ....]
021566030 20A7D988 00000000 2156000A 00000000 [... ......V!....]
021566040 21566070 00000000 203B06E0 00000000 [p`V!......; ....]
021566050 20A7DAD8 00000000 80340013 00000001 [... ......4.....]
021566060 8034AC9C 00000001 215662D0 00000000 [..4......bV!....]
021566070 00000000 00000000 00000000 00000000 [................]
Repeat 6 times
0215660E0 00000000 00000000 204390A0 00000000 [..........C ....]
0215660F0 00000000 00000000 00000000 00000000 [................]
Repeat 28 times
0215662C0 20A7D988 00000000 20A7E1B0 00000000 [... ....... ....]
0215662D0 203B06E0 00000000 20A7DAD8 00000000 [..; ....... ....]
0215662E0 00000013 00000000 203F53E0 00000000 [.........S? ....]
0215662F0 20AD5BF0 00000000 00000022 00000001 [.[. ....".......]
021566300 00000023 00000000 203A3630 00000000 [#.......06: ....]
021566310 00000000 00000000 20430B78 00000000 [........x.C ....]
021566320 203C0FB0 00000000 203C0F60 00000000 [..< ....`.< ....]
021566330 2044CB30 00000000 203BFF54 00000022 [0.D ....T.; "...]
021566340 20A70013 00000000 20A7E1B0 00000000 [... ....... ....]
021566350 203F53E0 00000000 1F2CACC0 00000000 [.S? ......,.....]
021566360 236C3119 0000C54B 20A7D988 00000000 [.1l#K...... ....]
021566370 2044CB30 00000000 203BFF54 00000000 [0.D ....T.; ....]
021566380 20A7DAD8 00000000 203B06E0 00000000 [... ......; ....]

========== FRAME [2] (kpxtGetCol()+220 -> 000000005EF96F68) ==========
defined by frame pointers 0x21566010 and 0x21565f90
CALL TYPE: CALL??? ERROR SIGNALED: no COMPONENT: (null)
Dump of memory from 0x0000000021566010 to 0x0000000021566090
021566010 1F2CACC0 00000000 8034B66D 00000001 [..,.....m.4.....]
021566020 20A7E1B0 00000000 20A7DAD8 00000000 [... ....... ....]
021566030 20A7D988 00000000 2156000A 00000000 [... ......V!....]
021566040 21566070 00000000 203B06E0 00000000 [p`V!......; ....]
021566050 20A7DAD8 00000000 80340013 00000001 [... ......4.....]
021566060 8034AC9C 00000001 215662D0 00000000 [..4......bV!....]
021566070 00000000 00000000 00000000 00000000 [................]
Repeat 1 times

========== FRAME [3] (kpxtInitColInfo()+789 -> kpxtGetCol()) ==========
defined by frame pointers 0x215663a0 and 0x21566010
CALL TYPE: CALL??? ERROR SIGNALED: no COMPONENT: (null)
Dump of memory from 0x00000000215663A0 to 0x0000000021566730
0215663A0 20443428 00000000 8034B135 00000001 [(4D ....5.4.....]
0215663B0 215663F0 00000000 80414274 00000001 [.cV!....tBA.....]
0215663C0 203F5234 00000000 20430022 00000000 [4R? ....".C ....]
0215663D0 216CCA80 00000000 20A7E1B0 00000000 [..l!....... ....]
0215663E0 203B06E0 00000000 20A7D988 00000000 [..; ....... ....]
0215663F0 20A7DAD8 00000000 00000000 00000000 [... ............]
021566400 2044CB30 00000000 203A3630 00000000 [0.D ....06: ....]
021566410 216CCA80 00000000 20392DE0 00000000 [..l!.....-9 ....]
021566420 203B06E0 00000000 20AD5BF0 00000000 [..; .....[. ....]
021566430 0034A054 00000022 203F5234 00000000 [T.4."...4R? ....]
021566440 00000001 00000000 20443428 00000000 [........(4D ....]
021566450 20A7DAD8 00000000 20A7D988 00000000 [... ....... ....]
021566460 2043BE30 00000000 20AD5BF0 00000000 [0.C .....[. ....]
021566470 203F55E0 00000000 203BFA88 00000000 [.U? ......; ....]
021566480 00000001 00000000 80206CD6 00000001 [.........l .....]
021566490 20A7E1B0 00000000 20A7DAD8 00000000 [... ....... ....]
0215664A0 215664F0 00000000 00000002 00000000 [.dV!............]
0215664B0 203F5508 00000000 203F53E0 00000000 [.U? .....S? ....]
0215664C0 2043BE30 00000000 203BFA88 00000000 [0.C ......; ....]
0215664D0 20AD5A50 00000000 20A7E1B0 00000000 [PZ. ....... ....]
0215664E0 20A7D988 00000000 20A7DAD8 00000000 [... ....... ....]
0215664F0 00000000 00000000 203B06E0 00000000 [..........; ....]
021566500 20443428 00000000 20392E30 00000000 [(4D ....0.9 ....]
021566510 203932A0 00000000 20393318 00000000 [.29 .....39 ....]
021566520 20392EF8 00000000 20392F98 00000000 [..9 ...../9 ....]
021566530 1F2CACC0 00000000 203F5508 00000000 [..,......U? ....]
021566540 00000190 00000000 00000004 009C4000 [.............@..]
021566550 00000000 00000000 00000001 00000000 [................]
021566560 00000002 00000000 00000002 00000001 [................]
021566570 203F5302 00000001 00000000 00000000 [.S? ............]
021566580 203C0BE8 00000000 203BFE88 00000000 [..< ......; ....]
021566590 2043BE30 00000000 20AD5BF0 00000000 [0.C .....[. ....]
0215665A0 203F55E0 00000000 21566840 00000000 [.U? ....@hV!....]
0215665B0 203F53E0 00000000 80205C81 00000001 [.S? ..... .....]
0215665C0 00000050 00000000 099EABCC 00000000 [P...............]
0215665D0 00000070 00000000 00000058 00000000 [p.......X.......]
0215665E0 203F53E0 00000000 2043BE30 00000000 [.S? ....0.C ....]
0215665F0 203BFA88 00000000 20AD5A50 00000000 [..; ....PZ. ....]
021566600 20AD5A10 00000000 20AD59A0 00000000 [.Z. .....Y. ....]
021566610 203BF798 00000000 203BF6C0 00000000 [..; ......; ....]
021566620 20A7E1B0 00000000 20A7D988 00000000 [... ....... ....]
021566630 20A7DAD8 00000000 09201A40 00000000 [... ....@. .....]
021566640 036AC684 00000000 036AC684 00000000 [..j.......j.....]
021566650 203BF6C0 00000000 20AD5A10 00000000 [..; .....Z. ....]
021566660 203BFC20 00000000 20AD59A0 00000000 [ .; .....Y. ....]
021566670 2043BE30 00000000 203BF798 00000000 [0.C ......; ....]
021566680 203BF6C0 00000000 092271A4 00000000 [..; .....q".....]
021566690 120685E0 00000000 00020C68 00000000 [........h.......]
0215666A0 00000000 00000000 00020B78 00000000 [........x.......]
0215666B0 099EAC90 00000000 099EA868 00000000 [........h.......]
0215666C0 00000000 00000000 00000000 00000000 [................]
0215666D0 20A68B98 00000000 203BFBF0 00000000 [... ......; ....]
0215666E0 20A7E1B0 00000000 20A7D988 00000000 [... ....... ....]
0215666F0 20A7DAD8 00000000 20443428 00000000 [... ....(4D ....]
021566700 20AD5960 00000000 203BFC20 00000000 [`Y. .... .; ....]
021566710 203B06E0 00000000 1FE20460 00000000 [..; ....`.......]
021566720 236C3119 0000C54B 203C0BE8 00000000 [.1l#K.....< ....]

以下SQL语句是接数的一个插入过程，平时都好好的，而且我查询结果，仍然没有问题，

INSERT INTO INT_BET_BATCH (ID,

PLATFORM_IDENT,

BATCH_NO,

GAMETYPE

) SELECT SEQ_INT_BET_BATCH.NEXTVAL,

PLATFORM_IDENT,

BATCH_NO,

CODE

FROM (

SELECT T.*,ROW_NUMBER() OVER(PARTITION BY PLATFORM_IDENT,BATCH_NO,CODE ORDER BY BATCH_NO DESC) AS RN

FROM t_r7463743 T WHERE BATCH_NO IS NOT NULL

) WHERE RN = 1；

于是乎，就是support 搜索资料，查看有那些解决办法；

1.support 上有说要重建触发器的（Doc ID 2014421.1）

这个站不住脚，没有用触发器，

2.有说是需要修改隐形参数_complex_view_merging（Doc ID 1578532.1）

修改语句：alter system set "_complex_view_merging"=TRUE scope=both;

我查看使用的隐形参数：

SELECT A.KSPPINM NAME, B.KSPPSTVL VALUE, A.KSPPDESC DESCRIPTION
FROM sys.X$KSPPI A, sys.X$KSPPCV B
WHERE A.INDX = B.INDX
AND A.KSPPINM LIKE '_complex_view_merging';

 很明显不对啊，本身就是true；而且，由于是准生产环境，没有开启归档模式，所以也没有进行rman备份，也还有说是。

3.修改隐含参数_optim_peek_user_binds

终于找到一个比较类似的文档了（Doc ID 1499916.1）

说的是1.1.0.7即以上版本

The following error is generated:

ORA-07445: exception encountered: core dump [qksbgGetCursorVal()+77] [ACCESS_VIOLATION] [ADDR:0x88CB7A9F0] [PC:0x1EFE303] [UNABLE_TO_READ] []

and call stack that is like :

qksbgGetCursorVal <- kxsBindPeekEnabled <- kxsPeekBinds <- kksCompareBinds <- kksfbc <- opiexe <- opipls <- opiodr <- rpidrus <- rpidru  <- rpiswu2 <- rpidrv <- psddr0 <- psdnal <- pevm_EXECC

 

引起的原因是：

This is caused by Bug:14276485: ORA-7445[QKSBGGETCURSORVAL()+63] AND ORA-7445[QKSBGGETVAL()+4659] OCCURRED.

closed as duplicate of :

Bug:12656350: OLTP : PERF - 110602 - ATOMICS( 

 

处理的办法一共三种：

1.Upgrade to 12.1 which includes the fix of Bug:12656350. 

-OR-

2.Apply Patch 12656350 if available for your platform & version.

-OR-

3.Either workaround the issue with:

 SQL > ALTER SYSTEM SET "_optim_peek_user_binds"=false;

查看隐含参数_optim_peek_user_binds

 

 默认是开启的，所以需要关闭。

ALTER SYSTEM SET "_optim_peek_user_binds"=false; 后期进行观察跟进。

 

结论：

1.11.2.0.4之前的版本（11g）很容易出发BUG,所以一般生产上建议使用11.2.0.4比较稳定的版本。

2.此次解决是业务程序进行了重启，并且修改参数，后期观察（如果还是触发，只能够升级到12.1，或者打上Patch 12656350 这个补丁）

 

后续：

ALTER SYSTEM SET "_optim_peek_user_binds"=false; 后期进行观察跟进。这个修改后，还是触发，所以建议还是打上补丁号Patch 12656350 ；由于环境是11.2.0.1，没有windows的补丁(11.2.0.2有)，中有hp-unix,还是建议升级成11.2.0.4打上最新的前一个季度的psu.