为了避免dblink造成的影响，对公司的一套11.2.0.3.5的单实例，升级到11.2.0.3.15过程记录
1.停止数据库
shutdown immediate;
2.root用户备份db_home grid_home
tar -cvf /export/oracle20180602.tar /u01/app/oracle/product/11.2.0/db_1/* -p -P
tar -cvf /export/grid20180602.tar /u01/11.2.0/grid/* -p -P
tar -cvf /export/oraInventory20180602.tar /u01/app/oraInventory/* -p -P
3.开始打补丁
4.开始GI的补丁应用
# opatch auto /u01/software -oh /u01/11.2.0/grid -ocmrf /home/grid/ocm.rsp
[root@xxxx01 OPatch]# ./opatch auto /u01/software -oh /u01/11.2.0/grid -ocmrf /home/grid/ocm.rsp
Executing /u01/11.2.0/grid/perl/bin/perl /u01/11.2.0/grid/OPatch/crs/patch11203.pl -patchdir /u01 -patchn software -oh /u01/11.2.0/grid -ocmrf /home/grid/ocm.rsp -paramfile /u01/11.2.0/grid/crs/install/crsconfig_params
This is the main log file: /u01/11.2.0/grid/cfgtoollogs/opatchauto2018-06-02_19-17-15.log
This file will show your detected configuration and all the steps that opatchauto attempted to do on your system:
/u01/11.2.0/grid/cfgtoollogs/opatchauto2018-06-02_19-17-15.report.log
2018-06-02 19:17:15: Starting Oracle Restart Patch Setup
Using configuration parameter file: /u01/11.2.0/grid/crs/install/crsconfig_params
Stopping CRS...
Stopped CRS successfully
patch /u01/software/17592127 apply successful for home /u01/11.2.0/grid
patch /u01/software/20760997 apply successful for home /u01/11.2.0/grid
Starting CRS...
CRS-4123: Oracle High Availability Services has been started.
opatch auto succeeded.
[root@xxxx01 OPatch]#
5.开始DB补丁应用
# opatch auto /u01/software -oh /u01/app/oracle/product/11.2.0/db_1 -ocmrf /home/oracle/ocm.rsp
[root@xxxx01 OPatch]# ./opatch auto /u01/software -oh /u01/app/oracle/product/11.2.0/db_1 -ocmrf /home/oracle/ocm.rsp
Executing /u01/11.2.0/grid/perl/bin/perl /u01/app/oracle/product/11.2.0/db_1/OPatch/crs/patch11203.pl -patchdir /u01 -patchn software -oh /u01/app/oracle/product/11.2.0/db_1 -ocmrf /home/oracle/ocm.rsp -paramfile /u01/11.2.0/grid/crs/install/crsconfig_params
This is the main log file: /u01/app/oracle/product/11.2.0/db_1/cfgtoollogs/opatchauto2018-06-02_19-27-17.log
This file will show your detected configuration and all the steps that opatchauto attempted to do on your system:
/u01/app/oracle/product/11.2.0/db_1/cfgtoollogs/opatchauto2018-06-02_19-27-17.report.log
2018-06-02 19:27:17: Starting Oracle Restart Patch Setup
Using configuration parameter file: /u01/11.2.0/grid/crs/install/crsconfig_params
Stopping RAC /u01/app/oracle/product/11.2.0/db_1 ...
Stopped RAC /u01/app/oracle/product/11.2.0/db_1 successfully
patch /u01/software/17592127/custom/server/17592127 apply successful for home /u01/app/oracle/product/11.2.0/db_1
patch /u01/software/20760997 apply failed for home /u01/app/oracle/product/11.2.0/db_1 <<<<<<<<db补丁升级失败
Starting RAC /u01/app/oracle/product/11.2.0/db_1 ...
Started RAC /u01/app/oracle/product/11.2.0/db_1 successfully
opatch auto succeeded.
[root@xxxx01 OPatch]
db补丁升级失败。检查日志/u01/app/oracle/product/11.2.0/db_1/cfgtoollogs/opatchauto2018-06-02_19-27-17.log
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++
2018-06-02 19:28:08: The apply patch output is Oracle Interim Patch Installer version 11.2.0.3.19
Copyright (c) 2018, Oracle Corporation. All rights reserved.
Oracle Home : /u01/app/oracle/product/11.2.0/db_1
Central Inventory : /u01/app/oraInventory
from : /u01/app/oracle/product/11.2.0/db_1/oraInst.loc
OPatch version : 11.2.0.3.19
OUI version : 11.2.0.3.0
Log file location : /u01/app/oracle/product/11.2.0/db_1/cfgtoollogs/opatch/opatch2018-06-02_19-28-03PM_1.log
Verifying environment and performing prerequisite checks...
Prerequisite check "CheckActiveFilesAndExecutables" failed.
The details are:
Following executables are active :
/u01/app/oracle/product/11.2.0/db_1/lib/libclntsh.so.11.1
UtilSession failed: Prerequisite check "CheckActiveFilesAndExecutables" failed.
Log file location: /u01/app/oracle/product/11.2.0/db_1/cfgtoollogs/opatch/opatch2018-06-02_19-28-03PM_1.log
OPatch failed with error code 73
2018-06-02 19:28:08: patch /u01/software/20760997 apply failed for home /u01/app/oracle/product/11.2.0/db_1
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++
检查/u01/app/oracle/product/11.2.0/db_1/cfgtoollogs/opatch/opatch2018-06-02_19-28-03PM_1.log，发现oracle的一个lib文件被占用了，导致failed
[Jun 2, 2018 7:28:08 PM] [INFO] Finish fuser command /sbin/fuser /u01/app/oracle/product/11.2.0/db_1/lib/libclntsh.so.11.1 at Sat Jun 02 19:28:08 CST 2018
[Jun 2, 2018 7:28:08 PM] [INFO] Files in use by a process: /u01/app/oracle/product/11.2.0/db_1/lib/libclntsh.so.11.1 PID( 464 ) <<<<464进程
[Jun 2, 2018 7:28:08 PM] [INFO] Following executables are active :
/u01/app/oracle/product/11.2.0/db_1/lib/libclntsh.so.11.1
[Jun 2, 2018 7:28:08 PM] [INFO] Prerequisite check "CheckActiveFilesAndExecutables" failed.
The details are:
Following executables are active :
/u01/app/oracle/product/11.2.0/db_1/lib/libclntsh.so.11.1
[Jun 2, 2018 7:28:08 PM] [INFO] Start fuser command /sbin/fuser /u01/app/oracle/product/11.2.0/db_1/bin/amdu at Sat Jun 02 19:28:08 CST 2018
[Jun 2, 2018 7:28:08 PM] [INFO] Finish fuser command /sbin/fuser /u01/app/oracle/product/11.2.0/db_1/bin/amdu at Sat Jun 02 19:28:08 CST 2018
[Jun 2, 2018 7:28:08 PM] [INFO] Start fuser command /sbin/fuser /u01/app/oracle/product/11.2.0/db_1/bin/kfed at Sat Jun 02 19:28:08 CST 2018
[Jun 2, 2018 7:28:08 PM] [INFO] Finish fuser command /sbin/fuser /u01/app/oracle/product/11.2.0/db_1/bin/kfed at Sat Jun 02 19:28:08 CST 2018
+++++++++++++++++++++++++++++++++++++++++++++++++++++++++
检查哪些进程在使用该文件libclntsh.so.11.1。 有两个ggsci进程，占用了该文件
[root@xxxx01 ~]# lsof|grep libclntsh.so.11.1
ggsci 378 ggate mem REG 253,8 52693988 689586 /u01/app/oracle/product/11.2.0/db_1/lib/libclntsh.so.11.1 <<<<<<<<<<<<<
ggsci 464 oracle mem REG 253,8 52693988 689586 /u01/app/oracle/product/11.2.0/db_1/lib/libclntsh.so.11.1 <<<<<<<<<<<<<
ohasd.bin 30906 grid mem REG 253,8 52735196 922358 /u01/11.2.0/grid/lib/libclntsh.so.11.1
oraagent. 32111 grid mem REG 253,8 52735196 922358 /u01/11.2.0/grid/lib/libclntsh.so.11.1
evmd.bin 32127 grid mem REG 253,8 52735196 922358 /u01/11.2.0/grid/lib/libclntsh.so.11.1
tnslsnr 32130 grid mem REG 253,8 52735196 922358 /u01/11.2.0/grid/lib/libclntsh.so.11.1
evmlogger 32175 grid mem REG 253,8 52735196 922358 /u01/11.2.0/grid/lib/libclntsh.so.11.1
cssdagent 32191 grid mem REG 253,8 52735196 922358 /u01/11.2.0/grid/lib/libclntsh.so.11.1
ocssd.bin 32215 grid mem REG 253,8 52735196 922358 /u01/11.2.0/grid/lib/libclntsh.so.11.1
[root@xxxx01 ~]# kill -9 464 378
再次打db补丁。应用ok
6.检查升级后的补丁
[oracle@xxxx01 OPatch]$ ./opatch lspatches
20760997;Database Patch Set Update : 11.2.0.3.15 (20760997)
17592127;Grid Infrastructure Patch Set Update : 11.2.0.3.9 (HAS Components)
OPatch succeeded.
[oracle@xxxx01 OPatch]$
至此打补丁结束