昨天安装的测试环境的rac--2节点
CentOS release 6.8 (Final)
SQL*Plus: Release 11.2.0.4.0 Production
今天测试突然出现问题
在rac01节点上面操作报错
Connected. SQL> select * from v$instance; select * from v$instance * ERROR at line 1: ORA-01012: not logged on Process ID: 0 Session ID: 0 Serial number: 0
这个时候创建表空间，用户均报错
用toad工具连接vip 209，进行创建表空间，用户均可以成功，于是怀疑rac01节点有问题
果然
执行就报错
检查节点1的权限和路径
[root@rac11 ~]# chown -R grid:oinstall /u01/app/11.2.0/grid/ [root@rac11 ~]# ll /u01/app/11.2.0/grid/
这时候asmcmd可以执行
然后登陆sqlplus
[oracle@rac11 ~]$ sqlplus / as sysdba SQL*Plus: Release 11.2.0.4.0 Production on Wed Jun 5 15:48:44 2019 Copyright (c) 1982, 2013, Oracle. All rights reserved. Connected. SQL> select * from v$log; select * from v$log * ERROR at line 1: ORA-01012: not logged on Process ID: 0 Session ID: 0 Serial number: 0
查看错误日志
[oracle@rac11 trace]$ tail -n 100 /u01/app/oracle/diag/rdbms/bol/bol1/trace/alert_bol1.log Fatal NI connect error 12547, connecting to: (DESCRIPTION=(ADDRESS=(PROTOCOL=beq)(PROGRAM=/u01/app/11.2.0/grid/bin/oracle)(ARGV0=oracle+ASM1_o000_bol1)(ENVS='ORACLE_HOME=/u01/app/11.2.0/grid,ORACLE_SID=+ASM1')(ARGS='(DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))'))(enable=setuser)(CONNECT_DATA=(CID=(PROGRAM=oracle@rac11)(HOST=rac11)(USER=oracle)))) VERSION INFORMATION: TNS for Linux: Version 11.2.0.4.0 - Production Oracle Bequeath NT Protocol Adapter for Linux: Version 11.2.0.4.0 - Production Time: 05-JUN-2019 15:51:55 Tracing not turned on. Tns error struct: ns main err code: 12547 TNS-12547: TNS:lost contact ns secondary err code: 12560 nt main err code: 517 TNS-00517: Lost contact nt secondary err code: 32 nt OS err code: 0 ERROR: Failed to connect with connect string: (DESCRIPTION=(ADDRESS=(PROTOCOL=beq)(PROGRAM=/u01/app/11.2.0/grid/bin/oracle)(ARGV0=oracle+ASM1_o000_bol1)(ENVS='ORACLE_HOME=/u01/app/11.2.0/grid,ORACLE_SID=+ASM1')(ARGS='(DESCRIPTION=(LOCAL=YES)(ADDRESS=(PROTOCOL=beq)))'))(enable=setuser)) WARNING: ASM communication error: op 18 state 0x40 (12547) ERROR: slave communication error with ASM NOTE: Deferred communication with ASM instance Errors in file /u01/app/oracle/diag/rdbms/bol/bol1/trace/bol1_pmon_840.trc: ORA-12547: TNS:lost contact
[oracle@rac11 trace]$ more /u01/app/oracle/diag/rdbms/bol/bol1/trace/bol1_pmon_840.trc WARNING: ASM communication error: op 18 state 0x40 (1034) ERROR: slave communication error with ASM NOTE: Deferred communication with ASM instance ORA-01034: ORACLE not available ORA-27123: unable to attach to shared memory segment Linux-x86_64 Error: 13: Permission denied Additional information: 26 Additional information: 360454 WARNING: ASM communication error: op 18 state 0x40 (1034) ERROR: slave communication error with ASM NOTE: Deferred communication with ASM instance ORA-01034: ORACLE not available ORA-27123: unable to attach to shared memory segment Linux-x86_64 Error: 13: Permission denied Additional information: 26 Additional information: 360454
查看db状态
[grid@rac11 ~]$ srvctl status asm -a ASM is running on rac11,rac12 ASM is enabled. [grid@rac11 ~]$ srvctl status database -d bol Instance bol1 is not running on node rac11 Instance bol2 is running on node rac12
节点1没有启动
尝试启动报错
[grid@rac11 ~]$ srvctl start instance -d bol -i bol1 PRCR-1013 : Failed to start resource ora.bol.db PRCR-1064 : Failed to start resource ora.bol.db on node rac11 CRS-5017: The resource action "ora.bol.db start" encountered the following error: ORA-01078: failure in processing system parameters ORA-01565: error in identifying file '+DATA/bol/spfilebol.ora' ORA-17503: ksfdopn:2 Failed to open file +DATA/bol/spfilebol.ora ORA-12547: TNS:lost contact . For details refer to "(:CLSN00107:)" in "/u01/app/11.2.0/grid/log/rac11/agent/crsd/oraagent_oracle//oraagent_oracle.log". CRS-2674: Start of 'ora.bol.db' on 'rac11' failed
没遇到这样的问题，一阵baidu，google骚操作，尝试执行
[grid@rac11 ~]$ ls -l /u01/app/11.2.0/grid/bin/oracle -rwxr-x--x 1 grid oinstall 209914479 Jun 4 15:32 /u01/app/11.2.0/grid/bin/oracle [grid@rac11 ~]$ chmod 6751 /u01/app/11.2.0/grid/bin/oracle [grid@rac11 ~]$ ls -l /u01/app/11.2.0/grid/bin/oracle -rwsr-s--x 1 grid oinstall 209914479 Jun 4 15:32 /u01/app/11.2.0/grid/bin/oracle
[oracle@rac11 ~]$ ls -l /u01/app/oracle/product/11.2.0/db_1/bin/oracle -rwxr-s--x 1 oracle asmadmin 239626641 Jun 4 16:00 /u01/app/oracle/product/11.2.0/db_1/bin/oracle
---rac02 [grid@rac12 ~]$ ls -l /u01/app/11.2.0/grid/bin/oracle -rwsr-s--x 1 grid oinstall 209914479 Jun 4 15:33 /u01/app/11.2.0/grid/bin/oracle [oracle@rac12 ~]$ ls -l /u01/app/oracle/product/11.2.0/db_1/bin/oracle -rwsr-s--x 1 oracle asmadmin 239626641 Jun 4 16:03 /u01/app/oracle/product/11.2.0/db_1/bin/oracle
--rac01 [grid@rac11 ~]$ cd $ORACLE_HOME/bin/ [grid@rac11 bin]$ ll setasmgid -rwxr-x--x 1 grid oinstall 2279833 Jun 4 15:32 setasmgid [grid@rac11 bin]$ set setasmgid setasmgidwrap setfattr setkeycodes setmetamode setsid setup setarch setasmgid0 setfacl setfont setleds setserial setterm setxkbmap [grid@rac11 bin]$ setasmgidwrap o=/u01/app/oracle/product/11.2.0/db_1/bin/oracle [grid@rac11 bin]$ ls -l /u01/app/oracle/product/11.2.0/db_1/bin/oracle -rwxr-s--x 1 oracle asmadmin 239626641 Jun 4 16:00 /u01/app/oracle/product/11.2.0/db_1/bin/oracle [启动实例bol1][grid@rac11 bin]$ srvctl status database -d bol Instance bol1 is running on node rac11 Instance bol2 is running on node rac12
节点01可以启动
--很费劲为什么会出现这样的问题，看了一下history，01,02节点的命令都是一样的，执行的时候也没出什么错误
~~~~~