rhel 6.4 + udev + 11.2.0.3 + asm 单点安装

第一块磁盘的大小为50G,安装RHEL6.4 及 gi standalone,oracle software。
第二块磁盘的大小为40G,使用udev配置成asm的磁盘。


安装OS结束后，执行下面的步骤

cd /mnt
mkdir cdrom
mount /dev/cdrom /mnt/cdrom


chkconfig cups off
chkconfig sendmail off
chkconfig isdn off
chkconfig smartd off
chkconfig iptables off

reboot

创建第二块盘
cd D:Program FilesVMwareVMware Server

vmware-vdiskmanager.exe -c -s 40000Mb -a lsilogic -t 2 H:/VM_ware/asm_data1.vmdk

下面类容添加到 dbasm 的 Red Hat Linux.vmx中

scsi1.present = "TRUE" 
scsi1.virtualDev = "lsilogic" 
scsi1.sharedBus = "virtual" 

scsi1:1.present = "TRUE" 
scsi1:1.mode = "independent-persistent" 
scsi1:1.filename = "H:/VM_ware/asm_data1.vmdk" 
scsi1:1.deviceType = "plainDisk" 

disk.locking = "false" 
diskLib.dataCacheMaxSize = "0" 
diskLib.dataCacheMaxReadAheadSize = "0" 
diskLib.DataCacheMinReadAheadSize = "0" 
diskLib.dataCachePageSize = "4096" 
diskLib.maxUnsyncedWrites = "0"

需要添加内容结束


修改OS的信息

vi /etc/sysconfig/network

NETWORKING=yes
NETWORKING_IPV6=no
HOSTNAME=dbasm

vi /etc/sysconfig/network-scripts/ifcfg-eth0

DEVICE=eth0
BOOTPROTO=static
HWADDR=00:0C:29:59:4B:00
ONBOOT=yes
IPADDR=10.1.1.35
NETMASK=255.255.255.0
GATEWAY=10.1.1.1


vi /etc/hosts
10.1.1.35 asmnode


--重启网络服务，使修改生效
service network restart


建立oracle,grid用户
11gr2建议将oracle用户的权限分离，当然不分离也是可以的，不过分离是应该的，
把数据库用户和存储用户区别开，就好比 data tablespace 和index tablespace 一样让人概念清晰，管理方便
估计会在12c中强制分离

创建 相应 的组
 groupadd -g 501 oinstall
 groupadd -g 502 dba
 groupadd -g 503 oper

 groupadd -g 504 asmadmin
 groupadd -g 505 asmdba
 groupadd -g 506 asmoper
 
创建oracle用户及grid用户，这里可以看出grid的权限是比oracle大的
 useradd -u 1100 -g oinstall -G asmdba,dba,oper oracle
 useradd -u 1110 -g oinstall -G asmadmin,asmdba,asmoper,dba,oper grid

修改用户的密码
 passwd oracle
 passwd grid


如果有错可以用usermod 命令修改
usermod -G osasm,osdba,osoper,dba,oper oracle


创建目录
mkdir -p /u01/app/oracle/product/11.2.0/db_1
mkdir -p /u01/app/grid/product/11.2.0/grid_1
mkdir -p /u01/app/gridbase

chown -R oracle:oinstall /u01/app
chown -R grid:oinstall /u01/app/grid
chown -R grid:oinstall /u01/app/gridbase
chmod -R 775 /u01

修改一些系统配置
vi /etc/security/limits.conf
#ORACLE SETTING
grid                 soft    nproc   655350
grid                 hard    nproc   655350
grid                 soft    nofile  655350
grid                 hard    nofile  655350

oracle               soft    nproc   655350
oracle               hard    nproc   655350
oracle               soft    nofile  655350
oracle               hard    nofile  655350


vi /etc/pam.d/login
#ORACLE SETTING
session    required    /lib64/security/pam_limits.so
session    required    pam_limits.so


vi /etc/sysctl.conf
#ORACLE SETTING
#kernel.shmall = 2097152
#kernel.shmmax = 536870912
kernel.shmmni = 4096
kernel.sem = 250 32000 100 128
fs.aio-max-nr = 1048576
fs.file-max = 6815744
net.ipv4.ip_local_port_range = 9000 65500
net.core.rmem_default = 262144
net.core.rmem_max = 4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048586

立即生效
sysctl -p

禁止selinux
vi /etc/selinux/config
SELINUX=disabled


关掉防火墙
service iptables status
service iptables stop
chkconfig iptables off


--应该是不需要的，单机需要时间同步？在11gr2 RAC中建议使用CTSS
gird时间同步所需要的设置，Network Time Protocol Setting

/sbin/service ntpd stop
chkconfig ntpd off
mv /etc/ntp.conf /etc/ntp.conf.bak 或者 rm /etc/ntp.conf

fdisk 处理裸设备，切记不要格式化为文件系统 

特别注意：如果是虚拟机，就要在虚拟机的配置文件里设置 disk.EnableUUID = "TRUE",否则 scsci_id 获取不到磁盘的字符串
/dev/sdb1
/dev/sdb2
/dev/sdb3

/sbin/partprobe /dev/sdb1
/sbin/partprobe /dev/sdb2
/sbin/partprobe /dev/sdb3

配置udev设备
touch /etc/udev/rules.d/99-oracle-asmdevices.rules

#添加记录到/etc/scsi_id.config，如果没有该文件，则手动创建
echo "options=--whitelisted --replace-whitespace"  >> /etc/scsi_id.config

for i in b1 b2 b3
do
echo "KERNEL=="sd$i", BUS=="scsi", PROGRAM=="/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/$parent", RESULT=="`/sbin/scsi_id --whitelisted --replace-whitespace --device=/dev/sd${i:0:1}`", NAME="asm-disk$i", OWNER="grid", GROUP="asmadmin", MODE="0660""      
done;

输出结果添加到 /etc/udev/rules.d/99-oracle-asmdevices.rules

# /sbin/udevadm control --reload-rules
# start_udev

# ls -lrt /dev/asm*

oracle 用户的.bash_profile 文件
vi /home/oracle/.bash_profile

export ORACLE_BASE=/u01/app/oracle
export ORACLE_HOME=$ORACLE_BASE/product/11.2.0/db_1
export ORACLE_SID=dbasm
#export TNS_ADMIN=$ORACLE_HOME/network/admin
#export ORA_NLS10=$ORACLE_HOME/nls/data
export NLS_LANG=AMERICAN_AMERICA.ZHS16GBK

export PATH=.:${PATH}:$HOME/bin:$ORACLE_HOME/bin
export PATH=${PATH}:/usr/bin:/bin:/usr/bin/X11:/usr/local/bin
export PATH=${PATH}:$ORACLE_BASE/common/oracle/bin

export LD_LIBRARY_PATH=$ORACLE_HOME/lib
export LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:$ORACLE_HOME/oracm/lib
export LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:/lib:/usr/lib:/usr/local/lib

export CLASSPATH=$ORACLE_HOME/JRE
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/jlib
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/rdbms/jlib
export CLASSPATH=${CLASSPATH}:$ORACLE_HOME/network/jlib

export TEMP=/tmp
export TMP=/tmp
export TMPDIR=/tmp


用户的.bash_profile 文件 ORACLE_HOSTNAME请自行设置
vi /home/grid/.bash_profile
export ORACLE_BASE=/u01/app/gridbase
export ORACLE_HOME=/u01/app/grid/product/11.2.0/grid_1
export ORACLE_SID=+ASM

export TEMP=/tmp
export TMP=/tmp
export TMPDIR=/tmp

PATH=$ORACLE_HOME/bin:$PATH; export PATH


yum 配置

vi /etc/yum.conf
追加如下内容
[base]
name=base pyb yum test
baseurl=file:///mnt/cdrom
gpgkey=file:///mnt/cdrom/RPM-GPG-KEY-redhat-release

[updates-released]
name= updates-released pyb yum test
baseurl=file:///mnt/cdrom
gpgkey=file:///mnt/cdrom/RPM-GPG-KEY-redhat-release

修改其中的 gpgcheck参数，改为gpgcheck=0 
修改其中的 enabled参数，改为enabled=1 


先安装 gi software ，可以仅安装软件，或者安装软件时同时配置( standalone)。建议后面一种方式。
再安装 oracle software，之后再dbca建库

安装 grid software，这里是仅安装软件，中间会检查系统参数和OS的依赖包，用yum install 安装就可以了
最后运行弹出窗口的脚本
/u01/app/oraInventory/orainstRoot.sh
/u01/app/grid/product/11.2.0/grid_1/root.sh


配置监听
[grid@asmnode software]$ netca 

运行asmca
[grid@asmnode software]$ asmca

如果只安装软件，在运行asmca 时会报错，需要 以root运行 grid 用户的这个文件 
# perl /u01/app/grid/product/11.2.0/grid_1/crs/install/roothas.pl 
可以会出错，提示要先卸载
# perl /u01/app/grid/product/11.2.0/grid_1/crs/install/roothas.pl -verbose -deconfig -force


重新运行root.sh
# /u01/app/grid/product/11.2.0/grid_1/root.sh
# perl /u01/app/grid/product/11.2.0/grid_1/crs/install/roothas.pl

下面为相关的日志输出，供学习研究用
# perl /u01/app/grid/product/11.2.0/grid_1/crs/install/roothas.pl
Using configuration parameter file: /u01/app/grid/product/11.2.0/grid_1/crs/install/crsconfig_params
User ignored Prerequisites during installation
CRS is already configured on this node for crshome=/u01/app/grid/product/11.2.0/grid_1
Cannot configure two CRS instances on the same cluster.
Please deconfigure before proceeding with the configuration of new home. 


# perl /u01/app/grid/product/11.2.0/grid_1/crs/install/roothas.pl -verbose -deconfig -force
Using configuration parameter file: /u01/app/grid/product/11.2.0/grid_1/crs/install/crsconfig_params
PRKO-2573 : ONS daemon is already stopped.
CRS-2500: Cannot stop resource 'ora.cssd' as it is not running
CRS-4000: Command Stop failed, or completed with errors.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'asmnodedup'
CRS-2673: Attempting to stop 'ora.evmd' on 'asmnodedup'
CRS-2677: Stop of 'ora.evmd' on 'asmnodedup' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'asmnodedup' has completed
CRS-4133: Oracle High Availability Services has been stopped.

Successfully deconfigured Oracle Restart stack

# /u01/app/grid/product/11.2.0/grid_1/root.sh
Performing root user operation for Oracle 11g 

The following environment variables are set as:
    ORACLE_OWNER= grid
    ORACLE_HOME=  /u01/app/grid/product/11.2.0/grid_1

Enter the full pathname of the local bin directory: [/usr/local/bin]: 
The contents of "dbhome" have not changed. No need to overwrite.
The contents of "oraenv" have not changed. No need to overwrite.
The contents of "coraenv" have not changed. No need to overwrite.

Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.

To configure Grid Infrastructure for a Stand-Alone Server run the following command as the root user:
/u01/app/grid/product/11.2.0/grid_1/perl/bin/perl -I/u01/app/grid/product/11.2.0/grid_1/perl/lib -I/u01/app/grid/product/11.2.0/grid_1/crs/install /u01/app/grid/product/11.2.0/grid_1/crs/install/roothas.pl

To configure Grid Infrastructure for a Cluster execute the following command:
/u01/app/grid/product/11.2.0/grid_1/crs/config/config.sh
This command launches the Grid Infrastructure Configuration Wizard. The wizard also supports silent operation, and the parameters can be passed through the response file that is available in the installation media.



# perl /u01/app/grid/product/11.2.0/grid_1/crs/install/roothas.pl
Using configuration parameter file: /u01/app/grid/product/11.2.0/grid_1/crs/install/crsconfig_params
User ignored Prerequisites during installation
LOCAL ADD MODE 
Creating OCR keys for user 'grid', privgrp 'oinstall'..
Operation successful.
LOCAL ONLY MODE 
Successfully accumulated necessary OCR keys.
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
CRS-4664: Node asmnodedup successfully pinned.
Adding Clusterware entries to upstart

asmnode     2016/04/26 08:56:20     /u01/app/grid/product/11.2.0/grid_1/cdata/asmnodedup/backup_20160426_085620.olr
Successfully configured Oracle Grid Infrastructure for a Standalone Server


grid 用户下，注意用sysasm登录(11g新加的角色)
$ sqlplus /nolog
SQL> conn / as sysasm
Connected.
SQL> shutdown immediate
ASM diskgroups dismounted
ASM instance shutdown
------------
如果在11g grid 下启动asm实例会报 ORA-29701 错误
$ sqlplus / as sysasm
SQL*Plus: Release 11.2.0.3.0 Production onTue Apr 26 15:44:30 2016
Copyright (c) 1982, 2011, Oracle.  All rights reserved.
Connected to an idle instance.
SQL> startup
ORA-01078: failure in processing system parameters
ORA-29701: unable to connect to Cluster Synchronization Service

那是因为css没有起来，可以手动起来，或者稍等一下，因为重启后会随着系统启动，存在延迟

注意用户.bash_profile 的 ORACLE_SID 和dbca 的实例名的大小写

--检查css
crsctl check css  
ps -ef|grep -i cssd

--检查has
crsctl check has  
ps -ef|grep -i d.bin

手动启动css
crsctl start resource ora.cssd  

手动启动全部资源
crsctl start resource -all

# ./crs_stat -t -v
Name           Type           R/RA   F/FT   Target    State     Host        
----------------------------------------------------------------------
ora.DG_DATA.dg ora....up.type 0/5    0/     ONLINE    ONLINE    asmnode     
ora.asm        ora.asm.type   0/5    0/     ONLINE    ONLINE    asmnode     
ora.cssd       ora.cssd.type  0/5    0/5    ONLINE    ONLINE    asmnode     
ora.dbasm.db   ora....se.type 0/2    0/1    ONLINE    ONLINE    asmnode     
ora.diskmon    ora....on.type 0/10   0/5    OFFLINE   OFFLINE               
ora.evmd       ora.evm.type   0/10   0/5    ONLINE    ONLINE    asmnode     
ora.ons        ora.ons.type   0/3    0/     OFFLINE   OFFLINE   

# ./crsctl status resource -t -init
--------------------------------------------------------------------------------
NAME           TARGET  STATE        SERVER                   STATE_DETAILS       
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DG_DATA.dg
               ONLINE  ONLINE       asmnode                                      
ora.asm
               ONLINE  ONLINE       asmnode                  Started             
ora.ons
               OFFLINE OFFLINE      asmnode                                      
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.cssd
      1        ONLINE  ONLINE       asmnode                                      
ora.dbasm.db
      1        ONLINE  ONLINE       asmnode                  Open                
ora.diskmon
      1        OFFLINE OFFLINE                                                   
ora.evmd
      1        ONLINE  ONLINE       asmnode   

1)默认情况下HAS(High Availability Service)是自动启动的.通过如下命令可以取消和启用自动启动
        crsctl disable has        
        crsctl enable has      
2)HAS手动启动和停止        
        crsctl start has        
        crsctl stop has      
3)查看HAS的状态        
        crsctl check has      
4)如果想让ora.css和ora.diskmon服务随着HAS的启动而自动启动，
  那么你可以这两个服务的AUTO_START属性        
  crsctl modify resource "ora.cssd" -attr "AUTO_START=1"       
  or         
  crsctl modify resource "ora.diskmon" -attr "AUTO_START=1"   
  
5)如果想取消ora.css和ora.diskmon的Auto start         
  crsctl modify resource "ora.cssd" -attr "AUTO_START=never"  
  or  
  crsctl modify resource "ora.diskmon" -attr "AUTO_START=never"

----------------------------------------------------------

安装oracle software,仅安装数据库软件
下一步，一直下一步 注意选择 only database software
/u01/app/oracle/product/11.2.0/db_1/root.sh 

分别运行后 数据库软件就算安装完毕了

开始创建数据库，运行dbca
$ dbca

注意存储时选择ASM，

DG_DATA01

注意选择数据库的编码，要和OS的 NLS_LANG 变量一致

再后面是创建数据库了，没什么好说的了