1 准备工作

1.1 关于GRID的一些变化

1.1.1 简化的基于映像的Oracle Grid Infrastructure安装

从Oracle Grid Infrastructure 12c第2版（12.2）开始，Oracle Grid Infrastructure软件可用作下载和安装的映像文件。

此功能大大简化了Oracle Grid Infrastructure的安装过程。

注意：你必须将GRID软件解压缩到希Grid Home位于的目录中，然后运行gridSetup.sh脚本以启动Oracle Grid Infrastructure安装。

1.1.2 支持Oracle域服务集群和Oracle成员集群

从Oracle Grid Infrastructure 12c第2版（12.2）开始，Oracle Grid Infrastructure安装程序支持部署Oracle域服务集群和Oracle成员集群的选项。

1.1.3 支持Oracle可扩展集群

从Oracle Grid Infrastructure 12c第2版（12.2）开始，Oracle Grid Infrastructure安装程序支持将不同位置的集群节点配置为Oracle扩展集群的选项。 Oracle扩展集群由位于称为站点的多个位置的节点组成。

1.1.4 全局网格基础设施管理知识库-GIMR

Oracle Grid Infrastructure部署现在支持全局离群网格基础架构管理存储库（GIMR）。此存储库是具有用于每个集群的GIMR的可插入数据库（PDB）的多租户数据库。全局GIMR在Oracle域服务集群中运行。全局GIMR使本地群集免于在其磁盘组中为此数据专用存储，并允许长期历史数据存储用于诊断和性能分析。

这个在后面安装GRID时候，会提示你是否为GIMR单独创建一个磁盘组用于存放数据。

1.2 硬件最低配置要求

序号

组件

内存

Oracle Grid Infrastructure installations

4GB以上

Oracle Database installations

最小1GB，建议2GB以上

1.3 RAC规划

服务器主机名	rac1	rac2
公共 IP 地址（eth0）	192.168.56.121	192.168.56.123
虚拟 IP 地址（eth0）	192.168.56.122	192.168.56.124
私有 IP 地址（eth1）	192.168.57.121	192.168.57.123
ORACLE RAC SID http://www.cndba.cn/Expect-le/article/1819	cndba1	cndba2
集群实例名称	cndba
SCAN IP	192.168.56.125
操作系统	Red hat7.3	http://www.cndba.cn/Expect-le/article/1819
Oracle 版本	12.2.0.1

1.4 磁盘划分

12C R2中对磁盘组空间要求更大。OCR外部冗余最少40G，NORMAL最少80G。

磁盘组名称	磁盘	大小	冗余策略
DATAFILE	data01	40G	NORMAL
DATAFILE	data02	40G	NORMAL
OCR	OCRVOTING01	30G	NORMAL
	OCRVOTING02	30G
	OCRVOTING03	30G

1.5 操作系统安装

具体过程略.....

注意Redhat 7.3 中主机名和IP地址的操作。

1.6 配置host

在所有节点修改：

[root@rac1 ~]# cat /etc/hosts

127.0.0.1   localhost



192.168.56.121 rac1

192.168.57.121 rac1-priv

192.168.56.122 rac1-vip

 

192.168.56.123 rac2

192.168.57.123 rac2-priv

192.168.56.124 rac2-vip

 

192.168.56.125 rac-scan

1.7 添加用户和组

/usr/sbin/groupadd -g 54321 oinstall

/usr/sbin/groupadd -g 54322 dba

/usr/sbin/groupadd -g 54323 oper

/usr/sbin/groupadd -g 54324 backupdba

/usr/sbin/groupadd -g 54325 dgdba

/usr/sbin/groupadd -g 54326 kmdba

/usr/sbin/groupadd -g 54327 asmdba

/usr/sbin/groupadd -g 54328 asmoper

/usr/sbin/groupadd -g 54329 asmadmin

/usr/sbin/groupadd -g 54330 racdba

/usr/sbin/useradd -u 54321 -g oinstall -G dba,asmdba,oper oracle

/usr/sbin/useradd -u 54322 -g oinstall -G dba,oper,backupdba,dgdba,kmdba,asmdba,asmoper,asmadmin,racdba grid

修改用户密码：

[root@rac1 ~]# passwd grid

[root@rac1 ~]# passwd oracle

确认用户信息：

[root@rac1 ~]# id oracle

uid=54321(oracle) gid=54321(oinstall) groups=54321(oinstall),54322(dba),54323(oper),54327(asmdba)

[root@rac1 ~]# id grid

uid=54322(grid) gid=54321(oinstall) groups=54321(oinstall),54322(dba),54323(oper),54324(backupdba),54325(dgdba),54326(kmdba),54327(asmdba),54328(asmoper),54329(asmadmin),54330(racdba)

[root@rac1 ~]#

1.8 关闭防火墙和selinux

防火墙：

[root@rac1 ~]# systemctl stop firewalld.service

[root@rac1 ~]# ]# systemctl disable firewalld.service

rm '/etc/systemd/system/basic.target.wants/firewalld.service'

rm '/etc/systemd/system/dbus-org.Fedoraproject.FirewallD1.service'

SELINUX：

[root@rac1 ~]# cat /etc/selinux/config

# This file controls the state of SELinux on the system.

# SELINUX= can take one of these three values:

#     enforcing - SELinux security policy is enforced.

#     permissive - SELinux prints warnings instead of enforcing.

#     disabled - No SELinux policy is loaded.

SELINUX=disabled

# SELINUXTYPE= can take one of these two values:

#     targeted - Targeted processes are protected,

#     mls - Multi Level Security protection.

SELINUXTYPE=targeted

1.9 配置时间同步

停用NTP

[root@rac1 ~]# systemctl stop ntpd.service

[root@rac1 ~]# systemctl disable ntpd.service

[root@rac1 etc]# systemctl stop chronyd.service

[root@rac1 etc]# systemctl disable chronyd.service

Removed symlink /etc/systemd/system/multi-user.target.wants/chronyd.service.

1.10 创建目录

mkdir -p /u01/app/12.2.0/grid

mkdir -p /u01/app/grid

mkdir -p /u01/app/oracle/product/12.2.0/dbhome_1

chown -R grid:oinstall /u01

chown -R oracle:oinstall /u01/app/oracle

chmod -R 775 /u01/

1.11 配置用户环境变量

1.11.1 ORACLE用户

[root@rac1 ~]# cat /home/oracle/.bash_profile

# .bash_profile

 

# Get the aliases and functions

if [ -f ~/.bashrc ]; then

. ~/.bashrc

fi

 

# User specific environment and startup programs

 

ORACLE_SID=cndba1;export ORACLE_SID  

#ORACLE_SID=cndba2;export ORACLE_SID  

ORACLE_UNQNAME=cndba;export ORACLE_UNQNAME

JAVA_HOME=/usr/local/java; export JAVA_HOME

ORACLE_BASE=/u01/app/oracle; export ORACLE_BASE

ORACLE_HOME=$ORACLE_BASE/product/12.2.0/dbhome_1; export ORACLE_HOME

ORACLE_TERM=xterm; export ORACLE_TERM

NLS_DATE_FORMAT="YYYY:MM:DDHH24:MI:SS"; export NLS_DATE_FORMAT

NLS_LANG=american_america.ZHS16GBK; export NLS_LANG

TNS_ADMIN=$ORACLE_HOME/network/admin; export TNS_ADMIN

ORA_NLS11=$ORACLE_HOME/nls/data; export ORA_NLS11

PATH=.:${JAVA_HOME}/bin:${PATH}:$HOME/bin:$ORACLE_HOME/bin:$ORA_CRS_HOME/bin

PATH=${PATH}:/usr/bin:/bin:/usr/bin/X11:/usr/local/bin

export PATH

LD_LIBRARY_PATH=$ORACLE_HOME/lib

LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:$ORACLE_HOME/oracm/lib

LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:/lib:/usr/lib:/usr/local/lib

export LD_LIBRARY_PATH

CLASSPATH=$ORACLE_HOME/JRE

CLASSPATH=${CLASSPATH}:$ORACLE_HOME/jlib

CLASSPATH=${CLASSPATH}:$ORACLE_HOME/rdbms/jlib

CLASSPATH=${CLASSPATH}:$ORACLE_HOME/network/jlib

export CLASSPATH

THREADS_FLAG=native; export THREADS_FLAG

export TEMP=/tmp

export TMPDIR=/tmp

umask 022

1.11.2 GRID用户

[root@rac1 ~]# cat /home/grid/.bash_profile

# .bash_profile

 

# Get the aliases and functions

if [ -f ~/.bashrc ]; then

. ~/.bashrc

fi

 

# User specific environment and startup programs

 

PATH=$PATH:$HOME/bin

 

export ORACLE_SID=+ASM1  

#export ORACLE_SID=+ASM2  

export ORACLE_BASE=/u01/app/grid

export ORACLE_HOME=/u01/app/12.2.0/grid

export PATH=$ORACLE_HOME/bin:$PATH:/usr/local/bin/:.

export TEMP=/tmp

export TMP=/tmp

export TMPDIR=/tmp

umask 022

export PATH

1.12 修改资源限制

1.12.1 修改/etc/security/limits.conf

添加如下内容

[root@rac1 ~]# vi  /etc/security/limits.conf

grid  soft  nproc  2047

grid  hard  nproc  16384

grid  soft   nofile  1024

grid  hard  nofile  65536

grid  soft   stack  10240

grid  hard  stack  32768

 

oracle  soft  nproc  2047

oracle  hard  nproc  16384

oracle  soft  nofile  1024

oracle  hard  nofile  65536

oracle  soft  stack  10240

oracle  hard  stack  32768

oracle soft memlock 3145728

oracle hard memlock 3145728

  
  
   1.13   
   配置NOZEROCONF
 编辑 /etc/sysconfig/network文件增加以下内容
 
 [root@rac1 ~]# vi /etc/sysconfig/network

NOZEROCONF=yes
 
  
     1.14   
     修改内核参数
 
 [root@rac1 ~]# vim /etc/sysctl.conf 
fs.file-max = 6815744
kernel.sem = 250 32000 100 128
kernel.shmmni = 4096
kernel.shmall = 1073741824
kernel.shmmax = 4398046511104
kernel.panic_on_oops = 1
net.core.rmem_default = 262144
net.core.rmem_max = 4194304
net.core.wmem_default = 262144
net.core.wmem_max = 1048576
net.ipv4.conf.all.rp_filter = 2
net.ipv4.conf.default.rp_filter = 2
fs.aio-max-nr = 1048576
net.ipv4.ip_local_port_range = 9000 65500
[root@rac1 ~]#sysctl -p
 
  
     1.15   
     安装必要的包
 yum 的配置参考如下文章：
  Linux 平台下 YUM 源配置 手册
  http://www.cndba.cn/dave/article/154
 
 yum install binutils  compat-libstdc++-33   gcc  gcc-c++  glibc  glibc.i686  glibc-devel   ksh   libgcc.i686   libstdc++-devel  libaio  libaio.i686  libaio-devel  libaio-devel.i686  libXext  libXext.i686  libXtst  libXtst.i686  libX11  libX11.i686 libXau  libXau.i686  libxcb  libxcb.i686  libXi  libXi.i686  make  sysstat  unixODBC  unixODBC-devel  zlib-devel  zlib-devel.i686 compat-libcap1 –y
 
  
     1.16   
     安装cvuqdisk
 cvuqdisk存于oracle安装介质的cv/rpm目录下，解压缩database的安装介质即可看到此包：
 
 export CVUQDISK_GRP=asmadmin

[root@rac1 rpm]# pwd

/software/database/rpm

[root@rac1 rpm]# ll

total 12

-rwxr-xr-x 1 root root 8860 Jan  5 17:36 cvuqdisk-1.0.10-1.rpm

[root@rac1 rpm]# rpm -ivh cvuqdisk-1.0.10-1.rpm

Preparing...                          ################################# [100%]

Using default group oinstall to install package

Updating / installing...

   1:cvuqdisk-1.0.10-1                ################################# [100%]

[root@rac1 rpm]#
 
  拷贝至另一个节点也安装一下。
  
     1.17   
     配置共享磁盘
 执行如下脚本：
 
 [root@rac1 ~]#

for i in b c d e f ; 

do

echo "KERNEL==/"sd*/",ENV{DEVTYPE}==/"disk/",SUBSYSTEM==/"block/",PROGRAM==/"/usr/lib/udev/scsi_id -g -u -d /$devnode/",RESULT==/"`/usr/lib/udev/scsi_id -g -u /dev/sd$i`/", RUN+=/"/bin/sh -c 'mknod /dev/asmdisk$i b  /$major /$minor; chown grid:asmadmin /dev/asmdisk$i; chmod 0660 /dev/asmdisk$i'/""

done
执行结果： 
 
 KERNEL=="sd*",ENV{DEVTYPE}=="disk",SUBSYSTEM=="block",PROGRAM=="/usr/lib/udev/scsi_id -g -u -d $devnode",RESULT=="1ATA_VBOX_HARDDISK_VB90ea2842-3d5cfe18", RUN+="/bin/sh -c 'mknod /dev/asmdiskb b  $major $minor; chown grid:asmadmin /dev/asmdiskb; chmod 0660 /dev/asmdiskb'"

KERNEL=="sd*",ENV{DEVTYPE}=="disk",SUBSYSTEM=="block",PROGRAM=="/usr/lib/udev/scsi_id -g -u -d $devnode",RESULT=="1ATA_VBOX_HARDDISK_VB0c31ed82-ca3c7a2f", RUN+="/bin/sh -c 'mknod /dev/asmdiskc b  $major $minor; chown grid:asmadmin /dev/asmdiskc; chmod 0660 /dev/asmdiskc'"

KERNEL=="sd*",ENV{DEVTYPE}=="disk",SUBSYSTEM=="block",PROGRAM=="/usr/lib/udev/scsi_id -g -u -d $devnode",RESULT=="1ATA_VBOX_HARDDISK_VBd2eba70f-9707444e", RUN+="/bin/sh -c 'mknod /dev/asmdiskd b  $major $minor; chown grid:asmadmin /dev/asmdiskd; chmod 0660 /dev/asmdiskd'"

KERNEL=="sd*",ENV{DEVTYPE}=="disk",SUBSYSTEM=="block",PROGRAM=="/usr/lib/udev/scsi_id -g -u -d $devnode",RESULT=="1ATA_VBOX_HARDDISK_VB15946091-75f9c0f4", RUN+="/bin/sh -c 'mknod /dev/asmdiske b  $major $minor; chown grid:asmadmin /dev/asmdiske; chmod 0660 /dev/asmdiske'"

KERNEL=="sd*",ENV{DEVTYPE}=="disk",SUBSYSTEM=="block",PROGRAM=="/usr/lib/udev/scsi_id -g -u -d $devnode",RESULT=="1ATA_VBOX_HARDDISK_VBac950c6b-de84431c", RUN+="/bin/sh -c 'mknod /dev/asmdiskf b  $major $minor; chown grid:asmadmin /dev/asmdiskf; chmod 0660 /dev/asmdiskf'"
 
  
 创建规则文件：/etc/udev/rules.d/99-oracle-asmdevices.rules,并将上述内容添加到文件中。
 
 [root@rac1 rules.d]# cat 99-oracle-asmdevices.rules

KERNEL=="sd*",ENV{DEVTYPE}=="disk",SUBSYSTEM=="block",PROGRAM=="/usr/lib/udev/scsi_id -g -u -d $devnode",RESULT=="1ATA_VBOX_HARDDISK_VB90ea2842-3d5cfe18", RUN+="/bin/sh -c 'mknod /dev/asmdiskb b  $major $minor; chown grid:asmadmin /dev/asmdiskb; chmod 0660 /dev/asmdiskb'"

KERNEL=="sd*",ENV{DEVTYPE}=="disk",SUBSYSTEM=="block",PROGRAM=="/usr/lib/udev/scsi_id -g -u -d $devnode",RESULT=="1ATA_VBOX_HARDDISK_VB0c31ed82-ca3c7a2f", RUN+="/bin/sh -c 'mknod /dev/asmdiskc b  $major $minor; chown grid:asmadmin /dev/asmdiskc; chmod 0660 /dev/asmdiskc'"

KERNEL=="sd*",ENV{DEVTYPE}=="disk",SUBSYSTEM=="block",PROGRAM=="/usr/lib/udev/scsi_id -g -u -d $devnode",RESULT=="1ATA_VBOX_HARDDISK_VBd2eba70f-9707444e", RUN+="/bin/sh -c 'mknod /dev/asmdiskd b  $major $minor; chown grid:asmadmin /dev/asmdiskd; chmod 0660 /dev/asmdiskd'"

KERNEL=="sd*",ENV{DEVTYPE}=="disk",SUBSYSTEM=="block",PROGRAM=="/usr/lib/udev/scsi_id -g -u -d $devnode",RESULT=="1ATA_VBOX_HARDDISK_VB15946091-75f9c0f4", RUN+="/bin/sh -c 'mknod /dev/asmdiske b  $major $minor; chown grid:asmadmin /dev/asmdiske; chmod 0660 /dev/asmdiske'"

KERNEL=="sd*",ENV{DEVTYPE}=="disk",SUBSYSTEM=="block",PROGRAM=="/usr/lib/udev/scsi_id -g -u -d $devnode",RESULT=="1ATA_VBOX_HARDDISK_VBac950c6b-de84431c", RUN+="/bin/sh -c 'mknod /dev/asmdiskf b  $major $minor; chown grid:asmadmin /dev/asmdiskf; chmod 0660 /dev/asmdiskf'"
 
 执行生效
 
 [root@rac1 ~]# /sbin/udevadm trigger --type=devices --action=change
 
 如果权限没有变，尝试重启。
 
 [root@rac1 rules.d]# ll /dev/asm*

brw-rw---- 1 grid asmadmin 8, 16 Mar 21 22:01 /dev/asmdiskb

brw-rw---- 1 grid asmadmin 8, 32 Mar 21 22:01 /dev/asmdiskc

brw-rw---- 1 grid asmadmin 8, 48 Mar 21 22:01 /dev/asmdiskd

brw-rw---- 1 grid asmadmin 8, 64 Mar 21 22:01 /dev/asmdiske

brw-rw---- 1 grid asmadmin 8, 80 Mar 21 22:01 /dev/asmdiskf
 
  
     1.17.1  
     修改磁盘属性
 （1）修改磁盘属性
 
 echo deadline >/sys/block/sdb/queue/scheduler

echo deadline > /sys/block/sdc/queue/scheduler

echo deadline >/sys/block/sdd/queue/scheduler

echo deadline > /sys/block/sde/queue/scheduler

echo deadline >/sys/block/sdf/queue/scheduler
 
  
     （2） 
     验证属性修改结果：
 如：http://www.cndba.cn/Expect-le/article/1819
 
 [root@rac1 dev]#  more /sys/block/sdb/queue/scheduler

noop anticipatory [deadline]cfq

[root@rac1 dev]#  more /sys/block/sdc/queue/scheduler

noop anticipatory [deadline]cfq
 
  
     2  
     安装GRID
 下载地址：
 http://www.oracle.com/technetwork/database/enterprise-edition/downloads/oracle12c-linux-12201-3608234.html
  
     2.1   
     上传并解压介质
 注意：12cR2 的GRID 的安装和之前版本不同，采用的是直接解压缩的模式。 所以需要先把安装介质复制到GRID HOME，然后直接进行解压缩。 这个目录必须在GRID HOME下才可以进行解压缩。
 About Image-Based Oracle Grid Infrastructure Installation
 Starting with Oracle Grid Infrastructure 12c Release 2 (12.2), installation and configuration of Oracle Grid Infrastructure software is simplified with image-based installation.
 
 [grid@rac1 ~]$ echo $ORACLE_HOME

/u01/app/12.2.0/grid

[grid@rac1 ~]$ cd $ORACLE_HOME

[grid@rac1 grid]$ ll linuxx64_12201_grid_home.zip

-rw-r--r-- 1 grid oinstall 2994687209 Mar 21 22:10 linuxx64_12201_grid_home.zip

[grid@rac1 grid]$

[grid@rac1 grid]$ unzip linuxx64_12201_grid_home.zip
 
 解压缩完成后文件自动就补全了，剩下的在执行脚本即可。 没有了安装的过程了。
 
 [grid@rac1 grid]$ ll

total 2924572

drwxr-xr-x  2 grid oinstall        102 Jan 27 00:12 addnode

drwxr-xr-x 11 grid oinstall        118 Jan 27 00:10 assistants

drwxr-xr-x  2 grid oinstall       8192 Jan 27 00:12 bin

drwxr-xr-x  3 grid oinstall         23 Jan 27 00:12 cdata

drwxr-xr-x  3 grid oinstall         19 Jan 27 00:10 cha

drwxr-xr-x  4 grid oinstall         87 Jan 27 00:12 clone

drwxr-xr-x 16 grid oinstall        191 Jan 27 00:12 crs

drwxr-xr-x  6 grid oinstall         53 Jan 27 00:12 css

drwxr-xr-x  7 grid oinstall         71 Jan 27 00:10 cv

drwxr-xr-x  3 grid oinstall         19 Jan 27 00:10 dbjava

drwxr-xr-x  2 grid oinstall         22 Jan 27 00:11 dbs

drwxr-xr-x  2 grid oinstall         32 Jan 27 00:12 dc_ocm

drwxr-xr-x  5 grid oinstall        191 Jan 27 00:12 deinstall

drwxr-xr-x  3 grid oinstall         20 Jan 27 00:10 demo

drwxr-xr-x  3 grid oinstall         20 Jan 27 00:10 diagnostics

drwxr-xr-x  8 grid oinstall        179 Jan 27 00:11 dmu

-rw-r--r--  1 grid oinstall        852 Aug 19  2015 env.ora

drwxr-xr-x  7 grid oinstall         65 Jan 27 00:12 evm

drwxr-xr-x  5 grid oinstall         49 Jan 27 00:10 gpnp
 
  
     2.2   
     运行安装
 在节点1执行安装脚本，这里依赖图形界面，可使用xshell 或者 vnc 进行调用。
 Linux VNC 安装配置
 http://www.cndba.cn/dave/article/1814
 
 [grid@rac1 grid]$ pwd

/u01/app/12.2.0/grid

[grid@rac1 grid]$ ll *.sh

-rwxr-x--- 1 grid oinstall 5395 Jul 21  2016 gridSetup.sh

-rwx------ 1 grid oinstall  603 Jan 27 00:12 root.sh

-rwx------ 1 grid oinstall  612 Jan 27 00:12 rootupgrade.sh

-rwxr-x--- 1 grid oinstall  628 Sep  5  2015 runcluvfy.sh 
 
 
 [grid@rac1 grid]$ ./gridSetup.sh

Launching Oracle Grid Infrastructure Setup Wizard...
 
 
 
 
 
 
 添加节点并配置SSH 验证
 
 
 
 
 注意：新增了一个冗余类型FLEX：并且对磁盘组空间也有新的更高要求
 官方文档解释：
 FLEX REDUNDANCY是一种磁盘组，允许数据库在创建磁盘组后指定自己的冗余。 文件的冗余也可以在创建后进行更改。 此类型的磁盘组支持Oracle ASM文件组和配额组。 灵活磁盘组需要至少存在三个故障组。 如果弹性磁盘组具有少于五个故障组，则它可以容忍丢失一个; 否则，它可以容忍两个故障组的丢失。 要创建一个弹性磁盘组，COMPATIBLE.ASM和COMPATIBLE.RDBMS磁盘组属性必须设置为12.2或更高。
 
 如果前提检查出现NTP，内存方面的警告，还有什么avahi-deamon的问题。可以忽略。
 
 开始安装
 
 执行脚本
 
 
 
 [root@rac1 etc]# /u01/app/12.2.0/grid/root.sh

Performing root user operation.

 

The following environment variables are set as:

    ORACLE_OWNER= grid

    ORACLE_HOME=  /u01/app/12.2.0/grid

 

Enter the full pathname of the local bin directory: [/usr/local/bin]:

   Copying dbhome to /usr/local/bin ...

   Copying oraenv to /usr/local/bin ...

   Copying coraenv to /usr/local/bin ...


Creating /etc/oratab file...

Entries will be added to the /etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root script.

Now product-specific root actions will be performed.

Relinking oracle with rac_on option

Using configuration parameter file: /u01/app/12.2.0/grid/crs/install/crsconfig_params

The log of current session can be found at:

  /u01/app/grid/crsdata/rac1/crsconfig/rootcrs_rac1_2017-03-21_11-50-15PM.log

2017/03/21 23:50:20 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.

2017/03/21 23:50:20 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector.

2017/03/21 23:50:53 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.

2017/03/21 23:50:53 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.

2017/03/21 23:50:57 CLSRSC-363: User ignored prerequisites during installation

2017/03/21 23:50:58 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.

2017/03/21 23:51:00 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.

2017/03/21 23:51:01 CLSRSC-594: Executing installation step 5 of 19: 'SaveParamFile'.

2017/03/21 23:51:12 CLSRSC-594: Executing installation step 6 of 19: 'SetupOSD'.

2017/03/21 23:51:13 CLSRSC-594: Executing installation step 7 of 19: 'CheckCRSConfig'.

2017/03/21 23:51:13 CLSRSC-594: Executing installation step 8 of 19: 'SetupLocalGPNP'.

2017/03/21 23:51:49 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.

2017/03/21 23:51:58 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.

2017/03/21 23:51:58 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.

2017/03/21 23:52:04 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.

2017/03/21 23:52:19 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'

2017/03/21 23:52:42 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.

2017/03/21 23:52:48 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed

CRS-4133: Oracle High Availability Services has been stopped.

CRS-4123: Oracle High Availability Services has been started.

2017/03/21 23:53:17 CLSRSC-400: A system reboot is required to continue installing. The command '/u01/app/12.2.0/grid/perl/bin/perl -I/u01/app/12.2.0/grid/perl/lib -I/u01/app/12.2.0/grid/crs/install /u01/app/12.2.0/grid/crs/install/rootcrs.pl ' execution failed

[root@rac1 etc]#
 
  
 执行root.sh脚本时，出现了
 
 2017/03/21 23:53:17 CLSRSC-400: A system reboot is required to continue installing. The command '/u01/app/12.2.0/grid/perl/bin/perl -I/u01/app/12.2.0/grid/perl/lib -I/u01/app/12.2.0/grid/crs/install /u01/app/12.2.0/grid/crs/install/rootcrs.pl ' execution failed
 
 官方文档解释：要求一定要重启服务器，然后再次执行这两个脚本。时间稍微有点长....
 
 
 如果出现CLSRSC-1102: failed to start resource 'qosmserver'这种错误，有可能是你分配的内存不够造成的，造成资源不够启动该服务。增加内存后，重新执行root.sh脚本。
 root.sh脚本最后：
 
 CRS-6016: Resource auto-start has completed for server rac1

CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources

CRS-4123: Oracle High Availability Services has been started.

2017/03/21 14:12:39 CLSRSC-343: Successfully started Oracle Clusterware stack

2017/03/21 14:12:39 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.

2017/03/21 14:16:10 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.

2017/03/21 14:17:55 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded
 
 表示成功了。
 Log 有点长，有兴趣自己看：
 
 [root@rac1 ~]# /u01/app/12.2.0/grid/root.sh

Performing root user operation.


The following environment variables are set as:

    ORACLE_OWNER= grid

    ORACLE_HOME=  /u01/app/12.2.0/grid

 

Enter the full pathname of the local bin directory: [/usr/local/bin]:

The contents of "dbhome" have not changed. No need to overwrite.

The contents of "oraenv" have not changed. No need to overwrite.

The contents of "coraenv" have not changed. No need to overwrite.

 

Entries will be added to the /etc/oratab file as needed by

Database Configuration Assistant when a database is created

Finished running generic part of root script.

Now product-specific root actions will be performed.

Relinking oracle with rac_on option

Using configuration parameter file: /u01/app/12.2.0/grid/crs/install/crsconfig_params

The log of current session can be found at:

  /u01/app/grid/crsdata/rac1/crsconfig/rootcrs_rac1_2017-03-22_00-00-32AM.log

2017/03/22 00:00:37 CLSRSC-594: Executing installation step 1 of 19: 'SetupTFA'.

2017/03/22 00:00:37 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector.

2017/03/22 00:00:37 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.

2017/03/22 00:00:37 CLSRSC-594: Executing installation step 2 of 19: 'ValidateEnv'.

2017/03/22 00:00:40 CLSRSC-363: User ignored prerequisites during installation

2017/03/22 00:00:40 CLSRSC-594: Executing installation step 3 of 19: 'CheckFirstNode'.

2017/03/22 00:00:42 CLSRSC-594: Executing installation step 4 of 19: 'GenSiteGUIDs'.

2017/03/22 00:00:43 CLSRSC-594: Executing installation step 5 of 19: 'SaveParamFile'.

2017/03/22 00:00:45 CLSRSC-594: Executing installation step 6 of 19: 'SetupOSD'.

2017/03/22 00:00:47 CLSRSC-594: Executing installation step 7 of 19: 'CheckCRSConfig'.

2017/03/22 00:00:47 CLSRSC-594: Executing installation step 8 of 19: 'SetupLocalGPNP'.

2017/03/22 00:00:49 CLSRSC-594: Executing installation step 9 of 19: 'ConfigOLR'.

2017/03/22 00:00:51 CLSRSC-594: Executing installation step 10 of 19: 'ConfigCHMOS'.

2017/03/22 00:01:37 CLSRSC-594: Executing installation step 11 of 19: 'CreateOHASD'.

2017/03/22 00:01:38 CLSRSC-594: Executing installation step 12 of 19: 'ConfigOHASD'.

2017/03/22 00:01:53 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.service'

2017/03/22 00:02:16 CLSRSC-594: Executing installation step 13 of 19: 'InstallAFD'.

2017/03/22 00:02:20 CLSRSC-594: Executing installation step 14 of 19: 'InstallACFS'.

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'

CRS-2673: Attempting to stop 'ora.evmd' on 'rac1'

CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'

CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'

CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'

CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded

CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded

CRS-2677: Stop of 'ora.evmd' on 'rac1' succeeded

CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed

CRS-4133: Oracle High Availability Services has been stopped.

CRS-4123: Oracle High Availability Services has been started.

2017/03/22 00:02:52 CLSRSC-594: Executing installation step 15 of 19: 'InstallKA'.

2017/03/22 00:02:57 CLSRSC-594: Executing installation step 16 of 19: 'InitConfig'.

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed

CRS-4133: Oracle High Availability Services has been stopped.

CRS-4123: Oracle High Availability Services has been started.

CRS-2672: Attempting to start 'ora.evmd' on 'rac1'

CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1'

CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded

CRS-2676: Start of 'ora.evmd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1'

CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1'

CRS-2672: Attempting to start 'ora.gipcd' on 'rac1'

CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded

CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.cssd' on 'rac1'

CRS-2672: Attempting to start 'ora.diskmon' on 'rac1'

CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded

CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded

 

Disk groups created successfully. Check /u01/app/grid/cfgtoollogs/asmca/asmca-170322AM120336.log for details.

 

2017/03/22 00:04:39 CLSRSC-482: Running command: '/u01/app/12.2.0/grid/bin/ocrconfig -upgrade grid oinstall'

CRS-2672: Attempting to start 'ora.crf' on 'rac1'

CRS-2672: Attempting to start 'ora.storage' on 'rac1'

CRS-2676: Start of 'ora.storage' on 'rac1' succeeded

CRS-2676: Start of 'ora.crf' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.crsd' on 'rac1'

CRS-2676: Start of 'ora.crsd' on 'rac1' succeeded

CRS-4256: Updating the profile

Successful addition of voting disk 07f57bf9f7634f5abfb849735e86d3aa.

Successful addition of voting disk 3c930c3a19f34f25bfddc3a5a41bbb4e.

Successful addition of voting disk 4fab95ab67ed4f07bf4e9aa67e3e095e.

Successfully replaced voting disk group with +OCR.

CRS-4256: Updating the profile

CRS-4266: Voting file(s) successfully replaced

##  STATE    File Universal Id                File Name Disk group

--  -----    -----------------                --------- ---------

 1. ONLINE   07f57bf9f7634f5abfb849735e86d3aa (/dev/asmdiskb) [OCR]

 2. ONLINE   3c930c3a19f34f25bfddc3a5a41bbb4e (/dev/asmdiskd) [OCR]

 3. ONLINE   4fab95ab67ed4f07bf4e9aa67e3e095e (/dev/asmdiskc) [OCR]

Located 3 voting disk(s).

CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'rac1'

CRS-2673: Attempting to stop 'ora.crsd' on 'rac1'

CRS-2677: Stop of 'ora.crsd' on 'rac1' succeeded

CRS-2673: Attempting to stop 'ora.storage' on 'rac1'

CRS-2673: Attempting to stop 'ora.crf' on 'rac1'

CRS-2673: Attempting to stop 'ora.gpnpd' on 'rac1'

CRS-2673: Attempting to stop 'ora.mdnsd' on 'rac1'

CRS-2677: Stop of 'ora.crf' on 'rac1' succeeded

CRS-2677: Stop of 'ora.gpnpd' on 'rac1' succeeded

CRS-2677: Stop of 'ora.storage' on 'rac1' succeeded

CRS-2673: Attempting to stop 'ora.asm' on 'rac1'

CRS-2677: Stop of 'ora.mdnsd' on 'rac1' succeeded

CRS-2677: Stop of 'ora.asm' on 'rac1' succeeded

CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'rac1'

CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'rac1' succeeded

CRS-2673: Attempting to stop 'ora.ctssd' on 'rac1'

CRS-2673: Attempting to stop 'ora.evmd' on 'rac1'

CRS-2677: Stop of 'ora.evmd' on 'rac1' succeeded

CRS-2677: Stop of 'ora.ctssd' on 'rac1' succeeded

CRS-2673: Attempting to stop 'ora.cssd' on 'rac1'

CRS-2677: Stop of 'ora.cssd' on 'rac1' succeeded

CRS-2673: Attempting to stop 'ora.gipcd' on 'rac1'

CRS-2677: Stop of 'ora.gipcd' on 'rac1' succeeded

CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'rac1' has completed

CRS-4133: Oracle High Availability Services has been stopped.

2017/03/22 00:06:15 CLSRSC-594: Executing installation step 17 of 19: 'StartCluster'.

CRS-4123: Starting Oracle High Availability Services-managed resources

CRS-2672: Attempting to start 'ora.evmd' on 'rac1'

CRS-2672: Attempting to start 'ora.mdnsd' on 'rac1'

CRS-2676: Start of 'ora.mdnsd' on 'rac1' succeeded

CRS-2676: Start of 'ora.evmd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.gpnpd' on 'rac1'

CRS-2676: Start of 'ora.gpnpd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.gipcd' on 'rac1'

CRS-2676: Start of 'ora.gipcd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.drivers.acfs' on 'rac1'

CRS-2674: Start of 'ora.drivers.acfs' on 'rac1' failed

CRS-2672: Attempting to start 'ora.cssdmonitor' on 'rac1'

CRS-2676: Start of 'ora.cssdmonitor' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.cssd' on 'rac1'

CRS-2672: Attempting to start 'ora.diskmon' on 'rac1'

CRS-2676: Start of 'ora.diskmon' on 'rac1' succeeded

CRS-2676: Start of 'ora.cssd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'rac1'

CRS-2672: Attempting to start 'ora.ctssd' on 'rac1'

CRS-2676: Start of 'ora.ctssd' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.drivers.acfs' on 'rac1'

CRS-2674: Start of 'ora.drivers.acfs' on 'rac1' failed

CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.asm' on 'rac1'

CRS-2676: Start of 'ora.asm' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.storage' on 'rac1'

CRS-2676: Start of 'ora.storage' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.crf' on 'rac1'

CRS-2676: Start of 'ora.crf' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.crsd' on 'rac1'

CRS-2676: Start of 'ora.crsd' on 'rac1' succeeded

CRS-6023: Starting Oracle Cluster Ready Services-managed resources

CRS-6017: Processing resource auto-start for servers: rac1

CRS-6016: Resource auto-start has completed for server rac1

CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources

CRS-4123: Oracle High Availability Services has been started.

2017/03/22 00:09:08 CLSRSC-343: Successfully started Oracle Clusterware stack

2017/03/22 00:09:08 CLSRSC-594: Executing installation step 18 of 19: 'ConfigNode'.

 

CRS-2672: Attempting to start 'ora.ASMNET1LSNR_ASM.lsnr' on 'rac1'

CRS-2676: Start of 'ora.ASMNET1LSNR_ASM.lsnr' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.asm' on 'rac1'

CRS-2676: Start of 'ora.asm' on 'rac1' succeeded

CRS-2672: Attempting to start 'ora.OCR.dg' on 'rac1'

CRS-2676: Start of 'ora.OCR.dg' on 'rac1' succeeded

2017/03/22 00:14:18 CLSRSC-594: Executing installation step 19 of 19: 'PostConfig'.

2017/03/22 00:17:02 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded

[root@rac1 ~]#
 
 
  
     2.3   
     验证集群是否正常
 
 [grid@rac1 ~]$ crsctl stat res -t

--------------------------------------------------------------------------------

Name           Target  State        Server                   State details       

--------------------------------------------------------------------------------

Local Resources

--------------------------------------------------------------------------------

ora.ASMNET1LSNR_ASM.lsnr

               ONLINE  ONLINE       rac1                     STABLE

               ONLINE  ONLINE       rac2                     STABLE

ora.LISTENER.lsnr

               ONLINE  ONLINE       rac1                     STABLE

               ONLINE  ONLINE       rac2                     STABLE

ora.OCR_VOTE.dg

               ONLINE  ONLINE       rac1                     STABLE

               ONLINE  ONLINE       rac2                     STABLE

ora.net1.network

               ONLINE  ONLINE       rac1                     STABLE

               ONLINE  ONLINE       rac2                     STABLE

ora.ons

               ONLINE  ONLINE       rac1                     STABLE

               ONLINE  ONLINE       rac2                     STABLE

--------------------------------------------------------------------------------

Cluster Resources

--------------------------------------------------------------------------------

ora.LISTENER_SCAN1.lsnr

      1        ONLINE  ONLINE       rac1                     STABLE

ora.MGMTLSNR

      1        OFFLINE OFFLINE                               STABLE

ora.asm

      1        ONLINE  ONLINE       rac1                     Started,STABLE

      2        ONLINE  ONLINE       rac2                     Started,STABLE

      3        OFFLINE OFFLINE                               STABLE

ora.cvu

      1        ONLINE  ONLINE       rac1                     STABLE

ora.qosmserver

      1        ONLINE  ONLINE       rac1                     STABLE

ora.rac1.vip

      1        ONLINE  ONLINE       rac1                     STABLE

ora.rac2.vip

      1        ONLINE  ONLINE       rac2                     STABLE

ora.scan1.vip

      1        ONLINE  ONLINE       rac1                     STABLE

--------------------------------------------------------------------------------

[grid@rac1 ~]$
 
  
     3  
     ASMCA创建磁盘组
 界面都清爽了许多
 
 
  
     4  
     安装DB
 这个安装方式和之前一样，没有变化
 ./runInstaller
 安装部分就省略了，基本上就是配置ssh，选择磁盘组等等。
 
 
 组分的更细了，分工更明确了。
 
 
 
 
  
     5  
     DBCA创建数据库
 略....
  
     6  
     验证
  
     6.1   
     查看创建的容器数据库
 
 SQL> select name,cdb from v$database;

NAME	  CDB

--------  ---------

CNDBA	  YES
 
  
     6.2   
     查看存在的插拨数据库
 
 SQL> col pdb_name for a30

SQL> select pdb_id,pdb_name,dbid,status,creation_scn from dba_pdbs;

 

    PDB_ID PDB_NAME	DBID STATUS	CREATION_SCN

---------- ------------------------------ ---------- ---------- ------------

 3 lei	  3459708341 NORMAL	     1456419

 2 PDB$SEED	  3422473700 NORMAL	     1408778