10g RAC两节点for AIX安装
注意事项：创建(hagsuser)组，然后oracle用户属于hagsuser组,xlc版本必须大于7.0。
在hacmp中的主机名和节点名要一样。
环境描述
硬件环境：两节点IBM P550
操作系统：AIX5303
网络配置：
节点一 En1 heartbeat 1.1.1.1 En0 public 10.6.183.75
节点二 En1 heartbeat 1.1.1.2 En0 public 10.6.183.76
在节点一、二上需要两个IP作为RAC的VIP地址
10.6.183.58 rac_vip1
10.6.183.59 rac_vip2
安装前准备工作
在每个节点上执行如下步骤：
1、 创建dba组；
2、 创建oinstall组；
3、 创建hagsuser组，（该组也会在安装CRS过程中，执行rootpre.sh会自动创建该组，但需要确认每个节点上的组ID相同，并通过手工将oracle用户加入该组）；
4、 创建oracle用户，将oracle用户加到上述组中；
$ id
uid=500(oracle)gid=550(oinstall) groups=1(staff),500(dba),206(hagsuser)
注意：请保证在所有节点上上述组和用户的ID相同。
5、 修改oracle用户.profile,需包含如下内容
ORACLE_BASE=/oracle/orabase
export ORACLE_BASE
ORACLE_HOME=$ORACLE_BASE/product/10g/rdbms
export ORACLE_HOME
LD_LIBRARY_PATH=$ORACLE_HOME/lib
export LD_LIBRARY_PATH
ORACLE_SID=ora10g1
export ORACLE_SID
ORA_CRS_HOME=$ORACLE_BASE/product/10g/crs
export ORA_CRS_HOME
PATH=$PATH:$ORA_CRS_HOME/bin;$ORACLE_HOME/bin
export PATH
6、 确认每个系统中存在nobody用户；
7、 修改用户允许的最大进程数，以root用户执行smitty chgsys，详见下图；
8、 修改oracle用户的资源限制,在每个节点上修改文件/etc/security/limits，内容如下：
oracle:
fsize = -1
data = -1
stack = -1
9、 调整网络参数，并重起系统生效
no -p -o udp_sendspace=65536
no -p -o udp_recvspace=655360
no -p -o tcp_sendspace=65536
no -p -o tcp_recvspace=65536
no -p -o rfc1323=1
no -p -o sb_max=1310720
no -r -o ipqmaxlen=512
10、 创建Oracle软件安装目录或文件系统；
11、 安装并配置HACMP(在测试系统上安装的版本为HACMP5.2)，详见HACMP安装配置文档；
12、 创建concurrent VG ，并用varyonvg –c命令在每一个节点上进行激活VG；
例如：varyonvg –c racvg
13、 在concurrent VG上创建裸设备(lv),包含给CRS使用的和给数据库使用的LV;
mklv -y rac_system_raw_500m -T O -w n -s n -r n racvg 8
mklv -y rac_sysaux_raw_800m -T O -w n -s n -r n racvg 13
mklv -y rac_undotbs1_raw_500m -T O -w n -s n -r n racvg 8
mklv -y rac_undotbs2_raw_500m -T O -w n -s n -r n racvg 8
mklv -y rac_temp_raw_250m -T O -w n -s n -r n racvg 4
mklv -y rac_example_raw_m -T O -w n -s n -r n racvg 3
mklv -y rac_users_raw_120m -T O -w n -s n -r n racvg 2
mklv -y rac_redo1_1_raw_m -T O -w n -s n -r n racvg 2
mklv -y rac_redo2_1_raw_m -T O -w n -s n -r n racvg 2
mklv -y rac_redo1_2_raw_m -T O -w n -s n -r n racvg 2
mklv -y rac_redo2_2_raw_m -T O -w n -s n -r n racvg 2
mklv -y rac_control1_raw_m -T O -w n -s n -r n racvg 2
mklv -y rac_control2_raw_m -T O -w n -s n -r n racvg 2
mklv -y rac_control3_raw_m -T O -w n -s n -r n racvg 2
mklv -y rac_spfile_raw_5m -T O -w n -s n -r n racvg 1
mklv -y rac_pwdfile_raw_m -T O -w n -s n -r n racvg 1
mklv -y ora_ocr_raw_100m -T O -w n -s n -r n racvg 2
mklv -y ora_vote_raw_20m -T O -w n -s n -r n racvg 1
按如下方法，修改裸设备权限设置# ls -l rora*
crw-r----- 1 root oinstall crw-r--r-- 1 oracle oinstall # ls -l rrac*
crw-rw---- 1 oracle dba crw-rw---- 1 oracle dba crw-rw---- 1 oracle dba crw-r----- 1 oracle dba crw-rw---- 1 oracle dba 40, 16 Apr 19 10:00 rora_ocr_raw_100
40, 17 Apr 29 13:57 rora_vote_raw_20
40, 12 Apr 19 13:01 rrac_control1_ra
40, 13 Apr 19 12:29 rrac_control2_ra
40, 6 Apr 12 14:48 rrac_example_raw
40, 15 Apr 19 12:06 rrac_pwdfile_raw
40, 8 Apr 29 09:00 rrac_redo1_1_raw
crw-rw---- 1 oracle dba 40, 10 Apr 29 09:00 rrac_redo1_2_raw
crw-rw---- 1 oracle dba 40, 9 Apr 19 13:00 rrac_redo2_1_raw
crw-rw---- 1 oracle dba 40, 11 Apr 19 13:00 rrac_redo2_2_raw
crw-rw---- 1 oracle dba 40, 14 Apr 19 16:03 rrac_spfile_raw_
crw-rw---- 1 oracle dba 40, 2 Apr 28 20:01 rrac_sysaux_raw_
crw-rw---- 1 oracle dba 40, 1 Apr 19 12:54 rrac_system_raw_
crw-rw---- 1 oracle dba 40, 5 Apr 19 12:29 rrac_temp_raw_25
crw-rw---- 1 oracle dba 40, 3 Apr 19 12:55 rrac_undotbs1_ra
crw-rw---- 1 oracle dba 40, 4 Apr 19 12:29 rrac_undotbs2_ra
crw-rw---- 1 oracle dba 40, 7 Apr 19 12:29 rrac_users_raw_1
14、 安装必须的操作系统包和补丁，在执行CRS安装的过程中Oracle会自动进行必须的包和补丁的检查，并给出检查结果
➢ 操作系统包：
bos.adt.base、bos.adt.lib、bos.adt.libm、bos.perf.libperfstat、bos.perf.perfstat、
bos.perf.proctools、bos.cifs_fs.rte
➢ 操作系统补丁
IY59386(bos.rte.bind_cmds,5.3.0.1)
IY60930(bos.mp,5.3.0.1)
IY60930(bos.mp64,5.3.0.1)
IY66513(bos.mp64,5.3.0.20)
IY66513(bos.mp,5.3.0.20)
IY70159(bos.mp,5.3.0.22)
IY70159(bos.mp64,5.3.0.22)
IY58143(bos.mp64,5.3.0.1)
IY58143(bos.acct,5.3.0.1)
IY58143(bos.adt.include,5.3.0.1)
IY58143(bos.adt.libm,5.3.0.1)
IY58143(bos.adt.prof,5.3.0.1)
IY58143(bos.alt_disk_install.rte,5.3.0.1)
IY58143(bos.cifs_fs.rte,5.3.0.1)
IY58143(bos.diag.com,5.3.0.1)
IY58143(bos.perf.libperfstat,5.3.0.1)
IY58143(bos.perf.perfstat,5.3.0.1)
IY58143(bos.perf.tools,5.3.0.1)
IY58143(bos.rte.boot,5.3.0.1)
IY58143(bos.rte.archive,5.3.0.1)
IY58143(bos.rte.bind_cmds,5.3.0.1)
IY58143(bos.rte.control,5.3.0.1)
IY58143(bos.rte.filesystem,5.3.0.1)
IY58143(bos.rte.install,5.3.0.1)
IY58143(bos.rte.libc,5.3.0.1)
IY58143(bos.rte.lvm,5.3.0.1)
IY58143(bos.rte.man,5.3.0.1)
IY58143(bos.rte.methods,5.3.0.1)
IY58143(bos.rte.security,5.3.0.1)
IY58143(bos.rte.serv_aid,5.3.0.1)
15、 安装8.0版本的c编译环境
16、 修改每个节点上的.rhosts或/etc/hosts.equiv文件，使节点之间相互信任；
安装CRS软件(Cluster Ready Service)
1、 在其中一个节点上进入CRS安装盘，执行runInstaller启动CRS的安装；
2、 按提示在每个安装节点上以root用户执行rootpre.sh，该脚本在CRS安装盘上的rootpre目录下；
# ./rootpre.sh
./rootpre.sh output will be logged in /tmp/rootpre.out_06-04-13.12:33:04
Saving the original files in /etc/ora_save_06-04-13.12:33:04....
Copying new kernel extension to /etc....
Loading the kernel extension from /etc
Oracle Kernel Extension Loader for AIX
Copyright (c) 1998,1999 Oracle Corporation
Successfully loaded /etc/pw-syscall.64bit_kernel with kmid: 0x441e300
Successfully configured /etc/pw-syscall.64bit_kernel with kmid: 0x441e300
The kernel extension was successfuly loaded.
Configuring Asynchronous I/O....
Asynchronous I/O is already defined
Configuring POSIX Asynchronous I/O....
Checking if group services should be configured....
Group \"hagsuser\" does not exist.
Creating required group for group services: hagsuser
Please add your Oracle userid to the group: hagsuser
Configuring HACMP group services socket for possible use by Oracle.
The group or permissions of the group services socket have changed.
Please stop and restart HACMP before trying to use Oracle.
3、 输入Oracle CRS产品清单目录的路径及确定oracle用户的组名为dba组；
4、 选择CRS安装目录
5、 点击下一步后，安装程序自动进行系统环境的检查，过程如下：
注意：果检查不通过，状态为failed，在此次的安装过程中就发现IY58143(bos.cifs_fs.rte,5.3.0.1)检查不通过，手工检查发现bos.cifs_fs.rte未安装，安装该包后检查通过。
Checking operating system requirements ...
Expected result: One of 5200.004,5300.002
Actual Result: 5300.002
Check complete. The overall result of this check is: Passed
=====================================================================
Checking operating system package requirements ...
Checking for bos.adt.base(0.0); found bos.adt.base(5.3.0.30). Passed
Checking for bos.adt.lib(0.0); found bos.adt.lib(5.3.0.30). Passed
Checking for bos.adt.libm(0.0); found bos.adt.libm(5.3.0.30). Passed
Checking for bos.perf.libperfstat(0.0); found bos.perf.libperfstat(5.3.0.30). Passed
Checking for bos.perf.perfstat(0.0); found bos.perf.perfstat(5.3.0.30). Passed
Checking for bos.perf.proctools(0.0); found bos.perf.proctools(5.3.0.30). Passed
Check complete. The overall result of this check is: Passed
======================================================================
Checking recommended operating system patches
Checking for IY59386(bos.rte.bind_cmds,5.3.0.1); found
(bos.rte.bind_cmds,5.3.0.30). Passed
Checking for IY60930(bos.mp,5.3.0.1); found (bos.mp,5.3.0.30). Passed
Checking Passed
for IY60930(bos.mp64,5.3.0.1); found (bos.mp64,5.3.0.30).
Checking Passed
for IY66513(bos.mp64,5.3.0.20); found (bos.mp64,5.3.0.30).
Checking for IY66513(bos.mp,5.3.0.20); found (bos.mp,5.3.0.30). Passed
Checking for IY70159(bos.mp,5.3.0.22); found (bos.mp,5.3.0.30). Passed
Checking Passed
for IY70159(bos.mp64,5.3.0.22); found (bos.mp64,5.3.0.30).
Checking Passed
for IY58143(bos.mp64,5.3.0.1); found (bos.mp64,5.3.0.30).
Checking for IY58143(bos.acct,5.3.0.1); found (bos.acct,5.3.0.30). Passed
Checking for IY58143(bos.adt.include,5.3.0.1); found (bos.adt.include,5.3.0.30).
Passed
Checking for IY58143(bos.adt.libm,5.3.0.1); found (bos.adt.libm,5.3.0.30). Passed
Checking for IY58143(bos.adt.prof,5.3.0.1); found (bos.adt.prof,5.3.0.30). Passed
Checking for IY58143(bos.alt_disk_install.rte,5.3.0.1); found
(bos.alt_disk_install.rte,5.3.0.30).
Passed
Checking for IY58143(bos.cifs_fs.rte,5.3.0.1); found Not found. Failed <<<<
Checking for IY58143(bos.diag.com,5.3.0.1); found (bos.diag.com,5.3.0.30). Passed
Checking for IY58143(bos.perf.libperfstat,5.3.0.1); found
(bos.perf.libperfstat,5.3.0.30). Passed
Checking for IY58143(bos.perf.perfstat,5.3.0.1); found
(bos.perf.perfstat,5.3.0.30). Passed
Checking for IY58143(bos.perf.tools,5.3.0.1); found (bos.perf.tools,5.3.0.30). Passed
Checking for IY58143(bos.rte.boot,5.3.0.1); found (bos.rte.boot,5.3.0.30). Passed
Checking for IY58143(bos.rte.archive,5.3.0.1); found (bos.rte.archive,5.3.0.30). Passed
Checking for IY58143(bos.rte.bind_cmds,5.3.0.1); found
(bos.rte.bind_cmds,5.3.0.30). Passed
Checking for IY58143(bos.rte.control,5.3.0.1); found (bos.rte.control,5.3.0.30). Passed
Checking for IY58143(bos.rte.filesystem,5.3.0.1); found
(bos.rte.filesystem,5.3.0.30). Passed
Checking for IY58143(bos.rte.install,5.3.0.1); found (bos.rte.install,5.3.0.30). Passed
Checking for IY58143(bos.rte.libc,5.3.0.1); found (bos.rte.libc,5.3.0.30). Passed
Checking for IY58143(bos.rte.lvm,5.3.0.1); found (bos.rte.lvm,5.3.0.30). Passed
Checking for IY58143(bos.rte.man,5.3.0.1); found (bos.rte.man,5.3.0.30). Passed
Checking for IY58143(bos.rte.methods,5.3.0.1); found
(bos.rte.methods,5.3.0.30). Passed
Checking for IY58143(bos.rte.security,5.3.0.1); found (bos.rte.security,5.3.0.30). Passed
Checking for IY58143(bos.rte.serv_aid,5.3.0.1); found (bos.rte.serv_aid,5.3.0.30). Passed
Check complete. The overall result of this check is: Failed <<<<
Problem: Some recommended patches are missing (see above).
Recommendation: You may actually have installed patches which have obsoleted these, in which case you can successfully continue with the install. If you have not, it is recommended that you do not continue. Refer to the readme to find out how to get the missing patches.
=====================================================================
Checking for Oracle Home incompatibilities ....
Actual Result: NEW_HOME
Check complete. The overall result of this check is: Passed
=====================================================================
Checking Oracle Home path for spaces...
Check complete. The overall result of this check is: Passed
=====================================================================
Checking local Cluster Synchronization Services (CSS) status ...
Check complete. The overall result of this check is: Passed
=====================================================================
Checking whether Oracle 9.2 RAC is available on all selected nodes
Check complete. The overall result of this check is: Passed
6、 编辑CRS群集环境
最后群集状态为：
7、 指定OCR存储介质，用normal方式启用多路复用
8、 指定voting disk存储介质，用normal方式启用多路复用
9、 开始安装
10、 按照提示在每个节点上执行orainstRoot.sh
执行过程中可能会遇到如下错误，通过安装高版本的c环境解决：
$ lslpp -L |grep -i xlc
xlC.adt.include 8.0.0.0 C F C Set ++ Application
xlC.aix50.rte 8.0.0.0 C F C Set ++ Runtime for AIX 5.0
11、 按提示在每个节点上顺序执行root.sh
12、 配置VIP——使用vipca
在执行vipca进行VIP配置的过程中，可能会用到下述命令：
# echo $CRS_NODELIST (某个脚本中的变量)
deca1,p550_2
# echo $CRS_NODEVIPS
deca1/rac_vip1/255.255.255.0/en0,p550_2/rac_vip2/255.255.255.0/en0
# ./vipca -silent -nodelist $CRS_NODELIST -nodevips $CRS_NODEVIPS
The given interface(s), \"en0\" is not public. Public interfaces should be used to configure virtual IPs.
# ./srvctl add nodeapps -n deca1_boot -o /oracle/orabase/product/10g/crs -A 10.6.183.58/255.255.255.0/en0
# ./srvctl add nodeapps -n p550_2_boot -o /oracle/orabase/product/10g/crs -A 10.6.183.59/255.255.255.0/en0
至此，完成了CRS的安装配置工作，但在目前的测试系统中仍有有一个遗留问题是在其中一个节点上gsd守护进程无法启动。但是通过在metalink创建tar进行咨询后得到的确认是可以忽略该错误。实践也证明虽然gsd无法正常启动但是RAC的安装及RAC数据库的创建没有任何问题。
安装RAC数据库软件
1、 运行runInstaller启动安装界面，出现下图的节点选择界面，如果不能出现节点选择界面说明不正常。
2、 选择安装软件
3、 开始安装
4、 安装过程中会自动向其他节点push软件
创建数据库
1、 启动dbca创建数据库。初始的Service配置页，Service名称为ora10g，其他使用默认值，其他部分与创建单实例数据库相同。
因篇幅问题不能全部显示，请点此查看更多更全内容