重启multipathd 服务，验证配置 # service multipathd restart # chkconfig multipathd on
进入/dev/mapper 目录进行验证： # ls -lrt /dev/mapper/*
查看映射情况 # multipath -ll
在 iSCSI 卷上创建分区
[root@racnode1 ~]# fdisk /dev/mapper/racdb-crs Command (m for help): n Command action e extended
p primary partition (1-4) p
Partition number (1-4): 1
First cylinder (1-1012, default 1): 1
Last cylinder or +size or +sizeM or +sizeK (1-1012, default 1012): 1012
Command (m for help): p
Disk /dev/iscsi/crs1/part: 2315 MB, 2315255808 bytes 72 heads, 62 sectors/track, 1012 cylinders
Units = cylinders of 4464 * 512 = 2285568 bytes
Device Boot Start End Blocks /dev/iscsi/crs1/part1 1 1012 2258753
Command (m for help): w
The partition table has been altered!
Calling ioctl() to re-read partition table. Syncing disks.
# ---------------------------------------
[root@racnode1 ~]# fdisk /dev/mapper/racdb-data Command (m for help): n Command action e extended
p primary partition (1-4)
Id System 83 Linux p
Partition number (1-4): 1
First cylinder (1-33888, default 1): 1
Last cylinder or +size or +sizeM or +sizeK (1-33888, default 33888): 33888
Command (m for help): p
Disk /dev/iscsi/data1/part: 35.5 GB, 35534143488 bytes 64 heads, 32 sectors/track, 33888 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes
Device Boot Start End Blocks Id System /dev/iscsi/data1/part1 1 33888 34701296 83 Linux Command (m for help): w
The partition table has been altered!
Calling ioctl() to re-read partition table. Syncing disks.
# ---------------------------------------
[root@racnode1 ~]# fdisk /dev/mapper/racdb-fra Command (m for help): n Command action e extended
p primary partition (1-4) p
Partition number (1-4): 1
First cylinder (1-33888, default 1): 1
Last cylinder or +size or +sizeM or +sizeK (1-33888, default 33888): 33888
Command (m for help): p
Disk /dev/iscsi/fra1/part: 35.5 GB, 35534143488 bytes 64 heads, 32 sectors/track, 33888 cylinders Units = cylinders of 2048 * 512 = 1048576 bytes
Device Boot Start End Blocks Id System /dev/iscsi/fra1/part1 1 33888 34701296 83 Linux
Command (m for help): w
The partition table has been altered!
Calling ioctl() to re-read partition table. Syncing disks.
在 racnode1 上创建所有需要的分区之后，要执行一下multipath命令刷新映射名称 [root@racnode1 ~]# multipath -F --清除多路径设备缓存,不然信息不能更新 [root@racnode1 ~]# multipath –v3 --重新加载 [root@racnode1 ~]# fdisk -l
[root@racnode1 mapper]# ls -lrt /dev/mapper/*
crw------- 1 root root 10, 62 Nov 12 04:42 /dev/mapper/control brw-rw---- 1 root disk 253, 0 Nov 12 05:33 /dev/mapper/crs brw-rw---- 1 root disk 253, 1 Nov 12 05:33 /dev/mapper/fra brw-rw---- 1 root disk 253, 2 Nov 12 05:33 /dev/mapper/data brw-rw---- 1 root disk 253, 3 Nov 12 05:33 /dev/mapper/crsp1 brw-rw---- 1 root disk 253, 4 Nov 12 05:33 /dev/mapper/datap1 brw-rw---- 1 root disk 253, 5 Nov 12 05:33 /dev/mapper/frap1
这里多了一下/dev/mapper/frap1，datap1 和crsp1 的分区，这些就是已经格式化之后的磁盘。我们可以直接使用。这里要注意一个问题，权限问题。现在看到的用户是root。我们需要在Oracle 用户。修改rc.local. 让系统每次在启动时修改文件属性： [root@racnode1 mapper]# cat /etc/rc.d/rc.local #!/bin/sh #
# This script will be executed *after* all the other init scripts. # You can put your own initialization stuff in here if you don't # want to do the full Sys V style init stuff.
touch /var/lock/subsys/local
chown oracle:oinstall /dev/mapper/fra* chown oracle:oinstall /dev/mapper/data* chown oracle:oinstall /dev/mapper/crs*
执行下脚本：
[root@racnode1 mapper]# sh /etc/rc.d/rc.local
现在应使用以下命令以“root”用户帐户从 Oracle RAC 集群的所有其余节点 (racnode2) 将分区更改通知给内核。
在 racnode2 上运行以下命令： [root@racnode2 ~]# partprobe [root@racnode2 ~]# fdisk -l
[root@racnode2 ~]# multipath -ll
2.5，在Oracle RAC节点上配置ASM
在集群中的两个Oracle RAC节点上都要配置ASM。而创建ASM磁盘组只应在 RAC 集群的节点1上执行，节点2刷新就可以了。
2.5.1，安装ASM包
先安装ASM 包，这个几个包可以从Oracle 官网下载：
http://www.oracle.com/technetwork/topics/linux/asmlib/index-101839.html 根据你的系统版本下载对应的包，下面是我的下载包： oracleasmlib-2.0.4-1.el5.x86_64.rpm
oracleasm-support-2.1.8-1.el6.x86_64.rpm kmod-oracleasm-2.0.6.rh1-2.el6.x86_64.rpm
注意：最后一个包只是针对RHEL6或centos6以上的，6以下不叫这个名字。 # rpm -Uvh *.rpm
2.5.2，配置ASM初始化
oracleasm命令的默认路径为/usr/sbin。以前版本中使用的/etc/init.d 路径并未被弃用，但该路径下的oracleasm二进制文件现在一般用于内部命令。如果输入oracleasm configure命令时不带 -i 标志，则显示当前配置。
# oracleasm configure -i -- 在所有节点都要执行。 Configuring the Oracle ASM library driver.
This will configure the on-boot properties of the Oracle ASM library driver. The following questions will determine whether the driver is loaded on boot and what permissions it will have. The current values will be shown in brackets ('[]'). Hitting
Default user to own the driver interface []: grid
Default group to own the driver interface []: asmadmin Start Oracle ASM library driver on boot (y/n) [n]: y Scan for Oracle ASM disks on boot (y/n) [y]: y
Writing Oracle ASM library driver configuration: done You have new mail in /var/spool/mail/root 该脚本完成以下任务：
创建 /etc/sysconfig/oracleasm 配置文件 创建 /dev/oracleasm 挂载点 挂载 ASMLib 驱动程序文件系统
输入以下命令以加载oracleasm内核模块：
[root@rac1 mnt]# oracleasm init -- 在所有节点都要执行。 Creating /dev/oracleasm mount point: /dev/oracleasm Loading module \
Mounting ASMlib driver filesystem: /dev/oracleasm
如果这里没有配置，在安裝Clusterware后执行root.sh脚本时可能会触发错误
2.5.3，创建ASM磁盘组
创建过程在一个节点执行即可。另一个节点扫描一下就可以识别到了。 在node1：
#oracleasm createdisk CRS /dev/mapper/racdb-crsp1 #oracleasm createdisk DATA /dev/mapper/racdb-datap1 #oracleasm createdisk FRA /dev/mapper/racdb-frap1 node2：
# oracleasm scandisks
Reloading disk partitions: done Cleaning any stale ASM disks... Scanning system for ASM disks... Instantiating disk \Instantiating disk \Instantiating disk \
[root@rac2 mnt]# oracleasm listdisks CRS DATA FRA
如果创建错误，可以用deletedisk参数，如：oracleasm deletedisk DATA [root@rac2 mnt]# oracleasm querydisk DATA Disk \到此，ASM的安装配置结束。
三，安装集群软件部分 3.1，准备安装软件
一共3个压缩包：
p10404530_112040_Linux-x86-64_1of7.zip p10404530_112040_Linux-x86-64_2of7.zip p10404530_112040_Linux-x86-64_3of7.zip 其中：
p13390677_112040_Linux-x86-64_1of7.zip p13390677_112040_Linux-x86-64_2of7.zip