config priv 000249-006227[005979]: copy=01 offset=000231 enabled log priv 006228-007168[000941]: copy=01 offset=000000 enabled Multipathing information: numpaths: 4
c5t0d0s2 state=enabled type=secondary c5t4d0s2 state=enabled type=
#vxdmpadm_getdmpnode_nodename=c5t4d0s2
NAME STATE ENCLR-TYPE PATHS ENBL DSBL ENCLR-NAME
=========================================================================
c5t0d0s2 ENABLED EMC_CLARiiON 4 4 0 EMC_CLARiiON0
#vxdmpadm_get_dmpnode enclosure=EMC_CLARiiON0 NAME STATE ENCLR-TYPE PATHS ENBL DSBL ENCLR-NAME
=========================================================================
c5t0d0s2 ENABLED EMC_CLARiiON 4 4 0 EMC_CLARiiON0 c5t0d1s2 ENABLED EMC_CLARiiON 4 4 0 EMC_CLARiiON0 c5t0d2s2 ENABLED EMC_CLARiiON 4 4 0 EMC_CLARiiON0
#vxdmpadm_getsubpaths_ctlr=c5
NAME STATE PATH-TYPE DMPNODENAME ENCLR-TYPE ENCLR-NAME
======================================================================
c5t0d0s2 ENABLED SECONDARY c5t0d0s2 EMC_CLARiiON EMC_CLARiiON0 c5t0d1s2 ENABLED SECONDARY c5t0d1s2 EMC_CLARiiON EMC_CLARiiON0 c5t0d2s2 ENABLED
#vxdmpadm.getsubpaths.ctlr=c6
NAME STATE PATH-TYPE DMPNODENAME ENCLR-TYPE ENCLR-NAME
======================================================================
c6t2d0s2 ENABLED SECONDARY c5t0d0s2 EMC_CLARiiON EMC_CLARiiON0 c6t2d1s2 ENABLED SECONDARY c5t0d1s2 EMC_CLARiiON EMC_CLARiiON0 c6t2d2s2 ENABLED
CTLR-NAME ENCLR-TYPE STATE ENCLR-NAME
===================================================== c1 SENA ENABLED sena0 c4 SENA ENABLED sena0
c5 EMC_CLARiiON ENABLED EMC_CLARiiON0 c6 EMC_CLARiiON ENABLED EMC_CLARiiON0
7. 通过vxdisk list 列某一块盘时,能看到信息 Multipathing information: numpaths: 2
c3t1d9s2 state=enabled c4t1d9s2 state=enabled
# vxdisk list c3t1d9s2 Device: c3t1d9s2 devicetag: c3t1d9 type: sliced hostid: sun2801
disk: name=abcdg00 id=1052368240.2809.sun2801 group: name=abcdg id=1052368257.2812.sun2801 flags: online ready private autoconfig autoimport imported
pubpaths: block=/dev/vx/dmp/c3t1d9s4 char=/dev/vx/rdmp/c3t1d9s4 privpaths: block=/dev/vx/dmp/c3t1d9s3 char=/dev/vx/rdmp/c3t1d9s3 version: 2.2
iosize: min=512 (bytes) max=256 (blocks) public: slice=4 offset=0 len=6287360 private: slice=3 offset=1 len=2559 update: time=1052812106 seqno=0.54 headers: 0 248
configs: count=1 len=1865 logs: count=1 len=282 Defined regions:
config priv 000017-000247[000231]: copy=01 offset=000000 enabled config priv 000249-001882[001634]: copy=01 offset=000231 enabled log priv 001883-002164[000282]: copy=01 offset=000000 enabled Multipathing information: numpaths: 2
c3t1d9s2 state=enabled(阵列单控制器的情况下,没有看到type=primary c4t1d9s2 state=enabled 或type=secondary?在阵列为A/P时看到)
8. 如果通过vxdisk list 能看到两倍的盘,说明VM的DMP没有正确配置。 先通过命令查看同一块盘的信息是否一样,如果不同,先调阵列。 # cd /etc/vx/diag.d
# ./vxdmpinq /dev/rdsk/c3t1d9s2
Inquiry for /dev/rdsk/c3t1d9s2, evpd 0x0, page code 0x0 Vendor id : DGC Product id : RAID 5 Revision : 0524
Serial Number : 093E580000CL # ./vxdmpinq /dev/rdsk/c4t1d9s2
Inquiry for /dev/rdsk/c4t1d9s2, evpd 0x0, page code 0x0 Vendor id : DGC Product id : RAID 5 Revision : 0524
Serial Number : 093E580000CL
9. 如果阵列VM缺省不支持,请先安装ASL包。 #vxddladm listjbod
VID PID Opcode Page Code Page Offset SNO length
========================================================================== SEAGATE ALL PIDs 18 -1 36 12 SUN SESS01 18 -1 36 12
10. 然后添加到DMP支持列表库 #vxddladm addjbod vid=DGC #vxddladm listjbod
VID PID Opcode Page Code Page Offset SNO length
========================================================================== SEAGATE ALL PIDs 18 -1 36 12 SUN SESS01 18 -1 36 12 DGC ALL PIDs 18 -1 36 12
11. 执行#vxdctl enable
12. #vxdisk list应只能看到一倍的盘。
13. The following three parameters must be set on the master controller unit: Ø Multi-path support software: § DMP: sys mp_support rw § STMS: sys mp_support mpxio Ø sys cache auto Ø sys mirror auto
14. 有一种工作方式:有些阵列控制器的工作方式可以是对具体的LUN互为备援。既partner pair configuration ,所以当用命令#vxdisk list查看,会发现只列出第一块HBA卡所读到的信息。
The T3 array in partner pair configuration provides 2 paths to each logical unit (LUN). One path is considered the primary and the other path is considered the secondary for any given LUN. In normal operation, all I/O for a particular LUN goes down the primary path. If the primary path for a LUN fails, I/O for that LUN is sent down the secondary path. In order to balance the I/O load, half of the LUNs use one path as the primary and half use the other. This means that both paths are considered primary for some LUNs and secondary for some LUNs. Because there is a primary and secondary path for each LUN, the T3 is an Active/Passive type array.
When Dynamic Multipathing (DMP) scans the device list looking for devices that are accessed through more than one controller, it assigns the name of the disk media record based on whichever controller is probed first. Because of this all the LUNs in the array will have DM records that start with the same controller. The DM record name does not indicate which controller is in use as the primary path for a particular LUN.
EXAMPLE:
The array is attached to the host through 2 controllers, C1 and C4. One LUN uses the C1 path as the primary and C4 as the secondary. The other LUN uses C4 as the primary and C1 as the secondary. Both LUNs have DM records that begin with C1.
# vxdisk list
DEVICE TYPE DISK GROUP STATUS
c1t2d0s2 sliced disk01 rootdg online c1t2d1s2 sliced disk02 rootdg online
DMP does know which path is primary and which is secondary for each LUN. That information can be displayed with the vxdisk list
vxdisk list c1t2d0s2 Device: c1t2d0s2 devicetag: c1t2d0 type: sliced hostid: tpsw-154
disk: name=disk01 id=966899066.1066.tpsw-154 group: name=rootdg id=966899051.1025.tpsw-154 flags: online ready autoconfig autoimport imported
pubpaths: block=/dev/vx/dmp/c1t2d0s4 char=/dev/vx/rdmp/c1t2d0s4 privpaths: block=/dev/vx/dmp/c1t2d0s3 char=/dev/vx/rdmp/c1t2d0s3 version: 2.1
iosize: min=512 (bytes) max=2048 (blocks) public: slice=4 offset=0 len=279707648 private: slice=3 offset=1 len=8191 update: time=966899613 seqno=0.9
headers: 0 248
configs: count=1 len=6027 logs: count=1 len=913 Defined regions:
config priv 000017-000247[000231]: copy=01 offset=000000 enabled config priv 000249-006044[005796]: copy=01 offset=000231 enabled log priv 006045-006957[000913]: copy=01 offset=000000 enabled Multipathing information: numpaths: 2
c1t2d0s2 state=enabled type=secondary c4t1d0s2 state=enabled
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
vxdisk list c1t2d1s2 Device: c1t2d1s2 devicetag: c1t2d1 type: sliced hostid: tpsw-154
disk: name=disk02 id=966899118.1145.tpsw-154 group: name=rootdg id=966899051.1025.tpsw-154 flags: online ready autoconfig autoimport imported
pubpaths: block=/dev/vx/dmp/c1t2d1s4 char=/dev/vx/rdmp/c1t2d1s4 privpaths: block=/dev/vx/dmp/c1t2d1s3 char=/dev/vx/rdmp/c1t2d1s3 version: 2.1
iosize: min=512 (bytes) max=2048 (blocks) public: slice=4 offset=0 len=279707648 private: slice=3 offset=1 len=8191 update: time=966899613 seqno=0.7 headers: 0 248
configs: count=1 len=6027 logs: count=1 len=913 Defined regions:
config priv 000017-000247[000231]: copy=01 offset=000000 enabled config priv 000249-006044[005796]: copy=01 offset=000231 enabled log priv 006045-006957[000913]: copy=01 offset=000000 enabled Multipathing information: numpaths: 2
c1t2d1s2 state=enabled
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
The multipathing information shows that C1 is primary for disk02 and secondary for disk01,