AIX环境下安装PowerPath
安装软件
1 将powerpath ODM上传到AIX主机下的/tmp/emc目录下，然后用uncompres 命令将包文件解开；
#uncompress /tmp/powerpath/EMC.AIX.5.3.0.1.tar.Z
#tar –xvf EMC.AIX.5.3.0.1.tar
2 smitty 命令选择安装目录，安装AIX ODM
#smitty installp
3 将powerpath4.5.3 for AIX上传到AIX主机下的/tmp/emc/powerpath目录下，然后用gunzip命令将包文件解开；
#gunzip /tmp/emc/powerpath/EMCpower.AIX.4.5.3.patch.tar.gz
#tar –xvf EMCpower.AIX.4.5.3.tar
4 smitty 命令选择安装目录，安装powerpath软件
#smitty installp
5.确认powerpath是否安装成功
#lslpp -l|grep power
6.注册PowerPath软件
#emcpreg –install
7.#cfgmgr -v//确保系统认到新的hdiskpower and hdisk
#powermt config//执行powermt命令识别POWERPATH设备
#powermt display dev=all //检查POWERPATH设备识别情况,policy为SymmOpt #powermt save//保存POWERPATH配置
卸载PowerPath
1 lslpp -l|grep power//检查powerpath安装的版本
2smitty remove
3 选择要卸载的powerpath，Esc+7选择
4 回车确定卸载
5 lslpp -l|grep power //检查是否卸载成功
配制HACMP
/usr/sbin/cluster/utilities/clcustomdisk -c -tdisk/pseudo/power
-Ndisk/pseudo/power -gSCSI3 -hSCSI_TUR
-b/usr/lpp/EMC/Symmetrix/bin/emcpowerreset -ptrue -mMKDEV
odmget HACMPdisktype
1安装PowerPath的集群AIX平台使用EMC Symmetrix磁盘注意事项
1.1在HACMP中设置emcpowerreset以及break reserves in
parallel =true
为保证HACMP能够顺利切换并且最大限度地加快切换速度, 需要在HACMP配置中遵循以下指导:
For HACMP 5.1 and higher (SMIT)
1. Enter into the SMIT fastpath for HACMP "smitty hacmp".
2. Select Extended Configuration.
3. Select Extended Resource Configuration.
4. Select HACMP Extended Resources Configuration.
5. Select Configure Custom Disk Methods.
6. Select Add Custom Disk Methods.
7. The following fields are available, enter as follows;
For IBM Fibre Channel configurations with PowerPath 3.0.3 and higher:
Disk Type (PdDvLn field from CuDv) = disk/pseudo/power
Method to identify ghost disks = SCSI3
Method to determine if a reserve is held = SCSI_TUR
Method to break a reserve = /usr/lpp/EMC/Symmetrix/bin/emcpowerreset
Break reserves in parallel = true
Method to make the disk available = MKDEV
8. Configure the same custom disk processing method on each node in the cluster and synchronize the cluster resources. The cluster verification process ensures that the method that you configured exists and is executable on all nodes. The synchronization process ensures that the ODM entries are the same on all nodes, but will not synchronize the methods named in the ODM entries.
Note To help insure emcpowerreset is installed and configured correctly, go to "/etc/objrepos" and enter the command "odmget HACMPdisktype". If installed correctly you should see "emcpowerreset" called on the "breakres" line. See example below: HACMPdisktype:
PdDvLn = "disk/pseudo/power"
ghostdisks = "SCSI3"
checkres = "SCSI_TUR"
breakres = "/usr/lpp/EMC/Symmetrix/bin/emcpowerreset"
parallel = "true"
makedev = "MKDEV"
reserved1 = ""
reserved2 = ""
reserved3 = ""
In addition, after a failover, you can look at the "hacmp.out" file and confirm emcpowerreset appears for the FC Path and/or hdisk entry. See example below:
Clar_Cascade_1:cl_disk_available[13] ckres_rc=2
Clar_Cascade_1:cl_disk_available[13] [[ 2 != 0 ]]
Clar_Cascade_1:cl_disk_available[29]
/usr/lpp/EMC/CLARiiON/bin/emcpowerreset fscsi1 hdiskpower38
Clar_Cascade_1:cl_disk_available[1228] echo
Clar_Cascade_1,Clar_Cascade_1 Clar_Cascade_1:cl_disk_available[1228]
read vg
注: 从HACMP V5.4开始, 无需配置使用“emcpowerreset”
1.2LV Striping
EMC强烈建议在条件许可的情况下, 在主机层面进行LV Striping设置以提高IO性能. 通常Striping宽度为4的倍数, 深度取决于客户应用的IO Size, 一般可取32k.
2安装PowerPath的集群AIX平台使用EMC Clariion磁盘注意事项
2.1在HACMP中设置emcpowerreset以及break reserves in
parallel =true
为保证HACMP能够顺利切换并且最大限度地加快切换速度, 需要在HACMP配置中遵循以下指导:
For HACMP 5.1 and higher (SMIT)
1. Enter into the SMIT fastpath for HACMP "smitty hacmp".
2. Select Extended Configuration.
3. Select Extended Resource Configuration.
4. Select HACMP Extended Resources Configuration.
5. Select Configure Custom Disk Methods.
6. Select Add Custom Disk Methods.
7. The following fields are available, enter as follows;
For IBM Fibre Channel configurations with PowerPath 3.0.3 and higher:
Disk Type (PdDvLn field from CuDv) = disk/pseudo/power
Method to identify ghost disks = SCSI3
Method to determine if a reserve is held = SCSI_TUR
Method to break a reserve = /usr/lpp/EMC/Symmetrix/bin/emcpowerreset
Break reserves in parallel = true
Method to make the disk available = MKDEV
8. Configure the same custom disk processing method on each node in the cluster and synchronize the cluster resources. The cluster verification process ensures that the method
that you configured exists and is executable on all nodes. The synchronization process ensures that the ODM entries are the same on all nodes, but will not synchronize the methods named in the ODM entries.
Note To help insure emcpowerreset is installed and configured correctly, go to "/etc/objrepos" and enter the command "odmget HACMPdisktype". If installed correctly you should see "emcpowerreset" called on the "breakres" line. See example below: HACMPdisktype:
PdDvLn = "disk/pseudo/power"
ghostdisks = "SCSI3"
checkres = "SCSI_TUR"
breakres = "/usr/lpp/EMC/Symmetrix/bin/emcpowerreset"
parallel = "true"
makedev = "MKDEV"
reserved1 = ""
reserved2 = ""
reserved3 = ""
In addition, after a failover, you can look at the "hacmp.out" file and confirm emcpowerreset appears for the FC Path and/or hdisk entry. See example below:
Clar_Cascade_1:cl_disk_available[13] ckres_rc=2
Clar_Cascade_1:cl_disk_available[13] [[ 2 != 0 ]]
Clar_Cascade_1:cl_disk_available[29]
/usr/lpp/EMC/CLARiiON/bin/emcpowerreset fscsi1 hdiskpower38
Clar_Cascade_1:cl_disk_available[1228] echo
Clar_Cascade_1,Clar_Cascade_1 Clar_Cascade_1:cl_disk_available[1228]
read vg
注: 从HACMP V5.4开始, 无需配置使用“emcpowerreset”
2.2在HACMP+PowerPath环境中设置cfgscsi_id以提高HACMP启
动和切换速度
注1：在Symmetrix环境中不需要设置此脚本，而在Clariion环境中需要设置此脚本。安装时，必须同时安装”emcpowerreset”。
注2：“cfgscsi_id”取代了以前的”set_scsi_id”，某些用户可能已经安装了”set_scsi_id”，这种情况下，不需要重新安装。
Procedure to configure into HACMP:
After going to Powerlink to download "cfgscsi_id", put it into /usr/sbin on all nodes in the cluster, and make it executable. Use the procedure below, on every node in the cluster, to add the "cfgscsi_id" utility into the HACMP environment.
1. Check for and remove any previous "set_scsi_id" or "set_scsi_id.sh" cluster events that may have been used. Do this by running "odmget HACMPcustom" and note any events
named "set_scsi_id" or "set_scsi_id.sh". If one is found run the command below to remove it and then re-run odmget command to confirm all are gone.
/usr/es/sbin/cluster/utilities/clrmcustom -t event -n'set_scsi_id' (or -n'set_scsi_id.sh')
2. Add the custom cluster event to your HACMP configuration. This event is the name given to the script that will be added later to select pre-defined HACMP events. Note that this is one long command with no carriage returns.
/usr/es/sbin/cluster/utilities/claddcustom -t event -n'cfgscsi_id' -I'Set correct scsi id on EMC CLARiiON pseudo devices.' -v'/usr/sbin/cfgscsi_id'
3. Verify your custom cluster event was added correctly by running the command below and comparing the output.
odmget HACMPcustom
HACMPcustom:
name = "cfgscsi_id"
type = "event"
description = "Set correct scsi id on EMC CLARiiON pseudo devices."
value = "/usr/sbin/cfgscsi_id"
relation = ""
status = 0
4. Run the two commands below to modify the pre-defined HACMP event by giving the event command your custom cluster event as a pre-event command.
/usr/es/sbin/cluster/utilities/clchevent -O'node_up'
-s'/usr/es/sbin/cluster/events/node_up' -b 'cfgscsi_id' -c '0'
/usr/es/sbin/cluster/utilities/clchevent -O'node_down'
-s'/usr/es/sbin/cluster/events/node_down' -b 'cfgscsi_id' -c '0'
5. Verify the events were properly modified by running the two commands below and
comparing the output.
odmget -q name=node_up HACMPevent
HACMPevent:
name = "node_up"
desc = "Script run when a node is attempting to join the cluster."
setno = 101
msgno = 7
catalog = "events.cat"
cmd = "/usr/es/sbin/cluster/events/node_up"
notify = ""
pre = "cfgscsi_id"
post = ""
recv = ""
count = 0
event_duration = 0
odmget -q name=node_down HACMPevent
HACMPevent:
name = "node_down"
desc = "Script run when a node is attempting to leave the cluster."
setno = 101
msgno = 8
catalog = "events.cat"
cmd = "/usr/es/sbin/cluster/events/node_down"
notify = ""
pre = "cfgscsi_id"
post = ""
recv = ""
count = 0
event_duration = 0
6. Once the "cfgscsi_id" utility has been installed and configured on every node in the cluster, synchronize the cluster and ensure there are no errors resulting from the addition of the
pre-event scripts.
Notes: The modified script must reside in the same location on all nodes in the cluster. The script must be made executable on all nodes. Synchronization for the cluster will fail if it is not.
2.3LV Striping
EMC建议在使用CLARiiON LUN时，如果在CLARiiON 内部已经做了RAID5 或RAID 10的情况下：（1）如果选择的LUN来在不同的Raid Group, 在主机层面, 可以做LV RAID 0 Striping设置, Striping的size建议选取64k的倍数，对于是否运用LV striping和striping szie 大小取决于应用程序的I/O特性和I/O size. （2）如果选择的LUN来自同一个RAID Group，则不建议做LV Striping.
EMC强烈建议一个卷组内使用的LUN平均分布在CLARiiON的两个控制器上(SPA,SPB)，以提高控制器的利用率。
Best Regards
Chen Xiao Feng(陈晓峰)
EMC Global Services - TIS
China, EMC Corporation
Office:010-********-6143
24-hour Mandarin Support Line: 8008190009 / 8008103777
EMC2
where information lives