Linux下VCS5.0安装指导

Linux下VCS5.0安装指导华为技术有限公司版权所有侵权必究Linux下VCS5.0安装指导文档密级:内部公开修订记录Linux下VCS 5.0安装指南文档密级:内部公开目录第1章方案范围 (1)第2章系统需求 (2)2.1 软件环境 (2)2.2 硬件环境 (4)2.3 操作系统环境 (4)2.4 组网环境 (5)第3章安装准备 (6)3.1 方案的软件清单 (6)3.2 方案的网络规划 (6)第4章方案实施指导 (8)4.1 安装VCS前准备工作 (8)4.1.1 设置系统环境变量 (8)4.1.2 配置SuSE网卡 (9)4.1.3 设置私有网络 (10)4.1.4 LLT网口设置 (10)4.1.5 设置共享存储 (10)4.1.6 设置集群节点信任关系 (10)4.1.7 获取License文件 (12)4.1.8 加载软件光盘 (12)4.2 安装VCS软件包 (12)4.2.2 启动VCS安装程序 (13)4.2.3 配置集群节点和安装特性 (16)4.2.4 安装VCS相关软件包并生成相关配置文件 (23)4.2.5 启动VCS和相关组件 (23)4.2.6 验证集群节点VCS服务 (24)Linux下VCS 5.0安装指南文档密级:内部公开关键词:VERITAS、Linux、VCS、SLES摘要:本文主要介绍在Linux (SuSE Linux Enterprise Server 9、Redhat EnterpriseLinux 4) 操作系统下安装VERITAS Cluster Server 5.0缩略语清单:SLES 9 SuSE Linux Enterprise Server 9VCS VERITAS Cluster ServerVVR VERITAS Volume ReplicationRHEL Red Hat Enterprise LinuxSLES SUSE Linux Enterprise Server参考资料清单:VERITAS Cluster Server Installation Guide for LinuxLinux下VCS 5.0安装指南文档密级:内部公开第1章方案范围随着计算机的日益广泛应用,计算机系统用来提供各种及时可靠的信息和服务.在电信、证券、金融、零售、制造、军事等领域中,服务器的持续可靠运行是保证整个系统运行的关键,往往要求系统的可用性达到99. 9 %以上.服务器的可用性通常在两种情况下会受到影响:一种是系统当机、错误操作和管理引起的异常失败；另一种是在系统维护和升级时,因安装新的硬件或软件而引起的系统正常关机.有效地避免上述情况对系统的影响,保证系统能为客户提供全天候不间断的可靠服务,是高可用性系统要解决的主要问题.VERITAS Cluster Server是Symantec公司提供的高可用集群配置解决方案.VCS软件能够实现多种方式高可用方案（主备方式、1＋1模式、N+1模式等）VERITAS Storage Foundation软件能够实现扩展磁盘的卷管理和基于VCS 的多种方式高可用方案（主备方式、1＋1模式、N+1模式等）以及基于卷复制的容灾方案本文主要根据VCS在TECAL服务器的应用特点,给出了VCS 5.0在Linux下的安装指导.由于产品的方案不同,在配置方面也会存在差异,在本文档中相应的位置也将进行说明.Linux下VCS 5.0安装指南文档密级:内部公开第2章系统需求2.1 软件环境在本例中,搭建系统的软件光盘选用VERITAS的Storage FoundationEnterprise VERITAS File System.VERITAS各产品套件见下表.可以根据现场需要制定光盘,安装过程大致相同.表2-1VERITAS产品套件Linux下VCS 5.0安装指南文档密级:内部公开Linux 下VCS 5.0安装指南 文档密级:内部公开2.2 硬件环境在本例中,搭建系统的硬件选用华为TECAL 服务器（AMD 系列处理器单板）和FC SAN 存储系统等.表2-2 硬件环境表2.3 操作系统环境VCS 5.0支持RHEL 和SLES9操纵系统.详情见表2.本文两台服务器的操作系统为64位SLES 9 SP3 版本,内核版本为:2.6.5-7.244-smp表2-3 VCS 5.0支持Linux 系统表Linux下VCS 5.0安装指南文档密级:内部公开安装双机高可用软件的两台服务器本地磁盘要预留412MB空间安装该软件包的空间,要求两台主机系统最低内存大小配置至少为1GB.表2-4VCS硬盘空间要求2.4 组网环境TECAL服务器需要用一台存储对数据库数据进行保存；在本操作指导中,采用的存储为华为FC SAN磁盘阵列S6800,双机高可用的拓扑图如下:图2-1双机系统网络拓扑图Linux下VCS 5.0安装指南文档密级:内部公开第3章安装准备3.1 方案的软件清单在本方案中,搭建双机系统需要用到的软件包为:●SUSE LINUX Enterprise Server 9 (x86_64)操作系统●Service Patch 3 操作系统补丁,内核升级到 2.6.5-7.244-smp版本●VERITAS Storage Foundation Enterprise HA软件说明:当前VERITAS Cluster Server的最新补丁为Maintanence Patch 2.0,此补丁主要为增强VCS对Oracle的支持,如果不是应用Oracle服务可以不用安装. 3.2 方案的网络规划在双机系统中,定义主备服务器为:主服务器vcssvr1（主节点）,备服务器vcssvr2（备节点）.正常运行时,vcssvr1提供业务服务,vcssvr2处于备用状态,不提供业务服务.当vcssvr1服务器运行过程中出现异常,该服务器上的被高可用软件VCS将业务服务马上切换到vcssvr2备用服务器上.双机系统的IP规划如下:●双机系统私有通讯定义在Base2和Fabric2平面,即用eth1和eth3做心跳；●双机系统对外服务的IP定义在Fabric1平面,即用eth2做业务通道；●双机系统对外提供服务的浮动IP为10.105.1.10.本操作指导中,两台服务器IP设置如下:表3-1双机系统IP设置表Linux下VCS 5.0安装指南文档密级:内部公开说明:•上面表格关于网口名和eth编号的对应关系跟单板PCB版本和BIOS版本有关,仅供参考Sles 9,实际使用中如使用其他版本的Linux,请按照网卡识别的专题文档自行鉴别.•集群的私网心跳可以通过网络传输,也可以通过共享阵列在节点之间传输.本文给出的是一种简单常用的私网定义方式:一个独占的网口作为主要的私网通道（战友主要的私网通信带宽）,另一个低优先级的网口作为辅助的私网通道（同心数据量小,可以和其他应用网口共用,但要注意网口共用这一依赖关系可能带来相互干扰）.•VCS的心跳采用的是自身开发的LLT和GAB底层协议,不使用TCP/IP 协议,所以如果在集群中主机私网网口连接时经过了Switch,请务必不要对Switch划分Vlan,否则会造成VCS集群心跳异常.双机系统中的主机名不能以数字开始,本文以vcssvr1和vcssvr2为例.Linux下VCS 5.0安装指南文档密级:内部公开第4章方案实施指导4.1 安装VCS前准备工作在两台主机上安装完操纵系统后(本例操纵系统采用的是完全安装的方式)后,在两台服务器安装VCS软件前,都需要做以下准备工作:4.1.1 设置系统环境变量修改/etc/profile文件,设置软件使用到的命令路径和帮助文档路径.在/etc/profile文件后面增加下面PATH和MANPATH环境设置,增加部分如下:PATH=/usr/sbin:/sbin:$PATH:/opt/VRTS/bin:/opt/VRTSob/bin:/opt/VRTSvcs/binexport PATHMANPATH=${MANPATH}:/opt/VRTS/manexport MANPATH执行/etc/profile文件,使之增加的PATH和MANPATH环境变量生效.#source /etc/profileLinux下VCS 5.0安装指南文档密级:内部公开4.1.2 配置SuSE网卡为防止SuSE网卡名称在重启后变化,需要为每台SuSE服务器的网口配置为网络设备配置唯一网口名称.1. 确认hotplug参数配置在/etc/sysconfig/hotplug文件中,确保以下参数正确:HOTPLUG_PCI_QUEUE_NIC_EVENTS＝yes2. 配置系统网口唯一名称用ifconfig –a所见到的所有网口（ethX）,记录下所对应的MAC地址.在/etc/sysconfig/network路径下,对于存在ifcfg-eth-id-xxxxxxxxxxxx文件的网口ethX,将“PERSISTENT_NAME=ethX”这一行补充到该网口的ifcfg-eth-id-xxxxxxxxxxxx文件最后.例如:vcssvr1#:/etc/sysconfig/network # vi ifcfg-eth-id-00\:e0\:fc\:a2\:d7\:72BOOTPROTO='static'BROADCAST='192.168.128.255'IPADDR='192.168.128.11'NETMASK='192.168.128.0'NETWORK='192.168.128.0'STARTMODE='onboot'UNIQUE='Cw4d.pQ19g7K2hvA'_nm_name='bus-pci-0000:06:04.0'PERSISTENT_NAME='eth0'在/etc/sysconfig/network路径下,对于不存在ifcfg-eth-id-xxxxxxxxxxxx文件的网口ethX,则建立一个该网口ethX的ifcfg-eth-id-xxxxxxxxxxxx文件,将”PERSISTENT_NAME=ethX”这一行补充到该网口的ifcfg-eth-id-xxxxxxxxxxxx文件最后.例如:vcssvr1#:/etc/sysconfig/network # vi ifcfg-eth-id-00\:e0\:fc\:a2\:d7\:78Linux下VCS 5.0安装指南文档密级:内部公开PERSISTENT_NAME='eth1'4.1.3 设置私有网络建立心跳网络的连接,本例中通过T8000交换板卡进行通讯.4.1.4 LLT网口设置根据双机高可用特点,确定每台服务器的私网通信链路,双机cluster可通过网口进行心跳通信,为了防止出现由于“头脑分离”引起的数据损坏情况,建议每个cluster节点至少要有两条心跳（LLT通信）,且每条通路之间没有任何的关系,实现完全的冗余功能.首先将两个心跳网口的MAC地址记录下来,编辑/etc/sysconfig/network/config文件,在MANDATORY_DEVICES=””的双引号中加入当前主机上两心跳网口的MAC:“eth-id-xxxxxxxx”,两个字符串之间以空格分开,例如:MANDATORY_DEVICES=”eth-id-00:E0:FC:6D:37:85eth-id-00:E0:FC:6D:38:86”4.1.5 设置共享存储建立存储设备到两集群服务器的连接并分配相关的存储资源给两服务器.有关如何设置S6800存储设备的操作请参考《OceanStor S3100 3200 6800 开局指导书》4.1.6 设置集群节点信任关系在安装VCS软件时,会使用两台主机间网络,如果使用secure模式,需要对两台主机设置ssh信任主机.以下操作务必在root用户下执行.1. 检查两台主机的/etc/hosts文件确认hosts文件中是否正确配置了两台主机名与IP的对应关系.要求在两台主机的hosts文件中,都有下面信息:192.168.128.11 vcssvr1192.168.168.11 vcssvr110.105.1.11 vcssvr1Linux下VCS 5.0安装指南文档密级:内部公开192.168.100.11 vcssvr1192.168.128.12 vcssvr2192.168.168.12 vcssvr210.105.1.12 vcssvr2192.168.100.12 vcssvr210.105.1.10 vcssvr其中,192.168.168.11和192.168.168.12分别是vcssvr1和vcs2的eth1网口.2. 创建.ssh目录分别在两台主机上当前root用户目录（/root）下执行如下命令（以vcssvr1为例）:vcssvr1#mkdir ~/.ssh3. 生成dsa密钥使用ssh-keygen命令生成密钥,接受默认的配置文件:vcssvr1#ssh-keygen -t dsa将id_dsa.pub文件追加到authorized_keys2文件:vcssvr1#cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys24. 同步.ssh文件更改.ssh 文件权限,将其同步到另一台服务器（vcssvr2）上:vcssvr1#chmod 755 ~/.sshvcssvr1#scp ~/.ssh/* vcssvr2:~/.ssh5. 验证ssh功能分别在两台服务器上执行如下命令,如能正常完成,则表明信任关系设置正确.（以vcssvr1为例）vcssvr1#ssh –x –l root vcssrv2 lsvcssvr1#ssh –x –l root vcssrv2 ifconfig若采用rsh设置信任关系,将对方主机的主机名或IP地址写入~/.rhosts文件即可.Linux下VCS 5.0安装指南文档密级:内部公开4.1.7 获取License文件VCS产品有两种类型的License文件（产品正式序列号、产品测试序列号）,两种License类型的产品只是使用时间上有限制,软件本身并无差异.本方案中从VERITAS厂商获取到的License为测试序列号,有效期2008年1月止.4.1.8 加载软件光盘将包含VERITAS Cluster Server 5.0安装包的Storage Foundation and HighAvailablity 5.0安装光盘放入光驱中,以root用户登录操作系统,mount安装光盘后安装.命令如下:#mount –ro /dev/sr0 /mnt/cdrom4.2 安装VCS软件包本节（4.2节）安装操作可以通过网络,多台主机一起安装,因此只需要在一台服务器上执行安装即可.安装VCS大概要经历以下步骤:表4-1VCS安装任务Linux下VCS 5.0安装指南文档密级:内部公开4.2.2 启动VCS安装程序VERITAS可提供两种方法安装VCS:●通过installvcs程序当独安装VCS●通过VERITAS Product install程序选择安装VCS组件Linux下VCS 5.0安装指南文档密级:内部公开1. 通过installvcs程序安装运行VCS产品的安装脚本installvcs#cd /mnt/cdrom/sles9_x86_64/cluster_server#./installvcs说明:针对不同版本的Linux,VCS的安装路径也不同,请根据现场决定安装路径:RHEL 4 (i686) # cd /mnt/cdrom/rhel4_i686/cluster_serverRHEL 4 (x86_64)# cd /mnt/cdrom/rhel4_x86_64/cluster_serverSLES 9 (i586) # cd /mnt/cdrom/sles9_i586/cluster_serverSLES 9 (x86_64) # cd /mnt/cdrom/sles9_x86_64/cluster_server.说明:•VCS支持在一台主机上为整个网络的集群主机节点安装VCS软件,但需先在各主机节点上设置安全信任关系•如果安装VCS之前没有配置ssh安全信任关系,安装会失败.•如果各主机节点设置了rsh安全信任关系,可运行命令:”./installvcs -rsh”来安装如果不安装VCS而只是检查集群节点的安装环境,可以输入以下命令:#./installvcs –precheck vcssrv1 vcssrv22. 通过VERITAS Product installer程序安装执行installer安装脚本,进入VERITAS Storage Foundation and HighAvailability Solutions 5.0安装界面,命令如下:#cd /mnt/cdrom/sles9_x86_64/# ./installer说明针对不同版本的Linux,installer的安装路径也不同,请根据现场决定安装路径:RHEL 4 (i686) # cd /mnt/cdrom/rhel4_i686/RHEL 4 (x86_64)# cd /mnt/cdrom/rhel4_x86_64/SLES 9 (i586) # cd /mnt/cdrom/sles9_i586/SLES 9 (x86_64) # cd /mnt/cdrom/sles9_x86_64/下面以运行installer程序为例描述安装过程,若用installvcs可跳过Installation ProgramLinux下VCS 5.0安装指南文档密级:内部公开Copyright (c) 2006 Symantec Corporation. All rights reserved. Symantec, the Symantec Logo are trademarks or registeredtrademarks of Symantec Corporation or its affiliates in the U.S. and other countries. Other names may be trademarks oftheir respective owners.The Licensed Software and Documentation are deemed to be "commercial computer software" and "commercial computer softwaredocumentation" as defined in FAR Sections 12.212 and DFARS Section 227.7202. Logs for installer are being created in /var/tmp/installer-b0vHKY.Storage Foundation and High Availability Solutions 5.0Symantec Product Version Installed Licensed=========================================================================== VERITAS Cluster Server no noVERITAS File System no noVERITAS Volume Manager no noVERITAS Volume Replicator no noVERITAS Storage Foundation no noVERITAS Storage Foundation Cluster File System no noVERITAS Storage Foundation for DB2 no noVERITAS Storage Foundation for Oracle no noVERITAS Storage Foundation for Oracle RAC no noTask Menu:I) Install/Upgrade a Product C) Configure an Installed ProductL) License a Product P) Perform a Pre-Installation CheckU) Uninstall a Product D) View a Product DescriptionQ) Quit ?) HelpEnter a Task: [I,C,L,P,U,D,Q,?] I步骤1 选择”I”（安装/升级产品）,进行产品安装Storage Foundation and High Availability Solutions 5.01) VERITAS Cluster Server2) VERITAS Volume ReplicatorLinux下VCS 5.0安装指南文档密级:内部公开3) VERITAS Storage Foundation4) VERITAS Storage Foundation for Oracle5) VERITAS Storage Foundation for DB26) VERITAS Storage Foundation Cluster File System7) VERITAS Storage Foundation for Oracle RAC8) VERITAS Cluster Management Console9) Web Server for Storage Foundation Host Management10) Symantec Product Authentication Serviceb) Back to previous menuSelect a product to install: [1-10,b,q] 1步骤2 选择1,安装VERITAS组件——VERITAS Cluster Server4.2.3 配置集群节点和安装特性Storage Foundation and High Availability Solutions 5.0Enter the system names separated by spaces on which to install VCS: vcssvr1 vcssvr2步骤1 输入集群节点主机名称.给出需要安装VCS软件的系统主机名,如果本次需要在多台主机上安装,输入时用空格将主机名隔开.回车确认后,安装脚本会开始获取主机基本信息,并检查相应服务是否可用.Initial system check:installer requires that ssh commands used between systems execute withoutprompting for passwords or confirmations. If installer hangs or asks for a loginpassword or hangs, stop installer and run it again with the ssh configured forpassword free logins, or configure rsh and use the -rsh option.Checking ssh communication with vcssvr2.................. Linux2.6.5-7.244-smpChecking VCS installation on vcssvr1 ............................ notinstalledChecking kernel release on vcssvr1 ........................................244Checking distribution match with vcssvr1 ...................................OKChecking architecture on vcssvr1 ..........................................OKChecking rpm dist match with vcssvr1 .......................................OKLinux下VCS 5.0安装指南文档密级:内部公开Checking for SE Linux on vcssvr1 ..........................................OKChecking VCS installation on vcssvr2 .......................... not installedChecking kernel release on vcssvr2 ........................................244Checking distribution match with vcssvr2 ...................................OKChecking architecture on vcssvr2 ...........................................OKChecking rpm dist match with vcssvr2 .......................................OKChecking for SE Linux on vcssvr2 ..........................................OK步骤2 远程安装检查通过,回车继续注册VCS的license.Storage Foundation and High Availability Solutions 5.0Checking system licensingVCS is not licensed on vcssvr1Enter a VCS license key for vcssvr1: XXXX-XXXX-XXXX-XXXX-XXXX-XXXX-XXXXXX-XXXX-XXXX-XXXX-XXXX-XXXX-XX successfully registered on vcssvr1Demo VCS license registered on vcssvr1Do you want to enter another license key for vcssvr1? [y,n,q] (n)XXXX-XXXX-XXXX-XXXX-XXXX-XXXX-XX successfully registered on vcssvr2Demo VCS license registered on vcssvr2Do you want to enter another license key for vcssvr2? [y,n,q] (n)步骤3 为集群节点输入license说明:必需在安装VCS前为每个主机节点注册VCS license与注册产品正式序列号不同的是,本文以demo版本的 license为例,该license可以装在多个主机上.正式安装时,正式license注册过程可能会有些差异！VCS的license注册成功后,回车继续VERITAS基础组件安装包的检查和安装, Storage Foundation and High Availability Solutions 5.0Checking installed rpms on vcssvr1Linux下VCS 5.0安装指南文档密级:内部公开Checking installed rpms on vcssvr2Storage Foundation and High Availability Solutions 5.0VCS can be installed without optional rpms to conserve disk space.Additional rpms are typically installed to simplify future upgrades.1) Required VERITAS Cluster Server rpms - 394 MB required2) All VERITAS Cluster Server rpms - 456 MB required3) Storage Foundation Enterprise HA rpms - 800 MB requiredSelect the rpms to be installed on all systems? [1-3,q,?] (2)步骤4 输入”2”,选择安装软件包,系统会列出所需安装软件包Storage Foundation and High Availability Solutions 5.0The following VCS rpms will be installed:VRTSperl VERITAS Perl 5.8.8 RedistributionVRTSvlic VERITAS LicensingVRTSicsco Symantec Infrastructure Core Services CommonVRTSpbx Symantec Private Branch ExchangeVRTSsmf Symantec Service Management FrameworkVRTSatClient Symantec Product Authentication Service ClientVRTSatServer Symantec Product Authentication ServiceVRTSspt VERITAS Software Support ToolsSYMClma Symantec License Inventory AgentVRTSllt VERITAS Low Latency TransportVRTSgab VERITAS Group Membership and Atomic BroadcastVRTSvxfen VERITAS I/O FencingVRTSvcs VERITAS Cluster ServerVRTSvcsmg VERITAS Cluster Server Message CatalogsVRTSacclib VERITAS ACC LibraryVRTSvcsag VERITAS Cluster Server Bundled AgentsVRTSvcsdr VERITAS Cluster Server Disk Reservation Modules and Utilities VRTSvcsmn VERITAS Cluster Server Man PagesVRTSvcsdc VERITAS Cluster Server DocumentationPress [Enter] to continue:...continued:……VRTSmaprocommon VERITAS Storage Foundation GUI for MappingLinux下VCS 5.0安装指南文档密级:内部公开Press [Enter] to continue:It is possible to install VCS rpms without performing configuration.It is optional to configure VCS now. If you choose to configure VCS later, you can either do so manually or run theinstallvcs -configure command.Are you ready to configure VCS? [y,n,q] (y)步骤5 输入回车,开始配置VCSStorage Foundation and High Availability Solutions 5.0To configure VCS the following information is required:A unique Cluster nameA unique Cluster ID number between 0-65535Two or more NIC cards per system used for heartbeat linksOne or more heartbeat links are configured as private linksOne heartbeat link may be configured as a low priority linkAll systems are being configured to create one clusterEnter the unique cluster name: [?] vcssvrEnter the unique Cluster ID number between 0-65535: [b,?] 0步骤6 为VCS设置唯一的集群名称和集群ID.定义集群名称为”vcssrv”,集群ID号为0Discovering NICs on vcssvr1 ............... discovered eth0 eth1 eth2 eth3 sit0Enter the NIC for the first private heartbeat link on vcssvr1: [b,?] eth1eth1 has an IP address configured on it. It could be a public NIC on vcssvr1.Are you sure you want to use eth1 for the first private heartbeat link? [y,n,q,b,?] (n) yWould you like to configure a second private heartbeat link? [y,n,q,b,?] (y) Enter the NIC for the second private heartbeat link on vcssvr1: [b,?] eth3 eth3 has an IP address configured on it. It could be a public NIC on vcssvr1.Are you sure you want to use eth3 for the second private heartbeat link? [y,n,q,b,?] (n) yWould you like to configure a third private heartbeat link? [y,n,q,b,?] (n)Linux下VCS 5.0安装指南文档密级:内部公开Do you want to configure an additional low priority heartbeat link? [y,n,q,b,?] (n)Are you using the same NICs for private heartbeat links on all systems? [y,n,q,b,?] (y)Checking Media Speed for eth1 on vcssvr1............................. 1000Mb/sChecking Media Speed for eth3 on vcssvr1 .............................1000Mb/sChecking Media Speed for eth1 on vcssvr2 .............................1000Mb/sChecking Media Speed for eth3 on vcssvr2 .............................1000Mb/sStorage Foundation and High Availability Solutions 5.0Cluster information verification:Cluster Name: vcssvrCluster ID Number: 0Private Heartbeat NICs for vcssvr1: link1=eth1 link2=eth3Private Heartbeat NICs for vcssvr2: link1=eth1 link2=eth3Is this information correct? [y,n,q] (y) y步骤7 为集群设置心跳网口.Storage Foundation and High Availability Solutions 5.0VERITAS Cluster Server can be configured to utilize Symantec Security Services.Running VCS in Secure Mode guarantees that all inter-system communication is encrypted and that users are verified withsecurity credentials.When running VCS in Secure Mode, NIS and system usernames and passwords are used to verify identity. VCS usernames andpasswords are no longer utilized when a cluster is running i n Secure Mode.Before configuring a cluster to operate using Symantec Security Services, another system must already have SymantecSecurity Services installed and be operating as a Root Broker. Refer to the VERITAS Cluster Server Installation Guide formore information on configuring a VxSS Root Broker.Linux下VCS 5.0安装指南文档密级:内部公开Would you like to configure VCS to use Symantec Security Services? [y,n,q] (n) 步骤8 是否为集群设置VxSS,本例中不使用VxSS,选择N跳过此项.Storage Foundation and High Availability Solutions 5.0The following information is required to add VCS users:A user nameA password for the userUser privileges (Administrator, Operator, or Guest)Do you want to set the username and/or password for the Admin user(default username = 'admin', password='password')? [y,n,q] (n)Do you want to add another user to the cluster? [y,n,q] (y) nStorage Foundation and High Availability Solutions 5.0VCS User verification:User: admin Privilege: AdministratorsPasswords are not displayedIs this information correct? [y,n,q] (y)步骤9 主集群设置管理账号信息. 本例中只使用VCS默认账号(用户:admin/密码:password)Storage Foundation and High Availability Solutions 5.0Setup will now configure VERITAS Cluster Management Console.If you have configured a management server, you can configure the cluster to be managed by the management server.You can also configure VERITAS Cluster Management Console on cluster nodes to manage the local cluster.Do you want this cluster to be managed by a management serv er? Enter 'y' if you have set up a management server. [y,n,q] (y) n步骤10 为集群服务设置manager console.本例中不安装管理VCS管理console,跳过此项. Storage Foundation and High Availability Solutions 5.0Linux下VCS 5.0安装指南文档密级:内部公开The following information is required to configure the Cluster Management Con sole:A public NIC used by each system in the clusterA Virtual IP address and netmask for the Cluster Management ConsoleDo you want to configure the Cluster Management Console [y,n,q] (y) yActive NIC devices discovered on vcssvr1: eth0 eth1 eth2 eth3Enter the NIC for Cluster Management Console to use on vcssvr1: [b,?] eth0Is eth0 to be the public NIC used by all systems [y,n,q,b,?] (y)Enter the Virtual IP address for Cluster Management Console: [b,?] 192.168.128.11 Enter the netmask for IP 192.168.128.11: [b,?] (255.255.255.0)步骤11 为VCS设置管理网口.请根据现场方案自行设定Storage Foundation and High Availability Solutions 5.0Cluster Management Console verification:NIC: eth0IP: 192.168.128.11Netmask: 255.255.255.0Is this information correct? [y,n,q] (y) y步骤12 确认管理网口配置正确,回车继续.Storage Foundation and High Availability Solutions 5.0The following information is required to configure SMTP notification:The domain-based hostname of the SMTP serverThe email address of each SMTP recipientA minimum severity level of messages to send to each recipientDo you want to configure SMTP notification? [y,n,q] (y) n步骤13 设置SMTP邮件通知服务,本例中不使用,选择”n”跳过Storage Foundation and High Availability Solutions 5.0The following information is required to configure SNMP notification:System names of SNMP consoles to receive VCS trap messagesSNMP trap daemon port numbers for each consoleA minimum severity level of messages to send to each cons oleLinux下VCS 5.0安装指南文档密级:内部公开Do you want to configure SNMP notification? [y,n,q] (y) n步骤14 设置SMTP trap通知服务,本例中不使用,选择”n”跳过4.2.4 安装VCS相关软件包并生成相关配置文件完成所有选项后,系统会自动进行VCS安装并生成相关配置文件.Storage Foundation and High Availability Solutions 5.0Installing VCS: 100%Installation completed successfully on all systemsVerifying that all NICs have PERSISTENT_NAME set correctly on vcssvr1:For VCS to run correctly, the names of the NIC cards must be boot persistent.Press [Enter] to continue:Verifying that all NICs have PERSISTENT_NAME set correctly on vcssvr2:For VCS to run correctly, the names of the NIC cards must be boot persistent.Press [Enter] to continue:Creating VERITAS Cluster Server configuration files ........................... Done Copying configuration files to vcssvr1........ ........... .................... Done Copying configuration files to vcssvr2 ........................................ Done Do you want to start VERITAS Cluster Server processes now? [y,n,q] (y)4.2.5 启动VCS和相关组件配置文件生成完成之后,系统会提示是否马上启动VCS服务,选择”y”启动VCS服务Storage Foundation and High Availability Solutions 5.0Starting VCS: 100%Startup completed successfully on all systemsInstallation log files, summary file, and response file are saved at:/opt/VRTS/install/logs/installer-b0vHKY至此,安装配置VCS完成.Linux下VCS 5.0安装指南文档密级:内部公开4.2.6 验证集群节点VCS服务验证VCS的安装有下面几步:●验证集群启动情况●验证LLT和GAB的配置文件●验证LLT,GAB和Cluster操作●确认VCS的license是否为永久license说明两台主机系统重启后,会自动带起VCS进程.需要使用下面的步骤检查之前配置好的集群的状态.VCS安装验证操作要分别在两台主机上进行.1. 验证集群启动情况在任一点节点上输入以上命令来验证集群启动情况:# cd /etc/VRTSvcs/conf/config# hacf -verify .-- SYSTEM STATE-- System State FrozenA vcssrv1 RUNNING 0A vcssrv2 RUNNING 0-- GROUP STATE-- Group System Probed AutoDisabled StateB ClusterService vcssrv1 Y N ONLINEB ClusterService vcssrv2 Y N OFFLINE如果集群中所有节点状态都为运行,说明VCS已经安装成功,且能正常运行.可以在各节点上使用vcssys –display命令查看各节点详细的属性值,可以参考VCS帮助文档的说明信息,这里就不作说明.2. 验证LLT和GAB的配置文件验证LLT配置文件安装之后,/etc/llthosts和/etc/llttab文件会包含LLT的配置信息,类似信息如下所示.vcssvr1:/ #more /etc/llthosts0 vcssvr11 vcssvr2/etc/llthosts第一列为主机在集群中的系统ID,第二列为主机在集群中的主机Linux下VCS 5.0安装指南文档密级:内部公开名.vcssvr1:/ # cat /etc/llttabset-node vcssvr1set-cluster 1link eth3 eth-00:18:82:34:80:16 - ether - -link eth1 eth-00:18:82:34:80:17 - ether - -/etc/llttab文件中,第一行标识为主机名；第二行标识为集群唯一标识；第三行和第四行为本机LLT协议使用的网卡名.验证GAB配置文件两台主机安装VCS之后,/etc/gabtab文件会包含GAB的配置信息,类似信息如下所示.vcssvr1:/ # more /etc/gabtab/sbin/gabconfig -c -n23. 验证LLT,GAB和Cluster操作验证LLT运行状态使用lltstat –nvv命令,查看两台主机上LLT的运行状态,类似输出信息如下:vcssvr1:/ # lltstat -nvvLLT node information:Node State Link Status Address* 0 vcssrv1 OPENeth3 UP 00:18:82:34:80:16eth1 UP 00:18:82:34:80:171 vcssrv2 OPENeth3 UP 00:18:82:47:70:8Ceth1 UP 00:18:82:47:70:8C2 CONNWAITeth3 DOWNeth1 DOWN3 CONNWAITeth3 DOWNeth1 DOWN4 CONNWAITeth3 DOWNeth1 DOWN5 CONNWAITeth3 DOWNLinux下VCS 5.0安装指南文档密级:内部公开 eth1 DOWN集群中各主机节点State为OPEN,两个私网Link Status为UP就说明心跳是正常的.验证GAB运行状态使用gabconfig –a命令,查看两台主机上GAB的运行状态,类似输出信息如下:vcssvr1:/ #gabconfig -aGAB Port Memberships===============================================================Port a gen 44c301 membership 01Port a gen 44c301 jeopardy ;1Port h gen 44c303 membership 01Port h gen 44c303 jeopardy ;1vcssvr2:/ # gabconfig -aGAB Port Memberships===============================================================Port a gen 44c301 membership 01Port a gen 44c301 jeopardy ;1Port h gen 44c303 membership 01Port h gen 44c303 jeopardy ;1Port a表示GAB正在通信,membership 01表示集群中系统标识为0和1的主机是处于连接状态.Port h表示VCS已经起来,membership 01表示集群中系统标识为0和1的主机的VCS处于运行状态.注意:验证过程中发现某台主机的GAB或者LLT没有正常起来,可以尝试将异常主机再次重起.如果还是不行,可以考虑在异常主机上使用下面手工带起的方法（本步操作是在出现问题时,手工启停LLT和GAB的方法,要求咨询veritas产品工程师后再进行）.手工启动LLT和GAB的方法是,使用/etc/init.d/路径下的llt 或 gab脚本.其中,GAB是处于LLT之上的,所以在启llt和gab时,要先启llt,再启gab；在停llt和gab时,就要先停gab,再停llt.# /etc/init.d/llt start# /etc/init.d/gab start# /etc/init.d/gab stop# /etc/init.d/llt stopLinux下VCS 5.0安装指南文档密级:内部公开4. 确认VCS的license是否为永久license在两台主机上,使用vxlicrep命令查看当前系统安装的VERITAS产品的license信息.如果安装时使用的不是永久license,想升级为永久license,则此时需要使用vxlicinst命令,注册永久的license.说明#vxlicrep |more ——查看当前系统安装的VERITAS产品的license信息#vxlicinst ——注册新的永久license# vxlicrepSymantec License Manager vxlicrep utility version 3.02.16.0Copyright (C) 1996-2006 Symantec Corporation. All rights reserved.Creating a report on all VERITAS products installed on this system-----------------***********************-----------------License Key = P4C9-3ZXL-NP6H-8DAM-4O4P-39RC-PProduct Name = VERITAS Cluster ServerLicense Type = DEMO_EXTENSIO NOEM ID = 4095Demo End Date = Sat Jan 19 00:00:00 2008(30.0 days from now).Features :=Platform = LinuxVersion = 5.0 Tier = Unused Reserved = 0Mode = VCS 从“license Type”的值可以看出当前license是PERMANENT还是DEMO版的如果license不是永久的,可以使用下面的方法重新注册license,此步骤需要在集群中两台主机上都要进行.# vxlicinstSymantec License Manager vxlicinst utility version 3.02.16.0Linux下VCS 5.0安装指南文档密级:内部公开Copyright (C) 1996-2006 Symantec Corporation. All rights reserved. Enter your license key : XXXX-XXXX-XXXX-XXXX-XXXX-XXLicense key successfully installed for VERITAS Cluster Server。