Greenplum安装部署参考手册
- 格式:doc
- 大小:3.13 MB
- 文档页数:26
gpexpand用法-回复GPExpand是一个用于扩展关系数据库的工具,它能够在分布式环境下自动迁移数据并重新分布,从而提高数据库系统的性能和可伸缩性。
本文将为您详细介绍GPExpand的用法,并逐步回答您关于GPExpand的问题。
第一步:安装和配置GPExpand要使用GPExpand,首先要确保您已经正确安装和配置了Greenplum数据库。
确保您的系统满足GPExpand的要求,并按照官方文档进行安装和配置。
第二步:数据库准备在开始数据扩展之前,您需要准备好待扩展的数据库。
首先,您需要创建一个源数据库,作为扩展的基础。
然后,在源数据库中创建并填充初始数据。
确保您的数据库的结构和数据是正确的,并且满足您的扩展需求。
第三步:配置GPExpand在开始使用GPExpand进行扩展之前,您需要编辑GPExpand的配置文件。
这个配置文件包含了扩展的相关参数和选项。
您可以根据自己的需求来设置这些参数,以控制扩展的方式和过程。
第四步:运行GPExpand通过命令行或脚本,您可以启动GPExpand来执行扩展操作。
GPExpand会自动分析数据库,确定扩展要迁移的表和数据。
它还会通过一些算法来重新分配数据块和分布式表,以提高数据访问和查询的性能。
第五步:监控和优化在GPExpand运行期间,您可以监控GPExpand的进度和性能。
可以使用Greenplum的工具和查询来查看扩展的状态和性能指标。
如果需要,您可以对参数和配置进行调整,以优化扩展的过程和结果。
第六步:验证和测试在扩展完成后,您需要对新扩展的数据库进行验证和测试。
确保数据库的结构和数据与源数据库相同,并且性能得到了提升。
您可以使用一些查询和性能测试工具来测试数据库的性能和可伸缩性。
第七步:生产环境部署如果您对扩展的结果满意并通过了验证和测试,您可以将新扩展的数据库部署到生产环境中。
首先,您需要备份源数据库并恢复到新环境中。
然后,您可以将新环境中的数据库设置为生产环境,并开始使用新的扩展数据库。
Hillstone Networks,Inc.云·格CloudHive安全产品部署手册Version2.3Copyright2016Hillstone Networks,Inc..All rights reserved.Information in this document is subject to change without notice.The software described in this document is furnished under a license agreement or nondisclosure agreement.The software may be used or copied only in accordance with the terms of those agreements.No part of this publication may be reproduced, stored in a retrieval system,or transmitted in any form or any means electronic or mechanical,including photocopying and recording for any purpose other than the purchaser's personal use without the written permission of Hillstone Networks,Inc..Hillstone Networks,Inc.联系信息公司总部(北京总部):地址:北京市海淀区宝盛南路1号院20号楼5层邮编:100192联系我们:/about/contact_Hillstone.html关于本手册本手册介绍Hillstone Networks,Inc.云·格CloudHive安全产品的安装部署方法。
GreenPlum数据库集群安装说明及使用手册开心十二月总结****年**月**日目录1体系结构介绍 (4)2安装 (10)2.1安装 (10)2.1.1安装准备 (10)2.1.2安装gp-db (11)2.1.3配置通讯 (13)2.1.4建立数据存储池 (17)2.1.5同步系统时间 (17)2.1.6验证安装是否成功 (17)2.1.7初始化 (17)2.1.8数据库的启停 (18)2.2Master双机热备 (19)2.3Segment节点互备 (20)3GP数据库的使用 (22)3.1pgAdminIII工具 (22)3.1.1安装和第一次使用pgAdminIII (22)3.1.2主窗体 (23)3.1.3导航菜单 (23)3.1.4工具栏介绍 (24)3.1.5数据库与表的创建 (25)3.1.6使用pgAdminIII备份数据库 (25)3.2JDBC配置 (26)3.3GP数据库两个重要概念 (27)3.3.1什么是Schema (27)3.3.2数据分布存储 (28)3.4GP的SQL语法 (28)3.4.1数据加载 (28)3.4.2SQL并行查询 (32)3.4.3聚合函数 (32)3.4.4索引 (32)3.4.5分区 (34)3.4.6函数 (35)4维护数据库 (39)4.1数据库启动gpstart (39)4.2数据库停止gpstop (41)4.3查看实例配置和状态 (41)4.4查看数据库运行状态gpstate (42)4.5查看用户会话和提交的查询等信息 (43)4.6查看数据库、表占用空间 (43)4.7查看数据分布情况 (44)4.8实例恢复gprecoverseg (44)4.9查看锁信息 (44)4.10数据库的备份与恢复 (44)5调优、排错 (44)6附件 (44)6.1DBA常用命令 (44)7Q&A (45)7.1不支持触发器 (45)7.2更新操作中的若干问题 (45)1体系结构介绍Greenplum数据库产品——下一代数据仓库引擎和分析方法Greenplum公司是企业数据云计算解决方案的创始人,为客户提供灵活的数据商业智能和分析方法。
Virtual Switch Ignore AC In this lesson you will learn how you can set up a Multi to selectively ignore the grid toprioritise solar energy over the grid. This feature is called AC ignore. The system will run in off-grid mode most of the time and will only let grid in when thebatteries are empty or when the AC load is too big.IntroductionIn this lesson you will learn how you can set up a Multi* to selectively ignore the grid. This feature can be used to prioritize solar energy over the grid. This feature is called AC ignore.The AC ignore function can be set up so that the Multi will disconnect from the grid when the batteries are full enough and/or the AC load is not too big. The Multi will disconnect from the grid most of the time. It will only let the grid in when the batteries are empty or when you are running a big AC load. You now can use the grid like you would use a back-up generator.The mechanism behind the AC ignore function is the opening or closing the Multi’s internal AC input relay.This feature in not enabled by default. To set it up you will need to change settings in the Multi. This is done by connecting a computer to the Multi and using VE.Configure 3 software.* In this lesson Multi can mean any of our inverter/chargers like the Multiplus, MultiGrid, Quattro and EasySolarThe AC input relayHow can a Multi ignore the grid?If you look at the internal wiring diagram of a Multi you will see that it has a relay on the ACinput. This relay is called “AC input relay”. In some of our documentation the relay is calledthe “back-feed relay”.The normal function of this relay is to open as soon as the grid or generator is not there. For example, during a blackout or when a generator is off. This is a safety action. The relay prevents energy feeding into the grid during a blackout or when the generator is off.This relay can also be setup to purposefully ignore the grid. It will still perform its normal safety action but it can open and disconnect from the grid under more situations. It can ignore the grid when the batteries are still full enough. Now DC solar power can be prioritized and the grid will be used like a backup generatorWhen can the grid be ignored ?The AC input relay can be programmed to selectively ignore the grid, while looking at two parameters:It can look at battery voltage and/or at AC load parameters. (Further in this lesson we will explain these parameters in more detail.)The grid is ignored when the batteries are full enough. The grid is let in when the batteries are empty•This setting can be used to charge the batteries from the grid should the batteries get too empty. This can occur, for example, at night or during a long period of bad weather.•In this scenario the Multi will look at the battery voltage. It will let the grid in when the battery voltage is too low, for a certain amount of time. It will ignore the grid as soon as the battery voltage has increased above a certain level, for a certain amount of time.•The multi can also disconnect the grid on battery state of charge.The grid is ignored when the AC loads are low. The grid is let in when the AC loads are high•This setting can be used to allow grid in when the AC load is higher than the Multi rating . This will prevent the Multi going into overload. This setting can also be used for large loads that you do not want to run from the battery.•In this scenario the Multi will look at the AC load. As soon as it sees that the load is above a certain level, for a certain amount of time, the Multi will let the grid in. The multi will stop letting the grid in as soon as it sees that the AC load has dropped below a certain level, for a certain amount of time.Installing and running VE.Configure 3In a Multi the “Ignore AC” feature is not enabled by default. This feature can only be enabled with a software program called VE.Configure 3. VE.Configure* is part of the VE Configuration tools package. This package is available free of charge from our website.Instructions:•Download the VE Configuration tools package from https:///support-and-downloads/software •Install the VE Configuration package on your Windows computer•The package will install a number of software programs on your computer. One of these software files is the VE.Configure software program.* In the rest of this lesson we will use the terminology VE.Configure instead of VE.Configure 3The next step is to connect your computer to the Multi. For this you will need hardware, like a cable and an interface. Please follow below instructions on how to do that.Please note, that it is also possible to run VE.Configure in demo mode. Demo mode can be used if you don’t have an actual Multi to connect to. For demo mode instructions see page 8.Required items:• A MK3-USB interface (The older MK2-USB can also still be used)See: https:///accessories/interface-mk3-usb• A RJ45 UTP cableSee: https:///cables/rj45-utp-cableTo connect a Multi to a computer:•Disconnect the CCGX or Venus GX from the Multi (if present)•Connect the MK3-USB interface to a USB port on your computer•Connect the MK3-USB interface to a RJ45 UTP cable•Connect the other side of the RJ45 UTP cable to one of the RJ45 connectors in the Multiplus. It does not matter which one of the connectors you use.RJ45connectorsNow you need to make VE.Configure connect to the Multi. This is how to do that: Instructions•Open VE.Configure on your computer•Click on the [Port Selection] menu•Select [Com port]•Then select [Auto detect]•VE.Configure finds the Multi, connects to it and will retrieve the settingsYou can also run VE.Configure in “demo mode”. Demo mode allows you to practice configuration without the need to connect to an actual Multi. This is especially handy if you want to follow this lesson and you don’t have an actual Multi nearby. Use the demo mode to configure a “virtual” unit.To enter “demo mode”:•Click on the [Port Selection] menu•Select [Fake target with full options].•Select the unit of your choiceIt is also possible to view and/or make changes to a previously saved VE.Configure file.In that case:•Click on the [Port Selection]menu•Select [Fake target from file]TIP:To change the VE Configure language:•Click on the [Options] menu•Select [Language]•Select [check online for language]•Choose your preferred language.It is good practice to always save the Multis existing settings before making any changes to the settings.Thi s useful in case you need the initial configuration.Instructions:•Click on the [Get settings] button•Wait for the settings to be retrieved•Then click on the [File]menu•Select [Save settings]• A file containing the settings will be savedIt is also possible to load settings from an earlier saved file. Instructions:•Click on the [File] menu•Select [Load settings]•You will be asked which file you want to load•Click on the [Send settings]buttonProgramming AC ignore settings To program the AC ignore settings you will have to go to the “Virtual switch” tab in VE. Configure.Virtual switch (VS) is the part of VE.Configure where youcan make advanced settings. Like driving the programmable relay or set up Ignore AC.First you need to select what function you want Virtual switch to perform. In this case you want to choose “Ignore AC.”Instructions:•Go to the [Virtual switch]tab•Go to the [Usage] tab•Select the [dedicated ignore AC input] optionIn the “Ignore AC” tab you can specify the battery voltageInstructions:•Go to the [Ignore AC input] tabHint:When a time of -1 second is chosen, the condition isdeactivated. The text is grey.Accepting grid on AC load conditionsThis setting can be used to allow grid in when the AC load is higher than the Multi rating. This will prevent the Multi going into overload. This setting can also be used for large loads that you do not want to run from the battery.In this example the grid will not be ignored when the load exceeds 4000 Watt for more than 30 seconds.Do not ignore AC input means that the grid is accepted because the AC input relay is closedThe grid will be ignored when the load drops below 2999 W for more then 2 minutes.Ignore AC means that the grid is ignored because the AC input relay is open.It is important to leave a significant time interval between connecting to and disconnecting from the grid. This is so the AC input relay does not open and close to frequently.Accepting grid on battery voltage conditionsThis setting can be used to charge the batteries from the grid shouldthe batteries get too empty. This can occur, for example, at night orduring a long period of bad weather.In this example, the grid is not ignored when the battery voltage isless than 47 Volt for 60 seconds.Do not ignore AC input means that the grid is accepted because theAC input relay is closed.The grid will be ignored again when the battery voltage exceeds 51 Volt for more than 3 minutes.Ignore AC means that the grid is ignored because the AC input relay is open.Apart from “battery voltage”, there are two other options to choose from: “bulk finished” or “absorption” finished”. Choosing “absorption finished” is a good way to ensure the batteries are getting a full charge every now and then. But it can lead to a higher electricity bill. The absorption charge stage of a lead-acid battery is much less efficient than the bulk stage. This could be a reason to choose the “bulk finished” option. At the end of the bulk charge stage a lead-acid battery is about 85% full.For more information about bulk and absorption please see the Victron Energy book “Energy Unlimited”, page 25. Follow this link: https://.au/orderbookAccepting grid on state of chargeIt is also possible to let grid in when the batteries fall below a certain state of charge.IMPORTANTIn a DC coupled solar system the “state of charge” option should only be used if you have a Color Control GX or Venus GX in the system. And the Color Control GX or Venus GX is connected to both the Multi and the MPPT solar charger(s) and/or a BMV battery monitor. In addition to this a setting needs to be made in the Color Control GX or Venus GX . See this link for more information:https:///live/ccgx:start#battery_state_of_charge_soc Instructions:•Go to the [General] tab in VE.Configure•Tick the [Enable battery monitor] tick box•Fill in the battery capacity•Fill in the charge efficiency. This should be around 0.8 for lead-acid batteries •Then go to the [Virtual switch] tab•Go to the [Ignore AC input] tab•F ill in state of charge lower than 50% (for lead acid batteries)100% self-consumption by disabling the charge functionality of the MultiIt can be quite expensive to charge the batteries from the grid. Lead-acid batteries have a low charge efficiency. About 20% of the energy used to charge the batteries is lost in the form of heat. Some installers therefore prefer to disable the charger functionality of the Multi.When the charger functionality is disabled and the Multi is accepting the grid, it will supply the loads with grid power, but will not charge the batteries. The batteries will only receive charge from the MPPT charge controllers. In this type of system it is very important to have a large enough solar array. It also important that the Ignore AC battery voltage settings are set higher than you would do normally. This is to make sure that the battery has some extra charge left should there be blackout.Instructions:•Go To the [charger] tab•Untick the [Enable charger] tick box•Go to the [Virtual switch] tab•Go to the [Ignore AC input] tab•Increase the [when Udc lower than] valueWARNINGIncorrect system design can cause battery damageDisabling the charger is only recommended in systems thathave excess solar power.If the batteries get empty during the night, the systemcannot be recovered unless you connect an external batterycharger.Low battery voltage inverter shutdownThe “DC input low shut-down voltage” parameter is the battery bank voltage at which below the inverter will stop operating. This feature protects the battery bank from becoming to deeply discharged. If this value is set too low, the batteries will get discharged too deeply and they will get damaged. This will reduce the lifetime of the batteries.By default the Multi is set at a very low “DC input low shut-down” voltage. You should this value in VE.Configure. This so the batteries are better protected. We advice to set this voltage to 44V (for a 48V battery bank*). When you change the “DC input low shut-down” voltage, the “DC input low restart” voltage will automatically increase. T herefore you will need to reduce this voltage again. Set the “DC input low restart” voltage to 4V above the shut down voltage.Instructions:•Go to the [Inverter] tab•Set [DC input low shut-down] to 44V•Set [DC input low restart] to 48V•Set [DC input low pre-alarm] to 45V* For a 24V system divide these voltages by 2 and for a 12V system divide these by 4.Finished programmingWhen you have completed the VE configure settings, you will need to send those settings to the Multi. You can do this byclicking the “send settings” button.It is good practice, to also save a copy of the setting to your computer. This way you will always have a record of the settings you have made for your customer.To save the s ettings on your computer:•Go to the [File] menu•Click on [Save Settings]VE Configure 3 tutorialShould you want to learn more about VE. Configure, we have an instruction video available from our website. The video is in English, but subtitles are available for many other languages.This is the link: https://youtu.be/V1Zceq02vMAAssistants -Advanced AC ignore functionalityIt is also possible to use “Assistants” to program advanced AC ignore situations. For example AC ignore by looking at state of charge values from a BMV battery monitor. However, in this lesson we purposefully decided to just explain the AC ignore settings via Virtual switch to be used in simple systems.“Assistants” are more complex to set up or to program. For example “Assistants” are only possible after a firmware update of the Multi. For those of you that want to find out more about ‘Assistants” please contact you Victron Distributor. Warning and disclaimerThe only aim of this lesson is to help you to understand the basic principles of a Victron Energy system that selectively connects to the grid. We will not be held responsible in case of damages caused by inappropriate installation of our products.•Please be aware that incorrect grid ignore settings can discharge batteries too far and can cause irreparably battery damage.•Read and understand the safety warnings published in the product manuals.•Professional advice and instruction should always be sought before commencing any electrical work.•Electrical installations and installation work must always be compliant with the local standards and authority requirements.SummaryIn this lesson you have learned how you can set up a Multi to selectively ignore the grid, so solar energy will be prioritised over the grid. This feature is called “AC ignore”.The following was explained:•The mechanics behind the AC ignore feature•The criteria when to ignore the grid•How to download, setup and connect VE.Configure•How to program the AC ignore settings into the Multi by using VE.ConfigureEnergy. Anytime. Anywhere.。
Splunk Enterprise 6.0分布式部署⼿册⽣成时间:2013 年 10 ⽉ 15 ⽇,下午 3:27336789111111111111111115161617171819202021212324Table of Contents概述分布式 Splunk 概述数据如何通过 Splunk :数据管道调整您的部署规模:Splunk 组件组件与⾓⾊实现分布式部署本⼿册其余部分的内容转发数据分布式搜索Splunk 部署监视器应⽤升级 Splunk 组件通⽤部署架构通⽤部署架构概述部署拓扑结构如何调整部署规模预估硬件需求针对分布式 Splunk 部署的硬件容量规划分布索引和搜索Splunk 如何搜索数据参考硬件容纳并发⽤户和搜索Splunk 应⽤对资源需求的影响性能建议摘要升级您的部署升级您的分布式环境升级 Windows 通⽤转发器升级 *nix 系统的通⽤转发器概述分布式 Splunk 概述本⼿册介绍如何跨多个计算机分布 Splunk 功能的各种组件。
通过分布 Splunk,您可以调整其功能以解决任何规模和复杂程度的企业的数据需求。
在单机部署中,由⼀个 Splunk 实例处理从数据输⼊、创建索引到搜索的整个端到端过程。
单机部署⾮常适⽤于测试和评估⽬的,可以满⾜部门规模环境的需求。
不过,在⼤型环境中,许多计算机都会⽣成数据,⽽且许多⽤户都需要搜索数据,此时您会希望跨多个 Splunk 实例分布功能。
本⼿册介绍如何在这种分布式环境中部署和使⽤ Splunk。
Splunk 如何调整Splunk 会在数据通过数据管道时执⾏三项关键功能。
⾸先,Splunk 从⽂件、网络或其他位置获取数据。
然后建⽴数据索引。
(实际上,它是先对数据进⾏分析,然后再建⽴数据索引,但鉴于本讨论内容的⽬的,我们将分析视为索引过程的⼀部分。
)最后,它会对索引数据运⾏交互式搜索或计划的搜索。
您可以跨多个专门的 Splunk 实例拆分此功能,实例数量从几个到数千个不等,具体取决于您所处理的数据数量以及您环境中的其他变量。
Linux环境EIP7产品多服务部署手册广州宏天软件股份有限公司2020年4月20日版本管理目录1总体部署图 (4)2常用linux命令 (4)3运行环境和中间件安装 (6)3.1安装JDK1.8 (6)3.2安装MySQL (8)3.3安装Redis (12)3.4安装ActiveMQ (14)3.5部署EurekaServer (15)4应用部署 (15)4.1Java应用 (15)4.2Web应用 (18)4.2.1Nginx的安装和配置 (19)4.2.2部署web端 (20)1总体部署图2常用linux命令1.使用xshell等工具远程连接到linux服务器,通过xftp可以上传下载文件,在linux中没有像windows一样分为C盘、D盘等不同的盘符,所有目录都通过/开头来访问,如下图所示2.常用的命令3.yum命令可以用来安装系统中不存在的命令,比如vim命令不存在时,可以通过yum install vim来安装。
注意在安装的过程中系统可能会跳出一些询问,输入y回车就可以继续安装了4.vim命令可以对文本文件进行修改,例如vim /etc/f可以打开mysql的配置文件,刚打开文本时为浏览模式,不能添加、删除、修改任何内容。
文本内容过多时,快捷键shift+g可以直接定位到文本的最后一行;内容过多也可以通过”/搜索内容”来快速查找,有多个匹配结果时n可以查看下一个。
按insert进入输入模式,完成编辑以后按esc按钮退出编辑模式,输入:q!放弃保存,输入:wq则保存修改。
5.防火墙配置3运行环境和中间件安装3.1安装JDK1.8使用xshell工具连接linux服务器,在命令行中输入java -version,检查JDK 是否安装以及版本是否为1.8如果JDK未安装或者版本不正确,则重新安装JDK。
1.将jdk的安装包拷贝到linux服务器(通过xftp上传上去,在/tmp目录下创建一个hotent目录,用于存放上传的文件)2.将该文件拷贝到/usr/local/java目录下,并解压3.查看解压出来的目录名4.配置jdk到环境变量,通过vim命令编辑/etc/profile,进入编辑模式后,shift+g定位到文件的最后一行,点击insert命令进入编辑模式,编辑完以后按ecs按钮,输入:wq+回车则保存文件,输入:q!则放弃保存。
2015/6/13 22:51 GP架构_1与GreenPlum类似的产品:IBM NITIZA(国内没人用)Terndata2007年被EMC收购GreenPlum国外市场:纳斯达克,skypeGreenPlum国内市场:阿里,民生银行,深发展银行,电信业(MPP架构)MPP架构:海量并行处理Massively Parallel Processingshare nothing 模式,每一个节点不进行资源共享,集群中每个节点有独立的CPU、内存、存储、总线等。
SMP架构:symmetric mass processing 对称多处理系统:耦合的多处理系统,共享总线、内存、IO资源,传统的ORCKLE,DB2是非常典型的产品ORACLE_RAC 处于半共享状态,各节点连接共享存储,所以不能算MPPGreenPlum 基于PostGreSQL8.2 之前在国内使用比较少,在国外使用广泛。
Mysql与PostGreSQL地位同等,但mysql被Oracle收购之后没落。
GreenPlum 在函数、dataloading、存储过程等继承了PostGreSQLGP增加BI和数据仓库的支持:A、外部表、并行加载(优势明显)B、资源队列管理的优化,对角色、用户、组进行资源优化分配,管理。
C、GP在查询优化器的增强、分布支持、分区表、执行计划的优化、空间回收、数据分析,简化调优,架构时对称、数据分布均匀的话,可以免去调优Master Host:访问系统的入口,所有请求都需要从Master Host访问,正常来讲,管理员也不可以直接访问SegmentHost ,系统中只允许直接访问MasterHost ,单独操作SegmentHost 影响一致性和完整性。
数据监听进程(PostGres):监听用户请求。
处理所有用户连接。
建立执行计划,通过网络层分发给SegmentHost。
协调整个处理过程,保证SegmentHost处理结果侧一致和同步。
IBM Spectrum Protect Plus 简易安装配置手册(包含免费试用版)目录SPP软件安装 (4)系统需求 (4)试用版软件下载 (4)SPP软件安装(VMWare vSphere方法) (6)导入虚拟机SPP (7)修改SPP虚拟机的资源 (14)启动SPP虚拟机 (16)得到SPP的IP地址 (17)用浏览器访问SPP虚拟机 (18)安装vCenter Server Appliance (21)把这个vCenter加入到SPP中 (46)SPP软件配置 (49)SPP进行备份的大概步骤如下: (49)创建/导入vSnap (49)进入vCenter,导入OVF (49)启动vSnap (54)在vSnap中修改root账号密码 (57)在vSanp中创建用户 (57)在SPP中登记vSnap (58)初始化vSnap (59)定义备份策略SLA (62)创建新的SLA (62)管理需要备份的虚机 (63)通过vCenter添加或删除需要备份的虚机 (63)选择需要备份的虚机 (63)可在SLA里面的Actions里面选择是否需要立即执行或终止备份策略 (64)查看备份状态 (64)数据恢复 (66)查找备份文件 (66)恢复单个文件 (67)恢复整个虚机 (67)SPP软件安装系统需求请确保你的系统满足下面需求以安装运行IBM Spectrum Protect Plus。
虚机环境要求:IBM Spectrum Protect Plus 是安装在虚机环境中的,请确认已经具备下面环境来安装配置IBM SPP。
•VMware 或者Microsoft Hyper-V template•vSphere5.5,6.0,6.5 或者Microsoft Hyper-V Server 2016硬件最低要求:•64位双核机器•32GB 内存浏览器要求:下面浏览器经过测试可以支持SPP.•Firefox 55.0.3•Google Chrome 60.0.3112•Microsoft Edge 40.15063试用版软件下载可以访问下面IBM官方网址下载30天试用,下载前系统会要求提供联系方式。
greenplum gdfdist使用手册Greenplum GDFDist 使用手册概述Greenplum GDFDist 是一个用于在 Greenplum 数据库集群中进行分布式数据传输和加载的工具。
它提供了高效、可靠和并行的数据传输功能,能够加速数据导入和导出的过程。
本手册将向您介绍 GDFDist 的安装和配置方法,并提供一些常见的使用示例。
安装和配置1. 安装 GDFDistGDFDist 是作为 Greenplum 数据库分发功能的一部分提供的。
在安装 Greenplum 数据库时,GDFDist 已经被自动包括在内。
确保已正确安装 Greenplum 数据库版本来使用 GDFDist。
2. 配置 GDFDist在开始使用 GDFDist 之前,需要进行一些配置。
打开 Greenplum 数据库配置文件(通常位于 `$MASTER_DATA_DIRECTORY/gpseg-1/postgresql.conf`),找到以下配置项,并根据需要进行修改: - `gp_external_enable`:确保该配置项的值为 `on`,以启用外部表和 GDFDist 功能。
- `gp_external_max_segs`:根据您的集群规模和性能需求,适当调整此配置项的值。
它控制了能使用 GDFDist 进行数据传输的并行进程数量。
完成配置后,重新加载Greenplum 数据库配置文件以使更改生效。
使用示例以下是一些常见的 GDFDist 使用示例,展示了不同场景下如何高效地使用数据传输功能。
1. 从本地文件导入数据到 Greenplum 数据库使用 `COPY` 命令结合 GDFDist,可以将本地文件中的数据快速导入到 Greenplum 数据库中。
示例命令如下:```COPY my_table FROM PROGRAM 'gdfdist -F text -b my_file.txt' WITH (FORMAT CSV, HEADER);```在上述命令中,`my_table` 是指目标表的名称,`my_file.txt` 是指本地文件的路径名。
Greenplum安装部署参考⼿册Greenplum安装部署参考⼿册V1.02016年3⽉⽬录第⼀章硬件环境部署 (2)1.1 服务器与机柜 (2)1.2 ⽹络部署 (2)1.2.1服务器⽹络连接 (2)1.2.2⽹卡绑定(bond)推荐模式 (3)1.3 raid及⽂件系统规划 (3)1.3.1 Master服务器配置 (3)1.3.2 Segment服务器配置 (4)第⼆章 GP软件环境部署 (5)2.1 操作系统环境安装部署 (5)2.2.1 BIOS设置开启超线程 (5)2.2.2 安装操作系统基础包 (5)2.2.3 安装系统语⾔ (5)2.2.4 安装系统⼯具包 (6)2.2.5 开发语⾔连接驱动 (8)2.2.6 时区配置 (8)2.2.7 ⽂件系统和分区配置 (9)2.2.8 ⽹卡配置 (10)2.2.9 操作系统安全配置 (11)2.2.10 操作系统⽤户组和⽤户 (13)2.2.11 ⽹络IP配置 (14)2.2.12 对外服务VIP设置 (15)2.2.13 集群NTP服务时钟同步配置 (15)2.2.14 ssh服务参数调整 (15)2.2 操作系统参数设置 (15)2.3 数据库系统安装部署 (18)Greenplum软件安装 (18)数据库初始化 (21)2.6 后续⼯作 (24)第⼀章硬件环境部署1.1服务器与机柜服务器器与机柜的摆放应需要充分考虑机器散热的问题,不建议每个机柜都完全放满。
1.2⽹络部署1.2.1服务器⽹络连接Greenplum集群内部各节点服务器通过独⽴的万兆以太⽹交换机连接,交换机为集群内部私有,配置两台,两台交换机直连,以双活⽅式⼯作。
每台集群内部服务器需配置两个万兆⽹⼝,每个⽹⼝连接⼀个交换机,同时两个万兆⽹⼝以mode4 ⽅式邦定,配置⼀个IP。
如下图所⽰,每台服务器的第⼀张⽹卡都连接到⼀台交换机上,同理另⼀张⽹卡都连接到另⼀台交换机上。
每台服务器的第⼀张⽹卡统⼀连接到⼀台交换机上两台交换机之间也需要互联,双活⽅式⼯作。
greenplum基本操作及管理命令第1章系统管理 1.1 GP服务启停 su - gpadmingpstart #正常启动gpstop #正常关闭gpstop -M fast #快速关闭gpstop –r #重启gpstop –u #重新加载配置文件 1.2 登陆 psql gpdbpsql -d gpdb -h gphostm -p 5432 -U gpadmin 1.3 查看segment配置 select * from gp_segment_configuration; 1.4 文件系统 select * from pg_filespace_entry; 1.5 列出所有数据库 psql –l 1.6 行表库最大尺寸一个数据库最大尺寸无限制已存在有32TB 的数据库一个表的最大尺寸 32 TB一行记录的最大尺寸 1.6 TB一个字段的最大尺寸? 1 GB一个表里最大行数无限制一个表里最大列数 250-1600 与列类型有关一个表里的最大索引数量无限制当然实际上没有真正的无限制还是要受可用磁盘空间、可用内存/交换区的制约。
事实上当这些数值变得异常地大时系统性能也会受很大影响。
表的最大尺寸32 TB 不需要操作系统对大文件的支持。
大表用多个 1 GB 的文件存储因此文件系统尺寸的限制是不重要的。
如果缺省的块大小增长到32K 最大的表尺寸和最大列数还可以增加到四倍 1.7 存储空间一个 Postgres 数据库存储一个文本文件所占用的空间最多可能需要相当于这个文本文件自身大小5倍的磁盘空间。
第2章 Psql操作 2.1 创建/删除用户创建用户createuser [-a] [-A] [-d] [-D] [-e] [-P] [-h 主机名] [-p port] 用户名参数说明[-a]允许创建其他用户相当于创建一个超级用户[-A]不允许此用户创建其他用户[-d]允许此用户创建数据库[-D]不允许此用户创建数据库[-e]将执行过程显示到Shell上[-P]创建用户时同时设置密码[-h 主机名]为某个主机上的Postgres创建用户[-p port]与-h参数一同使用指定主机的端口。
InCloud Rail6.5.1部署手册济南浪潮数据技术有限公司2022年4月目录目录 (I)1概述 (1)1.1InCloud Rail简介 (1)1.2InCloud Storage简介 (2)2物理硬件要求 (4)3超融合部署 (6)3.1硬件配置 (6)3.2Raid直通配置(已弃用) (10)3.3部署方式介绍 (16)3.3.1SR-IOV BOND部署(推荐) (16)3.3.2直通部署(非首选) (17)3.4安装InCloud Rail虚拟化系统 (18)3.4.1安装出厂预装节点 (18)3.4.2安装计算管理节点主备 (21)3.4.3安装计算节点 (29)3.5iCenter访问 (35)3.5.1访问iCenter (35)3.5.2iCenter无法访问排查 (37)3.6超融合许可证 (38)3.6.1许可证分类 (39)3.6.2试用版许可证申请流程 (42)3.6.3获取正式版license激活码 (44)3.6.4SDS许可证 (46)3.6.5配置license (47)3.7一键构建超融合集群 (48)3.8镜像库(可选) (55)3.8.1增加镜像库 (55)3.8.2查看镜像库 (61)3.8.3上传镜像文件 (61)3.8.4下载镜像文件 (64)3.8.5删除镜像文件 (64)3.9配置iSCSI服务(可选) (65)3.9.1增加iSCSI服务 (66)3.9.2划分LUN说明 (68)3.9.3增加LUN (70)3.10计算节点增加IP-SAN存储设备(可选) (73)3.11配置CFS共享存储(可选) (78)3.11.1增加存储域 (78)3.11.2增加数据存储 (82)3.12业务网配置 (86)3.12.1增加虚拟交换机 (86)3.12.2增加SR-IOV交换机 (89)4虚拟机操作 (92)4.1虚拟机创建 (92)4.2虚拟机配置业务网 (94)4.3安装ICS VM Tools (95)5术语表 (98)1概述本文档主要对InCloud Rail6.5.1版本超融合部署进行介绍,文中所提到的InCloud Rail超融合皆为6.5.1版本相关内容。
MacroSAN MS2500G2系列存储设备安装手册文档版本:V1.45杭州宏杉科技股份有限公司400-650-5527声明版权所有©2021杭州宏杉科技股份有限公司。
保留所有权利。
未经杭州宏杉科技股份有限公司书面许可,任何单位和个人不得擅自摘抄本手册的内容,且不得以任何形式传播本手册。
本手册仅作为操作参考,由于软件版本升级或其他原因,本手册的内容可能滞后于最新的软件版本或设备配置,杭州宏杉科技股份有限公司保留在没有任何通知或提示的情况下对本手册的内容进行修改的权利。
商标信息MacroSAN、ODSP、ODSP_MSC、ODSP_JMC、ODSP Scope、宏杉均为杭州宏杉科技股份有限公司的商标。
对于本手册中出现的其他公司的商标、产品标识及商品名称,由各自权利人拥有。
目录MacroSAN MS2500G2系列存储设备 ..................................................................................................... 1-1安装手册 .................................................................................................................................................. 1-1声明.......................................................................................................................................................... 1-2商标信息 .................................................................................................................................................. 1-2目录.......................................................................................................................................................... 1-3图目录...................................................................................................................................................... 1-8表目录.................................................................................................................................................... 1-12 1前言..................................................................................................................................................... 1-151.1 读者对象.................................................................................................................................... 1-151.2 适用范围.................................................................................................................................... 1-151.3 文档结构.................................................................................................................................... 1-151.4 文档约定.................................................................................................................................... 1-161.4.1 手册描述约定................................................................................................................... 1-161.4.2 其他约定.......................................................................................................................... 1-171.5 术语........................................................................................................................................... 1-171.5.1 DSU ................................................................................................................................ 1-171.5.2 EMC ................................................................................................................................ 1-171.5.3 EP ................................................................................................................................... 1-171.5.4 FC ................................................................................................................................... 1-171.5.5 GE ................................................................................................................................... 1-171.5.6 GUI ................................................................................................................................. 1-171.5.7 iSCSI ............................................................................................................................... 1-171.5.8 ODSP .............................................................................................................................. 1-171.5.9 ODSP Scope ................................................................................................................... 1-171.5.10 ODSP Scope+ ............................................................................................................... 1-181.5.11 SAN............................................................................................................................... 1-181.5.12 SAS ............................................................................................................................... 1-181.5.13 SATA ............................................................................................................................. 1-181.5.14 SP ................................................................................................................................. 1-181.5.15 SPU............................................................................................................................... 1-181.5.16 SSD............................................................................................................................... 1-181.6 资料获取方式............................................................................................................................. 1-181.7 资料意见或建议反馈方式............................................................................................................ 1-18 2设备使用注意事项............................................................................................................................... 2-192.1 用电安全注意事项...................................................................................................................... 2-192.2.2 无防静电腕带时紧急操作方法 .......................................................................................... 2-202.3 激光安全注意事项...................................................................................................................... 2-202.4 电池安全注意事项...................................................................................................................... 2-202.5 EMC注意事项 ........................................................................................................................... 2-212.6 磁盘使用注意事项...................................................................................................................... 2-212.7 操作安全注意事项...................................................................................................................... 2-22 3产品介绍 ............................................................................................................................................. 3-223.1 产品概述.................................................................................................................................... 3-223.2 产品规格.................................................................................................................................... 3-233.2.1 SPU规格......................................................................................................................... 3-233.2.2 DSU规格......................................................................................................................... 3-263.2.3 磁盘模块规格................................................................................................................... 3-273.3 产品外观.................................................................................................................................... 3-283.3.1 产品高度说明................................................................................................................... 3-283.3.2 2U SPU外观 ................................................................................................................... 3-283.3.3 4U SPU外观 ................................................................................................................... 3-383.3.4 2U DSU外观 ................................................................................................................... 3-443.3.5 3U DSU外观 ................................................................................................................... 3-493.3.6 4U DSU外观 ................................................................................................................... 3-533.3.7 电源模块外观................................................................................................................... 3-563.3.8 磁盘模块外观................................................................................................................... 3-573.4 产品指示灯 ................................................................................................................................ 3-603.4.1 SP指示灯........................................................................................................................ 3-603.4.2 EP指示灯........................................................................................................................ 3-613.4.3 风扇模块和电池模块指示灯.............................................................................................. 3-613.4.4 电源模块指示灯 ............................................................................................................... 3-633.4.5 磁盘模块指示灯 ............................................................................................................... 3-633.4.6 IO插卡模块指示灯........................................................................................................... 3-63 4安装设备 ............................................................................................................................................. 4-654.1 安装规划.................................................................................................................................... 4-654.2 安装流程.................................................................................................................................... 4-664.3 安装前准备 ................................................................................................................................ 4-674.3.1 准备安装场所................................................................................................................... 4-674.3.2 准备机柜.......................................................................................................................... 4-704.3.3 准备安装工具................................................................................................................... 4-714.4 安装前检查 ................................................................................................................................ 4-714.4.1 检查环境.......................................................................................................................... 4-714.4.3 检查线缆.......................................................................................................................... 4-744.5 安装机柜.................................................................................................................................... 4-754.5.1 安装机柜.......................................................................................................................... 4-754.5.2 安装机柜后检查 ............................................................................................................... 4-754.6 安装托架式滑道 ......................................................................................................................... 4-754.6.1 托架式滑道介绍 ............................................................................................................... 4-754.6.2 确定滑道位置................................................................................................................... 4-764.6.3 安装滑道.......................................................................................................................... 4-774.6.4 安装滑道后检查 ............................................................................................................... 4-794.7 安装SPU ................................................................................................................................... 4-794.7.1 安装SPU流程................................................................................................................. 4-794.7.2 安装SPU到机柜中.......................................................................................................... 4-804.7.3 安装SPU电池模块和拆卸电池模块假面板(可选) ......................................................... 4-814.7.4 安装SPU磁盘模块和磁盘假面板(可选) ....................................................................... 4-834.7.5 安装SPU后检查 ............................................................................................................. 4-844.7.6 安装SPU面板(可选)................................................................................................... 4-854.8 安装DSU ................................................................................................................................... 4-854.8.1 安装DSU流程................................................................................................................. 4-854.8.2 安装DSU到机柜中.......................................................................................................... 4-864.8.3 安装DSU磁盘模块和磁盘假面板(可选) ....................................................................... 4-864.8.4 安装DSU后检查 ............................................................................................................. 4-874.9 安装线缆.................................................................................................................................... 4-884.9.1 布线注意事项................................................................................................................... 4-884.9.2 安装线缆流程................................................................................................................... 4-904.9.3 安装接地线 ...................................................................................................................... 4-914.9.4 安装电源线 ...................................................................................................................... 4-924.9.5 安装SAS线缆 ................................................................................................................. 4-954.9.6 安装SP业务接口线缆.................................................................................................... 4-1024.9.7 安装SP管理网口线缆.................................................................................................... 4-1054.9.8 安装客户端服务器线缆................................................................................................... 4-1054.9.9 安装线缆后检查 ............................................................................................................. 4-106 5启动与配置设备................................................................................................................................. 5-1065.1 设备上电前检查 ....................................................................................................................... 5-1065.2 设备上电及启动 ....................................................................................................................... 5-1075.2.1 DSU上电及启动 ............................................................................................................ 5-1075.2.2 DSU启动后检查 ............................................................................................................ 5-1075.2.3 SPU上电及启动 ............................................................................................................ 5-1085.3 设备配置.................................................................................................................................. 5-1095.3.1 设备默认配置................................................................................................................. 5-1095.3.2 设备配置准备................................................................................................................. 5-1095.3.3 设备配置........................................................................................................................ 5-1105.4 设备关机及下电 ....................................................................................................................... 5-112 6安装与拆卸设备组件 ......................................................................................................................... 6-1126.1 安装/拆卸SPU面板 ................................................................................................................. 6-1136.1.1 SPU面板介绍................................................................................................................ 6-1136.1.2 安装SPU面板............................................................................................................... 6-1136.1.3 拆卸SPU面板............................................................................................................... 6-1136.2 安装/拆卸SP ........................................................................................................................... 6-1146.2.1 安装/拆卸2U SPU的SP ................................................................................................ 6-1146.2.2 安装/拆卸4U SPU的SP ................................................................................................ 6-1156.3 安装/拆卸EP ........................................................................................................................... 6-1176.3.1 安装/拆卸2U DSU的EP ............................................................................................... 6-1176.3.2 安装/拆卸3U DSU的EP ............................................................................................... 6-1196.3.3 安装/拆卸4U DSU的EP ............................................................................................... 6-1206.4 安装/拆卸SPU风扇模块和电池模块......................................................................................... 6-1216.4.1 安装/拆卸2U SPU风扇模块(无电池模块) .................................................................. 6-1216.4.2 安装/拆卸2U SPU风扇模块(含电池模块) .................................................................. 6-1236.4.3 安装/拆卸4U SPU风扇模块........................................................................................... 6-1246.4.4 安装/拆卸4U SPU电池模块........................................................................................... 6-1256.5 安装/拆卸DSU风扇模块.......................................................................................................... 6-1276.5.1 安装/拆卸2U DSU风扇模块........................................................................................... 6-1276.5.2 安装/拆卸3U DSU风扇模块........................................................................................... 6-1296.5.3 安装/拆卸4U DSU风扇模块........................................................................................... 6-1306.6 安装/拆卸电源模块................................................................................................................... 6-1316.6.1 电源模块介绍................................................................................................................. 6-1316.6.2 安装电源模块................................................................................................................. 6-1336.6.3 拆卸电源模块................................................................................................................. 6-1336.7 安装/拆卸IO插卡模块.............................................................................................................. 6-1336.7.1 IO插卡模块介绍 ............................................................................................................ 6-1346.7.2 安装IO插卡模块 ........................................................................................................... 6-1346.7.3 拆卸IO插卡模块 ........................................................................................................... 6-1356.8 安装/拆卸磁盘模块................................................................................................................... 6-1356.8.1 磁盘模块介绍................................................................................................................. 6-1356.8.2 安装/拆卸2.5英寸磁盘模块A ........................................................................................ 6-1366.8.3 安装/拆卸2.5英寸磁盘模块B ........................................................................................ 6-1376.8.4 安装/拆卸3.5英寸磁盘模块A ........................................................................................ 6-1396.8.5 安装/拆卸3.5英寸磁盘模块B ........................................................................................ 6-1406.8.6 安装磁盘假面板 ............................................................................................................. 6-142 7常见故障处理 .................................................................................................................................... 7-1437.1 SP故障处理 ............................................................................................................................ 7-1437.1.1 故障现象1:SP的告警指示灯闪烁或常亮...................................................................... 7-1437.1.2 故障现象2:SP的运行指示灯常亮或常灭...................................................................... 7-1447.1.3 故障现象3:SP启动过程中,LED数码管无法显示信息 ................................................ 7-1447.1.4 故障现象4:SP启动过程中,LED数码管停留在88 ...................................................... 7-1457.1.5 故障现象5:SP启动过程中,LED数码管长时间停留在某个固定值 ............................... 7-1457.2 EP故障处理 ............................................................................................................................ 7-1457.2.1 故障现象1:告警指示灯闪烁或常亮............................................................................... 7-1457.2.2 故障现象2:运行指示灯常亮或常灭............................................................................... 7-1467.3 风扇模块故障处理.................................................................................................................... 7-1467.4 电池模块故障处理.................................................................................................................... 7-1477.5 电源模块故障处理.................................................................................................................... 7-1477.6 磁盘模块故障处理.................................................................................................................... 7-1487.7 其他故障处理........................................................................................................................... 7-148 8附录A.拇指螺钉的安装方法.............................................................................................................. 8-148 9附录B.中国有害物质声明 ................................................................................................................. 9-151 10附录C. V1.2.40T04之前的版本登录存储设备管理界面的步骤.................................................... 10-152图目录图3-1 2U SPU前正视图(一)............................................................................................................. 3-29图3-2 2U SPU前正视图(二)............................................................................................................. 3-29图3-3 MS2500G2-12S SPU后正视图.................................................................................................. 3-30图3-4 2U SPU的SP正视图(一)...................................................................................................... 3-31图3-5 2U SPU的SP正视图(二)...................................................................................................... 3-33图3-6 2U SPU的SP正视图(三)...................................................................................................... 3-35图3-7 2U SPU风扇模块(无电池模块)正视图................................................................................... 3-37图3-8 2U SPU风扇模块(含电池模块)正视图................................................................................... 3-37图3-9 4U SPU前正视图(带面板) ..................................................................................................... 3-38图3-10 4U SPU前正视图(不带面板)................................................................................................ 3-38图3-11 4U SPU后正视图 ..................................................................................................................... 3-39图3-12 4U SPU的SP正视图............................................................................................................... 3-41图3-13 4U SPU风扇模块正视图........................................................................................................... 3-43图3-14 4U SPU电池模块正视图........................................................................................................... 3-43图3-15 DSU1625前正视图................................................................................................................... 3-44图3-16 DSU2625前正视图................................................................................................................... 3-44图3-17 DSU1625后正视图................................................................................................................... 3-45图3-18 DSU2625后正视图................................................................................................................... 3-45图3-19 DSU1625 EP正视图................................................................................................................. 3-46图3-20 DSU2625的EP正视图 ............................................................................................................ 3-47图3-21 DSU1625风扇模块正视图........................................................................................................ 3-48图3-22 DSU2625风扇模块正视图........................................................................................................ 3-49图3-23 DSU1616前正视图................................................................................................................... 3-50图3-24 DSU1616后正视图................................................................................................................... 3-50图3-25 DSU1616 EP正视图................................................................................................................. 3-51图3-26 DSU1616风扇模块正视图........................................................................................................ 3-52图3-27 DSU2624前正视图................................................................................................................... 3-53图3-28 DSU2624后正视图................................................................................................................... 3-54图3-29 DSU2624 EP正视图................................................................................................................. 3-55图3-30 DSU2624风扇模块正视图........................................................................................................ 3-56图3-31 DSU2624电源模块正视图........................................................................................................ 3-56图3-32 其他电源模块正视图 ................................................................................................................. 3-57图3-34 2.5英寸磁盘模块B前面板 ....................................................................................................... 3-58图3-35 3.5英寸磁盘模块A外观........................................................................................................... 3-59图3-36 3.5英寸磁盘模块B外观........................................................................................................... 3-59图3-37 3.5英寸磁盘模块前面板 ........................................................................................................... 3-59图4-1 存储设备的安装规划示意图 ........................................................................................................ 4-66图4-2 存储设备的安装流程示意图 ........................................................................................................ 4-67图4-3 设备防拆封条示意图 ................................................................................................................... 4-74图4-4 带拇指螺钉托架式滑道(左侧滑道)示意图............................................................................... 4-76图4-5 带定位销托架式滑道(左侧滑道)示意图 .................................................................................. 4-76图4-6 安装带拇指螺钉的托架式左侧滑道示意图 .................................................................................. 4-77图4-7 安装拇指螺钉示意图 ................................................................................................................... 4-78图4-8 检查滑道示意图........................................................................................................................... 4-78图4-9 安装带定位销的托架式左侧滑道示意图...................................................................................... 4-79图4-10 SPU安装流程示意图 ................................................................................................................ 4-80图4-11 安装SPU示意图....................................................................................................................... 4-81图4-12 安装2U SPU风扇模块(含电池模块)示意图......................................................................... 4-82图4-13 安装4U SPU电池模块示意图 .................................................................................................. 4-83图4-14 安装SPU面板示意图 ............................................................................................................... 4-85图4-15 DSU安装流程示意图................................................................................................................ 4-85图4-16 安装DSU示意图 ...................................................................................................................... 4-86图4-17 固定线缆端子示意图 ................................................................................................................. 4-88图4-18 线缆捆扎示意图(一).............................................................................................................. 4-89图4-19 线缆捆扎示意图(二).............................................................................................................. 4-90图4-20 线缆捆扎示意图(三).............................................................................................................. 4-90图4-21 线缆安装流程示意图 ................................................................................................................. 4-91图4-22 接地线示意图 ............................................................................................................................ 4-91图4-23 松开设备接地端子的螺钉示意图............................................................................................... 4-92图4-24 安装接地线示意图..................................................................................................................... 4-92图4-25 电源线示意图 ............................................................................................................................ 4-93图4-26 安装电源线示意图(二).......................................................................................................... 4-93图4-27 电源线捆扎示意图..................................................................................................................... 4-94图4-28 安装电源线示意图(一).......................................................................................................... 4-94图4-29 A类SAS线缆示意图................................................................................................................ 4-95图4-30 B类SAS线缆示意图................................................................................................................ 4-96。
Greenplum 日常维护手册1. 数据库启动:gpstart常用可选参数: -a :直接启动,不提示终端用户输入确认—m:只启动master 实例,主要在故障处理时使用2。
数据库停止:gpstop:常用可选参数:—a:直接停止,不提示终端用户输入确认—m:只停止master 实例,与gpstart –m 对应使用—M fast:停止数据库,中断所有数据库连接,回滚正在运行的事务-u:不停止数据库,只加载pg_hba。
conf 和postgresql。
conf中运行时参数,当改动参数配置时候使用。
评:—a用在shell里,最多用的还是-M fast。
3. 查看实例配置和状态select * from gp_configuration order by 1 ;主要字段说明:Content:该字段相等的两个实例,是一对P(primary instance)和M(mirrorInstance)Isprimary:实例是否作为primary instance 运行Valid:实例是否有效,如处于false 状态,则说明该实例已经down 掉。
Port:实例运行的端口Datadir:实例对应的数据目录4. gpstate :显示Greenplum数据库运行状态,详细配置等信息常用可选参数:-c:primary instance 和 mirror instance 的对应关系-m:只列出mirror 实例的状态和配置信息—f:显示standby master 的详细信息-Q:显示状态综合信息该命令默认列出数据库运行状态汇总信息,常用于日常巡检。
评:最开始由于网卡驱动的问题,做了mirror后,segment经常down掉,用-Q参数查询综合信息还是比较有用的.5. 查看用户会话和提交的查询等信息select * from pg_stat_activity 该表能查看到当前数据库连接的IP 地址,用户名,提交的查询等。
gpload使⽤1. 介绍windows下分别⽤Kettle和cmd命令调⽤GPload。
1.1. ⽬的使⽤gpload,⼀⽅⾯我们可以实现GREENPLUM中不能直接实现的merge操作,另外通过结合命名管道,我们可以实现⽆落地⽂件的并⾏快速加载。
从⽽帮助我们提⾼海量数据加载效率,也避免了使⽤传统落地⽂件⽅式加载的过⼤存储开销,以及超⼤⽂件落地过程导致的加载性能瓶颈2. 安装部署2.1.安装包准备(1)python2.5.4版本GPload的加载程序(gpload.py)使⽤python写的,并且windows下⾯GPload只⽀持python2.5.4版本,⽤其他版本运⾏会报异常;python的版本只能是32位,不然也会报异常。
(2)PyGreSQL-4.1.1.win-amd64-py2.5.exegreenplum的内核是PostGrelSql,这个组件是python调⽤PostGreSql使⽤(3)PyYAML-3.10.win32-py2.5.exe这个组件使⽤写⼀些配置⽂件所使⽤如(*.yml)(4)greenplum-loaders-5.15.1-WinXP-x86_32.msi这个是windows下⾯GPload的安装包(5)pdi-ce-8.2.0.0-342这个是kettle8.2的安装包2.2.软件安装(1)python安装:运⾏python安装包,安装到指定⽬录,当安装选择⽤户时,不要选择for all users. 不然安装PyGreSQL和PyYAML的python组件会找不到python注册⽬录。
安装完成打开cmd控制台输⼊python,如果出现不是内部或外部命令,则请配置环境变量。
(2)PyGreSQL安装:直接安装exe⽂件,选择⽤户时也选择"this user only"。
(3)PyYAML安装:直接安装就⾏,选择⽤户选择"this user only"。
Greenplum安装部署参考手册V1.02016年3月目录第一章硬件环境部署 (2)1.1 服务器与机柜 (2)1.2 网络部署 (2)1.2.1服务器网络连接 (2)1.2.2网卡绑定(bond)推荐模式 (3)1.3 raid及文件系统规划 (3)1.3.1 Master服务器配置 (3)1.3.2 Segment服务器配置 (4)第二章 GP软件环境部署 (5)2.1 操作系统环境安装部署 (5)2.2.1 BIOS设置开启超线程 (5)2.2.2 安装操作系统基础包 (5)2.2.3 安装系统语言 (5)2.2.4 安装系统工具包 (6)2.2.5 开发语言连接驱动 (8)2.2.6 时区配置 (8)2.2.7 文件系统和分区配置 (9)2.2.8 网卡配置 (10)2.2.9 操作系统安全配置 (11)2.2.10 操作系统用户组和用户 (13)2.2.11 网络IP配置 (14)2.2.12 对外服务VIP设置 (15)2.2.13 集群NTP服务时钟同步配置 (15)2.2.14 ssh服务参数调整 (15)2.2 操作系统参数设置 (15)2.3 数据库系统安装部署 (18)Greenplum软件安装 (18)数据库初始化 (21)2.4 数据库参数设置 (23)2.5 基准性能测试 (24)2.6 后续工作 (24)第一章硬件环境部署1.1服务器与机柜服务器器与机柜的摆放应需要充分考虑机器散热的问题,不建议每个机柜都完全放满。
1.2网络部署1.2.1服务器网络连接Greenplum集群内部各节点服务器通过独立的万兆以太网交换机连接,交换机为集群内部私有,配置两台,两台交换机直连,以双活方式工作。
每台集群内部服务器需配置两个万兆网口,每个网口连接一个交换机,同时两个万兆网口以mode4 方式邦定,配置一个IP。
如下图所示,每台服务器的第一张网卡都连接到一台交换机上,同理另一张网卡都连接到另一台交换机上。
每台服务器的第一张网卡统一连接到一台交换机上两台交换机之间也需要互联,双活方式工作。
示意图如下:另外,Greenplum数据库集群的管理节点Maser/standby机器,需要与上层业务网络互连,作为集群访问的入口,具体连接方式根据客户环境网络情况确定,同时需要综合考虑后续文件服务器、ETL服务器等的网络连接情况。
1.2.2网卡绑定(bond)推荐模式为了达到网络带宽的最大化,建议两块万兆网卡采用Active-Active的方式进行绑定,具体绑定参数设置如下:BONDING_OPTS='mode=4 miimon=100 xmit_hash_policy=layer3+4'其对应具体算法如下:layer3+4:((source port XOR dest port) XOR ((source IP XOR dest IP) AND 0xfff参考EMC DCA一体机的配置如下:BONDING_OPTS="miimon=100 mode=4 xmit_hash_policy=1"两者实际是一样的:MODULE_PARM_DESC(xmit_hash_policy, "balance-xor and 802.3ad hashing method: 0 for layer 2 (default), 1 for layer 3+4, 2 for layer 2+3")1.3raid及文件系统规划1.3.1 Master服务器配置Master为1张阵列卡,6块2.5寸的900GB的10000转速的sas硬盘。
其中2块硬盘做一组RAID10安装操作系统,剩下4块硬盘做成1个RAID5磁盘组。
如下图所示:SWAP=物理内存/data xfs ~2.5TB/boot ext4500MB /ext4100GB /tmp ext420GB /home ext4400GB剩余按行方要求1.3.2 Segment 服务器配置Segment 服务器配置为1张阵列卡,24块2.5寸的900GB 的10000转速的sas 硬盘。
每台服务器2块硬盘做一组RAID10安装操作系统,预留两块盘作为全局热备盘,剩下20块硬盘分为2组,做成2个RAID5磁盘组。
RAID 组条带大小为128KB ,写cache 策略为“WRITE BACK ”,读磁盘策略设置为“READ AHEAD ”,电池充放电时写磁盘策略仍为“WRITE BACK ”。
如下图所示:(10块盘)(10块盘)/data1xfs ~7.5TB/data2xfs ~7.5TBSWAP=物理内存/boot ext4500MB /ext4100GB /tmp ext420GB /home ext4400GB剩余按行方要求第二章GP软件环境部署2.1操作系统环境安装部署2.2.1BIOS设置开启超线程进入BIOS功能界面,开启BIOS 超线程验证BIOS超线程设置合规性:A: grep –i ‘cpu cores’ | /proc/cpuinfo |wc –lB: grep –i ‘processor’ | /proc/cpuinfo |wc –l检查结果:步骤B执行结果是步骤A的两倍。
操作系统安装设置2.2.2安装操作系统基础包操作系统版本:Redhat Enterprise Linux Server 6 (64bit) 以上版本要求:选择“最小”软件组方式安装Red Hat Enterprise Linux选中“现在自定义”选项,选择安装其他系统工具包。
验证操作系统版本合规性:执行命令:uname –a执行结果(例):Linux by19sorsvdb1001 2.6.32-279.e16.x86_642.2.3安装系统语言要求:操作系统安装过程中,请安装以下语言支持。
POSIX C 和 en_US.utf8 locales 在安装操作系统时安装。
即The POSIX C anden_US.utf8 locales must be installed during the OS installation.Additional locales may be installed as necessary to suit the customer.以 English(English)作为操作系统安装/登录时采用的语言。
除英文环境,在安装附加语言支持时,选择简体中文。
即zh_CN.gbk、zh_CN.gb18030、zh_CN.utf8、zh_CN.BIG5,等中文语言包需要在安装操作系统时一并安装。
验证语言支持包合规性:执行命令:locale –a执行结果:POSIX_Cen_US.UTF-8zh_CN.UTF8zh_CN.gbkzh_CN.gb18030zh_CN.BIG5….2.2.4安装系统工具包2.2.5开发语言连接驱动开发语言连接数据库需要特定的驱动,目前Greenplum与第三方开发语言连接方式有如下规范:Greenplum自带C/C++开发语言驱动,不需要安装任何驱动。
Greenplum自带JDBC/ODBC连接驱动,开发语言可通过JDBC或ODBC连接数据库,例如 Java开发语言可通过JDBC连接数据库。
对于自带有JDBC/ODBC连接驱动的开发语言,可直接通过自身的JDBC/ODBC连接数据库Python及Perl开发语言不能通过JDBC/ODBC连接数据库,需通过DBD连接,则要在安装操作系统完成后独立部署安装。
例如LDS及SOR数据库集群开发语言是Perl,则是需要安装如下DBD驱动软件包。
postgresql-libs-8.4.11-1.el6_2.x86_64perl-DBI-1.609-4.el6.x86_64perl-DBD-Pg-2.15.1-3.el6.x86_642.2.6时区配置配置时区要求如下:选择时区为东八区“亚洲/上海 - 中国东部”Asia/Shanghai East China – Beijing,Guangdong,Shanghai,etc.系统时钟不使用UTC验证时区配置合规性:执行命令:date执行结果:Wed Nov 13 11:07:09 CST 20132.2.7文件系统和分区配置操作系统使用的文件系统,包括根目录、tmp目录、home目录都采用ext3或者ext4;GP数据库使用的文件系统都采用xfs文件系统,并且需要配置挂载参数“rw,noatime,inode64,allocsize=16m”。
由于master和segment主机配置不相同,在划分分区,格式化文件系统,文件系统挂载都有差异,具体操作如下:【master服务器】:1、在独立的raid5组上创建gpt分区:parted -s /dev/sdb mklabel gptparted -- /dev/sdb mkpart primary 0GB -1partprobe /dev/sdb2、格式化分区mkfs -t xfs -f -L /data /dev/sdb13、vi /etc/fstab,增加挂载点配置,路径为/dataLABEL=/data /data xfs rw,noatime,inode64,allocsize=16m 0 04、挂在文件系统mount /data【segment服务器】:1、在独立的raid5组上创建gpt分区:parted -s /dev/sdb mklabel gptparted -- /dev/sdb mkpart primary 0GB -1partprobe /dev/sdbparted -s /dev/sdc mklabel gptparted -- /dev/sdc mkpart primary 0GB -1partprobe /dev/sdc2、格式化分区mkfs -t xfs -f -L /data1 /dev/sdb1mkfs -t xfs -f -L /data2 /dev/sdc13、vi /etc/fstab,增加挂载点配置,路径为/data1和/data2LABEL=/datat1 /datat1 xfs rw,noatime,inode64,allocsize=16m 0 0 LABEL=/datat2 /datat2 xfs rw,noatime,inode64,allocsize=16m 0 0 4、挂在文件系统mount /data1mount /data2验证分区Disk Layout合规性:执行命令:df –h 检查数据盘cat /proc/swaps 检查swap分区mount 检查分区挂载情况,对应xfs的挂载参数如下:/dev/sdf on /data1 type xfs (rw,noatime,inode64,allocsize=16m) 2.2.8网卡配置Greenplum集群各个节点网卡采用双网卡绑定的模式2.2.9操作系统安全配置关闭防火墙和SELinux在操作系统安装过程中,关闭操作系统自带防火墙。