ibm-websphere作业

2006 年 2 月 23 日数据整合的核心内容是从数据源中抽取数据，然后对这些数据进行转化，最终加载的目标数据库或者数据仓库中去，这也就是我们通常所说的 ETL 过程。

IBM WebSphere DataStage 为整个 ETL 过程提供了一个图形化的开发环境。

引言传统的数据整合方式需要大量的手工编码，而采用 IBM WebSphere DataStage 进行数据整合可以大大的减少手工编码的数量，而且更加容易维护。

数据整合的核心内容是从数据源中抽取数据，然后对这些数据进行转化，最终加载的目标数据库或者数据仓库中去，这也就是我们通常所说的ETL过程。

IBM WebSphere DataStage 为整个 ETL 过程提供了一个图形化的开发环境。

本文将从以下几个方面来介绍 IBM WebSphere DataStage：1．数据源连接能力2．完备的开发环境3． ETL Job 的并行执行能力4．开发一个简单的 ETL Job出色的数据源连接能力数据整合工具的数据源连接能力是非常重要的，这将直接决定它能够应用的范围。

IBM WebSphere DataStage 能够直接连接非常多的数据源，包括：1、文本文件2、 XML 文件3、企业应用程序，比如 SAP、Siebel、Oracle 以及PeopleSoft4、几乎所有的数据库系统，比如 DB2、Oracle、SQL Server、Informix等5、 Web services6、 WebSphere MQ正是因为这么好的连接能力，IBM WebSphere DataStage 使用户能够专注于数据转换的逻辑而不用太担心数据的抽取和加载。

完备的开发环境IBM WebSphere DataStage 的开发环境是基于 C/S 模式的，通过 DataStage Client 连接到DataStage Server 上进行开发。

这里有一点需要注意，DataStage Client 只能安装在 Windows 平台上面。

IBM Websphere MQ原理及在民航气象数据库中的应用米永胜【摘要】文章阐述了IBM Websphere MQ的通信原理和互联通信的实现方法,结合实例重点阐述了MQ在民航气象数据库系统中的应用及维护,旨在加深对MQ的理解与运用.【期刊名称】《气象水文海洋仪器》【年(卷),期】2014(031)004【总页数】5页(P63-67)【关键词】中间件;消息队列;民航气象数据库系统;应用实例;维修实例【作者】米永胜【作者单位】民航新疆空中交通管理局气象中心,乌鲁木齐市830016【正文语种】中文【中图分类】TP399消息中间件是位于操作系统和应用程序之间的一种软件，其典型产品是IBM Websphere MQ(MQ是Message Queue的缩写，即消息队列，以下简称MQ)。

简言之，MQ是一种应用程序与应用程序之间的通信方法，通过读出和写入列队中的针对应用程序的数据(消息)来通信，依靠消息传递和消息排队技术，使应用程序能在不同组件(诸如：处理器、子系统、操作系统)以及不同通信协议的网络间彼此通信，实现了跨平台的数据可靠通信传输。

[1-3]民航气象数据库系统从2004年二期升级改造开始，充分利用MQ的跨平台、跨网络的特性，及其先进的传输机制，做到不丢失、不复传，通信可靠性大大提高。

1.1 MQ的通信原理相互通信的应用程序可以在不同的时间运行(即所谓异步通信)，如图1所示。

程序A和B不在网络上直接相互通话，而是间接地将消息放入消息队列，因为程序间没有直接的联系，所以它们不必同时运行。

如果A、B之间的通信线路不通，或程序B没有运行，消息就会留在传输队列中，直到最后被成功地传送，这就是MQ最基本而最重要的技术—消息的可靠传输；而且MQ还能够防止消息重复传送，确保消息1次且仅1次(once-and-only-once)传递。

通信以及对通信错误的恢复都是由队列管理器完成的。

1.2 MQ的互连通信的实现图2是一个不同操作系统平台之间的双向MQ通信传输示例。

IBM WebSphere MQVersion 8.0Quick Start GuideUse this guide to get started with IBM WebSphere MQ Version 8.0.National Language Version:To obtain the Quick Start Guide in other languages,print the language-specific PDF from the Quick Start DVD.Product overviewWebSphere ®MQ provides a universal messaging backbone with robust connectivity for flexible and reliable messaging for applications,and integration of existing IT assets that use a service-oriented architecture (SOA).WebSphere MQ supports application portability through its message queuing interface (MQI),which is a consistent application programming interface available across all the supported platforms.WebSphere MQ also supports the Java ™Message Service (JMS)application programming interface,and both queue-based and publish/subscribe messaging.Managed File Transfer extends your WebSphere MQ messaging network to support file-based integration,and a range of security features is available to protect both the messaging system and the messages that pass through it.You can use the WebSphere MQ Explorer graphical user interface to administer and configure the entire WebSphere MQ network.Product documentation for all versions of WebSphere MQ is available at /software/integration/wmq/library/.Specifically,the WebSphere MQ Version 8.0product documentation is also available in IBM Knowledge Center (/support/knowledgecenter/SSFKSJ_8.0.0/com.ibm.mq.helphome.v80.doc/WelcomePagev8r0.htm).You can also download the WebSphere MQ Version 8.0product documentation as a series of PDF files from ftp:///software/integration/wmq/docs/V8.0/PDFs.Service and support information is provided in the documentation.Information about how to use WebSphere MQ Explorer can be accessed either from within WebSphere MQ Explorer or in the product documentation.WebSphere MQ architectures range from simple architectures that use a single queue manager,to more complex networks of interconnected queue managers.For more information about planning your WebSphere MQ architecture,see the Planning (/support/knowledgecenter/SSFKSJ_8.0.0/com.ibm.mq.pla.doc/q004690_.htm)section of the product documentation.For installation instructions for WebSphere MQ on AIX,HP-UX,Linux,Solaris,IBM i,or Microsoft Windows,and fordetails of the hardware and software configurations that are required,see the Installing(/support/ knowledgecenter/SSFKSJ_8.0.0/com.ibm.mq.ins.doc/q008250_.htm)section of the product documentation.For installation instructions for WebSphere MQ on z/OS®,and for details of the hardware and software configurations that are required,see the Installing WebSphere MQ for z/OS(/support/knowledgecenter/SSFKSJ_8.0.0/ com.ibm.mq.ins.doc/q009640_.htm)section of the product documentation.Further scenarios help you to configure or use product features by taking you through the appropriate task steps.The scenarios include links to other content that helps you to gain a better understanding of the area in which you areinterested.More informationFor more information about WebSphere MQ,see the following resources:Product readme fileThe product readme file(readme.html)is included on the product media and is installed when you installproduct components.The latest version is available on the product readmes web page(/support/docview.wss?rs=171&uid=swg27006097).IBM Support PortalSupport information available through IBM Support Portal includes the following resources:v Support technotes(/support/search.wss?q=websphere+mq)v Available downloads and other resources(/support/entry/portal/product/websphere/websphere_mq?productContext=24824631)v Social Media channels for WebSphere and CICS®Support(/support/docview.wss?uid=swg21410956#2IBM WebSphere MQ Version8.0Licensed Materials-Property of IBM.©Copyright IBM Corp.2006,ernment Users Restricted Rights-Use,duplication or disclosure restricted by GSA ADP Schedule Contract with IBM Corp.IBM,the IBM logo,®,AIX,CICS,Passport Advantage,WebSphere and z/OS are trademarks or registered trademarks of International Business Machines Corp.,registered in many jurisdictions worldwide.Java and all Java-based trademarks and logos are trademarks or registered trademarks of Oracle and/or its affiliates.Linux is a registered trademark of Linus Torvalds in the United States,other countries,or both.Microsoft,Windows,and the Windows logo are trademarks of Microsoft Corporation in the United States,other countries,or both.Other product and service names might be trademarks of IBM or other companies.A current list of IBM trademarks is available on the Web at“Copyright and trademark information”(/legal/copytrade.shtml).Part Number:CF4BZMLPrinted in Ireland。

IBM WebSphere CloudBurst Appliance Delivers enterprise cloud services to speed application deploymentHighlightsSpeed application deployment and dramatically reduce setup time forIBM WebSphere® environments from weeks to minutes with predefined patterns and virtual images. Dynamically manage application health and performance with thenew WebSphere Application Server Hypervisor Edition – Intelligent Management Pack.Dispense multiple images in a single pattern to better capture your applica-tion’s true topology.Maximize reuse of resources in a private cloud by automatically returning them to the shared resource pool upon completion.Gain insight into cloud resource utiliza-tion and charge back departments with management reports that track usage of physical and virtual anizations are facing a complexity and affordability crisis. Costs to manage and power operations can exceed the budget for hardware and software. Fortunately the world is becoming smarter, more instru-mented, interconnected and intelligent.A Smarter Planet™ is about working smarter, making more informed decisions and creating deeper relationships and business processes that are more agile and efficient, all while optimizing costs. The need has never been greater for organizations to optimize the management of their business applications to create fresh possibilities across the enter-prise and seize tomorrow’s opportunities.Businesses are extending Service-Oriented Architecture (SOA) by applying it to cloud services, making deployments more flexible and easy to use. By extending SOA to private clouds, organizations can realize both the economic benefits of a virtualized infrastructure man-aged as a single resource and the security of a private cloud behind the corporate firewall.IBM WebSphere CloudBurst™ Appliance empowers developers, IT and operations managers to intelligently deploy and manage their SOA foundation in private cloud computing environments to lower costs and rapidly roll out new applications and services. This hardware appli-ance provides access to software virtual images and patterns to be used as is or easily customized then securely deployed and managed in a private cloud. Combined with WebSphere Hypervisor Edition virtualimages, these intelligent management solutions allow organi-zations to easily, quickly and repeatedly create application environments that can be published and managed in a private cloud. Organizations can seamlessly extend their investment in SOA into a cloud services environment.The first hardware appliance of its kind, WebSphere CloudBurst Appliance stores and secures WebSphere Hypervisor Edition virtual images and patterns to be dispensed into a cloud. WebSphere CloudBurst Appliance helps customers easily and quickly develop, test and deploybusiness applications, ending the use of manual, complex or time-intensive processes associated with creating application environments. Once finished, resources are automatically returned to the shared resource pool and logged for internal charge-back purposes. WebSphere CloudBurst Appliance also manages individual user and group access, giving IT man-agers the right kind of access controls with optimal efficiency rates.WebSphere CloudBurst Appliance incorporates more than 10 years of management best practices for cost-effective, rapid and repeatable application deployment and fully inte-grates with development and service management tools from Rational® and Tivoli® brands for a seamless end-to-end process.WebSphere CloudBurst Appliance is targeted for privateor on-premise cloud computing environments. It can also be used by service providers providing hosted public clouds and software-as-a-service environments to simplify and standard-ize repeated deployments. It’s part of a powerful and compre-hensive set of cloud computing and virtualization solutions for intelligently deploying and managing SOA applications, services and environments to achieve smarter business out-comes. These solutions deliver robustness and agility to enable applications to adapt to changing market conditionswhile lowering costs.IBM WebSphere CloudBurst ApplianceFeature BenefitsSecurely deploy, manage and maintain application environments in a private cloud Lower hardware, power and cooling costs by utilizing shared virtualized infrastructure and driving higher hardware utilization rates in a private cloudPredefined patterns (such as WebSphere application environments) based on more than 10 years ofIBM software management best practices Rapid, and repeatable application deploymentLower development and deployment costs by ending the use of manual, complex and time-intensive processes associated with creating application environments Reduce riskStreamline resources and time dedicated to WebSphere environment configuration and administrationCustomize multi-image patterns to meet your specific needs Increase agilityEnhance repeatability and lower the potential for costly errorsPreloaded WebSphere Application Server Hypervisor Edition 6.1 and 7.0 virtual images Running systems available in VMware ESX, PowerVM™ and z/VM® environment in minutesLower installation, administration and maintenance costsWebSphere Process Server Hypervisor Edition 6.2 and 7.0 virtual images Running systems available in VMware ESX and PowerVM environment in minutes Efficiently and cost-effectively deploy and manage BPM applications using cloud principlesPreloaded WebSphere Application Server Hypervisor Edition – Intelligent Management Pack Drive down costs and enhance application performance by delivering application edition management, health management and other popular application virtualiza-tion functions via the WebSphere CloudBurst Appliance“Lock” images, patterns and specific parameters(such as, memory size = 1024)Ensure identical, repeated deployments Management reports track usage by users and groups Accurately charge back departmentsSelf-service virtual system management console Set up and tear down WebSphere environments based on user input times at the click of a button Apply updates to images and patterns once and republish for broader user access Running systems available within minutesSimplified administration and managementFrees developers to focus on development and testers on testingFeature BenefitsAppliance serves as an encrypted vault whereimages, patterns and permissions are storedAppliance has a self-disabling switch, which istriggered if the appliance cover is removedProvides granular access controls, allowing adminis-trators to restrict visibility, pattern creation privilegesand deployment rights to individuals and groupsIntegrates with existing LDAP directories to tie intoexisting access control listsPasswords for virtual systems deployed are set atthe time of deployment, guaranteeing root accessonly to credentialed partiesSecurity through the entire infrastructure life cycleREST APIs allow for standards-based integration intoexisting data center management software, includingTivoliSeamless integration into management tools including Tivoli softwareVirtual image customization to include binaries for monitors and corporate governance agents Ensure complianceEasily integrate with monitoring tools for optimal performanceDrag-and-drop tooling for assembling virtual images, scripts and topologies into customized patterns Easily customize predefined patterns to meet customer needsLicense Management Automatically alert users/administrators when product requests exceed availableentitlementsSchedule deployment of patterns and automaticallyreturn them to shared resource pool upon completionMaximize reuse of resourcesManage individual user and group access Optimize efficiency ratesFor more informationT o learn more about IBM WebSphere CloudBurst Appliance, contact your IBM representative or IBM Business Partner, or visit /cloudburstAdditionally, financing solutions from IBM Global Financing can enable effective cash management, protection from technology obsolescence, improved total cost of ownership and return on investment. Also, our Global Asset Recovery Services help address environmental concerns with new, more energy-efficient solutions. For more information on IBM Global Financing, visit: /financing ©Copyright IBM Corporation 2010IBM CorporationSoftware GroupRoute 100Somers, NY 10589 U.S.A.Produced in the United States of AmericaJune 2010All Rights ReservedBM, the IBM logo, , CloudBurst, PowerVM, Rational, Smarter Planet, Tivoli, WebSphere and z/VM are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and otherIBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (® or ™), these symbols indicate U.S. registered or common law trademarks owned by IBM at thetime this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list of IBM trademarks is available on the web at “Copyright and trademark information” at /legal/copytrade.shtmlOther product, company or service names may be trademarks or service marks of others.Plea s e Recycle。

泉州市行政执法信息平台建设项目配置文档福建南威软件工程发展有限公司2009年6月版本历史目录1.IBM WebShere 中间件应用服务器集群配置 (5)1.1.集群服务器安装 (5)1.1.1.安装环境 (5)1.1.1.1.主机列表 (5)1.1.1.2.WAS 6 ND集群拓扑 (5)1.1.2.安装步骤 (6)1.1.2.1.准备工作 (6)1.1.2.2.安装WAS ND (6)1.1.2.3.安装WebSphere Application 6.1.0.0补丁 (12)1.1.2.4.建立DM Profile (12)1.1.2.5.建立Application Server Profile (20)1.1.2.6.安装验证 (26)1.1.3.WAS Cluster配置 (28)1.1.3.1.添加节点到Network Deployment (28)1.1.3.2.创建集群 (30)1.1.4.WEB服务器安装 (35)1.1.4.1.安装步骤（先安装IBM Http Server在安装插件） (35)1.1.4.2.Web服务器配置 (39)1.2.应用程序部署与配置 (45)1.2.1.应用程序部署 (45)1.2.2.应用程序websphere配置 (48)1.2.2.1.Session会话同步配置 (48)1.2.2.2.java虚拟机堆大小配置 (51)1.2.2.3.线程池大小配置 (51)2.日常管理与维护 (52)2.1.WAS 管理控制台简介 (52)2.1.1.检查应用程序服务器状态 (53)2.1.2.检查Cluster（集群）状态 (54)2.1.3.部署应用程序 (54)2.1.4.监控应用服务器性能 (55)2.2.更新应用程序 (56)2.3.问题处理 (58)1.IBM WebSphere集群部署和配置1.1.集群服务器安装安装环境Windows 2008 Enterprise Server ,Service Pack1IBM WebSphere Application 6.1.安装路径：C:\Program Files\IBM\WebSphere\AppServer安装前请务必确认各主机间网络通讯没有问题，防火墙端口已经打开；已经配置好C:\WINNT\system32\drivers\etc\hosts文件。

1.Websphere JVM相关问题诊断：由JVM引起的Websphere问题主要有应用服务器宕机和性能下降，JVM相关问题的特征如下：(1).Websphere应用服务器停止响应：a.Websphere服务器宕机。

b.Websphere进程挂起。

c.JVM内存溢出。

(2).性能下降：JVM进程号(process Id)不停地改变。

2.诊断JVM相关问题所需文件：(1).核心文件(Core files)：a.进程快照或者系统的核心文件。

b.完整的JVM内存快照等。

注意：文件非常庞大，需要ISA(IBM Support Assistant)的日志分析工具解析。

(2).javacore文件：a.正在运行的java进程的快照。

b.Websphere应用服务器发生错误时自动生成的文件。

存储路径为：<WAS_install_root>/profiles/<profile>。

(3).JVM详细的垃圾回收器日志。

(4).JVM堆快照。

3.JVM垃圾回收器日志：(1).设置Websphere中JVM垃圾回收器步骤：在Websphere管理控制窗口点击：Servers->Applicationservers-><server_name>->Java and Process Management ->Process Definition->Java Virtual Machine, 勾选” Verbose Garbage Collection ”复选框，重启Websphere即可。

(2).JVM详细的垃圾回收器日志写在系统错误日志文件中(native_stderr)。

(3).在产品发布以后，推荐将Websphere的JVM垃圾回收器日志打开，它消耗资源非常的少。

4.JVM关于堆的相关参数设置：(1).JVM最大的堆内存大小(maximum heap, -Xmx)：设置合理的最大堆有助于JVM优化性能，最大堆越大，JVM垃圾回收器收集一次垃圾花费的时间越长；最大堆越小，JVM垃圾回收器运行很频繁。