如何利用Websphere MQ实现大文件交换

Websphere MQ入门教程——使用IBM Websphere MQ提纲前言今天，大多数企业都希望他们的硬件和软件提供者不只受限于一家厂商，相反，大家普遍认为应当面向多家厂商能够运行多种软件的多种硬件平台，这些硬件平台既可以是大型机，也可以是笔记本计算机。

其中包括传统的中央集中式系统，通常指大型企业所采用的大型机，部门级小型计算机和个人用个人计算机或工作站。

通常这些平台是在“混乱”中发展起来的，当时它们的成长既有独立性又有偶然性。

混乱造成的结果是由企业“玻璃房子”控制的清静、秩序井然的世界退化成了一个个独立而分散的部门，并要求任务能够满足其独立而分散的需求。

有些公司一直在寻求一种成熟的策略，以便在企业范围内扩展应用和数据，使其距最终用户最近。

这种需求在设计时，存在许多限制，因为目前的交互式主要是同步形式，它要求对方一直处于通讯状态，这必然会大大增加网络代价。

目前，许多企业都是由一些相对于整体业务问题而孤立的解决方案所组成的自动化孤岛。

在信息共享的大环境下，如果能在这些孤岛之间架起桥梁，那么效率和利润都将得到提高。

从我们与不同行业客户与服务提供者广泛接触的经验来看，这种沟通非常必要，而且正变得越来越重要。

有些公司已经找到了连接网络若干个部分的解决方案，它们或者是自行开发的或者只有较窄的应用领域。

如IBM用户事务处理的CICS就有这样的连接功能，但数据处理软件的设计、维护和开发通常都非常昂贵。

因此需要一种通用软件，它能够集成多个运行于供应商所提供的系统上的应用程序。

这种软件不仅成本不高，而且可以可靠地处理很高的吞吐量，消息中间件正是解决这种互连问题的解决方案。

商业消息中间件的出现保证了消息传输的可靠性，高效率和安全性，同时也减少了系统的开发周期。

目前应用最多的消息中间件产品为IBM Websphere MQ。

本文就针对Websphere MQ的体系结构、管理和开发进行详细的阐述，希望对读者有所帮助。

WebSphere MQ传输环境搭建和测试IBM公司的WebSphere MQ产品可以方便地实现分布式异构系统之间的消息传递。

对于大型的分布式系统，使用MQ进行数据通信可以说是非常有效的，而且适用于异构环境（如NT和多种UNIX之间通信）。

本文主要介绍：MQ核心组件简介、MQ环境的搭建以及通过编写简单的程序对MQ进行测试，希望能起到抛砖引玉的作用。

一、MQ核心组件简介MQ的核心组件包括：队列管理器（QueueManager）、队列（Queue）、通道（Channel）、消息（Message）和集群（Cluster）。

队列管理器（QueueManager）提供队列服务，管理属于该队列管理器的队列和通道等所有MQ对象。

队列（Queue）是用于存储消息（Message）的数据结构，有四种类型：本地队列（LocalQueue）、远程队列（RemoteQueue）、别名队列（AliasQueue）和模型队列（ModelQueue），最常用到的是本地队列和远程队列。

通道（Channel）是提供了从一个队列管理器到其他队列管理器的数据传输路径。

通道类型有若干种，其中常用的是发送方通道（SenderChannel）和接收方通道（ReceiverChannel）。

消息（Message）是应用程序之间传递的一系列字节数据，MQ传递的消息有两部分组成：消息描述符（MessageDescriptor）和应用数据（ApplicationData）。

默认最大传递的消息大小是4MB，可以根据需要进行设置，最大可到100MB。

集群（Cluster）是分布式网络上的多个队列管理器的集合，本文不涉及集群的具体内容，有兴趣的读者可参考相关资料。

二、MQ环境的搭建本文搭建的环境以Windows平台为例，搭建步骤如下：（一）、准备工作准备2台Win2000环境（XP也可），通过以太网连通。

机器A：IP地址为：10.1.1.1机器B：IP地址为：10.1.1.2均安装MQ 5.3，如需进行第三部分的程序测试，需要安装JDK并设置相应的类路径。

IBMWebSphereMQ安装及配置详解1. 打开MQ安装程序，选择下⼀步，默认安装WebSphere MQ，2. 完成MQ的安装⼯作，启动WebSphere MQ，3. 服务器配置，选择新建队列管理器，创建名为 "mq"的队列管理器,其他选项默认不变，点"下⼀步"4. 允许在 TCP/IP上进⾏队列管理器的远程管理，点击"下⼀步"，完成MQ队列管理器的创建。

5. 新建本地队列，在mq下创建名为"MQ_send"的本地队列(⽤户可以根据⾃⼰的需求更改本地队列的名字和数量)，其他选项默认即可。

6. 在 mq下创建名为"MQ_CHL"的服务器通道，其他选项默认即可。

7. 在MQ服务器端的计算机⽤户中添加MQ客户端所在计算机的系统⽤户。

例如：我的MQ客户端所在的计算机⽤户名为Administrator，则在服务器端系统中添加名为"Administrator"的⽤户。

具体步骤如下：<1>点击"开始"->"控制⾯板"->"管理⼯具"->"计算机管理"->"本地⽤户和组"->"⽤户"，选择Administrator点右键，打开属性⾯板，选择“⾪属于”把mqmt添加进去。

如下图所⽰：（如果客户端计算机使⽤的其他的⽤户名，在服务器端新建⼀个⽤户名，同样操作，把⽤户名添加⾪属于mqm组⾥⾯）注意：1. 客户端连接MQ服务出现2035错误MQRC_NOT_AUTHORIZED2.找到mq的安装⽬录下的bin⽬录，在cmd环境下执⾏命令runmqsc 然后执⾏命令 alter qmgr chlauth(disabled) 把权限验证下掉就可以了，如下图所⽰：3. MQ常⽤命令：登录MQI，⼀般是cd到MQ安装⽬录下bin，然后切换mqm账户，mqm账户是mq默认的管理员账户。

IBM WebSphere MQ File Transfer EditionLower business risk and increase productivity withtrusted and secured file transfersHighlightsMake the most of your existing Enterprise Service Bus infrastructure for universal service delivery including messages, files and events.Gain an end-to-end audit trail across internal and external file transfers.Get reliable streaming of file data between internal systems to the business-to-business gateway.Allow your applications to use web appli-cation programming interfaces to move files such as office productivity tools and computer assisted design programs. Modernize batch-oriented architecture into micro-batches for simple messaging conversion.T oday’s dynamic business environments and economic uncertainty require organizations to work smarter in order to remain competitive, eliminate costly redundancies and promote reuse of existing services—while ensur-ing that these services are secure and dependable.IBM®WebSphere®provides a SMART SOA®approach to untangle the costly and debilitating IT complexity associated with point-to-point connectivity and integration, while maintaining the highest levels of reliability.IBM has gone a step further to create a manageable and trustworthy file transfer solution that makes the most of proven message-oriented middle-ware technology to unify data movement and helps you capitalize upon your existing IT investment. The managed file transfer solution from IBM, WebSphere MQ File T ransfer Edition, delivers a complete solution for reliable file movement. And unlike File T ransfer Protocol, which offers a low-cost technology with limited capabilities and only point-to-point file transfers, IBM WebSphere MQ File T ransfer Edition helps eliminate the threat of data loss and increases transfer visibility, lowering IT operating costs.Why a managed file transfer solution?The simplest tool for file transfer is File T ransfer Protocol (FTP), available on almost all platforms for the quick exchange of files. However, many mission-critical business transactions using file transfer require a managed file transfer (MFT) solu-tion to reduce integration costs by providing extreme reliability, secured management and auditability. In these cases a managed file transfer solution can provide:Extreme reliabilityTrack the movement of files:T ake action to eliminate file corruption and demonstrate transaction integrity by monitor-ing the file from source to target. FTP does not manage, track or secure transfers; it can only move files from one point to another.Automate transfers without human intervention to avoid unnecessary delays and lower levels of staff productivity; FTP supports only manual transfers for files, and automation with the protocol is unavailable.Secured management and auditability of mission-critical filesSet permission-based access to specific file transfers to ensure data security; FTP cannot limit access or provide file security.Establish role-based permissions to strengthen security and compliance as files move through various departments; FTP cannot specify security based on job role.Strengthen compliance for audits; report from a central activity log on all file transfers using robust auditability; FTP cannot report when a file was created, moved or opened.Reduction in integration costsConsolidate files and messages into a single transport, eliminating separate infrastructures and the associated cost of maintenance; FTP creates multiple file transfer points that cannot be managed from a single location.Managed file transfer usingIBM WebSphere MQ File Transfer Edition Improves reliability of file transfer infrastructure. WebSphere MQ File T ransfer Edition takes advantage ofthe reliability and delivery assurances of WebSphere MQ. WebSphere MQ File T ransfer Edition uses WebSphereMQ to deliver files reliably to any WebSphere MQ-supported platform.Delivers improved security of file contents.WebSphere MQ File T ransfer Edition uses a strong message digest algorithm to verify that each file is delivered completely and correctly.Offers “zero-programming.”WebSphere MQ File T ransfer Edition can provide all the benefits of visibility, management and auditability without requiring your IT resources to develop programs or complex scripts.Lets you take advantage of an existing service-oriented architecture (SOA) infrastructure.WebSphere MQ File T ransfer Edition is part of theIBM WebSphere MQ Family and can be deployed in concert with a new or existing SOA infrastructure.WebSphere MQ File T ransfer Edition can be used to create value for various mission-critical business scenarios throughout industries. Examples include:HealthcareHealthcare providers must maintain secure and auditable file transfers to meet compliance obligations of the U.S. Food and Drug Administration (FDA) and the Health Insurance Portability and Accountability Act (HIPAA). Unlike FTP, WebSphere MQ File T ransfer Edition enables the reliable andsecurity-rich transfer of patient data and provides an audit trail that helps to prevent unauthorized access of files in transit. In addition, clinics reduce the wait time for test results when they can receive patient files in a timely and secure manner, helping doctors move more quickly to diagnosis and providing higher-quality care—all while strengthening the organization’s ability to meet regulatory mandates.test labhospitalspatientsdoctors IBM WebSphere MQ File Tr ansfer Editionpatient datatest resultsGovernmentThe United States government must collect and track tax sub-missions from various federal, state and local agencies in order to assure the timely collection of funds within the fiscal year.T ransfer of tax files using FTP is common, but can lead to loss of sensitive financial information from incomplete file transfers.A managed file transfer solution such as IBM WebSphere MQ File T ransfer Edition supports the extreme reliability and secu-rity of all file transfers, helping agencies collect funds within the correct fiscal quarter and making it easier to meet year-end budget requirements.US govt.US treasuryIRSstate agency tax payerstax payersFederal agencyIBM WebSphere MQ File Tr ansfer EditionTax Revenue data and reportsTax RecordsRetailRetailers need to transfer point-of-sale (POS) data into inven-tory management systems; this is part of daily store operations that track and analyze buying behavior and organize efficient restocking. The use of overnight batch file transfers using FTP is error-prone, labor-intensive and costly because transfers are not automated—or batch transfer fail, creating backlogs that require maintenance. A managed file transfer solution such as WebSphere MQ File T ransfer Edition provides real-time, auto-mated and reliable file transfer that helps to eliminate backlogs and can report failures in transmission. This enables a continu-ous transfer compared to overnight batches, helping retailers gain an “up-to-the-minute” view of demand and stock levels.head officestoresIBM WebSphere MQ File Tr ansfer EditionlogisticsDelivery schedulesPurchase records T ransaction LogsNew product info Loyalty card offers Delivery schedulesInsuranceInsurance companies cannot afford inefficiencies in the systems that process health claims. Most insurers require that claims be complete within a 24-hour period in order to avoid backlogs and keep up with the increasing number of new incomingclaims. Using file transfer technologies like FTP eliminates the untimely processing of claims due to file transmission delays or files that are lost or incomplete. WebSphere MQ File T ransfer Edition provides an automated, managed file transfer solution for reliable transport, which reduces claim processing times and helps insurance companies increase operational efficiencies and improve customer satisfaction.clearing houseshospitalagencyclaims agentclients IBM WebSphere MQ File Tr ansfer EditionClaim reportclaim recordinsurersadjustersBankingRegulatory and corporate compliance rules issued by the U.S.Securities and Exchange Commission (SEC) require banks to carefully manage and track all file transfers. FTP cannot meet the requirements in these scenarios. IBM WebSphere MQ File T ransfer Edition offers a robust managed file transfer solution to strengthen compliance by providing security-rich,auditable and reliable file transport of critical business data and helping to eliminate business uncertainty and risks. In addition,IBM WebSphere T ransformation Extender can be used for data transformation and compliance required by the Financial Information Exchange (FIX), the National Automated Clearing House Association (NACHA), the Society for Worldwide Interbank Financial Communication (SWIFTNet) and the Software Engineering Process Authority (SEPA).SECIBM WebSphereT ransformation ExtenderIBM WebSphere MQ File Tr ansfer EditionRegulatory compliance reportsCompliance reportsFilesFilescorporatebranch head quarterofficeLife SciencesBiotechnology and pharmaceutical companies must securely exchange files that contain sensitive clinical trial data. All files must be secure and must provide audit reporting in order to meet FDA and HIPAA compliance. Many of these file transfers contain test sample data (such as tissue-scan images) which must be moved without file corruption. Unlike FTP (which cannot audit, secure or transfer files reliably), a managed file transfer solution such as WebSphere MQ File T ransfer Edition provides an audit trail for end-to-end file visibility and helps you take action to prevent unauthorized access to files in transit. Reducing the time and cost of exchanging drug-trial files between various business units helps pharmaceutical com-panies deliver new products to market in a timely manner.head officeprogress reportstrial statspatient data test resultsmanufacturingIBM WebSphere MQ File Tr ansfer Editionsurgeriestrial patientsdoctors r & dPlease RecycleIBM WebSphere MQ File T ransfer Edition helps you build a customized, scalable and automated solution. Manage, trust and secure file transfers while you eliminate costly redundancies,lower maintenance costs and make the most of your existing IT investments.configure track auditFile Transfer Edition WebSphere MQReliable BackboneProvides general purpose transportfor transfer reliability Specialized for FilesManaging, auditing and monitoringfile transfersFor more informationT o learn more about IBM WebSphere MQ File T ransfer Edition, please contact your IBM marketing representative or IBM Business Partner, or visit the following website: /software/integration/wmq/filetransfer/Additionally, financing solutions from IBM Global Financing can enable effective cash management, protection from tech-nology obsolescence, improved total cost of ownership and return on investment. Also, our Global Asset Recovery Services help address environmental concerns with new, more energy-efficient solutions. For more information on IBM Global Financing, visit: /financing©Copyright IBM Corporation 2010IBM Corporation Software Group Route 100Somers, NY 10589 U.S.A.Produced in the United States of America December 2010All Rights ReservedIBM, the IBM logo, , WebSphere, and SMART SOA aretrademarks or registered trademarks of International Business Machines Corporation in the United States, other countries, or both. If these and other IBM trademarked terms are marked on their first occurrence in this information with a trademark symbol (®or ™), these symbols indicate U.S.registered or common law trademarks owned by IBM at the time this information was published. Such trademarks may also be registered or common law trademarks in other countries. A current list ofIBM trademarks is available on the web at “Copyright and trademark information” at /legal/copytrade.shtmlOther product, company or service names may be trademarks or service marks of others.。