Are you new to IBM Integration Bus? Do you want to know how to configure, administer and monitor your nodes? Do you want to make it easier on yourself when deploying your message flow applications across multiple servers? Would you like to keep a record of all of the messages which flow through your applications? Would you like to know how you can configure a Continuous Integration and Deployment pipeline for you IIB integrations? If so come along and find out about how to administer and monitor your IBM Integration Bus environment.
The presentation will first cover the basics of administering and monitoring your Integration Nodes. Looking at the available commands and their options, as well as the most recent V10 improvements, including enhancements to the product runtime, covering the extended webui, policy, Integration Toolkit, command line, and programmatic front-ends.
Using the basics learnt initially, this session will then take a look at how you build a Continuous Integration pipeline using technologies such as git, Ant & Jenkins to programmatically configure your Nodes, create, build and test your integrations, and then deploy them to production.
3. Notices and Disclaimers Con’t.
• Information concerning non-IBM products was obtained from the suppliers of those products, their published announcements or
other publicly available sources. IBM has not tested those products in connection with this publication and cannot confirm the
accuracy of performance, compatibility or any other claims related to non-IBM products. Questions on the capabilities of non-IBM
products should be addressed to the suppliers of those products. IBM does not warrant the quality of any third-party products, or
the ability of any such third-party products to interoperate with IBM’s products. IBM EXPRESSLY DISCLAIMSALL WARRANTIES,
EXPRESSED OR IMPLIED, INCLUDING BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF MERCHANTABILITY AND
FITNESS FORA PARTICULAR PURPOSE.
• The provision of the information contained h erein is not intended to, and does not, grant any right or license under any IBM
patents, copyrights, trademarks or other intellectual property right.
• IBM, the IBM logo, ibm.com,Aspera®, Bluemix, Blueworks Live, CICS, Clearcase, Cognos®, DOORS®, Emptoris®, Enterprise
Document Management System™, FASP®, FileNet®, Global Business Services ®, Global Technology Services ®, IBM
ExperienceOne™, IBM SmartCloud®, IBM Social Business®, Information on Demand, ILOG, Maximo®, MQIntegrator®,
MQSeries®, Netcool®, OMEGAMON, OpenPower, PureAnalytics™, PureApplication®, pureCluster™, PureCoverage®,
PureData®, PureExperience®, PureFlex®, pureQuery®, pureScale®, PureSystems®, QRadar®, Rational®, Rhapsody®, Smarter
Commerce®, SoDA, SPSS, Sterling Commerce®, StoredIQ, Tealeaf®, Tivoli®, Trusteer®, Unica®, urban{code}®, Watson,
WebSphere®, Worklight®, X-Force® and System z® Z/OS, are trademarks of International Business Machines Corporation,
registered in many jurisdictions worldwide. Other product and service names might be trademarks of IBM or other companies. A
current list of IBM trademarks is available on the Web at "Copyright and trademark information" at:
www.ibm.com/legal/copytrade.shtml.
4
8. Integration Explorer
• Management option designed for administrators
• Plug-in to MQ Explorer
• Extra features
− Create/Manage Configurable Services
− Performance Views
− Group integration nodes
− Administration Log
− Administration Queue
− Manage statistics & tracing
− Replaced in v10 with
Web UI
9. • A wide selection of tools for scripting actions
• Requires a configured environment
– mqsicommandconsole (Windows)
– mqsiprofile (Linux/UNIX)
– JCL or ISPF (z/OS)
• Most commands work against local or remote integration nodes
• New “IIB” command in V10
Command line tools
BIP1121I: Creates an integration server.
Syntax:
mqsicreateexecutiongroup integrationNodeSpec -e integrationServerName [-w timeoutSecs] [-v traceFileName]
Command options:
'integrationNodeSpec' is one of:
(a) 'integrationNodeName' : Name of a locally defined integration node
(b) '-n integrationNodeFileName' : File containing remote integration node connection parameters (*.broker)
(c) '[integrationNodeName] -i ipAddress -p port' : hostname and port of a remote integration node. 'integrationNodeName' optional for validation.
(d) '[integrationNodeName] -i uri' : uri for the remote integration node in the form tcp://[<user>[:<password>]@]<host>:<port>
If a user name and password are supplied, any URI Reserved characters in the password must be percent-encoded.
'-e integrationServerName' name of the new integration server
'-w timeoutSecs' maximum number of seconds to wait for the integration server to be created (default is 60)
'-v traceFileName' send verbose internal trace to the specified file.
10. Integration API (CMP)
• Java interface that enables the administration tools
• Use for custom administration requirements
• Fully documented and samples available
• WMB v8 and later allows you to create and edit message flows too
– Build your entire system programmatically!
11. Web Visualisation and Analytics
§ A comprehensive tool for web management
– Manage all integration resources from zero-footprint client
– Analyze integration performance in real-time
– Supported on a variety of browsers: IE10, Firefox, Safari…
– Complements MQ Explorer and WAS Admin consoles
§ Managing Integration Resources
– View top-level integration node properties
– Add/remove/change integration servers
– Start/Stop integration data flows
– Role based access to control usage
– Advanced options include data replay, policy & monitoring
– Exploits underlying public REST/JSON API
§ Integration Performance Analysis
– Operational experience; no developer intervention required
• New and existing flows can exploit without change
– Many metrics of integration flow available in real-time
• CPU & I/O time shown by default in integration analyzer
• Other metrics include thread, data sizes, errors…
– Flexible display includes data tables and flow profile
• Drill down to understand detailed behaviour
– Exploits underlying MQTT web sockets technology
• Asynchronous notification at low CPU cost
13. V10 Web UI Administration Improvements
• IIB Web UI becomes the primary means ofruntime administration
– Browser approach is lightweightand universal
– Integration Bus Explorer no longer provided as partof IIBv10
• Programmatic intervention using public Java and RESTAPIs
• Integration Bus Explorer admin capabilities re-located
– Policy Set configuration moved to the IIB Toolkit
– ExportPort Configuration for external HTTP listeners in Web UI
– Integration Server Create,Rename and Delete added to Web UI
– BAR file deploymentadded to Web UI
14
14. Understanding integration node behaviour
• The tools include a lot of information that is useful to the administrator
– Administration log, Message flow and resource statistics
– Warnings when features that affect performance are enabled
– Activity Log – New in V10.0.0.4
• Use this information to understand recent configuration changes
− How the integration server is performing, connected endpoints, etc.
15. Significant Tool changes in V10
• Single install package and single installed component
– Unit test integration node automatically started with IIB development tool
– Can create additional integration nodes as required
• No longer any MQ pre-requisite
– All existing MQ use-cases still work (and now support remote MQ connections)
– All administration done through the web UI rather than the Integration Explorer
– Remote administration commands need to point at the integration node’s administration port rather than the queue
manager
• New “IIB Console”
– e.g. iib tools, iib help
– All mqsi* commands continue to work
(noting remote administration caveat above)
17. Controlling Integrations with Policy
• Integration Workload Management
– Provide intelligentmechanisms to control processing speed
– Most common scenario is to reduce back-end server load
– Design allows more policy-based processing over time
– Can be applied to new or existing integration data flows
• Policy defines threshold limits and relevant actions
– Set thresholds for integration data flow throughput
– Specify actions at threshold,for example:
• NOTIFY: Higher (or lower) than threshold generates publication
• DELAY: Excessive workload will have latency added to shape throughput
• Web Console used to manage WLM policy
– Sophisticated behaviour controllable by broker WLM policy
– Workload can be managed across classes ofmessage flows (e.g.batch vs. online)
– Policies stored in local registry,and dynamically configurable
– Developer can also specify limits as integration data flow properties
18
0
20
40
60
80
100
120
140
160
180
200
0
20
40
60
80
100
120
140
160
180
200
0
20
40
60
80
100
120
140
160
180
200
18. Optimizing and tuning
• The tools allow you to modify the configuration operationally
• These tweaks more efficient to make than modifying message flows
• Encourage developers to create message flows that enable operational tweaks to be made
– User-defined properties, Configurable Services, User-defined configurable services, Policies
19. Common Administrative Tasks
• Planning and configuration
– Bringing a new integration node online
– Making an integration node highly available
– Planning for disaster recovery
– Securing an integration node
• Managing integration nodes
– Deployment and redeployment
– Understanding behaviour
– Optimizing and tuning
– Migration
– Maintenance
21. Scripting and Automation
• General approaches for IIB provisioning
– Creating and configuring brokers manually
– Use of commandline tools from within scripts (e.g. shell scripts, Jenkins,
Ant, Maven…)
– Hypervisor images for deployment directlyon publicor private cloud
– Use of technologies such as Chef and Puppet for all environments
– Container technologiese.g.: Docker
• IIB Docker containers can now be used in production!
• Choose an approach that enables your environment to be
reproduced easily <project>
<target name=“deploy”>
<cvs command=“checkout” … />
<mqsipackagebar … />
<mqsiapplybaroverride … />
<mqsideploy … />
</target>
</project>
22. Continuous Delivery - Demo
• Following components
– RHEL7.1
– IIB V10 Runtime with Node created and started
– IIB V10 Toolkitwith Git client installed
– Git repository
– Jenkins
– PerfHarness – http://ibm.biz/PerfHarness
23
24. Continuous Delivery - Demo
Time for a Demo
25
Further information available at:
https://developer.ibm.com/integration/blog/2015/10/02/continuous-build-and-deploy-automation-with-ibm-integration-bus-v10-using-ant-git-and-jenkins/
25. Continuous Delivery
• Demo only covered the subset of what’s possible
– Unit Test
– ComponentTesting
– System Testing
• Many different system test possibilities using the existing administration tools
– Complete end to end testing includingnode creation
– Provisioning to the cloud
– Use the API to access FlowExerciserdata
• Possible to run against cut-down installation
26
26. Alternative Technologies
• Swiss National Train system – GitHub
– https://github.com/SchweizerischeBundesbahnen/iib-maven-plugin
• Apache - IIB9 Maven Build Lifecycle
– http://www.vadosity.com/maven/
• https://github.com/ot4i-cookbooks/ibm_integration_bus
27
27. MacOS
• IIB Toolkit is currently available on Windows & Linux
• New IIB on MacOS available via the V10 Open Beta program.
– https://ibm.biz/iibopenbeta
• Limited runtime capability
• Can connectand administerremote nodes.
28
28. This was Session 18863. The rest of the week ……
Day Monday Tuesday Wednesday Thursday Friday
8:30 Nobody Uses Files Any More
Do They? New Technologies
for Old Technology, File
Processing in MQ MFT and IIB
Room 225D
Common Problems and Problem
Determination for MQ z/OS
MQ and CICS - Integration
Options andCosts
Room 302B
10:00 Introduction toMQ - Can
MQ Really Make My Life
Easier?
Introduction totheNew MQ
Appliance
DevOps : Using z/OSMF to
Provision MQ for z/OS
MQ for z/OS: The Insider Story MQ for z/OS, UsingandAbusing
New Hardware and the New v8
Features
11:15 Introduction toIBM
Integration Bus onz/OS
MQ Security Bootcamp:
Understanding SSL/TLS Principles -
Taking You from Beginner toExpert,
Part 2 of 3
MQ Labs - Room 303A
OR
Giving It the Beans: UsingIBM MQ as
the Messaging Provider for JEE
Applications in IBM WebSphere
ApplicationServer
13:45 What's New in the
Messaging Family - MQ v8
and More [z/OS &
Distributed]
Thoughts on MQ Architecture &
Design
DevOps : IIB Administration for
Continuous Delivery and DevOps
Room 304B
15:15 What's New in IBM
Integration Bus and IIBon
Cloud
IBM Integration Bus MQ flexibility
[z/OS & Distributed]
MQ Security Bootcamp:
Security Features Deep Dive -
Securing your Enterprise,Part 3
of 3
IBM MQ: Are z/OS & Distributed
Platforms LikeOil & Water?
OR
DevOps : EmpoweringtheDelivery of
Data Centre Operations Through
Increased Automation andCloud
[Distributed] Room 304B
16:30 MQ Security Bootcamp:
Securing MQ from End to
End, Part 1 of 3
Digging into theMQ SMF Data Programming with PCF
Messages
Monitoring and AuditingMQ