IBM Z for the Digital Enterprise - DevOps for Z

1. DevOps for IBM Z October 2018
Sanjay Chandru
Program Director, Z DevOps
chandru@us.ibm.com

2. IBM Z DEVOPS
Disclaimer
Disclaimer: IBM’s statements regarding its plans, directions, and intent are subject
to change or withdrawal without notice at IBM’s sole discretion. Information
regarding potential future products is intended to outline our general product
direction and it should not be relied on in making a purchasing decision. The
information mentioned regarding potential future products is not a commitment,
promise, or legal obligation to deliver any material, code or functionality. Information
about potential future products may not be incorporated into any contract. The
development, release, and timing of any future features or functionality described
for our products remains at our sole discretion.

3. DevOps in Digital Transformation
3
People, Process, Tools
DevOps is not one of these things…
It’s all of them!
…across the entire lifecycle
…for all technologies and platforms
IBM Z / © 2018 IBM Corporation

4. Current z/OS Application Landscape
IBM Z / © 2018 IBM Corporation
Applications are very complex and tightly
coupled
Businesses need to react faster
There is a strong need for tools that can help organizations
be smarter and help make decisions based on a clear
understanding of the application landscape
+

5. Modern Development Environment
IBM Z / © 2018 IBM Corporation 5
Application Discovery
and Delivery Intelligence
(ADDI)
Discover And Understand
Your z/OS Assets, carry out
impact analysis
Make changes and test
effectively using operational
feedback
Application Delivery
Foundation for Z
Development Build Artifact
Repository
SCM Test
Environments
Prod
Environment
• Reduce development and testing efforts
10-30%
• Increase code quality by 50%
• Plan and manage automation activities in
50% the time

6. Application Discovery and Delivery Intelligence (ADDI)
Quickly and safely unlock the value of existing assets for digital
transformation
§ Rapidly analyze and visualize relationships
between application components, data,
and jobs to make changes safely and
efficiently
§ Reduce risk by reusing current assets and
understanding impacts of potential
changes
§ Increase productivity by automating
documentation, enabling new workers to
be effective in a fraction of the time, and
optimizing tests
§ Accelerate your digital transformation by
rapidly identifying and ensuring integrity
of APIs
IBM Z / © 2018 IBM Corporation

7. 7
Business Rule Mining in ADDI
7
• Automatically discover key artifacts of candidate business rules
(e.g. business terms, implementation names, snippets) from
applications.
• Leverage AD static analysis and structure information to reduce
the time required to produce business rules by half.
• Manage supporting information of Business Rules' artifacts (e.g.
implementation names, business terms and snippets) using a
consistent Web interface
• Export information to be used by third party tools (e.g. ODM)
AD REST API
& Search with
AI
Build a
catalog for
Business
terms and
their usage
Catalog
business rules
and extract as
API/ODM
Microservices
AI driven discoveryof business terms

8. 8
What is Application Delivery Foundation for z Systems
(ADFz)?
Application
Delivery
Foundation for
z Systems
Developer for z Systems
Enterprise Edition
Application
Performance Analyzer
for z/OS
Fault Analyzer for z/OS File Manager for z/OS
Built on IBM Explorer for z/OS Aqua
IDz EE
Comprehensive IDE
• Code/data development
• Automated test generation
• Web enablement
• Code Analysis
• SCM Integration
• Debug
FM
Manage your enterprise data
• Create, edit, copy, browse,
extract
• VSAM, QSAM, DB2, IMS, CICS,
MQ
APA
Application performance tuning
• Statement-level analysis of
resource consumption
FA
Rapidly pinpoint causes of failure
• Map abends to source
• Track/manage failures

9. Why a modern Source Code Manager
matters
Capability RTC/ GIT* Host SCM
Cross language / cross platform support
Branching / Streams – parallel development
“University grad friendly” – uses standard capabilities that new developers understand
Continuous Testing
Support for storing test cases along side of source code
Continuous Innovation
Common processes across teams
Open integrations
Host only configuration – can be complex configuration and upgrade
Host only source management
Limited traditional promotion paths
*Any flavor of Git – using the Rocket Software client on z/OSIBM Z / © 2018 IBM Corporation
Development Build Artifact
Repository
SCM Test
Environments
Prod
Environment

10. IBM Dependency Based Build (DBB)
IBM Z / © 2018 IBM Corporation 11
IBM Dependency Based Build (DBB) - Intelligent build environment for applications stored in Git
Build frame work for z/OS applications stored in Git
• Consists of a Liberty application server that hosts metadata (dependency data, build results) and a build toolkit (Java API, Groovy
Installation).
• Groovy driven build environment for compiling, linking and processing z/OS programs and applications
Dependency identification and understanding
• Automatically identify program dependencies and present the information to the developer/tester
Build intelligently based on dependencies
• Give the tester the option to selectively and automatically build impacted artifacts
Integration with any CI tooling (Jenkins etc)
Development Build Artifact
Repository
SCM Test
Environments
Prod
Environment

11. 12
Rapid Development
• Identify and make changes quickly and efficiently
• Build and debug application changes directly in the
development environment
• Using GIT and Jenkins, rapidly request a build for individual,
selected or impacted programs
Cost Effective development environment
• Essential tools for Z development provided in a clean
accessible environment without unnecessary and expensive
frills
Efficient and Expandable
• Access to deeper specialist tools and solutions available
directly from the environment
Flexibility
• Developers can work from the web with
minimal footprint or client requirements or
from an eclipse interface
Currency
• Easy to ensure developers have access to the
latest efficient intelligent tools
Z Open Development

12. Dependency Based Build typical
setup
IBM Z / © 2018 IBM Corporation 13
(Slave)
DBB WebApp
DBB Toolkit
PDSEzFS
z/OS Explorer
RSE
Editors
+
Z Open Development/IDz EE
Artifact
Repository
Source Code + Build
Scripts
x86z/OS
Developer
ZOD/IDz EE
Git and GitClient
Jenkins
Code and Binaries
External Artifact Repos

13. Shift Left Testing
IBM Z / © 2018 IBM Corporation 14
• Ability to automate all levels of testing - Unit, Integration,
Regression
• An Agile Source Code Management system that supports
true parallel development to enable parallel testing
• Isolated On-demand Test Environments with planned Test
Data Management to support parallel development and
testing.
• Ability to run sub-set of Batch cycles before End-to-End
Integration testing
• Ability to virtualize interfaces
• Ability to integrate into a DevOps Pipeline
Development Build Artifact
Repository
SCM Test
Environments
Prod
Environment

14. Unit Testing
IBM Z / © 2018 IBM Corporation 15
ü Automated Unit Testing based on the X-Unit framework
ü Wizard driven Test case generation based on User input and expected output
ü Generated Unit Tests are COBOL/PL1 programs that can be stored in the SCM and invoked with every build –
Starting point of Testing Automation and building a CICD pipeline
ü Test cases can be bundled into Test Suites
ü zUnit Test Runner allows assertions and Automated Fail/Pass Checks
ü Integrated Code Coverage capability
ü Encourage Behavior Driven Development with the use of stubs and mocks
IBM Developer for
z Systems
Developer
Requirements
Analysis
Design Development Testing Deployment Production
Project
Initiation
By testing Individual units/programs, it is possible to capture
coding defects much earlier in the cycle before the functional and
regression testing.
What is zUnit?
Development Build Artifact
Repository
SCM Test
Environments
Prod
Environment

15. Functional/Regression Testing
IBM Z / © 2018 IBM Corporation 16
Automate Regression Test Packs – Run regression tests after
deployment to each environment
Automate Functional Testing and virtualize interfaces that are not
available
IBM Rational Test Workbench
Enable performance, integration and functional testing,
including terminal based, throughout your project lifecycle
With a scriptless, wizard-driven test authoring
environment and support for more than 70 technologies
and protocols
IBM Rational Performance Test Server
Save time and effort by reusing your functional integration
tests for performance testing
Combine your tests to model real-world scenarios and
assess the impact of load on your integrated
infrastructure.
IBM Rational Test Virtualization Server
Model real system behavior to eliminate test
dependencies and simulate production,
Accelerate testing and reduce the setup and infrastructure
costs of traditional testing environments.
Test
Workbench
Functional Testing
Integration Testing
Performance Testing
Regression Testing
Test
Servers
Load Agents
Virtualization Agents
Test Lab
Infrastructure
QA DEV
Development Build Artifact
Repository
SCM Test
Environments
Prod
Environment

16. Test Environments
IBM Z / © 2018 IBM Corporation 17
Availability of Isolated environments is a key to Early Testing
Developers to perform unit tests without interference from other teams
Environment for Testers to run part of Batch schedules in isolation before full batch
run without impacting other teams – e.g Gain the ability to change logical dates and
run more than one batch cycles in a day
Enables Continuous Integration and Agile Development methodologies for z/OS
Faster and Easier Provisioning of Test Environments on demand or as part of a DevOps
Pipeline
Elimination of shared data issues
Enable developer autonomy and self-service in creating environments
Supports Cloud deployments – enables easy stand up and stand down of
environments
Affordable off host development
and test environment
Cloud Infrastructure
IMS DB2
CICS
WAS MQ
z/OS
COBOL, PL/I, C++, Java,
EGL, Batch, Assembler,
X86 Hardware running 64-bit Linux
zD&T
RTC RIT
UCD
IDz
DT
Development Build Artifact
Repository
SCM Test
Environments
Prod
Environment

17. Automate the Delivery Pipeline
IBM Z / © 2018 IBM Corporation 18
IBM Rational Team Concert (RTC) / IBM Dependency Based Build with
§ Reduce waste by enhancing collaboration across teams, technologies and platforms
through unified status and change & configuration management
§ Improve speed and predictability by automating build across all platforms and
technologies
IBM UrbanCode Deploy (UCD)
§ Improve speed and predictability by automating deploy & configuration across all
platforms and technologies
§ Reduce risks, number of rollbacks and meet audit and
compliance mandates with automated process enforcement
Deploy
Cloud
Distributed
Mainframe
System of
Engagement
System of
Record
Mobile Device
Development Build Artifact
Repository
SCM Test
Environments
Prod
Environment

18. 19
What’s New in DevOps – Recently Launched Capabilities
19
Q4 2017 Q1 2018 Q2 2018
BRM Tech Preview
Web platform to map
business artifacts to IT
artifacts
ZD&T Intelligent
Provisioning
ADDI install simplification
ADDI
Tech Preview: PL/I parser
ZD&T cloud integration
with Open Stack
Full set of RESTful APIs
DBB integration - IDz EE
only capability
Code coverage/zunit test
case results import into
SonarQube
ADFz Shift Left Testing:
Record input and output from
COBOL program and generate a
test case
Provision personal ZD&T
environment
IBM Z / © 2018 IBM Corporation

19. Development
Build Artifact
Repository
SCM
IBM Dependency Based Build
Deploy & Test
Automated Unit Tests Urbancode Deploy
Artifactory/Nexus
Urbancode Deploy
Rational Test Workbench
Other Testing Tools
IBM Z / © 2018 IBM Corporation
Environments
Z Systems Development & Test
Environment
IBM Z
IBM Developer for Z Systems EE
IBM ADDI
End to End Pipe Line – Integrated with
Open Source
Rational Team Concert
Code Review

20. Demo
IBM Z / © 2018 IBM Corporation

21. IBM Z / © 2018 IBM Corporation