SlideShare a Scribd company logo
1 of 82
Download to read offline
Migration mainframe x86 servers 
automated transformation toward Web, Java, Linux 
[email : contact@eranea.com] 
www.eranea.com
agenda 
● starting point 
● goals of migration 
● Eranea's proposition 
● methodology & technology 
● project steps 
● benefits / conclusions 
● complements : 
– screenshots NeaControlCenter (NCC) 
– situation / market 2014 
www.eranea.com 2 / 82
starting point 
● a (very) large mission-critical application for 
the customer 
● embedding his entire business expertise and 
driving key operational processes 
● bullet-proof after 10 / 20+ years of continuous 
activity 
● representing massive investments (10s, 100s, 
1'000s men-years of development) 
● doomed to technological obsolescence 
● highly expensive compared to 2014 standard 
systems (x86) 
www.eranea.com 3 / 82
goals 
● tactical : 
–massive cost savings → 80-90 % (capex + opex of M/F 
initial TCO) 
● strategic : 
– technological transformation : web, java, linux, etc. 
– back to standards → alternative suppliers rather than 
monopoly, leverage on innovative « boiling» of x86 world 
– functional improvements : 
● rich and flexible UI + new uses (mobile, etc.) 
●web services for SOA, BPM : batch & transactional 
● (private) cloud computing 
– adequation with 2014 competences : z/OS + Cobol getting 
(very) seldom → java, web and linux highly abundant 
www.eranea.com 4 / 82
business case / ROI example 
4.25 MEuros / year 
100% 
90% 
80% 
70% 
60% 
50% 
40% 
30% 
20% 
10% 
3rd party 
software 
system software 
(z/OS, Cics, DB2, etc..) 
peripherals 
(disks, tape drives, printers, etc.) 
cpu 
factor 10 
identical savings on numerous projects : 
minimum 80% and up to 90% ! 
www.eranea.com 5 / 82 
project : media group (CH) 
400 kEuros / year 
via 
x86, Linux, Java 
(→ > 3.8 MEuros / year savings !)
Eranea's proposition 
● reduce IT costs while guaranteeing : 
– investment protection : application software and human business 
expertise 
– deep technological transformation 
● via a unique migration path : 
– allowing continued maintenance (no stop) during project 
execution 
– fluid, incremental and secure progress : no big-bang (iso-functionnality, 
very small granularity) 
– industrial and repeatable process (100% automated application 
transformation) 
● with advanced and complete tooling for project execution 
and subsequent operations on new x86 system : 
– NeaControlCenter + associated components 
www.eranea.com 6 / 82
methodology 
www.eranea.com 7 / 82
strict iso-functionality 
● definition = 
– produce exact same results "to the last bit and pixel" 
● some examples : 
– computation with 31 significant digits in Java (> precision of 
BigDecimal java library) 
– Cobol semantics fully preserved for variables, groups with LEVEL, 
REDEFINES, management of POINTERs, implicit initialization 
according to PIC, etc. 
– full EBCDIC support on Linux for sorting (« collating sequence »), for 
Cobol programming [ ex : IF A > B ; A and B → PIC X(N)] 
● some advantages : 
– transparency for end-users, « invisible » migration for client systems, 
continued coherency in numbers on long-term historical reports, 
automated and quantified tests, etc. 
www.eranea.com 8 / 82
system transformation 
3270 bms custom 
UI 
cobol jcl utilities 
(sort,...) 
batch scheduler 
db2 vsam sequential 
files 
cics / ims other TP 
monitor 
www.eranea.com 9 / 82 
html/js 
(GWT) 
standards 
java xcl utilities 
batch scheduler 
relational 
data 
(db2, oracle) 
(sort,...) 
appl & transact services 
java AS (JBoss, tomcat, etc.) 
speed 
security 
sequential 
files 
browser 
new application platform = Java 100% 
→ OS-agnostic 
xms
incremental migration (1) 
maintenance in Cobol 
TP / batch 
DB2 
z/OS 
migration : 
users & jobs 
start end 
TP / batch 
N months 
www.eranea.com 10 / 82 
TP / batch 
DB2 / ORCL 
Linux 
DB2 
z/OS 
TP / batch 
Linux 
time 
DB migration 
mainframe stop 
x86 setup 
install transco + NCC 
initial tests 
maintenance in Java 
unique DB 
at all time
incremental migration (2) 
start end 
part 1 
part 2 
part 3 
part N 
... ... 
www.eranea.com 11 / 82 
part1 1 
part 2 
part 3 
part N 
tests rollout 
« cascading » migration
incremental migration (3) 
start end 
part 1 
part 2 
part 3 
... 
www.eranea.com 12 / 82 
part N 
part 1 
part 2 
part 3 
part N 
tests + rollout 
overlapping and combined migration 
recommandation 
● reduced duration 
● early hands-on 
● rapid feedback 
● fast savings
multi-level transformation 
DEV 
INTEG 
Import 
Sources Transcode Import 
Java 
Create 
Projects 
Compile 
Java 
www.eranea.com 13 / 82 
Package 
war 
Deploy 
n targets 
tests 
automated 
automated controlled 
PROD 
full transformation process at 
each level = guaranteed QA
technology 
www.eranea.com 14 / 82
technological core 
Syntax 
Analysis 
XML 
Screen 
“Cobol” support 
SQL support 
Display support 
CICS Emulation 
Tracing / logging 
Lexical 
Analysis 
Java 
Program 
(incl SQL) 
Internal 
Object 
implementation 
Cobol 
pgm 
DBMS 
Semantics 
Analysis 
www.eranea.com 15 / 82 
NeaTranscoder 
NeaRuntime 
SOA 
/ BPM 
Online 
Batch 
2 distinctive features : 100% automation + strict iso-fonctionnality 
remains 
after 
project 
XCL 
Code 
Generation 
Cobol 
copy 
BMS 
desc 
JCL 
disappears 
after 
project 
ws 
front-end 
(soap, rest)
NeaRuntime (incl. NeaWebTerm) 
● runtime framework 
– 100 % Java 
● its services : 
– advanced class loading (bytecode optimization, 
old version boycott, etc.) 
– substitute / emulation of APIs (CICS / IMS API, 
batch, SQL API, BMS → xms, etc.) 
– Cobol iso-functionnality 
– optimized management of JVM resources (sql 
connections, tcp/ip client sessions, pools for 
memory structures, gc minimization, etc.) 
– etc. 
www.eranea.com 16 / 82
incremental migration 
progressive 
migration 
www.eranea.com 17 / 82 
Y 
weeks 
DRDA 
time 
activity 
• 100% of data on z/OS 
• Cobol remains reference 
Cobol 
on mainframe 
Java 
on x86 
100% 
X 
months 
(X defined by customer) 
Java 
= 
reference 
data migration 
to linux dbms 
stop 
mainframe 
CICS DB2 
big bang avoidance → 
critical success factor 
instantaneous 
way-back 
0% 
tomcat 
cost 
reduction 
(if MLC)! 
JDBC
architecture (1) 
application code 
private cloud (CloudStack,OpenStack,etc.) 
CI 
engine 
deploy 
(war, zip) 
www.eranea.com 18 / 82 
synchronous 
data 
mirroring 
(real time) 
production BATCH 
sources 
repository 
DB 
ERIT 
NeaControlCenter 
(+ standard console) 
migration factory 
DB2 
production TP 
analyze, 
transcode, 
compile, 
package 
JDBC / 
DRDA 
run 
tools installed on-site 
→ “continuous migration” 
multi-layer processing cluster : 
(unification, distribution, processing) 
feedback 
(jmx, snmp) 
« engineered x86 system » : Cisco UCS, IBM Flex, Oracle Exa, EMC VCE, HP CloudSystem, etc. 
backup 
datacenter 
RACF / 
TopSecret 
LDAP
architecture (2) 
DB2 
HFS 
scheduler 
agent 
docs 
server 
DFS 
server 
mail 
server 
print 
server 
SAN 
www.eranea.com 19 / 82 
accès 
DB 
shared files 
access 
common services 
access 
storage 
access 
logical conditions 
management 
+ job launching 
remote 
synchronous 
mirroring 
backup 
SAN 
z/OS scheduler 
(ex : TWS, Control/M 
Autosys, CA7,etc.) 
Architecture / structure : 
● scheduling logic and organization 
fully preserved 
● dynamic (optimized) worker 
sheduling via agents 
● centralized supervision / reporting 
on NeaControlCenter 
● file sharing with z/OS (via HFS) as 
needed 
● ad hoc (= out of plan) job 
launching via NeaControlCenter 
scheduler 
agent 
scheduler 
agent 
scheduler 
agent
architecture (3) 
● high availability : 
–multiple stages , redundant instances 
● stringent security : 
– inter-entity isolation 
● top performances : 
– Intel Xeon : last generation extremely powerful! 
– flash arrays for million IOPs 
● total manageability : thousands of JMX or SNMP 
probes / samplers for all kinds of values / actions 
www.eranea.com 20 / 82
tests (1) - transactional 
3270 
www.eranea.com 21 / 82 
CICS DB2 
Tomcat 
XML 
screen / kb 
data 
XML 
screen /kb 
data 
HTML 
XML 
screen / kb 
data 
bug fix : 
runtime / application 
(1) 
(2) 
(3) 
(4) 
if (1) & (3) different 
DRDA to DB2 
(via JDBC) 
capture 
replay 
(batch or TP) 
code coverage 
measurements 
to quantify tests 
exhaustivity 
100s / 1'000s 
captures 
triggers 
JAVA 
application programs 
sometimes still have 
example: 35'000 screens 
to cover 10M lines 
at 90% level 
bugs ... 
XML 
modified 
db lines
tests – cross-ref captures <> pgms 
www.eranea.com 22 / 82
tests – coverage <> business entities 
www.eranea.com 23 / 82
tests – capture <> replay 
www.eranea.com 24 / 82
NeaControlCenter (1) 
● inventory tool for application assets 
– analysis of cross-references 
– full-text search engine 
● console to define and monitor tests : 
– organization of capture / replay campaigns 
– automated validation of iso-functionality 
(screens / DB / files identical) 
– supervision of code coverage progress for 
application software 
www.eranea.com 25 / 82
NeaControlCenter (2) 
● monitoring / management console for transcoding 
factory : 
– status and progress for transcoding / compilations / 
packaging 
– status and progress for tests and rollouts 
● monitoring / management console for opérations 
– exhaustive monitoring for transactional processing 
(sessions, TD, TS, SQL, MQ, ...) 
– launch + monitoring for status / progress of batch 
jobs 
● 200+ screens and functions 
www.eranea.com 26 / 82
dashboard – transcoding N 
www.eranea.com 27 / 82
rollouts – TP instances 
www.eranea.com 28 / 82
monitoring – user session 
www.eranea.com 29 / 82
monitoring - batch job details 
www.eranea.com 30 / 82
editor / viewer EBCDIC (ASCII) 
www.eranea.com 31 / 82
project : standard steps 
initial 
presentation(s) 
technical 
workshop(s) 
in-depth 
analysis 
Proof 
of Concept 
www.eranea.com 32 / 82 
proposal 
/ contract 
solution 
/ installation 
part 1 
/ part N 
client OK 
global 
validation 
detailed 
concept 
+ business case 
/ ROI 
N transactions + 
batch jobs 
fully running 
by customer
conclusion 
● x86 systems are simultaneously very strong (availability, 
performances) and most economically efficient in 2014 to 
support any large-scale mission-critical application 
● Eranea proposes an extremely efficient and risk-free transformation 
solution : 
–massive costs savings (allowing project auto-financing) 
– deep technological transformation 
– based on unique migration methodology 
● 2 keys for success : 
– savings and transformation (application + infrastructure) done 
in a single shot (<> pure « rehosting » like type Cobol-IT, 
MicroFocus limited to savings only without stategic benefits -> 
dead-end ?) 
– fluid and progressive migration → total absence of risks 
● no disturbance / productivity loss for end-users 
● rapid adaptation + adherence for developers 
www.eranea.com 33 / 82
Thanks ! 
● questions ? 
contact@eranea.com 
Eranea | Lausanne (Switzerland) 
www.eranea.com 34 / 82
complements 
www.eranea.com 35 / 82
neaControlCenter 
screenshots 
www.eranea.com 36 / 82
neaControlCenter 
monitoring : trancoding - rollout 
www.eranea.com 37 / 82
dashboard - tasks 
www.eranea.com 38 / 82
dashboard – transcodings 
www.eranea.com 39 / 82
dashboard – transcoding N 
www.eranea.com 40 / 82
dashboard – CICS API inventory 
www.eranea.com 41 / 82
dashboard – SQL inventory 
www.eranea.com 42 / 82
inventory - request 
www.eranea.com 43 / 82
inventory – dependencies (1) 
www.eranea.com 44 / 82
inventory – dependencies (2) 
www.eranea.com 45 / 82
inventory – file display 
www.eranea.com 46 / 82
dashboard - rollouts 
www.eranea.com 47 / 82
dashboard – rollout status 
www.eranea.com 48 / 82
dashboard – « hot » rollout 
www.eranea.com 49 / 82
rollouts – TP instances 
www.eranea.com 50 / 82
neaControlCenter 
tests : captures <> replays 
(examples for TP) 
www.eranea.com 51 / 82
tests – cross-ref captures <> pgms 
www.eranea.com 52 / 82
tests – coverage <> business org 
www.eranea.com 53 / 82
tests – request on captures 
www.eranea.com 54 / 82
tests – visualization of capture 
www.eranea.com 55 / 82
tests – monitoring captures replay 
www.eranea.com 56 / 82
tests – capture <> replay (1) 
www.eranea.com 57 / 82
tests – capture <> replay (2) 
www.eranea.com 58 / 82
neaControlCenter 
production : batch 
www.eranea.com 59 / 82
batch monitoring - overall 
www.eranea.com 60 / 82
batch monitoring – details (1) 
www.eranea.com 61 / 82
batch monitoring – details (2) 
www.eranea.com 62 / 82
batch – submission (out of scheduler) 
www.eranea.com 63 / 82
xcl editor 
www.eranea.com 64 / 82
editor / viewer EBCDIC (ASCII) 
www.eranea.com 65 / 82
editor / viewer EBCDIC (ASCII) 
www.eranea.com 66 / 82
neaControlCenter 
production : transactional processing 
www.eranea.com 67 / 82
server monitoring - overall 
www.eranea.com 68 / 82
JVMs monitoring - overall 
www.eranea.com 69 / 82
db / messaging - status 
www.eranea.com 70 / 82
db / messaging – connection details 
www.eranea.com 71 / 82
monitoring - programs 
www.eranea.com 72 / 82
monitoring sessions - overall 
www.eranea.com 73 / 82
monitoring – user session details 
www.eranea.com 74 / 82
queue monitoring (TD) - overall 
www.eranea.com 75 / 82
queue monitoring (TD) - details 
www.eranea.com 76 / 82
queue monitoring (TS) - overall 
www.eranea.com 77 / 82
queue monitoring (TS) - details 
www.eranea.com 78 / 82
market 2014 
www.eranea.com 79 / 82
market trends : why x86 
2 new generations 
since then... 
www.eranea.com 80 / 82 
Source : Phreshing 
since 2004, 
x86 > RISC & 
mainframe 
performances / functions / availability : 
x86 has come to par with RISC ! (at least...) 
Source : Intel
market trends : h/w → x86 
www.eranea.com 81 / 82 
● x86 is becoming standard 
● sold per year: 
– 4'000 mainframes 
– 220'000 Risc servers : x 50 
– 9'950'000 x86 servers : x 2'000 
● performances I/Os & CPUs : 
– x86 = Risc = M/F (→ Moore's Law...) 
– when architecture / setup is appropriate 
– much more cost efficient ! 
● where innovation happens : 
– heavy R&D : 
● Open Compute Project by Facebook 
– in-memory Dbs, flash arrays, ... 
– green IT 
– etc. 
Windows = lots 
of 
office automation 
servers 
source : Intel
market trends : s/w → linux 
worldwide server market 
(roll-outs, subscriptions, shipments) 
Windows = lots 
of 
office automation 
servers 
www.eranea.com 82 / 82 
● linux (on x86) is growing fast 
● proprietary systems disappear 
● linux references (finance): 
London Stock Exchange, 
NYSE, Euronext, etc. 
● for the “3S” : Speed, 
Stability, Security 
● cost ≈ free 
– based on OSS 
– compared to z/OS 
NB : Eranea's solution is OS-agnostic and works on any platform 
supporting Java : Solaris, AIX, MS-Windows, z/OS, zLinux, etc.

More Related Content

What's hot

Oracle Primavera P6 r8.2 and CM14 on Exa platform using oracle Fusion Middlew...
Oracle Primavera P6 r8.2 and CM14 on Exa platform using oracle Fusion Middlew...Oracle Primavera P6 r8.2 and CM14 on Exa platform using oracle Fusion Middlew...
Oracle Primavera P6 r8.2 and CM14 on Exa platform using oracle Fusion Middlew...p6academy
 
Upgrading to Oracle SOA 12.1 & 12.2 - Practical Steps and Project Experiences
Upgrading to Oracle SOA 12.1 & 12.2 - Practical Steps and Project ExperiencesUpgrading to Oracle SOA 12.1 & 12.2 - Practical Steps and Project Experiences
Upgrading to Oracle SOA 12.1 & 12.2 - Practical Steps and Project ExperiencesBruno Alves
 
Papyrus for Real Time at the OMG TC
Papyrus for Real Time  at the OMG TCPapyrus for Real Time  at the OMG TC
Papyrus for Real Time at the OMG TCCharles Rivet
 
WilliamArthur-Resume-1
WilliamArthur-Resume-1WilliamArthur-Resume-1
WilliamArthur-Resume-1Ted Arthur
 

What's hot (7)

Durai_Oracle Apps R12 DBA-2015
Durai_Oracle Apps R12 DBA-2015Durai_Oracle Apps R12 DBA-2015
Durai_Oracle Apps R12 DBA-2015
 
Oracle Primavera P6 r8.2 and CM14 on Exa platform using oracle Fusion Middlew...
Oracle Primavera P6 r8.2 and CM14 on Exa platform using oracle Fusion Middlew...Oracle Primavera P6 r8.2 and CM14 on Exa platform using oracle Fusion Middlew...
Oracle Primavera P6 r8.2 and CM14 on Exa platform using oracle Fusion Middlew...
 
CV
CVCV
CV
 
SAP HANA on POWER9 systems
SAP HANA on POWER9 systemsSAP HANA on POWER9 systems
SAP HANA on POWER9 systems
 
Upgrading to Oracle SOA 12.1 & 12.2 - Practical Steps and Project Experiences
Upgrading to Oracle SOA 12.1 & 12.2 - Practical Steps and Project ExperiencesUpgrading to Oracle SOA 12.1 & 12.2 - Practical Steps and Project Experiences
Upgrading to Oracle SOA 12.1 & 12.2 - Practical Steps and Project Experiences
 
Papyrus for Real Time at the OMG TC
Papyrus for Real Time  at the OMG TCPapyrus for Real Time  at the OMG TC
Papyrus for Real Time at the OMG TC
 
WilliamArthur-Resume-1
WilliamArthur-Resume-1WilliamArthur-Resume-1
WilliamArthur-Resume-1
 

Similar to Migrate Mainframe Apps to Java and Linux Platform for Cost Savings

End to End Processing of 3.7 Million Telemetry Events per Second using Lambda...
End to End Processing of 3.7 Million Telemetry Events per Second using Lambda...End to End Processing of 3.7 Million Telemetry Events per Second using Lambda...
End to End Processing of 3.7 Million Telemetry Events per Second using Lambda...DataWorks Summit/Hadoop Summit
 
Apache Samza 1.0 - What's New, What's Next
Apache Samza 1.0 - What's New, What's NextApache Samza 1.0 - What's New, What's Next
Apache Samza 1.0 - What's New, What's NextPrateek Maheshwari
 
KubeCon 2017: Kubernetes from Dev to Prod
KubeCon 2017: Kubernetes from Dev to ProdKubeCon 2017: Kubernetes from Dev to Prod
KubeCon 2017: Kubernetes from Dev to ProdSubhas Dandapani
 
Nagios Conference 2007 | Nagios in very large Environments by Werner Neunteufl
Nagios Conference 2007 | Nagios in very large Environments by Werner NeunteuflNagios Conference 2007 | Nagios in very large Environments by Werner Neunteufl
Nagios Conference 2007 | Nagios in very large Environments by Werner NeunteuflNETWAYS
 
Big Data Streams Architectures. Why? What? How?
Big Data Streams Architectures. Why? What? How?Big Data Streams Architectures. Why? What? How?
Big Data Streams Architectures. Why? What? How?Anton Nazaruk
 
WebCamp 2016: DevOps. Николай Дойков: Опыт создания клауда для потокового вид...
WebCamp 2016: DevOps. Николай Дойков: Опыт создания клауда для потокового вид...WebCamp 2016: DevOps. Николай Дойков: Опыт создания клауда для потокового вид...
WebCamp 2016: DevOps. Николай Дойков: Опыт создания клауда для потокового вид...WebCamp
 
Infrastructure Considerations : Design : "webops"
Infrastructure Considerations : Design : "webops"Infrastructure Considerations : Design : "webops"
Infrastructure Considerations : Design : "webops"Piyush Kumar
 
An adaptive and eventually self healing framework for geo-distributed real-ti...
An adaptive and eventually self healing framework for geo-distributed real-ti...An adaptive and eventually self healing framework for geo-distributed real-ti...
An adaptive and eventually self healing framework for geo-distributed real-ti...Angad Singh
 
How to deploy & optimize eZ Publish (2014)
How to deploy & optimize eZ Publish (2014)How to deploy & optimize eZ Publish (2014)
How to deploy & optimize eZ Publish (2014)Kaliop-slide
 
The Enterprise IT Checklist for Docker Operations
The Enterprise IT Checklist for Docker Operations The Enterprise IT Checklist for Docker Operations
The Enterprise IT Checklist for Docker Operations Nicola Kabar
 
Baidu cloudfoundry english
Baidu cloudfoundry englishBaidu cloudfoundry english
Baidu cloudfoundry englishJames Watters
 
2014 01-23-eranea-apalia-private-cloud
2014 01-23-eranea-apalia-private-cloud2014 01-23-eranea-apalia-private-cloud
2014 01-23-eranea-apalia-private-cloudDidier Durand
 
Mainframe migration
Mainframe migrationMainframe migration
Mainframe migrationGinfo Intl
 
OpenNebula Conf 2014 | ONE BIT to rule them all - Stefan Kooman
OpenNebula Conf 2014 | ONE BIT to rule them all - Stefan KoomanOpenNebula Conf 2014 | ONE BIT to rule them all - Stefan Kooman
OpenNebula Conf 2014 | ONE BIT to rule them all - Stefan KoomanNETWAYS
 
OpenNebulaConf 2014 - ONE BIT to rule them all - Stefan Kooman
OpenNebulaConf 2014 - ONE BIT to rule them all - Stefan KoomanOpenNebulaConf 2014 - ONE BIT to rule them all - Stefan Kooman
OpenNebulaConf 2014 - ONE BIT to rule them all - Stefan KoomanOpenNebula Project
 
CharlesSweetResume06155122015
CharlesSweetResume06155122015CharlesSweetResume06155122015
CharlesSweetResume06155122015Charlie Sweet
 
Strata Singapore: Gearpump Real time DAG-Processing with Akka at Scale
Strata Singapore: GearpumpReal time DAG-Processing with Akka at ScaleStrata Singapore: GearpumpReal time DAG-Processing with Akka at Scale
Strata Singapore: Gearpump Real time DAG-Processing with Akka at ScaleSean Zhong
 

Similar to Migrate Mainframe Apps to Java and Linux Platform for Cost Savings (20)

End to End Processing of 3.7 Million Telemetry Events per Second using Lambda...
End to End Processing of 3.7 Million Telemetry Events per Second using Lambda...End to End Processing of 3.7 Million Telemetry Events per Second using Lambda...
End to End Processing of 3.7 Million Telemetry Events per Second using Lambda...
 
Apache Samza 1.0 - What's New, What's Next
Apache Samza 1.0 - What's New, What's NextApache Samza 1.0 - What's New, What's Next
Apache Samza 1.0 - What's New, What's Next
 
KubeCon 2017: Kubernetes from Dev to Prod
KubeCon 2017: Kubernetes from Dev to ProdKubeCon 2017: Kubernetes from Dev to Prod
KubeCon 2017: Kubernetes from Dev to Prod
 
Nagios Conference 2007 | Nagios in very large Environments by Werner Neunteufl
Nagios Conference 2007 | Nagios in very large Environments by Werner NeunteuflNagios Conference 2007 | Nagios in very large Environments by Werner Neunteufl
Nagios Conference 2007 | Nagios in very large Environments by Werner Neunteufl
 
my_resume(eng)
my_resume(eng)my_resume(eng)
my_resume(eng)
 
Big Data Streams Architectures. Why? What? How?
Big Data Streams Architectures. Why? What? How?Big Data Streams Architectures. Why? What? How?
Big Data Streams Architectures. Why? What? How?
 
WebCamp 2016: DevOps. Николай Дойков: Опыт создания клауда для потокового вид...
WebCamp 2016: DevOps. Николай Дойков: Опыт создания клауда для потокового вид...WebCamp 2016: DevOps. Николай Дойков: Опыт создания клауда для потокового вид...
WebCamp 2016: DevOps. Николай Дойков: Опыт создания клауда для потокового вид...
 
Infrastructure Considerations : Design : "webops"
Infrastructure Considerations : Design : "webops"Infrastructure Considerations : Design : "webops"
Infrastructure Considerations : Design : "webops"
 
An adaptive and eventually self healing framework for geo-distributed real-ti...
An adaptive and eventually self healing framework for geo-distributed real-ti...An adaptive and eventually self healing framework for geo-distributed real-ti...
An adaptive and eventually self healing framework for geo-distributed real-ti...
 
How to deploy & optimize eZ Publish (2014)
How to deploy & optimize eZ Publish (2014)How to deploy & optimize eZ Publish (2014)
How to deploy & optimize eZ Publish (2014)
 
The Enterprise IT Checklist for Docker Operations
The Enterprise IT Checklist for Docker Operations The Enterprise IT Checklist for Docker Operations
The Enterprise IT Checklist for Docker Operations
 
Madrid meetup #7 deployment models
Madrid meetup #7   deployment modelsMadrid meetup #7   deployment models
Madrid meetup #7 deployment models
 
Baidu cloudfoundry english
Baidu cloudfoundry englishBaidu cloudfoundry english
Baidu cloudfoundry english
 
2014 01-23-eranea-apalia-private-cloud
2014 01-23-eranea-apalia-private-cloud2014 01-23-eranea-apalia-private-cloud
2014 01-23-eranea-apalia-private-cloud
 
Mainframe migration
Mainframe migrationMainframe migration
Mainframe migration
 
GoDocker presentation
GoDocker presentationGoDocker presentation
GoDocker presentation
 
OpenNebula Conf 2014 | ONE BIT to rule them all - Stefan Kooman
OpenNebula Conf 2014 | ONE BIT to rule them all - Stefan KoomanOpenNebula Conf 2014 | ONE BIT to rule them all - Stefan Kooman
OpenNebula Conf 2014 | ONE BIT to rule them all - Stefan Kooman
 
OpenNebulaConf 2014 - ONE BIT to rule them all - Stefan Kooman
OpenNebulaConf 2014 - ONE BIT to rule them all - Stefan KoomanOpenNebulaConf 2014 - ONE BIT to rule them all - Stefan Kooman
OpenNebulaConf 2014 - ONE BIT to rule them all - Stefan Kooman
 
CharlesSweetResume06155122015
CharlesSweetResume06155122015CharlesSweetResume06155122015
CharlesSweetResume06155122015
 
Strata Singapore: Gearpump Real time DAG-Processing with Akka at Scale
Strata Singapore: GearpumpReal time DAG-Processing with Akka at ScaleStrata Singapore: GearpumpReal time DAG-Processing with Akka at Scale
Strata Singapore: Gearpump Real time DAG-Processing with Akka at Scale
 

Migrate Mainframe Apps to Java and Linux Platform for Cost Savings

  • 1. Migration mainframe x86 servers automated transformation toward Web, Java, Linux [email : contact@eranea.com] www.eranea.com
  • 2. agenda ● starting point ● goals of migration ● Eranea's proposition ● methodology & technology ● project steps ● benefits / conclusions ● complements : – screenshots NeaControlCenter (NCC) – situation / market 2014 www.eranea.com 2 / 82
  • 3. starting point ● a (very) large mission-critical application for the customer ● embedding his entire business expertise and driving key operational processes ● bullet-proof after 10 / 20+ years of continuous activity ● representing massive investments (10s, 100s, 1'000s men-years of development) ● doomed to technological obsolescence ● highly expensive compared to 2014 standard systems (x86) www.eranea.com 3 / 82
  • 4. goals ● tactical : –massive cost savings → 80-90 % (capex + opex of M/F initial TCO) ● strategic : – technological transformation : web, java, linux, etc. – back to standards → alternative suppliers rather than monopoly, leverage on innovative « boiling» of x86 world – functional improvements : ● rich and flexible UI + new uses (mobile, etc.) ●web services for SOA, BPM : batch & transactional ● (private) cloud computing – adequation with 2014 competences : z/OS + Cobol getting (very) seldom → java, web and linux highly abundant www.eranea.com 4 / 82
  • 5. business case / ROI example 4.25 MEuros / year 100% 90% 80% 70% 60% 50% 40% 30% 20% 10% 3rd party software system software (z/OS, Cics, DB2, etc..) peripherals (disks, tape drives, printers, etc.) cpu factor 10 identical savings on numerous projects : minimum 80% and up to 90% ! www.eranea.com 5 / 82 project : media group (CH) 400 kEuros / year via x86, Linux, Java (→ > 3.8 MEuros / year savings !)
  • 6. Eranea's proposition ● reduce IT costs while guaranteeing : – investment protection : application software and human business expertise – deep technological transformation ● via a unique migration path : – allowing continued maintenance (no stop) during project execution – fluid, incremental and secure progress : no big-bang (iso-functionnality, very small granularity) – industrial and repeatable process (100% automated application transformation) ● with advanced and complete tooling for project execution and subsequent operations on new x86 system : – NeaControlCenter + associated components www.eranea.com 6 / 82
  • 8. strict iso-functionality ● definition = – produce exact same results "to the last bit and pixel" ● some examples : – computation with 31 significant digits in Java (> precision of BigDecimal java library) – Cobol semantics fully preserved for variables, groups with LEVEL, REDEFINES, management of POINTERs, implicit initialization according to PIC, etc. – full EBCDIC support on Linux for sorting (« collating sequence »), for Cobol programming [ ex : IF A > B ; A and B → PIC X(N)] ● some advantages : – transparency for end-users, « invisible » migration for client systems, continued coherency in numbers on long-term historical reports, automated and quantified tests, etc. www.eranea.com 8 / 82
  • 9. system transformation 3270 bms custom UI cobol jcl utilities (sort,...) batch scheduler db2 vsam sequential files cics / ims other TP monitor www.eranea.com 9 / 82 html/js (GWT) standards java xcl utilities batch scheduler relational data (db2, oracle) (sort,...) appl & transact services java AS (JBoss, tomcat, etc.) speed security sequential files browser new application platform = Java 100% → OS-agnostic xms
  • 10. incremental migration (1) maintenance in Cobol TP / batch DB2 z/OS migration : users & jobs start end TP / batch N months www.eranea.com 10 / 82 TP / batch DB2 / ORCL Linux DB2 z/OS TP / batch Linux time DB migration mainframe stop x86 setup install transco + NCC initial tests maintenance in Java unique DB at all time
  • 11. incremental migration (2) start end part 1 part 2 part 3 part N ... ... www.eranea.com 11 / 82 part1 1 part 2 part 3 part N tests rollout « cascading » migration
  • 12. incremental migration (3) start end part 1 part 2 part 3 ... www.eranea.com 12 / 82 part N part 1 part 2 part 3 part N tests + rollout overlapping and combined migration recommandation ● reduced duration ● early hands-on ● rapid feedback ● fast savings
  • 13. multi-level transformation DEV INTEG Import Sources Transcode Import Java Create Projects Compile Java www.eranea.com 13 / 82 Package war Deploy n targets tests automated automated controlled PROD full transformation process at each level = guaranteed QA
  • 15. technological core Syntax Analysis XML Screen “Cobol” support SQL support Display support CICS Emulation Tracing / logging Lexical Analysis Java Program (incl SQL) Internal Object implementation Cobol pgm DBMS Semantics Analysis www.eranea.com 15 / 82 NeaTranscoder NeaRuntime SOA / BPM Online Batch 2 distinctive features : 100% automation + strict iso-fonctionnality remains after project XCL Code Generation Cobol copy BMS desc JCL disappears after project ws front-end (soap, rest)
  • 16. NeaRuntime (incl. NeaWebTerm) ● runtime framework – 100 % Java ● its services : – advanced class loading (bytecode optimization, old version boycott, etc.) – substitute / emulation of APIs (CICS / IMS API, batch, SQL API, BMS → xms, etc.) – Cobol iso-functionnality – optimized management of JVM resources (sql connections, tcp/ip client sessions, pools for memory structures, gc minimization, etc.) – etc. www.eranea.com 16 / 82
  • 17. incremental migration progressive migration www.eranea.com 17 / 82 Y weeks DRDA time activity • 100% of data on z/OS • Cobol remains reference Cobol on mainframe Java on x86 100% X months (X defined by customer) Java = reference data migration to linux dbms stop mainframe CICS DB2 big bang avoidance → critical success factor instantaneous way-back 0% tomcat cost reduction (if MLC)! JDBC
  • 18. architecture (1) application code private cloud (CloudStack,OpenStack,etc.) CI engine deploy (war, zip) www.eranea.com 18 / 82 synchronous data mirroring (real time) production BATCH sources repository DB ERIT NeaControlCenter (+ standard console) migration factory DB2 production TP analyze, transcode, compile, package JDBC / DRDA run tools installed on-site → “continuous migration” multi-layer processing cluster : (unification, distribution, processing) feedback (jmx, snmp) « engineered x86 system » : Cisco UCS, IBM Flex, Oracle Exa, EMC VCE, HP CloudSystem, etc. backup datacenter RACF / TopSecret LDAP
  • 19. architecture (2) DB2 HFS scheduler agent docs server DFS server mail server print server SAN www.eranea.com 19 / 82 accès DB shared files access common services access storage access logical conditions management + job launching remote synchronous mirroring backup SAN z/OS scheduler (ex : TWS, Control/M Autosys, CA7,etc.) Architecture / structure : ● scheduling logic and organization fully preserved ● dynamic (optimized) worker sheduling via agents ● centralized supervision / reporting on NeaControlCenter ● file sharing with z/OS (via HFS) as needed ● ad hoc (= out of plan) job launching via NeaControlCenter scheduler agent scheduler agent scheduler agent
  • 20. architecture (3) ● high availability : –multiple stages , redundant instances ● stringent security : – inter-entity isolation ● top performances : – Intel Xeon : last generation extremely powerful! – flash arrays for million IOPs ● total manageability : thousands of JMX or SNMP probes / samplers for all kinds of values / actions www.eranea.com 20 / 82
  • 21. tests (1) - transactional 3270 www.eranea.com 21 / 82 CICS DB2 Tomcat XML screen / kb data XML screen /kb data HTML XML screen / kb data bug fix : runtime / application (1) (2) (3) (4) if (1) & (3) different DRDA to DB2 (via JDBC) capture replay (batch or TP) code coverage measurements to quantify tests exhaustivity 100s / 1'000s captures triggers JAVA application programs sometimes still have example: 35'000 screens to cover 10M lines at 90% level bugs ... XML modified db lines
  • 22. tests – cross-ref captures <> pgms www.eranea.com 22 / 82
  • 23. tests – coverage <> business entities www.eranea.com 23 / 82
  • 24. tests – capture <> replay www.eranea.com 24 / 82
  • 25. NeaControlCenter (1) ● inventory tool for application assets – analysis of cross-references – full-text search engine ● console to define and monitor tests : – organization of capture / replay campaigns – automated validation of iso-functionality (screens / DB / files identical) – supervision of code coverage progress for application software www.eranea.com 25 / 82
  • 26. NeaControlCenter (2) ● monitoring / management console for transcoding factory : – status and progress for transcoding / compilations / packaging – status and progress for tests and rollouts ● monitoring / management console for opérations – exhaustive monitoring for transactional processing (sessions, TD, TS, SQL, MQ, ...) – launch + monitoring for status / progress of batch jobs ● 200+ screens and functions www.eranea.com 26 / 82
  • 27. dashboard – transcoding N www.eranea.com 27 / 82
  • 28. rollouts – TP instances www.eranea.com 28 / 82
  • 29. monitoring – user session www.eranea.com 29 / 82
  • 30. monitoring - batch job details www.eranea.com 30 / 82
  • 31. editor / viewer EBCDIC (ASCII) www.eranea.com 31 / 82
  • 32. project : standard steps initial presentation(s) technical workshop(s) in-depth analysis Proof of Concept www.eranea.com 32 / 82 proposal / contract solution / installation part 1 / part N client OK global validation detailed concept + business case / ROI N transactions + batch jobs fully running by customer
  • 33. conclusion ● x86 systems are simultaneously very strong (availability, performances) and most economically efficient in 2014 to support any large-scale mission-critical application ● Eranea proposes an extremely efficient and risk-free transformation solution : –massive costs savings (allowing project auto-financing) – deep technological transformation – based on unique migration methodology ● 2 keys for success : – savings and transformation (application + infrastructure) done in a single shot (<> pure « rehosting » like type Cobol-IT, MicroFocus limited to savings only without stategic benefits -> dead-end ?) – fluid and progressive migration → total absence of risks ● no disturbance / productivity loss for end-users ● rapid adaptation + adherence for developers www.eranea.com 33 / 82
  • 34. Thanks ! ● questions ? contact@eranea.com Eranea | Lausanne (Switzerland) www.eranea.com 34 / 82
  • 37. neaControlCenter monitoring : trancoding - rollout www.eranea.com 37 / 82
  • 38. dashboard - tasks www.eranea.com 38 / 82
  • 39. dashboard – transcodings www.eranea.com 39 / 82
  • 40. dashboard – transcoding N www.eranea.com 40 / 82
  • 41. dashboard – CICS API inventory www.eranea.com 41 / 82
  • 42. dashboard – SQL inventory www.eranea.com 42 / 82
  • 43. inventory - request www.eranea.com 43 / 82
  • 44. inventory – dependencies (1) www.eranea.com 44 / 82
  • 45. inventory – dependencies (2) www.eranea.com 45 / 82
  • 46. inventory – file display www.eranea.com 46 / 82
  • 47. dashboard - rollouts www.eranea.com 47 / 82
  • 48. dashboard – rollout status www.eranea.com 48 / 82
  • 49. dashboard – « hot » rollout www.eranea.com 49 / 82
  • 50. rollouts – TP instances www.eranea.com 50 / 82
  • 51. neaControlCenter tests : captures <> replays (examples for TP) www.eranea.com 51 / 82
  • 52. tests – cross-ref captures <> pgms www.eranea.com 52 / 82
  • 53. tests – coverage <> business org www.eranea.com 53 / 82
  • 54. tests – request on captures www.eranea.com 54 / 82
  • 55. tests – visualization of capture www.eranea.com 55 / 82
  • 56. tests – monitoring captures replay www.eranea.com 56 / 82
  • 57. tests – capture <> replay (1) www.eranea.com 57 / 82
  • 58. tests – capture <> replay (2) www.eranea.com 58 / 82
  • 59. neaControlCenter production : batch www.eranea.com 59 / 82
  • 60. batch monitoring - overall www.eranea.com 60 / 82
  • 61. batch monitoring – details (1) www.eranea.com 61 / 82
  • 62. batch monitoring – details (2) www.eranea.com 62 / 82
  • 63. batch – submission (out of scheduler) www.eranea.com 63 / 82
  • 65. editor / viewer EBCDIC (ASCII) www.eranea.com 65 / 82
  • 66. editor / viewer EBCDIC (ASCII) www.eranea.com 66 / 82
  • 67. neaControlCenter production : transactional processing www.eranea.com 67 / 82
  • 68. server monitoring - overall www.eranea.com 68 / 82
  • 69. JVMs monitoring - overall www.eranea.com 69 / 82
  • 70. db / messaging - status www.eranea.com 70 / 82
  • 71. db / messaging – connection details www.eranea.com 71 / 82
  • 72. monitoring - programs www.eranea.com 72 / 82
  • 73. monitoring sessions - overall www.eranea.com 73 / 82
  • 74. monitoring – user session details www.eranea.com 74 / 82
  • 75. queue monitoring (TD) - overall www.eranea.com 75 / 82
  • 76. queue monitoring (TD) - details www.eranea.com 76 / 82
  • 77. queue monitoring (TS) - overall www.eranea.com 77 / 82
  • 78. queue monitoring (TS) - details www.eranea.com 78 / 82
  • 80. market trends : why x86 2 new generations since then... www.eranea.com 80 / 82 Source : Phreshing since 2004, x86 > RISC & mainframe performances / functions / availability : x86 has come to par with RISC ! (at least...) Source : Intel
  • 81. market trends : h/w → x86 www.eranea.com 81 / 82 ● x86 is becoming standard ● sold per year: – 4'000 mainframes – 220'000 Risc servers : x 50 – 9'950'000 x86 servers : x 2'000 ● performances I/Os & CPUs : – x86 = Risc = M/F (→ Moore's Law...) – when architecture / setup is appropriate – much more cost efficient ! ● where innovation happens : – heavy R&D : ● Open Compute Project by Facebook – in-memory Dbs, flash arrays, ... – green IT – etc. Windows = lots of office automation servers source : Intel
  • 82. market trends : s/w → linux worldwide server market (roll-outs, subscriptions, shipments) Windows = lots of office automation servers www.eranea.com 82 / 82 ● linux (on x86) is growing fast ● proprietary systems disappear ● linux references (finance): London Stock Exchange, NYSE, Euronext, etc. ● for the “3S” : Speed, Stability, Security ● cost ≈ free – based on OSS – compared to z/OS NB : Eranea's solution is OS-agnostic and works on any platform supporting Java : Solaris, AIX, MS-Windows, z/OS, zLinux, etc.