Telecommunications market has been disrupted and Communications Service Providers (CSP) are at the point of relentless change. The shift to digital has created, on one side, new customer and partner expectations in products and services, type of engagement and level of control. On the other side Telcos are transitioning from CSPs to a Digital Service Provider (DSP) by unlocking service-centric operating model for greater agility driving network and IT convergence. The need to achieve the highest levels of adaptability, speed and efficiency to address market challenges of digital era. ZIRA DevOps toolchains and pipelines enabled the automation required by BH Telecom to practice continuous integration, continuous delivery and continuous operations without down-time utilizing specific software architecture models such as micro services and well documented APIs. ZIRA & BHT together drew up a structured approach covering People, Process & Technology to identify actions that improve practices across each of these categories. This DevOps Transformation covered the end-to-end software delivery lifecycle including an expanded set of stakeholders such as business owners and end users, and industry-proven practices. Continuous delivery was the desired future-state achieved with the application of a DevOps approach.

1. HOTEL EUROPE, October 19th, 2019
DevOps Transformation in BH Telecom
Case Study
Jasmin Ahmetbašić, Edin Husejnefendić

2. HOTEL EUROPE, October 19th, 2019

3. HOTEL EUROPE, October 19th, 2019
Agenda
01
02
03
History
IT (R) EVOLUTION
Road To Agility
DevOps Approach
04
05 Closing

4. HOTEL EUROPE, October 19th, 2019
Little bit of History
JU PAK

5. HOTEL EUROPE, October 19th, 2019
Little bit of History
JU PAK
X.25

6. HOTEL EUROPE, October 19th, 2019
Little bit of History

7. HOTEL EUROPE, October 19th, 2019
Little bit of history Present

8. HOTEL EUROPE, October 19th, 2019
Little bit of history Present
„The application development crisis"

9. HOTEL EUROPE, October 19th, 2019
Little bit of history Present
Time-to-market – 3 years!

10. HOTEL EUROPE, October 19th, 2019
IT (R)EVOLUTION
DIGITIZATION DIGITALIZATION DIGITAL TRANSFORMATION
It is the automation of a process by digitizing
information and injecting technology for the
purpose of automation.
Digitalization means turning interactions,
communications, business functions and
business models into (more) digital ones.
A profound and accelerating transformation of business
activities, processes, competencies and models to fully
leverage the changes and opportunities of digital
technologies and their impact across society in a strategic
and prioritized way.

11. HOTEL EUROPE, October 19th, 2019
IT (R)EVOLUTION
DIGITIZATION DIGITALIZATION DIGITAL TRANSFORMATION
It is the automation of a process by digitizing
information and injecting technology for the
purpose of automation.
Digitalization means turning interactions,
communications, business functions and
business models into (more) digital ones.
A profound and accelerating transformation of business
activities, processes, competencies and models to fully
leverage the changes and opportunities of digital
technologies and their impact across society in a strategic
and prioritized way.

12. HOTEL EUROPE, October 19th, 2019
BH Telecom Road to Agility
Time-to-market – 9 to 12 months!
Target: 4 weeks.
HOW?

13. HOTEL EUROPE, October 19th, 2019
BH Telecom Road to Agility
„How do you make sure people do things
how you want them to?“
You don’t.

14. HOTEL EUROPE, October 19th, 2019
BH Telecom Road to Agility

15. HOTEL EUROPE, October 19th, 2019
BH Telecom Road to Agility
SALES
CHANNELS
SMS
What are you
doing tonight?
Wanna go to
movies? USSD #111#*5WEB
BSSLAYER
JPP/JRK (UOM/CCM)
POSTPAID
PREPAID
FIX BPAK VPN BNET GSM
EXTERNAL
SYSTEMS
Call Center
Billing
GSM BNET
BPAK
VPN
FIX
FULFILLMENT SOA FUSION 11g
MEDIATOR – SALES CHANNELS HANDELING
OSSLAYER
TIS FIX
BIHPAK
INTERNET
PROVISIONING
ORDER
MANAGEMENT
HP
FMS

16. HOTEL EUROPE, October 19th, 2019
The Project Timeline
TO + 2
FIRST PHASE
13.04.2017
TO + 8
SECOND PHASE
13.10.2017
CONTRACT
13.02.2017
TO + 11
THIRD PHASE
13.01.2018
THE END
13.02.2018

17. HOTEL EUROPE, October 19th, 2019
The Project Timeline
TO + 2
FIRST PHASE
13.04.2017
TO + 8
SECOND PHASE
13.10.2017
CONTRACT
13.02.2017
TO + 11
THIRD PHASE
13.01.2018
THE END
13.02.2018

19. HOTEL EUROPE, October 19th, 2019
Architecture and Delivery
Processes
• ZERO Downtime for Application
Deployment and Scalability (CD/CI/
CO)
• Platform based on DevOps
practices
• Solution entirely based on
Microservices (securing
decomposition)
• Package (Agile) Continious
Current-state Architecture
Infrastructure
HAProxy
Virtualisation
Virtual Machine (VM Ware)
Backend (SpringBoot, RPM)
CCM
CCM IC
UOM
UOM IC
Authorization
UAA
PC
PC Runtime
Frontend
Product Catalog UI Common Customer Management UI
System Administration UIOrder Management UI
Authentication
Active Directory
DB Connectors
JDBC/JPA
PC IC
Application Factory
Registry
PC Util
CI / CD
Jenkins
Database Server(Oracle)
CUPROD UOM N2BREF N2BAPPREF PC
NGINX
JavaScript
AngularJS
API Gateway (ZUUL)
Billing 1..n Resource Mgmt Provisioning
Maven
Sonar Qube
Nexus
Ansible
Monitoring
Nagios
CGP/Collectd
ESB (Oracle Fusion Middleware)
IDE
Eclipse
Visual Studio Code
Test Tool
App Perfect Load
Inventory SAP

20. HOTEL EUROPE, October 19th, 2019
What is DevOps?
"DevOps is not technology or job role.
DevOps is CULTURE.
DevOps is MINDSET."

21. HOTEL EUROPE, October 19th, 2019
DevOps for Customers

22. HOTEL EUROPE, October 19th, 2019
Which DevOps Stack?

23. HOTEL EUROPE, October 19th, 2019
Our DevOps Stack

24. HOTEL EUROPE, October 19th, 2019
Monolithic vs Microservices
UI
Business
Logic
Data
Access
Layer
UI
Microservices Microservices Microservices Microservices
Microservices Microservices
Monolithic Architecture Microservices Architecture

25. HOTEL EUROPE, October 19th, 2019
• ZIRA DEV - Development
• ZIRA TEST – Functional Testing
• BHT DEV - Deployment, Functional Testing
• BHT TEST – E2E Testing, Pre-production
• BHT PROD – Production Release
Multiple Environments

26. HOTEL EUROPE, October 19th, 2019
DevOps Platform in BHT

27. HOTEL EUROPE, October 19th, 2019
Git->
Build->
Code validation->
Code testing->
Lib delivery->
Sanity testing>
Delivery->
Deployment->
Monitoring->
Git-> <-
DevOps Flow

28. HOTEL EUROPE, October 19th, 2019
Where is the Problem?

29. HOTEL EUROPE, October 19th, 2019
Who is Responsible for...?

30. HOTEL EUROPE, October 19th, 2019
Reading metrics and states from:
• Nagios
• Collectd
• Logs analyze
How to identify problem?

31. HOTEL EUROPE, October 19th, 2019
Continuous Monitoring

32. HOTEL EUROPE, October 19th, 2019
Continuous Monitoring
From prediction to decision making!

33. HOTEL EUROPE, October 19th, 2019
Nagios Monitoring
IT Infrastructure Monitoring
• Monitoring
• Alerting
• Graphing
• Reporting

34. HOTEL EUROPE, October 19th, 2019
Nagios Check Services

35. HOTEL EUROPE, October 19th, 2019
Nagios
Nagios – heart of monitoring!

36. HOTEL EUROPE, October 19th, 2019
Collectd

37. HOTEL EUROPE, October 19th, 2019
Collectd
Troubleshooting in the past –
improvement in the future.

38. HOTEL EUROPE, October 19th, 2019
Monitoring
• 27 servers BHT side
• ~1500 Nagios checks services BHT side
• ~200 Nagios hosts ZIRA side
• > 50 external integration points
• Data size: 1,2 TB
• Users from 1.504 offices
• Concurrent users: 500 in peak time.

39. HOTEL EUROPE, October 19th, 2019
Stability
Zero downtime High Availability
Continuous delivery Continuous Agile

40. HOTEL EUROPE, October 19th, 2019
Customer Happy

41. HOTEL EUROPE, October 19th, 2019
Closing

42. HOTEL EUROPE, October 19th, 2019
Closing
Agility is the new currency of business.

43. HOTEL EUROPE, October 19th, 2019
Reduced chance of product failure. Software delivered by DevOps teams is usually more fit-for-purpose and relevant to the
market thanks to the continuous feedback loop.
Improved flexibility and support. Applications built by DevOps teams are typically more scalable and easier to maintain due
to the use of microservices and cloud technologies (we’ll get to that later).
Faster time to market. App deployment becomes quick and reliable thanks to the advanced Continuous Integration (CI) and
automation tools DevOps teams usually rely on.
Better team efficiency. DevOps means collective responsibility, which leads to better team engagement and productivity.
Clear product vision within the team. Product knowledge is no longer scattered across different roles and departments
which means better process transparency and decision making.
DevOps Platform Advantages
DevOps implementation bring tangible ROI
Saving your time & resources increasing business velocity & competitiveness

44. Relatively outdated
technology
Manual deployments
Time To Market 9 to 12 months
Enhancements/year 30+
Deployment : 2+ hours with downtime
Time To Market 2 to 4 weeks
Enhancements/year 150+
Deployment : 10-20 minute with 0(zero) downtime
Technology and Functional Upgrade:
Product Catalog Configuration
Common Customer Management
Unified Order Management
TM Frameworkx Compliant
Adoption of DevOps principles
Automated Deployments
Microservice Architecture
Continuous Platform Monitoring
Summary
ZIRA
Solution
DevOps
Product Catalog Configuration
Common Customer Management
Unified Order Management

45. HOTEL EUROPE, October 19th, 2019

46. HOTEL EUROPE, October 19th, 2019
THANK YOU!