Measuring and showing progress is critical to drive technology adoption and ensure the success of your modernization effort. A wise customer once said, “If you thought getting people to believe digital transformation is possible was tough, wait until you try and convince people that you actually accomplished successful transformation.” Most people can relate! What is the language that describes digital transformation success? What are the success metrics of digital transformation that enterprises care deeply about? How does one know they are headed in the right direction? In this webinar, Pivotal and New Relic will cover how your teams can do the following: - Use lean principles and practices as applied to enterprise software delivery to measure transformation impact - Easily create dashboards to monitor business and strategic value delivered at every phase of your digital transformation journey - Ensure your entire stack—including infrastructure, cloud platform, applications, containers, and services—is tracking toward goals Speakers: Rajagopal Ramanujam, Director, Global Strategic Alliances, New Relic Bharat Raj, Technical Leader, Digital Intelligence, New Relic Kamala Dasika, GTM Lead for PCF Technology Partners, Pivotal

1. © Copyright 2018 Pivotal Software, Inc. All rights Reserved.© Copyright 2018 Pivotal Software, Inc. All rights Reserved. Version 1.0
Monitor and Measure
Your Way to Successful
Digital Transformation
Kamala Dasika
Product Marketing
Pivotal
@dasikakn
Raj Ramanujam
Director, Global Strategic Alliances
New Relic
Bharath Raj
Technical Leader, Digital Intelligence
New Relic

2. © Copyright 2018 Pivotal Software, Inc. All rights Reserved.
Digital Transformation is happening.
Source: Accelerate: 2018 State of DevOps

3. © Copyright 2018 Pivotal Software, Inc. All rights Reserved.
And the performance gap is real!
Source: Accelerate: 2018 State of DevOps

4. © Copyright 2018 Pivotal Software, Inc. All rights Reserved.
Digital Transformation Drivers
PEOPLE
Microservices Data Services
CI/CD Spring by Pivotal
Pivotal Container
Service (PKS)
Pivotal Cloud
Foundry (PCF)
TECHNOLOGYPROCESS

5. © Copyright 2018 Pivotal Software, Inc. All rights Reserved.
Outcomes Framework (Visual Representation)
New competitors &
business models
Changing customer
requirements
Comparatively
inefficient business
processes
Pressure on
administrative costs
Increasing security risks
Application
Outcomes
Technology
Outcomes
Pivotal-Enabled
Capabilities
Business
Outcomes
External
Forces
Revenue: Innovation to
drive growth,
profitability and market
share
Cost: Operational cost
savings to drive
profitability
Risk: Safeguards to
mitigate risk and ensure
service-level
compliance
How will custom
software impact the
realization of their
desired business
outcomes?
Which business
processes are the most
critical for custom
software to impact?
Which applications will
they be moving to the
platform and why? How
will they create value?
These will be specific to
the customer journey
Application
modernization (“AppTx”)
Innovative AppDev
(“Labs-led”)
Cloud-native Security
Platform as a Product
(“DevOps & Automation”)
Container Orchestration
(“PKS”)
Speed
Savings
Stability
Scalability
Security

6. © Copyright 2018 Pivotal Software, Inc. All rights Reserved.
Liberty Mutual: Modern AppDev: ‘Motorcycle Quote’ App
Emerging competitors
creating the need to
improve the new
customer experience for
buying motorcycle
insurance
Customers purchasing
motorcycle insurance
elsewhere may threaten
entire customer book of
business
Application
Outcomes
Technology
Outcomes
Pivotal-Enabled
Capabilities
Business
Outcomes
External
Forces
Revenue: Enable
customers to buy
motorcycle insurance
online (previously
unavailable)
“We need to be able to
quickly and iteratively test
and learn from our
customers to get new
products and capabilities
to market faster than we
were previously able to” -
Jonathan Reardon, Director
of IT
Motorcycle Quote App
Quote conversion:
Producing 11% ‘quote
to customer’
conversion rate (higher
than other feature-rich
applications)
Speed: Inception to MVP
in 28 days; pushed 45
updates to production in
the first 55 days
(shortening the customer
feedback loop)
Speed: From commit to
production in 10 minutes
Empowered, balanced
team
Microservices design
principles
Platform-enabled
operational automation
Platform-supported
automated test coverage
Platform-expedited
release pipelines
Source: https://pivotal.io/customers/liberty-mutual & https://builttoadapt.io/the-learning-never-stops-at-liberty-mutual-453a1bbeb70

7. © Copyright 2018 Pivotal Software, Inc. All rights Reserved.
Value Stream: The sequence of activities an
organization undertakes or requires to design,
produce, and deliver a good or service to a customer.
The best way to understand where problems start is by
performing an activity called value stream mapping.
The goal of the exercise to identify the steps inside a
process that get us into production by minimizing
waste.
Value Stream Mapping

8. © Copyright 2018 Pivotal Software, Inc. All rights Reserved.
Process, Required Resources and Timeline
Application
Portfolio
Analysis
App Dev VP(s)
& team(s)
Financial
Analysis &
Alignment
Finance
Aug
1
Aug
8
■
Understanding
of how
custom
ers cost and
build
out SDLC
MILESTONESMILESTONES
Sept 30
Oct 15
■ Execution
Value Stream
Mapping
App Dev, Ops
Leads and Teams
21
■
Defining
which
apps are
candidates for Cloud
Native inform
ing
end
ROI
and
execution
roadm
ap
■
Value Stream
Analysis
for a subset of apps or
app
team
’s determ
ined
by Application
portfolio
review
TIMELINE
■
Present findings
■
Recom
m
ended
next
steps - Platform
&
Apps
Sept 1 - 15
Executive Readout
and Execution Plan
IT Leadership
3 4
Business Case
Process Exec.
Review
IT Leadership
0
■
Executive Alignm
ent
Aug
1 - 31

9. © Copyright 2018 Pivotal Software, Inc. All rights Reserved.
Pivotal Cloud Foundry Business Case Categories
SPEED AND
AGILITY STABILITY
SAVINGSSCALABILITY
ROI
Security

10. © Copyright 2018 Pivotal Software, Inc. All rights Reserved.
Pivotal Cloud Foundry Business Case Categories
SPEED AND AGILITY
Initial Dev Setup
App Dev
Release Engineering
Day 2 Operations
STABILITY
High Availability
Blue/Green
Resilience
SAVINGS
Infrastructure Costs
Middleware
OS
Automation Software
SCALABILITY
Elasticity
Resource Utilization
ROI
Security

11. © Copyright 2018 Pivotal Software, Inc. All rights Reserved.
Ss One Level Down - Metrics by Persona
CIO/CTO
Lead Time across Portfolios
Velocity across Portfolios
Num of Releases (S/F) per
month per active app
% of Apps on a CD pipeline
Average response time for key
apps
MTTR across Portfolios
% of systems patched to latest
CVEs
VP of App Dev
Lead Time across a Portfolio
Velocity across a Portfolio
Num of Releases (S/F) per
month per active app
% of Apps on a CD pipeline
% of test coverage
% of auto tests failed
Average response time for key
apps
MTTR across Portfolio
VP of Infra
Average response time for key
apps
MTTR across Portfolios
% of systems patched to latest
CVEs
Lead Time across Portfolios
Key PCF Platform Metrics

12. © Copyright 2018 Pivotal Software, Inc. All rights Reserved.
How does Pivotal help you get there?
Time to Value in Days/Hours instead of Weeks/Months
Speed
Self-Service AppDev
“Just Push” apps
Microservices
Self Healing Apps
Unified apps Metrics
& Logs
CD Pipelines
Blue/Green
Stability
Self-Services Ops
Self Healing Platform
Multi-cloud
Root cause
Multi-tenancy
Unified
Platform/Services
Insights
HA/DR
Scalability
Zero Downtime App
and Platform
upgrades
Elastic and auto
scale up/down
Resource Utilization
Battle-Tested
Security
R – Repair
R – Repave
R – Rotate
Public Cloud Ready
Data Encryption
(Rest / in-flight)
Certifications
Savings
Operational
Efficiency
Developer
Productivity
Infrastructure
Consolidation
Middleware Takeout
OS Takeout

13. New Relic - helping customers move faster with confidence!
13©2008–18 New Relic, Inc. All rights reserved.
NEWR
NYSE – 2014
17k+
Customers
1.8B+
Scale: Events & Metrics Per Minute
14,000+ Disruptors2000+ Global Enterprises
Delivering the real-time insights that software-driven businesses need to innovate faster.
~45%
App Instances Reporting from AWS

14. 14
Instrument Everything
Bring it Together
Apply Intelligence
See the Connections
Alignment with Insight
OutliersError ProfilesBaselines
Service Maps Transaction TracesHealth Map
Browser
Apps
Mobile
On Premises
Relational Data
NoSQL
Data Store
On-Premises
Public Cloud
Micro
Services
A
P
I
Synthetic
customers
Customers
Apps
Apps
Customer
Experience
RadarAlerts
New Relic Platform: Instrumentation to Insight
Observe. Adapt. Align and Take Action

15. Cloud-Native Applications Journey
Web 1.0 Cloud Ready Cloud Friendly Cloud Resilient Cloud Native
Applications
Cloud-Native
Platform
Infrastructure
Microservices

16. 16
Instrument Everything
Bring it Together
Apply Intelligence
See the Connections
Alignment with Insight
OutliersError ProfilesBaselines
Service Maps Transaction TracesHealth Map
Browser
Apps
Mobile
On Premises
Relational Data
NoSQL
Data Store
On-Premises
Public Cloud
Micro
Services
A
P
I
Synthetic
customers
Customers
Apps
Apps
Customer
Experience
RadarAlerts
Observe. Adapt. Align and Take Action
New Relic
User Monitoring
Get Real Time User Experience
through New Relic Browser,
Synthetics and Mobile
New Relic Firehose Nozzle
(PCF Infrastructure)
PCF platform metrics and events data
captured and ingested into New Relic
New Relic Service Broker
(Application Monitoring)
PM for applications deployed on PCF
7 language agents:
java,.net,node.js,PHP, Ruby, Python, Go
PCF Integrations
New Relic for PCF : Instrumentation to Insight

17. ©2008–18 New Relic, Inc. All rights reserved
What Customers Care About
Productivity
Efficiency
Value
Developer
Operations
Business Owner / CXO

18. ©2008–18 New Relic, Inc. All rights reserved
Pivotal + New Relic | The Value Proposition
Visibility
Value
Velocity
Visibility across
the Pivotal stack
Business value
delivered at every phase
Accelerate new business
services to market
● End to end monitoring of PCF deployments
● Identify issues proactively, drive efficient devops and agile collaboration
● Increase developer productivity, operational efficiency and reduce risk
● Measure, enhance and quantify business value of the PCF deployments
● Business dashboards provide real-time measurement of business KPIs
● Showcase ROI, drive new revenue, save costs, increase sponsorship
● End to end insights - continuously benchmark your business performance
● Drive agile transformations, continuous improvements, overall business
agility, higher availability and SLAs and DevOps culture transformation
● Accelerate time to market, business agility and new business services

19. Developer Productivity
Operational Efficiency
Comprehensive Security
High Availability
SAVINGS
Pivotal + New Relic = Building a Value Ecosystem
Define | Measure | Optimize | Accelerate | Deliver
CIO
VP App
Dev
VP Ops
Velocity
Visibility
Value
SPEED STABILITY
SCALABILITY
Security
Pivotal 5S Value Framework

20. Accelerating Digital Transformation

21. Executive Value Drivers
User Experience
Ensure optimal user
experience across all
channels
Reduce downtime for
revenue critical systems
Consistent experience
regardless of load,
marketing events, new
features, etc
Decrease Business
Disruption
Business Agility
Reduce severity impact
events to your
applications
Reduce the time it takes
to recover from those
events
Enable easy root cause
detection for future
prevention
Increase developer
productivity to allow for
more business initiatives
Create environment for
rapid new feature and fix
deployment
Confidence for taking
innovative risks
Quantifiable savings
from reduced resolution
times
Measurable revenue
savings from decreased
disruptions
Reduction in total tickets
allows for savings in
resource-hours
Savings
Scalability
Speed Stability Scalability Stability Speed Stability Savings Stability
Speed SpeedScalability

22. Total Savings
Optimization of Time to Resolution
Developer Efficiency and Productivity
Increased Uptime
Increased User Experience
Increased Revenue Opportunities
User Satisfaction/Frustration
MTTR
System Uptime
So how do we accomplish this?
Front end performance
System Exhaustion
Transaction Volume and
Velocity
Feature and Bug Fix Velocity
Developer Productivity
Quality of Software Release
Translate and Track Business
Objectives to Quantifiable KPIs
● Business Disruption
● User Experience
● Business Agility
● Savings

23. Total Savings
Optimization of Time to Resolution
Developer Efficiency and Productivity
Increased Uptime
Increased User Experience
Increased Revenue Opportunities
User Satisfaction/Frustration
MTTR
System Uptime
So how do we accomplish this?
Front end performance
System Exhaustion
Transaction Volume and
Velocity
● Business Disruption
● User Experience
● Business Agility
● Savings
Feature and Bug Fix Velocity
Developer Productivity
Quality of Software Release
Speed
Stability
Scalability
Savings
Group KPIs into Actionable
Buckets

24. I’d like my user
experience to be
optimal.
In order to keep
user experience
optimal, we must
monitor and scale
appropriately.
Using New Relic
and Pivotal allow
us to scale and see
these changes.
Our users still have optimal
performance no matter the
load.
What does that really mean?
Business Objective

25. Confidential ©2008–17 New Relic, Inc. All rights reserved 25
Scalability Drives Operational Efficiency and High Availability

26. Confidential ©2008–17 New Relic, Inc. All rights reserved 26
Stability Drives High Availability and Operational Efficiency

27. Confidential ©2008–17 New Relic, Inc. All rights reserved 27
Speed Drives Developer Productivity and Operational Efficiency

28. Confidential ©2008–17 New Relic, Inc. All rights reserved 28
Savings Makes Executives Happy

29. Confidential ©2008–17 New Relic, Inc. All rights reserved 29
Executive Dashboard: Meeting Strategic and Business Objectives

30. Executive Value Drivers
User Experience
Ensure optimal user
experience across all
channels
Reduce downtime for
revenue critical systems
Consistent experience
regardless of load,
marketing events, new
features, etc
Decrease Business
Disruption
Business Agility
Reduce severity impact
events to your
applications
Reduce the time it takes
to recover from those
events
Enable easy root cause
detection for future
prevention
Increase developer
productivity to allow for
more business initiatives
Create environment for
rapid new feature and fix
deployment
Confidence for taking
innovative risks
Quantifiable savings
from reduced resolution
times
Measurable revenue
savings from decreased
disruptions
Reduction in total tickets
allows for savings in
resource-hours
Savings
Scalability
Speed Stability Scalability Stability Speed Stability Savings Stability
Speed SpeedScalability

31. Confidential ©2008–17 New Relic, Inc. All rights reserved
Cross-Platform Custom Dashboards and Real-Time Analytics for Every Project, Team, Audience and LOB
Enabling the Pivotal Transformation Journey
31
DevOps: Build/Deploy Automation, CI/CD, Developer Productivity KPIs
Cloud Native Adoption: Agile Development, Initial Deployments, Adoption KPIs
Baselining, Scoping, POC, Value Stream Engagements, Define KPIs
Plan
Digital Customer Experience and Business Transformation
driven by Cloud Foundry Business Value metrics / KPIs
Deploy Run
Cloud Native Readiness Optimization Transformation
Operations: Monitoring, Continuous Improvement, Agile Teams, Ops KPIs

32. Confidential ©2008–17 New Relic, Inc. All rights reserved
New Relic for PCF in Action

33. ©2008–18 New Relic, Inc. All rights reserved 33

34. ©2008–18 New Relic, Inc. All rights reserved
Our Challenge
34
West’s Challenge
We had a need and a desire as an
organization to transform and build a
cloud native platform that would
allow us to overcome the challenges
we faced.
Fragmented Tool
Set
A desire and a need to
consolidate tools within
the organization.
Over 600
Applications
600+ applications spread
across multiple verticals. A
diverse Portfolio.
Cost of Change
Change was slow and labor
intensive. Delivery Frequency
suffered.
Quality
We had a need to drive
quality up and increase
stability across our
products.

35. ©2008–18 New Relic, Inc. All rights reserved
West Corp - Value Delivered
35
80%
Effort Per
Release
0%100%100%
Tool
Availability
Application
Downtime
Application
Releases
Sev 1
Vulnerabilities
90%

36. Results:
Accelerated app migration to
microservices-based
architecture
End-to-end visibility into
application performance,
reliability & availability
More product development
experiments with less risk
Telco
North American
“New Relic and Pivotal Cloud Foundry are central to
the digital transformation initiative at West. The
dramatic shift to more modular, portable application
delivery with PCF are not without risks. New Relic
provides the safety net required to dramatically reduce
risk and speed our transformation with confidence.”
THOMAS SQUEO, SVP OF DIGITAL TRANSFORMATION
WEST CORP
Solution:
Testimony:

37. Customers finding success with Pivotal + New Relic…

38. Resources
● LEARN: Blog: Successful Digital Transformation with Pivotal
and New Relic:
● WATCH: Video: Path to Production: Value Stream Mapping
in a DevOps World
● TRY: Free Trial @ New Relic Pivotal Page
● VISIT: PCF Services Marketplace
● ENGAGE: Contact your Pivotal or New Relic team

39. © Copyright 2018 Pivotal Software, Inc. All rights Reserved.© Copyright 2018 Pivotal Software, Inc. All rights Reserved. Version 1.0
Monitor and Measure
Your Way to Successful
Digital Transformation
Kamala Dasika
Product Marketing
Pivotal
@dasikakn
Raj Ramanujam
Director, Global Strategic Alliances
New Relic
Bharath Raj
Technical Leader, Digital Intelligence
New Relic