The Accelerate State of DevOps Report is the result of five years of research—with over 30,000 data points—to understand high performance in the context of software development, and the factors that predict it. In this webinar, we discuss the key findings in the 2018 report. Join us to learn how: - Software delivery performance unlocks several competitive advantages including increased profitability, productivity, market share, customer service, and ability to achieve organization or mission goals. - Not just using cloud infrastructure, but implementing cloud as it’s intended to be used, contributes to high performance - Outsourcing may save money in the short term, but is much more likely to contribute to low performance - Identifying key technological practices can drive high performance across your organization (and evidence that industry vertical doesn’t matter) Dr. Nicole Forsgren is Co-founder, CEO and Chief Scientist at DevOps Research and Assessment (DORA) and co-author of the book Accelerate: The Science of Lean Software and DevOps. She is best known for her work measuring the technology process and as the lead investigator on the largest DevOps studies to date. In former lives, she’s been a professor, sysadmin, and performance engineer. Richard Seroter is a Senior Director of Product for Pivotal, a 10-time Microsoft MVP for cloud, an instructor for developer-centric training company Pluralsight, the lead InfoQ.com editor for cloud computing, and author of multiple books on application integration strategies. As a Senior Director of Product at Pivotal, Richard heads up product marketing and helps customers see how to transform the way they build software. Richard maintains a regularly updated blog (seroter.wordpress.com) on topics of architecture and solution design and can be found on Twitter as @rseroter.

1. © Copyright 2017 Pivotal Software, Inc. All rights Reserved. Version 1.0
Dr. Nicole Forsgren, DORA
Richard Seroter, Pivotal
October 11, 2018
The Accelerate State of
DevOps Report

2. About today’s
webinar
Impactful data, world-class hosts
Review key findings from the “Accelerate: State of
DevOps Report” conducted by Nicole and team.
Explore practices used by elite performers.
Look at differences from the findings of previous
years.
Offer takeaways for your team and organization.
Send questions in along the way, and we’ll address
them at the end!

3. Meet your hosts!
Dr. Nicole Forsgren
Lead investigator, PhD
CEO and Chief Scientist, DORA
Diet Coke lover
Richard Seroter
Senior Director of Product
Pivotal
Coke Zero aficionado

4. Topic deep dive
On to the report!

5. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.5
● Largest and longest-running research of its kind
● 5 years of rigorous research, surveying 30,000+ professionals worldwide
● Investigates practices that lead to higher software delivery performance
● Higher software delivery performance = powerful business outcomes
● Only report to include performance benchmarks with cluster analysis
● Predictive analysis to identify specific improvement strategies
The Accelerate: State of DevOps Report

6. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.6 © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Software Delivery and
Operational performance
(SDO performance)
2018 - Key Themes
SDO performance is the driver that
unlocks competitive advantages for IT
organizations.
SDO performance is the practice
behind not just creating, but also
operating, software in ways that
generate powerful business outcomes.

7. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.7 © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Identify the key
Technical Practices
that drive SDO performance
2018 - Key Themes
The Accelerate: State of DevOps
Report confirms findings from previous
years.
New for 2018, key technical practices
include:
● Monitoring and observability
● Continuous testing
● Database change management
● "Shifting left" on security

8. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.8 © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Identify the key
Cultural Practices
that drive SDO performance
2018 - Key Themes
The Accelerate: State of DevOps
Report confirms the Westrum cultural
model from previous years.
New for 2018! How to influence
culture through organizational work:
● Influencing culture through
autonomy & trust
● Creating a culture of learning
(retrospectives)

9. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.9
Key Findings - Elite Performers

10. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.10
Key Findings - Year over Year

11. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.11
2018: Key Differences

12. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.12 © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Adding Availability
Ability for teams to ensure their
product or service can be accessed
by end users
Software delivery +
operational performance is
SDO performance
Elite performers are
3.5X more likely to have strong
availability practices

13. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.13 © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Elite Performers
Data shows a new 4th high
performance group:
elite performers
Proportion of high performers has
grown YoY, but the bar for
excellence remains high
Elite performers are still able to
optimize for throughput and stability

14. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.14
Key Topics of Interest

15. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.15
New 2018 Performance Benchmarks

16. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.16 © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Doing Cloud Right
It's not just about adopting cloud, it’s
using cloud in essential ways that
matters.
Only 22% of teams are doing cloud
right
Teams that use these essentials
characteristics are 23X more likely
to be elite performers
AGREED OR STRONGLY AGREED
On-demand self-service
Broad network access
Resource Pooling
Rapid elasticity
Measured service

17. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.17 © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Open Source Software
The data shows that using open
source software is correlated with
high SDO performance
Teams that use open source
software are 1.75X more likely to be
elite performers
Those same teams are also
1.5X more likely to expand their
open source usage in future

18. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.18 © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Industry Doesn’t Matter
Industry does not matter for
achieving high performance for
software delivery
High performers exist in both non-
regulated and
highly regulated industries alike
Any team in any industry has the
potential to achieve a high degree of
SDO performance

19. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.19 © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Don’t Forget the Database
Integrating database work into
software delivery positively
contributes to SDO performance
Integrating database practices look
much like integrating ops work in
early days: communication, config
management, including teams,
visibility
Teams could think about this like
“shifting left”

20. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.20 © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
An Evolution in Testing
Automated testing played a role in
prior years’ research. We
investigated if the evolving role of
testing in continuous delivery
contributes.
Continuous testing extends
automated testing practices and
positively contributes to SDO
performance

21. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.21 © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Looking Into Our Systems
Teams with a comprehensive
monitoring and observability
solution were 1.3 times more likely
to be an elite performer.
Having a monitoring and
observability solution positively
contributed to SDO performance.
Fun stats fact: monitoring and
observability load together.

22. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.22
Deeper Analysis

23. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.23
Surprises

24. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.24 © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Misguided Performers
Some teams optimize for caution:
low deploy frequency, high lead
times, and low deployment failure
That same group also reports the
longest times to restore service
for outages (1-6 months!)
Large-batch changes add
complexity & no one thinks it will
happen to them, but 5% of teams
suffer the consequences

25. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.25
The J-Curve of Transformation
Teams begin
transformation
and identify
quick wins
Automation helps low
performers progress to
medium performers
Automation increases test
requirements, which are dealt
with manually. A mountain of
technical debt blocks progress.
Technical debt and increased
complexity cause additional manual
controls and layers of process around
changes, slowing work
Relentless improvement
work leads to excellence
and high performance!
High and elite
performers leverage
expertise and learn from
their environments to
see jumps in productivity

26. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.26 © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.
Outsourcing
Low performing teams are
3.9X more likely to use
functional outsourcing than
elite teams
Elite teams rarely adopt
functional outsourcing
Misguided performers have the
highest use of outsourcing
of all groups

27. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.27
Major Takeaways

28. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.28
Ways to Improve SDO Performance
● Adopting essential cloud characteristics is key to truly realizing benefits
● Organizations need to make smart investments in technology, lean
practices and culture -- holistic transformation is important
● The data on functional outsourcing is in, and it’s decisive: this is not a
winning bet
● Optimize for throughput, stability, and availability

29. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.29 http://devops-research.com © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.http://devops-research.com
Download the full
report
https://cloudplatformonline.com/2018-state-of-devops.html

30. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.30
Report Authors
The DORA Cofounders
Dr. Nicole Forsgren: PhD, sysadmin, scientist, author of Accelerate, named top 10 influencer in DevOps
Jez Humble: Author of Accelerate, Continuous Delivery, Lean Enterprise, and The DevOps Handbook
Gene Kim: Founder of Tripwire Inc, author of Accelerate, The Phoenix Project, DevOps Handbook, & more
Many thanks to George Miranda and Xavier Velasquez for their contributions to the report. Cheryl Coupe was our
copyeditor and Siobhan Doyle did design. We also thank those who assisted with research advice and guidance.

31. © 2018, DevOps Research and Assessment, LLC. All Rights Reserved.31
Gold Sponsors
Diamond Sponsor

32. Questions?
@nicolefv
@rseroter
https://devops-research.com/
https://cloudplatformonline.com/2018-state-of-devops.html
https://pivotal.io/platform
https://pivotal.io/devops

33. Transforming How The World Builds Software
© Copyright 2017 Pivotal Software, Inc. All rights Reserved.