Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

The right side of speed - learning to shift left

12 views

Published on

Many disciplines are on the wrong side of speed - there is a tradeoff with development speed and security, data science, compliance, etc. Let us look at disciplines that have succeeded in shifting left by integrating development, and learn successful patterns: testing, DevOps, agile, DataOps.

Published in: Software
  • Login to see the comments

  • Be the first to like this

The right side of speed - learning to shift left

  1. 1. www.scling.com The right side of speed - learning to shift left Lars Albertsson, Scling 1
  2. 2. www.scling.com Left is up 2 Winston W Royce: "Managing the development of large software systems"
  3. 3. www.scling.com Speed vs X tradeoff? security compliance Speed or quality operations tech debt 3
  4. 4. www.scling.com Enterprise culture - friction as a service analyst analyst architect architect developer developer risk manager vs risk manager security officer security officer tester tester ops engineer ops engineer 4
  5. 5. www.scling.com Is there a tradeoff? Separation pitches teams and interests against each other 5
  6. 6. www.scling.com Ghost of shifts past 70s - 90s: reign of waterfall 90s: flood of IT failures dot com crash 6
  7. 7. www.scling.com Extreme programming 7
  8. 8. www.scling.com A ladder to climb 8 Test certified program Google ~2006
  9. 9. www.scling.com Agile 9
  10. 10. www.scling.com Revenue models or role models 10Credits: @johncutlefish, @henrikkniberg
  11. 11. www.scling.com DevOps 11
  12. 12. www.scling.com No speed tradeoff! 12
  13. 13. www.scling.com Collaboration is 13 people workflows coupling / decoupling not tools
  14. 14. www.scling.com The most disruptive tech changes collaboration RDBMS version control GNU + Linux git + Github containers cloud Hadoop 14
  15. 15. www.scling.com Big data 15
  16. 16. www.scling.com Hadoop file storage batch processing single dimension database 16
  17. 17. www.scling.com Big data workflows immutable datasets functional transform processing data pipelines homogeneous, coordinated workflows 17
  18. 18. www.scling.com immutable datasets functional transform processing data pipelines homogeneous, coordinated workflows democratised data minimal operations minimal risk deployments reproducibility Big data workflows 18
  19. 19. www.scling.com Big data workflows immutable datasets functional transform processing data pipelines homogeneous, coordinated workflows democratised data minimal operations minimal risk deployments reproducibility 19 Real value of big data. Not achieved by late adopters.
  20. 20. www.scling.com Ghost of shifts present *Ops all the things 20
  21. 21. www.scling.com DataOps 21
  22. 22. www.scling.com Enterprise culture big data Hadoop / Spark / Flink + traditional workflows mutable data microservices functional teams heterogeneous data platform = worst of two worlds 22
  23. 23. www.scling.com Enterprise culture DevOps Kubernetes / cloud + test in staging handover deployment no prod access (Dev)Ops team ... 23
  24. 24. www.scling.com How to shift left common goals same definition of success incentives, not gateways common tools & environments common processes common teams 24
  25. 25. www.scling.com Craft - improving artifacts 25AMC Javelin, CZmarlin, https://commons.wikimedia.org/wiki/File:AMC_Javelin_1971-74_purple_blown_custom.JPG
  26. 26. www.scling.com Factory - improving processes 26 Lotus final assembly, Brian Snelson, https://www.flickr.com/photos/32659528@N00/2868525496 AMC Javelin, CZmarlin, https://commons.wikimedia.org/wiki/File:AMC_Javelin_1971-74_purple_blown_custom.JPG
  27. 27. www.scling.com 1994: OS/2 Warp CID installation 27 Grmbl, who reinstalled my machine?
  28. 28. www.scling.com IT craft to factory 28 Lotus final assembly, Brian Snelson, https://www.flickr.com/photos/32659528@N00/2868525496 AMC Javelin, CZmarlin, https://commons.wikimedia.org/wiki/File:AMC_Javelin_1971-74_purple_blown_custom.JPG Security Waterfall Application delivery Traditional operations Traditional QA Infrastructure DevSecOps Agile Containers DevOps CI/CD Infrastructure as code
  29. 29. www.scling.com Security Waterfall IT craft to factory 29 Application delivery Traditional operations Traditional QA Infrastructure DB-oriented architecture DevSecOps Agile Containers DevOps CI/CD Infrastructure as code Data factories, data pipelines, DataOps Lotus final assembly, Brian Snelson, https://www.flickr.com/photos/32659528@N00/2868525496 AMC Javelin, CZmarlin, https://commons.wikimedia.org/wiki/File:AMC_Javelin_1971-74_purple_blown_custom.JPG
  30. 30. www.scling.com DevSecOps 30 SECURITY
  31. 31. www.scling.com DevSecOps by induction validate security of system make secure easy validate security of changes ignore perfection - focus on delta 31
  32. 32. www.scling.com Ghost of shifts yet to come machine learning security compliance are still at ends with speed 32
  33. 33. www.scling.com MLOps 33 DATA SCIENCE
  34. 34. www.scling.com Naive ML 34
  35. 35. www.scling.com Towards sustainable production ML 35 Multiple models, parameters, features Assess ingress data quality Repair broken data from complementary source Choose model and parameters based on performance and input data Benchmark models Try multiple models, measure, A/B test
  36. 36. www.scling.com ComplianceOps 36 COMPLIANCE
  37. 37. www.scling.com ComplianceOps by induction validate compliance of system make compliant easy validate compliance of change ignore perfection - focus on delta 37
  38. 38. www.scling.com long game very long ladders recipes people & teams craft to process focus on delta Doing the shift 38
  39. 39. www.scling.com Doing the shift long game very long ladders recipes people & teams craft to process focus on delta learn faster by collaboration 39
  40. 40. www.scling.com Data value = data + domain expertise + data practices 40 Disrupt? https://xkcd.com/1831/ Adapt? + 1000s of failures...
  41. 41. www.scling.com Data value = data + domain expertise + data practices 41 Disrupt? https://xkcd.com/1831/ Adapt? + 1000s of failures...
  42. 42. www.scling.com Data value = data + domain expertise + data practices 42 Data lake Stream storage Client data + domain expertise Practices from data leaders Disrupt? https://xkcd.com/1831/ Collaborate? Data-value-as-a-service Adapt? + 1000s of failures...
  43. 43. www.scling.com The ghost of Winston W. Royce (1929-1995) 43
  44. 44. www.scling.com Tech has massive impact on society 44 Product? Supplier? Employer? Make an active choice whether to have an impact! Cloud?

×