A talk given at the 2016-07-26 edition of the Bay Area AWS Meetup. Covers the Spinnaker Continuous Delivery platform from Netflix.

1. Spinnaker
Bay Area AWS User Group
July 26th, 2016
Shifting the Curve Towards Reliable and Cost Effective Cloud Operations

2. Assumed Knowledge
* Cloud Deployment (doesn't have to be AWS)
* Continuous Delivery and the value of repeatable deployment pipelines
* Immutable Infrastructure
* Red/Black (or Blue/Green) Deployments

3. How many teams deploy more than once per day?

4. How many teams deploy more than twice per day?

5. How many teams deploy more than ten times per day?

6. How many teams deploy more than fifty times per day?

7. Deployments (by day)
1000
2000
3000
4000
May June July

9. This all sounds great ... but HOW?

10. https://flic.kr/p/56suBd

11. https://flic.kr/p/56suBd
Tools

12. https://flic.kr/p/56suBd
Tools
Culture

13. https://flic.kr/p/56suBd
Tools
* Asgard
Culture

14. https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
Culture

15. https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
* Jenkins
Culture

16. https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
* Jenkins
* Spinnaker
Culture

17. https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
* Jenkins
* Spinnaker
Culture
* Freedom and Responsibility

18. https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
* Jenkins
* Spinnaker
Culture
* Freedom and Responsibility
* Context over Control

19. https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
* Jenkins
* Spinnaker
Culture
* Freedom and Responsibility
* Context over Control
* Microservices

20. https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
* Jenkins
* Spinnaker
Culture
* Freedom and Responsibility
* Context over Control
* Microservices
* Run what you build

21. https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
* Jenkins
* Spinnaker
Culture
* Freedom and Responsibility
* Context over Control
* Microservices
* Run what you build
* No dedicated DevOps

22. https://flic.kr/p/56suBd
Tools
* Asgard
* Mimir
* Jenkins
* Spinnaker
Culture
* Freedom and Responsibility
* Context over Control
* Microservices
* Run what you build
* No dedicated DevOps
Contributors
* 8 engineers from Netflix (Delivery Engineering)
* 6 engineers from Google
* 3 engineers from Microsoft
* 1 engineer from Pivotal
+ numerous open-source committers (Target, Veritas, Full
Contact, Stitch Fix etc.)

23. Running @ Netflix
* Layer custom components and configuration over open source JARs (Bintray)
* No forking
* Dedicated cluster for every Spinnaker service
* Dedicated datastore for every Spinnaker service
* Authentication via SAML or x509
https://flic.kr/p/cpijTm

24. Running @ Netflix
* Layer custom components and configuration over open source JARs (Bintray)
* No forking
* Dedicated cluster for every Spinnaker service
* Dedicated datastore for every Spinnaker service
* Authentication via SAML or x509
Supporting Systems
* Atlas
* Eureka (aka Discovery)
* Automated Canary Analysis (aka ACA)
* Chronos (event tracking)
* Lemur (x509 Certificate Manager)
https://flic.kr/p/cpijTm

25. Running @ Netflix
* Layer custom components and configuration over open source JARs (Bintray)
* No forking
* Dedicated cluster for every Spinnaker service
* Dedicated datastore for every Spinnaker service
* Authentication via SAML or x509
Supporting Systems
* Atlas
* Eureka (aka Discovery)
* Automated Canary Analysis (aka ACA)
* Chronos (event tracking)
* Lemur (x509 Certificate Manager)
Extensions
* Additional Cloud Provider (Titus)
* Internal Spot Market (Reservation Reports)
* Canaries
* Fast/Dynamic Properties
* Application-specific IAM roles
* Service Migration (EC2 Classic -> VPC)
https://flic.kr/p/cpijTm

26. What does a Netflix engineer really care about?

27. Application

28. Application
Multiple
Accounts

29. Application
Multiple
Accounts
Multiple
Regions

30. Application
Multiple
Accounts
Multiple
Regions
ScalingPolicies

31. Application
Multiple
Accounts
Multiple
Regions
ScalingPolicies
Discovery

32. Application
Multiple
Accounts
Multiple
Regions
ScalingPolicies
DiscoveryELB

33. Application
Multiple
Accounts
Multiple
Regions
ScalingPolicies
DiscoveryELB
*
500+

34. Application
Multiple
Accounts
Multiple
Regions
ScalingPolicies
DiscoveryELB
ControlPlane
*
500+

35. Application
Multiple
Accounts
Multiple
Regions
ScalingPolicies
DiscoveryELB
ControlPlane
*
500+
Pager Duty
Chaos
Monkey
AtlasEdda
Discovery /
Eureka
Integrations
Jenkins

36. Lessons Learned

37. Lessons Learned
* Adoption does not come for free!

38. Lessons Learned
* Adoption does not come for free!
* Spinnaker Office Hours

39. Lessons Learned
* Adoption does not come for free!
* Spinnaker Office Hours
* Operational Metrics and Dashboards

40. Lessons Learned
* Adoption does not come for free!
* Spinnaker Office Hours
* Operational Metrics and Dashboards
* Ask yourself ... What could Spinnaker have done to prevent this
outage?

41. Lessons Learned
* Adoption does not come for free!
* Spinnaker Office Hours
* Operational Metrics and Dashboards
* Ask yourself ... What could Spinnaker have done to prevent this
outage?
* Deploy Spinnaker with Spinnaker

42. Lessons Learned
* Adoption does not come for free!
* Spinnaker Office Hours
* Operational Metrics and Dashboards
* Ask yourself ... What could Spinnaker have done to prevent this
outage?
* Deploy Spinnaker with Spinnaker
* Teams with embedded QA have much tighter integrations with
Spinnaker

43. Spinnaker in Action
(Demo)

44. Adam Jordens
@ajordens
Tomas Lin
@tomaslin

45. We're Hiring.
and accepting pull requests!

46. Further Reading
http://spinnaker.io
http://join.spinnaker.io (Slack)
http://techblog.netflix.com
https://continuousdelivery.com/implementing/patterns