Infrastructure-as-Code with Puppet Enterprise in the Cloud - Evan Scheessele, HP

1. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Infrastructure-as-Code: with Puppet Enterprise in the Cloud PuppetConf 2014
Evan Scheessele
HP Printing & Personal Systems
Sept 23, 2014

2. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
2
What is Possible

3. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
3
Today’s Agenda
•The Cloud: “User Land”
•Transformation
•Infrastructure as Code: “executable documentation”
•Our project’s success with Puppet, Puppet Enterprise
•Iterate, Improve, Evolve

4. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Thanks:
Mike
James
Vishnu
Devlin
Nick
Dave
Gajanan
Maneesh
Dina
Rahmath
Mark
Skip

5. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
5
Who am I?

6. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
6

7. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
7

8. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
8
Cloud
?

9. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
9

10. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
10
Flying High
OpenStack Execution Environment: business application stacks, iterating quickly
Riding atop Cloud Administration (“OpenStack Superusers” under clouds, admin)

11. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
11
11

12. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
12

13. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
13
Applications

14. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
14

15. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
15
Driving Vision
Infrastructure as “Cattle” not “Pets”
Modern configuration-management means: Executable Documentation
“Infrastructure as Code”
Focus on the production-pattern, and automate it end-to-end
Everything is consistently reproducible

16. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
16

17. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
17

18. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
18

19. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
19
“Full Stack” Deployment Orchestration Map: OpenStack Cloud
E2E Orchestration: Automated provisioning of whole-stack topologies
Per-Instance Orchestrated Configuration Setup & Management (Puppet)
Business Application / Partner Business Code & Middleware: Ready to go!
Interaction
Interaction

20. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
20
“Full Stack” Deployment Orchestration Map: AWS Cloud
E2E Orchestration: Automated provisioning of whole-stack topologies
Per-Instance Orchestrated Configuration Setup & Management (Puppet)
Business Application / Partner Business Code & Middleware: Ready to go!
Interaction
Interaction

21. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
21

22. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
September 2013

23. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
23

24. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
24
An application ‘super- stack’ is comprised of:
•1 DBaaS (MySQL)
•5 Load-Balancers
•52 virtual machines,
•148 block-storage volumes (some boot-drives, many data-drives),
•~250 other virtual objects gluing everything together
•Net: ~450 'things'

25. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
25

26. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
26
Puppet Core Benefits (we use PE 3.3)
PuppetDB and its APIs – the org’s home-grown Dashboard: whole portfolio view
Puppet Console (PE):
Node status-tracking
Rake API for classification
Rake API for CA work: white-list, no auto-signing!
Hiera by environment (Integration, Master)
+ hiera-eyaml: A backend for Hiera that provides per-value
asymmetric encryption of sensitive data
+ further abstraction to our self-service “Service Directory”
Head-end stack
[its configs]
Workflow engine stack
[its configs]
Partner API
[Configs…]
Content vault stack [its configs]
3rd-party partner API
[configs]
etc

27. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
27
Puppet Core Benefits (More)
Developers may work with Puppet code too
MCO, via Console, and via Jenkins: deep stack-savvy code-roll orchestration
PE Best-practices: R10K, Roles/Profiles, splay
Clean and simple agent installer!

28. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
28
Puppet Enterprise
Support
Integration – tested, and it just works
Speed to success
Scale
Installer
Console and its Rake APIs (Ext Node Classifier)
Vetted and scalable practices and patterns:
R10K for dynamic environments,
Roles & Profiles
Backups and DR …

29. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
29

30. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
30
Iterate, Improve, Evolve
Structure of Puppet-Code: Role and Profiles, branches and feature toggles
(35 modules, 113 profiles and 129 roles)
Portfolio: 1 cloud to 2 clouds
3 applications to 17

31. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
31
Thanks (photos)
City-scape cloud photos are used with permission
© Sebastian Opitz @ ablazewithlight.com

32. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Thanks:
Mike
James
Vishnu
Devlin
Nick
Dave
Gajanan
Maneesh
Dina
Rahmath
Mark
Skip

33. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.
Questions?

34. © Copyright 2014 Hewlett-Packard Development Company, L.P. The information contained herein is subject to change without notice.