This document discusses accelerating DevOps pipelines with AWS. It introduces common DevOps challenges around slow development processes and infrastructure issues. It then summarizes AWS services for the full development pipeline including Elastic Beanstalk for deploying apps, OpsWorks for managing apps and infrastructure, and CloudFormation for infrastructure as code. Code services like CodeCommit, CodePipeline, and CodeDeploy help with source control, CI/CD, and deploying code. Other services like Lambda, S3, Config, and ECS are also discussed for building DevOps workflows.

1. ©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved
Accelerating DevOps Pipelines with AWS
Konstantin Wilms, Solutions Architect
Rick Houlihan, Solutions Architect

2. ‘Ops is slowing us down’

3. ‘Devs are going to break things’

4. ‘We can’t train everyone’

5. Background
The End to End Development Pipeline

7. Production
Build
QA,
Integration
& Test
Staging
Artifacts

8. Manage Store Build DeployCode

9. MonitorProvisionDeployTestBuildCode
Elastic Beanstalk
OpsWorks
Cloud
Watch
Cloud
Formation
Code
Deploy
Code
Commit
Code
Pipeline
Integration
Development / QA / I&T Operations
DeploymentAgile
EC2

11. Artifacts – code, data, binaries,
containers? …

12. ‘Where do we start?’

13. Infrastructure Core
Base Level Design

14. MFA,
Users,
Groups,
Roles
Linked
Accounts,
Alerts
Resource
Separation
Log &
Audit
CloudFormation

15. Self Service
DIY – Sometimes at a Cost

16. • BYOS
– Flexibility - but sometimes at a time+complexity price
• Dependency Hell
– Cross-functional – OSS + Commercial 3rd Party
• Integration
– Problematic - multiple GUIs, services, etc. often NAS bound
• Portable
– Most ‘compatible’ with lift and shift (in and out) – to a point

17. Custom AMIs CloudInitVM ImportMarketplace

18. Infrastructure Services
Overview &ApplicationAreas

20. Elastic Beanstalk
Quickly Deploy & ManageApplications

21. • Fast and Simple
– Upload code and deploy in minutes, multi-version capable
• Developer Productivity
– Focus on the code and not the infrastructure
• Impossible to Outgrow
– Resilience & scalability are built in
• Complete Resource Control
– Full control over deployed infrastructure

24. OpsWorks
Model & Manage the Entire Stack

25. • Supports any Application
– Any architecture via custom Chef recipes, bash scripts & configs
• Configuration as Code
– Define and deploy from source repositories
• Automation to run at Scale
– Dynamic configuration and orchestration
• Resource Organization
– Logically organize and apply permissions to resources

26. Stack

27. OpsWorks Stack
Define
Instance
On-Prem
Install
Agent
Stack
Integration

28. CloudFormation
Infrastructure as Code

29. • Easy to Use & Repeatable
– ‘Describe anything’ via simple JSON-based syntax
• Full Control
– Open-ended template-based deployment, Callbacks, Triggers
• Customized via Parameters
– Customize templates at run-time for specific use cases
• Introspective Deployment
– Build by hand and abstract with CloudFormer

31. Create
Skeleton
Define
Resources
Execute

32. Service Catalog
CloudFormation as a Product

33. • Product Catalog
– Create custom catalogs containing products incorporating
standard CloudFormation architectures and configurations
• Centralized Control
– Provides IT with central management over portfolio of services
that end users can browse and launch
• Full Integration
– Integration with existing self service systems via rich APIs

34. Create
Portfolio
Define
Product
Attach
Template
Add
Constraints

35. Code Services
CodeCommit, CodePipeline, CodeDeploy

36. • CodeCommit
– Fully managed source control service for hosting private Git
repositories
• CodePipeline
– Standardizes and automates your software release process,
allowing you to rapidly release new features to users
• CodeDeploy
– Deploys your released code to a "fleet" of EC2 instances

37. Code
Commit
Code
Pipeline
Code
Deploy

38. CodeCommit CodePipeline CodeDeploy

39. Summary
Wrap Up & Some Things We Missed

40. • AWS Lambda & Amazon S3 Events
– Use to plumb up a simple artifact-based CI/CD workflow
– Process all your ancillary data types – media, thumbs, etc.
• AWS Config
– Continuously track configuration changes to your infrastructure
– Use for Audit, Discovery, Troubleshooting
• Amazon EC2 Container Service
– Highly scalable, performant container management service
– Docker containers, custom scheduler

42. CHICAGO