Containers provide a portable, flexible way to deploy applications. Amazon EC2 Container Service (ECS) makes it easy to run and manage containers across a cluster of Amazon EC2 instances. With ECS, users define tasks that specify containers, resources, and dependencies. Services are used for long-running applications and provide load balancing, scaling, and recovery of unhealthy containers. ECS handles scheduling tasks across the cluster and replacing containers as needed.

1. © 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Chris Barclay
September 17, 2015
Running Microservices with Amazon EC2
Container Service

2. Agenda
Containers
Services
Cluster Management
Q&A

3. Containers

4. Containers
Portable
Flexible
Fast
EfficientServer
Guest OS
Bins/Libs Bins/Libs
App2App1

5. Services

6. Services evolve to microservices

7. Containers are natural for services
Simple to model
Any app, any language
Image is the version
Test & deploy same artifact
Stateless servers decrease change risk

8. A container pipeline
IT Operations
Base
Image
PatchesUtilities

9. A container pipeline
IT Operations
Base
Image
Ruby Redis Logger

10. A container pipeline
IT Operations Developer
Base
Image
App
Ruby Redis Logger

11. A container pipeline
IT Operations Developer
Base
Image
App
Ruby Redis Logger

12. A container pipeline
IT Operations Developer
Base
Image
Patches
App
Ruby Redis Logger

13. Continuous Deployment
Bucket
Amazon ECS
AWS CloudFormation
ECS Cluster

14. Service discovery
Load Balancers
DNS
Service discovery services

15. Service discovery
Load Balancers
ECS Service scheduler

16. Service discovery
DNS
http://weave.works/guides/service
-discovery-with-weave-aws-
ecs.html

17. Service discovery
Service discovery services
https://aws.amazon.com/blogs/co
mpute/service-discovery-via-
consul-with-amazon-ecs

18. Monitoring & logging
Docker logs
Container logs

19. Cluster Management

20. Server
Guest OS
Bins/Libs Bins/Libs
App2App1
Managing one resource is straightforward

21. Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Server
Guest OS
Managing a cluster is hard

22. Fleet management
Monitor utilization
Grow capacity
Security

23. State Management
Availability Zone 1 Availability Zone 2

24. Scheduling

25. Scheduling 101
Know your constraints
Find resources that meet the constraints
Request a resource
Confirm the resource

26. Define a service
Volume Definitions
Container Definitions

27. Define a service
Shared Data Volume
PHP App Time of day App

28. EC2 Container Service

29. Architecture

30. Easily Manage Clusters for Any Scale
Nothing to run
Complete state
Control and monitoring
Scale

31. Scalable

32. Flexible Container Placement
Applications
Batch jobs
Multiple schedulers

33. Designed for use with other AWS services
Elastic Load Balancing
Amazon Elastic Block Store
Amazon Virtual Private Cloud
AWS Identity and Access Management
AWS CloudTrail

34. Extensible
Comprehensive APIs
Open source agent
Custom schedulers

35. Task Definitions
{
"environment": [],
"name": "simple-demo",
"image": "my-demo",
"cpu": 10,
"memory": 500,
"portMappings": [
{
"containerPort": 80,
"hostPort": 80
}
],
"mountPoints": [
{
"sourceVolume": "my-vol",
"containerPath": "/var/www/my-
vol"
}
],
"entryPoint": [
"/usr/sbin/apache2",
"-D",
"FOREGROUND"
],
"essential": true
},
{
"name": "busybox",
"image": "busybox",
"cpu": 10,
"memory": 500,
"volumesFrom": [
{
"sourceContainer": "simple-demo"
}
],
"entryPoint": [
"sh",
"-c"
],
"command": [
"/bin/sh -c "while true; do
/bin/date > /var/www/my-vol/date; sleep 1; done""
],
"essential": false
}

36. {
"environment": [],
"name": "simple-demo",
"image": "my-demo",
"cpu": 10,
"memory": 500,
"portMappings": [
{
"containerPort": 80,
"hostPort": 80
}
],
"mountPoints": [
{
"sourceVolume": "my-vol",
"containerPath": "/var/www/my-
vol"
}
],
"entryPoint": [
"/usr/sbin/apache2",
"-D",
"FOREGROUND"
],
"essential": true
},
Task Definitions
[
{
"image": "mysql",
"name": "db",
"cpu": 10,
"memory": 500,
"essential": true,
"entryPoint": [
"/entrypoint.sh"
],
"environment": [
{
"name": "MYSQL_ROOT_PASSWORD",
"value": "pass"
}
],
"portMappings": []
}
]
Essential to our Task
Create and mount volumes
Expose port 80 in container
to port 80 on host
10 CPU Units (1024 is full CPU),
500 Megabytes of Memory

37. {
"name": "busybox",
"image": "busybox",
"cpu": 10,
"memory": 500,
"volumesFrom": [
{
"sourceContainer": "simple-demo"
}
],
"entryPoint": [
"sh",
"-c"
],
"command": [
"/bin/sh -c "while true; do
/bin/date > /var/www/my-vol/date; sleep 1; done""
],
"essential": false
}
Task Definitions
[
{
"image": "tutum/wordpress-stackable",
"name": "wordpress",
"cpu": 10,
"memory": 500,
"essential": true,
"links": [
"db"
],
"entryPoint": [
"/bin/sh",
"-c"
],
"environment": [
…
],
"portMappings": [
{
"containerPort": 80,
"hostPort": 80
}
]
},
]
From Docker Hub
Mount volume from other container
Command to exec

38. Tasks
Container
Instance
Schedule
Shared Data Volume
PHP App Time of day App
Shared Data Volume
PHP App
Time of
day App

39. Services
Good for long-
running applications
and services

40. Services
Load Balance traffic across containers
Automatically recover unhealthy containers
Discover services
Shared Data Volume
PHP
App
Time of
day
App
Shared Data Volume
PHP
App
Time of
day
App
Shared Data Volume
PHP
App
Time of
day
App
Elastic Load Balancing

41. Update Service
Scale up
Scale down
Elastic Load Balancing
Shared Data Volume
PHP
App
Time of
day
App
Shared Data Volume
PHP
App
Time of
day
App
Shared Data Volume
PHP
App
Time of
day
App
Shared Data Volume
PHP
App
Time of
day
App

42. Update Service
Deploy new version
Drain connections
Elastic Load Balancing
Shared Data Volume
PHP
App
Time of
day
App
Shared Data Volume
PHP
App
Time of
day
App
Shared Data Volume
PHP
App
Time of
day
App

43. Update Service
Deploy new version
Drain connections
Shared Data Volume
PHP
App
Time of
day
App
Shared Data Volume
PHP
App
Time of
day
App
Shared Data Volume
PHP
App
Time of
day
App
Elastic Load Balancing

44. Update Service
Deploy new version
Drain connections
Shared Data Volume
PHP
App
Time of
day
App
Shared Data Volume
PHP
App
Time of
day
App
Elastic Load Balancing
Shared Data Volume
PHP
App
Time of
day
App

45. Walk through

46. Typical user workflow
I want to run a service

47. Typical user workflow
Run Instances Amazon
EC2
Use custom AMI with
Docker support and
ECS Agent. Instances
will register with
default cluster.

48. Typical user workflow
Create Task Definition
Declare resource
requirements for
containers
Shared Data Volume
PHP App
Time of day
App

49. Typical user workflow
Create Service
Declare resource
requirements for
service
Shared Data Volume
PHP App
Time of day
App
Elastic
Load
Balancing
X 5

50. Typical user workflow
Describe Service

51. Q&A