1. ARCHITECTING
FOR AWS
Carlos Conde │Solutions Architect

2. 1. ELASTICITY
2. DESIGN FOR FAILURE
3. LOOSE COUPLING
4. SECURITY
5. PERFORMANCE

3. # 1
ELASTICITY
●○○○○

4. AMAZON EC2
ELASTIC COMPUTE CLOUD

6. AMAZON
CLOUDWATCH
MONITORING FOR AWS RESOURCES

8. AUTO SCALING
SCALE UP/DOWN EC2 CAPACITY

10. ELASTIC LOAD
BALANCING
NETWORK TRAFFIC DISTRIBUTION

12. 6 am

13. 10 am

14. 10 am

15. 10 am

16. 7 pm

17. 7 pm

18. 7 pm

19. without elasticity you can't accelerate

20. what you really need is…
…adjustable capacity

21. # 2
DESIGN FOR FAILURE
●●○○○

22. « Everything fails
all the time »
Werner Vogels
CTO of Amazon

23. YOUR GOAL
Applications should continue to function even if
the underlying physical hardware fails or is
removed or replaced

24. Avoid single points of failure.
Assume everything fails, and design
backwards.

25. Avoid single points of failure.
Assume everything fails, and design
backwards.

27. AMAZON RDS
RELATIONAL DATABASE SERVICE

30. AMAZON
ROUTE 53
DOMAIN NAME SERVICE

35. AMAZON RDS
MULTI-AZ
DEPLOYMENT

40. AMAZON CLOUDWATCH
ALARMS

49. AWS BUILDING BLOCKS
Inherently Fault-Tolerant Services Fault-Tolerant with
the right architecture
 Amazon S3  Elastic Load
Balancing  Amazon EC2
 Amazon SimpleDB
 AWS IAM  Amazon EBS
 Amazon DynamoDB
 AWS Elastic  Amazon RDS
 Amazon CloudFront Beanstalk
 Amazon SWF  Amazon VPC
 Amazon
 Amazon SQS ElastiCache
 Amazon SNS  Amazon EMR
 Amazon SES  Amazon
CloudSearch
 Amazon Route53

51. NETFLIX
CHAOS MONKEY

53. # 3
LOOSE
COUPLING
●●●○○

54. BUILD LOOSELY
COUPLED SYSTEMS
The looser the are coupled,
the bigger they scale

55. Create independent components

56. Create independent components
Design everything as a Black Box

57. Create independent components
Design everything as a Black Box
Think in terms of services

58. TRANSCODE
RECEIVE
& PUBLISH

59. TRANSCODE
RECEIVE
& PUBLISH
QUEUE

62. AMAZON SQS
SIMPLE QUEUE SERVICE

65. START
CHECK
REJECT STOP
VIDEO
YES
NO
TOO SPAM PUBLISH
SPAM?
LONG? CHECK & NOTIFY
YES NO
SHORTEN
TRANSCODE
VIDEO

68. MAINTENANCE
AUDITABILITY
FLEXIBILITY
LOW-LEVEL

69. WHAT ARE WE
TRYING TO DO?

70. START
CHECK
REJECT STOP
VIDEO
YES
NO
TOO SPAM PUBLISH
SPAM?
LONG? CHECK & NOTIFY
YES NO
SHORTEN
TRANSCODE
VIDEO

71. START
CHECK
REJECT STOP
VIDEO
YES
NO
TOO SPAM PUBLISH
SPAM?
LONG? CHECK & NOTIFY
YES NO
SHORTEN
TRANSCODE
VIDEO

72. START
CHECK
REJECT STOP
VIDEO
YES
NO
TOO SPAM PUBLISH
SPAM?
LONG? CHECK & NOTIFY
YES NO
SHORTEN
TRANSCODE
VIDEO

73. TASKS
DECISIONS STATELESS !
HISTORY

74. STATELESS SCALES
HORIZONTALLY

75. AMAZON SWF
WORKFLOW SERVICE FOR SCALABLE,
RESILIENT APPLICATIONS

76. AMAZON SWF
Keeps track of :
 State
 Executed tasks
 Timeouts
 Errors

77. WORKFLOW
ACTORS

78. DECIDERS
COORDINATION LOGIC
1. Poll for work on a decision list
Long polling: 60 seconds
2. Evaluate workflow execution history
SWF sends full history in JSON format
3. Return decision to Amazon SWF
Usually scheduling another task

79. WORKERS
COORDINATION LOGIC
1. Poll for work on a specific task list
Long polling: 60 seconds
2. Execute works, send heartbeats
SWF sends input data from deciders
3. Return success / failure
Detailed data can be provided to deciders

82. ALL
HORIZONTAL SCALING
PATTERNS APPLY

89. NO NEW LANGUAGE
TO LEARN
YOUR CODE IS YOUR WORKFLOW LANGUAGE
SWF MAINTAINS STATE

90. AWS FLOW
FRAMEWORK
Java Library • Entire workflow can be
expressed in sequential code •
Integrated with Java Utils API

91. CHAINED TASKS
WITHOUT DECISIONS?
RECEIVE TRANSCODE NOTIFY
use AMAZON SQS

92. TASK GRAPH
WITH DECISIONS?
GOOD OK
RECEIVE CHECK SPAM
TRANSCODE
VIDEO LENGTH CHECK
LONG SPAM
SHORTEN PUBLISH
REJECT
VIDEO & NOTIFY
use AMAZON SWF

93. # 4
SECURITY
●●●●○

94. AWS IAM
IDENTITY AND ACCESS MANAGEMENT

96. MULTI-
MULTI-FACTOR
AUTHENTICATION

97. SECURITY GROUPS
LAYERED SECURITY

102. CERTIFICATIONS
& COMPLIANCE
 SAS 70 Type II audit
 ISO 27001 Certification
 Sarbanes-Oxley SOX
 HIPAA healthcare
 FISMA US Federal Government
 DIACAP MAC III Sensitive IATO

103.  PCI DSS Compliant
LEVEL 1 SERVICE PROVIDER

104. # 5
PERFORMANCE
●●●●●

105. VERTICAL
SCALING

107. CLUSTER COMPUTE
EIGHT EXTRA LARGE
2x Intel Xeon E5-2670, eight-core
Sandy Bridge architecture
60.5 GB of memory – 3.3 TB of storage

108. CLUSTER GPU
QUADRUPLE EXTRA LARGE
Intel Xeon X5570, quad-core
2x Nehalem architecture
NVIDIA Tesla Fermi
2x M2050 GPUs
22 GB of memory – 1.7 TB of storage

109. AMAZON
ELASTICACHE
MEMCACHED COMPATIBLE
IN-MEMORY CACHE

111. SEARCH
ENGINES

113. Relevance &
Ranking

114. Faceting

115. Range
Searching

116. AMAZON
CLOUDSEARCH
FULLY-MANAGED SEARCH SERVICE

117. +

118. DEMOCRATIZE SEARCH
Amazon CloudSearch delivers a fully-managed search service in the cloud
that can be set up and running in less than 1 hour, with automatic scaling for
data & traffic, at a price starting at less than $100 per month.

122. HTTP
POST
author=carlos;
date=2012-06-07;
article=text;
…

125. MEDIA SHARING
REFERENCE ARCHITECTURE

127. HTTP
POST
author=carlos;
date=2012-06-07;
article=text;
…
+

129. 1. ELASTICITY
2. DESIGN FOR FAILURE
3. LOOSE COUPLING
4. SECURITY
5. PERFORMANCE

131. « If you're not embarrassed when you ship
your first version you waited too long »
Matt Mullenweg
CEO & Founder of WordPress