This document summarizes an episode of a DevOps webinar series about enabling business agility through automated testing and monitoring. It discusses using AWS CloudFormation to automatically create test environments and AWS OpsWorks for automated deployments. This allows for on-demand test environments. It also discusses using CloudWatch alarms to monitor for failures, simulating extreme situations for crisis preparation, and replaying network activity and failures to test systems. The importance of validation, debriefing, and testing assumptions in a production-like environment is emphasized.

1. DEVOPS WEBINAR SERIES – EPISODE 4
ENABLING BUSINESS AGILITY:
AUTOMATED TESTING &
MONITORING
carlosco@amazon.lu
@caarlco

2. PREVIOUSLY...

3. PREVIOUSLY...

4. PREVIOUSLY...

5. PREVIOUSLY...

6. PREVIOUSLY...

7. AUTOMATED ENVIRONMENT CREATION
use AWS CloudFormation – episode 2
+
AUTOMATED DEPLOYMENT
use AWS OpsWorks – episode 3
=
ON DEMAND TEST ENVIRONMENT

9. CLOUDFORMATION
TEMPLATE

11. "Parameters"
:
{
!
"KeyName":
{
"Description"
:
"Name
of
an
existing
EC2
KeyPair
to
enable
SSH
access",
"Type":
"String",
"MinLength":
"1",
"MaxLength":
"255",
"AllowedPattern"
:
"[x20-­‐x7E]*",
"ConstraintDescription"
:
"can
contain
only
ASCII
characters."
},
!
"InstanceType"
:
{
"Description"
:
"WebServer
EC2
instance
type",
"Type"
:
"String",
"Default"
:
"m1.small",
"AllowedValues"
:
[
"t1.micro","m1.small","m1.medium","m1.large","m1.xlarge","m2.xlarge","m2.2xlarge",""ConstraintDescription"
:
"must
be
a
valid
EC2
instance
type."
},
!
"SiteName":
{
"Default":
"My
Site",
"Description"
:
"The
name
of
the
Drupal
Site",
"Type":
"String"
},
!
"SiteEMail":
{
"Description"
:
"EMail
for
site
adminitrator",
"Type":
"String"

14. LOAD TESTING

18. USING AMAZON EC2 TO SIMULATE
2.4 MILLION PLAYERS

20. DEMO
AMAZON CLOUDWATCH ALARMS

21. GAME DAYS

23. GOOD WEATHER DOESN’T MAKE GOOD SAILORS

24. PREPARE FOR
EXTREME SITUATIONS

25. SIMULATION ENVIRONMENT
FOR CRISIS SITUATIONS

26. THINGS ARE UNRELIABLE
UNTIL THEY ARE TESTED

27. SUPERVISORS & PLAYERS

28. MAKE A PLAN
ROLE PLAY & SCOPE DEFINITION

29. CREATE THE SIMULATION
ENVIRONMENT

30. BEST PRACTICES
CLOUDFORMATION
TEMPLATE

31. BEST PRACTICES
ACTIVATE AWS CLOUDTRAIL
GAMEPLAY RECORDING & AUDITING

33. SIMULATE ACTIVITY

34. REPLAY PRE-RECORDED NETWORK ACTIVITY

35. SIMULATE FAILURES

37. ‣ TERMINATE RESOURCES
‣ CHANGE SECURITY GROUPS
‣ CHANGE IAM ROLES
‣ DISABLE IAM USER
‣ CHANGE /ETC/HOSTS FILE
‣ AMAZON RDS FAIL-OVER TEST

39. KEY TEAM PLAYERS ?
SIMULATE “FAILURE”
SITUATION

40. IF YOU DON’T MEASURE IT,
IT DIDN’T HAPPEN

41. DEBRIEF
WHERE THE MAGIC HAPPENS

42. HOW LONG DOES IT TAKE TO
DETECT AN EVENT ?

43. VALIDATE ASSUMPTIONS
PROVE YOUR ARCHITECTURE
KNOW YOUR PROCEDURES

44. GOOD WEATHER DOESN’T MAKE GOOD SAILORS

45. #awswebinar

46. BEYOND UNIT TESTS

47. TEST IN PRODUCTION
ENVIRONMENT

49. 30 DEPLOYS PER DAY
1 DEPLOY EVERY 20 MINUTES

50. "PRODUCTION IS TRULY
THE ONLY PLACE
YOU CAN VALIDATE YOUR CODE."