SlideShare a Scribd company logo

Lessons Learned Managing Large AWS Environments

•
•
Ronald Bradford
Ronald Bradford

How to you optimize management of 500+ AWS servers? In this presentation I share my experiences using Amazon Web Servers covering techniques for webscale. Learn how to optimized your cost, handle security, automate and be prepared for handling failure.

TechnologyBusiness
1 of 74
Download to read offline
Lessons learned managing large AWS Environments Ronald Bradford http://ronaldbradford.com @RonaldBradford 2013.06
SCOPE Consulting experiences with AWS Several different clients Largest - 500+ servers Some 40-50+ servers Some 2-5 servers LAMP/RoR/RDS/Windows EffectiveMySQL.com - Performance, Scalability & Business Continuity
ABOUT MySELF Ronald BRADFORD Enterprise Data Architecture 24 years with RDBMS - 13 years with MySQL Using AWS 4+ years Published author - 4 books Accomplished presenter - 8 years Work at Independent MySQL Consultant EffectiveMySQL.com - Performance, Scalability & Business Continuity
Covering 1. Products 5. Instrumentation 2. Cost 6. Failure 3. Web Scale 4. Security EffectiveMySQL.com - Performance, Scalability & Business Continuity
1 AWS Products & Ecosystem EffectiveMySQL.com - Performance, Scalability & Business Continuity
ABOUT AWS AMAZON WEB SERVICES 30+ Many, many products and features EC2, S3, EBS, ELB, RDS, EMR,VPC, CDN, SWF, SQS, SES, SNS, IAM, ... Mechanical Turk Flexible Payments Service (FPS) EffectiveMySQL.com - Performance, Scalability & Business Continuity
AWS CONSOLE May 2013 Aug 2012 EffectiveMySQL.com - Performance, Scalability & Business Continuity
Announcements Product Announcements http://aws.amazon.com/about-aws/newsletters/ Pricing Changes New instance types New features (e.g. IOPS) New Products (e.g. Redshift/ OpsWorks) EffectiveMySQL.com - Performance, Scalability & Business Continuity
Announcements Product Announcements Examples in presentation http://aws.amazon.com/about-aws/newsletters/ Pricing Changes New instance types New features (e.g. IOPS) New Products (e.g. Redshift/ OpsWorks) EffectiveMySQL.com - Performance, Scalability & Business Continuity
ECOSYSTEM AWS Marketplace Over 800 https://aws.amazon.com/marketplace/ EffectiveMySQL.com - Performance, Scalability & Business Continuity
Product growth When I started No RDS, In-memory Cache, DynamoDB, Glacier No Elastic Beanstalk, OpsWorks No management console EffectiveMySQL.com - Performance, Scalability & Business Continuity
2 AWS Costs EffectiveMySQL.com - Performance, Scalability & Business Continuity
operating cost Are you monitoring your costs? Daily Hourly EffectiveMySQL.com - Performance, Scalability & Business Continuity
Operating Cost $ ec2_cost.sh https://github.com/ronaldbradford/aws EffectiveMySQL.com - Performance, Scalability & Business Continuity
Operating Cost $29,000 p.m. $ ec2_cost.sh https://github.com/ronaldbradford/aws EffectiveMySQL.com - Performance, Scalability & Business Continuity
Your Money What is AWS costing you? Instance types/sizes http://aws.amazon.com/ec2/instance-types Cost options http://aws.amazon.com/ec2/pricing EffectiveMySQL.com - Performance, Scalability & Business Continuity
Instance Types General-purpose Compute-optimized Memory-optimized Storage-optimized GPU EffectiveMySQL.com - Performance, Scalability & Business Continuity
$ Instance Prices Large Instance (m1.large) EffectiveMySQL.com - Performance, Scalability & Business Continuity
$ Instance Prices Large Instance (m1.large) On Demand $0.24 Reserved $0.136 * + Annual contract ( +$ 0.043) Spot $0.03+ * Can be terminated (budget) Per hour investment EffectiveMySQL.com - Performance, Scalability & Business Continuity
$ Instance Prices Large Instance (m1.large) On Demand $0.24 Reserved $0.136 * + Annual contract ( +$ 0.043) Spot $0.03+ * Can be terminated (budget) Per hour investment EffectiveMySQL.com - Performance, Scalability & Business Continuity
$ Instance Prices Large Instance (m1.large) On Demand $0.24 Reserved $0.136 * + Annual contract ( +$ 0.043) Spot $0.03+ * Can be terminated (budget) Per hour investment EffectiveMySQL.com - Performance, Scalability & Business Continuity
$ Instance Prices Large Instance (m1.large) Was $0.32 til 11/19/2012 Was $0.26 til 1/16/2013 On Demand $0.24 Reserved $0.136 * + Annual contract ( +$ 0.043) Spot $0.03+ * Can be terminated (budget) Light/Medium/Heavy utilization Per hour investment 40% saving up to 80+% saving EffectiveMySQL.com - Performance, Scalability & Business Continuity
SPOT EXAMPLE One hour (24 cents) 1 x Large - Reserved 7.5G, 4 CPUs, 850G 8 x Large - Spot or 1 x Eight Extra Large - Spot (cc2.8xlarge) 60G, 88 CPUs, 3.4T,10Gb NIC EffectiveMySQL.com - Performance, Scalability & Business Continuity
SPOT EXAMPLE One hour (24 cents) 1 x Large - Reserved 7.5G, 4 CPUs, 850G 8 x Large - Spot price has changed 3 times in 8 months or 1 x Eight Extra Large - Spot (cc2.8xlarge) 60G, 88 CPUs, 3.4T,10Gb NIC EffectiveMySQL.com - Performance, Scalability & Business Continuity
SPOT HISTORY 3c to 10c Zone A 3c to 40c Zone B 2013 $ ec2-describe-spot-price-history -t m1.large -d Linux/UNIX SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE 0.030000 0.100000 0.030000 0.100000 0.030000 0.030000 0.100000 0.060000 0.030000 0.240000 0.030000 0.030000 0.045000 0.050000 0.400000 0.260000 0.030000 0.030000 0.026000 2013-05-28T17:20:41-0500 2013-05-28T17:07:02-0500 2013-05-28T16:37:51-0500 2013-05-28T16:31:03-0500 2013-05-28T16:24:48-0500 2013-05-28T16:24:48-0500 2013-05-28T16:15:03-0500 2013-05-28T16:08:34-0500 2013-05-28T16:01:59-0500 2013-05-28T15:55:12-0500 2013-05-28T15:48:32-0500 2013-05-28T15:42:07-0500 2013-05-28T15:35:47-0500 2013-05-28T15:35:47-0500 2013-05-28T15:29:15-0500 2013-05-28T15:22:47-0500 2013-05-28T15:16:01-0500 2013-05-28T15:16:01-0500 2013-05-28T15:09:30-0500 m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX us-east-1a us-east-1a us-east-1a us-east-1a us-east-1d us-east-1a us-east-1a us-east-1d us-east-1b us-east-1b us-east-1b us-east-1a us-east-1a us-east-1b us-east-1b us-east-1b us-east-1d us-east-1a us-east-1a EffectiveMySQL.com - Performance, Scalability & Business Continuity
SPOT HISTORY 2.6c to 17c (1/2 of 34c) One AZ only 2012 $ ec2-describe-spot-price-history -t m1.large -d Linux/UNIX 0.0260 0.0260 0.0290 0.0370 0.0600 0.1700 0.1600 0.0600 0.0900 0.0260 0.0260 2012-09-27T09:45:46-0800 2012-09-27T09:45:46-0800 2012-09-27T09:38:37-0800 2012-09-27T09:38:37-0800 2012-09-27T09:31:29-0800 2012-09-27T09:31:29-0800 2012-09-27T09:24:20-0800 2012-09-27T09:17:11-0800 2012-09-27T09:17:11-0800 2012-09-27T09:09:55-0800 2012-09-27T09:09:55-0800 m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX us-east-1b us-east-1d us-east-1b us-east-1d us-east-1b us-east-1d us-east-1d us-east-1b us-east-1d us-east-1c us-east-1b EffectiveMySQL.com - Performance, Scalability & Business Continuity
Using SPOTS Is your volume predicable? Splitting on-demand/spot instances Can work be done asynchronously? i.e. can be queued Is work restartable? EffectiveMySQL.com - Performance, Scalability & Business Continuity
Using SPOTS Is your volume predicable? Splitting on-demand/spot instances Can work be done asynchronously? i.e. can be queued Is work restartable? WARNING: Not for general workloads EffectiveMySQL.com - Performance, Scalability & Business Continuity
Instance sizes Evaluating the right instance size What is your bottleneck? EffectiveMySQL.com - Performance, Scalability & Business Continuity
Instance sizes Evaluating the right instance size What is your bottleneck? Developing a tool to recommend savings EffectiveMySQL.com - Performance, Scalability & Business Continuity
TRUSTED ADVISOR AWS now offers Trusted Advisor Recommendations to save money Improve performance Close security problems http://aws.amazon.com/premiumsupport/trustedadvisor/ EffectiveMySQL.com - Performance, Scalability & Business Continuity
COST SAVINGS Other players http://www.newvem.com/ http://www.cloudyn.com/ EffectiveMySQL.com - Performance, Scalability & Business Continuity
OTHER COST SAvings CDN - Cloudfront Bandwidth http://aws.amazon.com/cloudfront/ Reduce response size (e.g. 10%) Storage old EBS snapshots Remove unused instances NEW: Announced 1/9/2103 CloudWatch Alarm Actions EffectiveMySQL.com - Performance, Scalability & Business Continuity
3 Web Scale (hint: no humans) EffectiveMySQL.com - Performance, Scalability & Business Continuity
ABOUT WEB SCALE GUI = #FAIL CLI is necessary Manual CLI use is slow Automation in crucial Parallel EffectiveMySQL.com - Performance, Scalability & Business Continuity
AWS CLI’s Different for EC2, ELB, RDS etc Updated frequently (i.e. monthly) $ git clone https://github.com/ronaldbradford/aws.git $ cd aws/scripts $ ./aws_cli_configure.sh EffectiveMySQL.com - Performance, Scalability & Business Continuity
AWS CLI’s Different for EC2, ELB, RDS etc Updated frequently (i.e. monthly) Simple helper $ git clone https://github.com/ronaldbradford/aws.git $ cd aws/scripts $ ./aws_cli_configure.sh EffectiveMySQL.com - Performance, Scalability & Business Continuity
RTFM http://aws.amazon.com/archives/Amazon-EC2 EffectiveMySQL.com - Performance, Scalability & Business Continuity
Identifiers Access Key ID Private Access Key X.509 Certificates (2 of) Private (*) & Public AWS Account ID Canonical User ID https://portal.aws.amazon.com/gp/aws/securityCredentials EffectiveMySQL.com - Performance, Scalability & Business Continuity
CLI Examples Launch Script Demand/Spot or switch between Verify SSH Verify MySQL Verify replication in sync Add to ELB EffectiveMySQL.com - Performance, Scalability & Business Continuity
CLI Examples Audit Script Consolidates information Parallel operations Unused EC2/EBS etc Feeds reporting ELB/EC2 usage EffectiveMySQL.com - Performance, Scalability & Business Continuity
CLI EXAMPLES Others Cost Measurement Cloning (optimizes scale-up) Move servers between load balancers Spot History graphing Spot History email alerts EffectiveMySQL.com - Performance, Scalability & Business Continuity
4 AWS Security EffectiveMySQL.com - Performance, Scalability & Business Continuity
SECURITY Do not give away the front door keys Do not open all the windows EffectiveMySQL.com - Performance, Scalability & Business Continuity
SECURITY OPTIONS Keypairs Learn the different benefits Security groups Virtual Private Cloud (VPC) Identity and Access Management (IAM) Multi-factor authentication http://aws.amazon.com/mfa/ EffectiveMySQL.com - Performance, Scalability & Business Continuity
SECURITY TIPS Restrict open access to port 80/443 Jump box Restrict IP Access Additional authentication Per user SSH authentication Do not use keypair EffectiveMySQL.com - Performance, Scalability & Business Continuity
products Many Others (AWS Summit 2013) Cloudaware Dome9 Enstratius SafeNet AlertLogic EffectiveMySQL.com - Performance, Scalability & Business Continuity
5 Instrumentation EffectiveMySQL.com - Performance, Scalability & Business Continuity
Instrumentation EffectiveMySQL.com - Performance, Scalability & Business Continuity
Instrumentation What is important to you? EffectiveMySQL.com - Performance, Scalability & Business Continuity
Instrumentation What is important to you? All server stats EffectiveMySQL.com - Performance, Scalability & Business Continuity
Instrumentation What is important to you? All server stats Sampling issues EffectiveMySQL.com - Performance, Scalability & Business Continuity
Instrumentation What is important to you? All server stats Sampling issues Deceiving averages (frequency) EffectiveMySQL.com - Performance, Scalability & Business Continuity
REQUESTS PER SEC 5 second averages, not 1 minute sample https://github.com/ronaldbradford/reqstat EffectiveMySQL.com - Performance, Scalability & Business Continuity
REQUESTS PER SEC 5 second averages, not 1 minute sample https://github.com/ronaldbradford/reqstat EffectiveMySQL.com - Performance, Scalability & Business Continuity
REQUESTS PER SEC -1,500 RPS 5 second averages, not 1 minute sample https://github.com/ronaldbradford/reqstat EffectiveMySQL.com - Performance, Scalability & Business Continuity
outliers EffectiveMySQL.com - Performance, Scalability & Business Continuity
outliers I care about these EffectiveMySQL.com - Performance, Scalability & Business Continuity
TESTING End to end testing critical Network latency ELB performance EffectiveMySQL.com - Performance, Scalability & Business Continuity
products AWS Cloudwatch Many Others (AWS Summit 2013) Datadog AppDynamics Boundary CopperEgg EffectiveMySQL.com - Performance, Scalability & Business Continuity
products AWS Cloudwatch What features matter? Many Others (AWS Summit 2013) Datadog AppDynamics Boundary CopperEgg EffectiveMySQL.com - Performance, Scalability & Business Continuity
6 Failure EffectiveMySQL.com - Performance, Scalability & Business Continuity
FAILURE EffectiveMySQL.com - Performance, Scalability & Business Continuity
FAILURE Instances fail EffectiveMySQL.com - Performance, Scalability & Business Continuity
FAILURE Instances fail Outages occur AWS scheduled reboots EffectiveMySQL.com - Performance, Scalability & Business Continuity
FAILURE Instances fail Outages occur AWS scheduled reboots Be prepared Chaos Monkey http://www.codinghorror.com/blog/2011/04/working-with-the-chaos-monkey.html EffectiveMySQL.com - Performance, Scalability & Business Continuity
CONCLUSION EffectiveMySQL.com - Performance, Scalability & Business Continuity
CONCLUSION Cost Management (saving money) EffectiveMySQL.com - Performance, Scalability & Business Continuity
CONCLUSION Cost Management (saving money) CLI automation EffectiveMySQL.com - Performance, Scalability & Business Continuity
CONCLUSION Cost Management (saving money) CLI automation Instrumentation (inc business metrics) EffectiveMySQL.com - Performance, Scalability & Business Continuity
CONCLUSION Cost Management (saving money) CLI automation Instrumentation (inc business metrics) Distribute your application & data EffectiveMySQL.com - Performance, Scalability & Business Continuity
CONCLUSION Cost Management (saving money) CLI automation Instrumentation (inc business metrics) Distribute your application & data Disaster is inevitable EffectiveMySQL.com - Performance, Scalability & Business Continuity
AWS for FREE http://aws.amazon.com/free/ Free EC2 t1.micro for a year Free RDS t1.micro for a year S3, DynamoDB, SimpleDB, +++ EffectiveMySQL.com - Performance, Scalability & Business Continuity
Ronald Bradford http://effectiveMySQL.com EffectiveMySQL.com - Performance, Scalability & Business Continuity

Recommended

Monitoring your technology stack with New Relic
Monitoring your technology stack with New RelicMonitoring your technology stack with New Relic
Monitoring your technology stack with New RelicRonald Bradford
 
Successful Scalability Principles - Part 1
Successful Scalability Principles - Part 1Successful Scalability Principles - Part 1
Successful Scalability Principles - Part 1Ronald Bradford
 
The History and Future of the MySQL ecosystem
The History and Future of the MySQL ecosystemThe History and Future of the MySQL ecosystem
The History and Future of the MySQL ecosystemRonald Bradford
 
MySQL Scalability Mistakes - OTN
MySQL Scalability Mistakes - OTNMySQL Scalability Mistakes - OTN
MySQL Scalability Mistakes - OTNRonald Bradford
 
MySQL Backup and Recovery Essentials
MySQL Backup and Recovery EssentialsMySQL Backup and Recovery Essentials
MySQL Backup and Recovery EssentialsRonald Bradford
 
My two cents about Mysql backup
My two cents about Mysql backupMy two cents about Mysql backup
My two cents about Mysql backupAndrejs Vorobjovs
 
MySQL High Availability and Disaster Recovery with Continuent, a VMware company
MySQL High Availability and Disaster Recovery with Continuent, a VMware companyMySQL High Availability and Disaster Recovery with Continuent, a VMware company
MySQL High Availability and Disaster Recovery with Continuent, a VMware companyContinuent
 
MySQL Enterprise Backup - BnR Scenarios
MySQL Enterprise Backup - BnR ScenariosMySQL Enterprise Backup - BnR Scenarios
MySQL Enterprise Backup - BnR ScenariosKeith Hollman
 

Recommended

Monitoring your technology stack with New Relic
Monitoring your technology stack with New RelicMonitoring your technology stack with New Relic
Monitoring your technology stack with New RelicRonald Bradford
 
Successful Scalability Principles - Part 1
Successful Scalability Principles - Part 1Successful Scalability Principles - Part 1
Successful Scalability Principles - Part 1Ronald Bradford
 
The History and Future of the MySQL ecosystem
The History and Future of the MySQL ecosystemThe History and Future of the MySQL ecosystem
The History and Future of the MySQL ecosystemRonald Bradford
 
MySQL Scalability Mistakes - OTN
MySQL Scalability Mistakes - OTNMySQL Scalability Mistakes - OTN
MySQL Scalability Mistakes - OTNRonald Bradford
 
MySQL Backup and Recovery Essentials
MySQL Backup and Recovery EssentialsMySQL Backup and Recovery Essentials
MySQL Backup and Recovery EssentialsRonald Bradford
 
My two cents about Mysql backup
My two cents about Mysql backupMy two cents about Mysql backup
My two cents about Mysql backupAndrejs Vorobjovs
 
MySQL High Availability and Disaster Recovery with Continuent, a VMware company
MySQL High Availability and Disaster Recovery with Continuent, a VMware companyMySQL High Availability and Disaster Recovery with Continuent, a VMware company
MySQL High Availability and Disaster Recovery with Continuent, a VMware companyContinuent
 
MySQL Enterprise Backup - BnR Scenarios
MySQL Enterprise Backup - BnR ScenariosMySQL Enterprise Backup - BnR Scenarios
MySQL Enterprise Backup - BnR ScenariosKeith Hollman
 
Moodle Moot Spain: Moodle Available and Scalable with MySQL HA - InnoDB Clust...
Moodle Moot Spain: Moodle Available and Scalable with MySQL HA - InnoDB Clust...Moodle Moot Spain: Moodle Available and Scalable with MySQL HA - InnoDB Clust...
Moodle Moot Spain: Moodle Available and Scalable with MySQL HA - InnoDB Clust...Keith Hollman
 
MySQL Best Practices - OTN
MySQL Best Practices - OTNMySQL Best Practices - OTN
MySQL Best Practices - OTNRonald Bradford
 
UKOUG 2011: MySQL Architectures for Oracle DBA's
UKOUG 2011: MySQL Architectures for Oracle DBA'sUKOUG 2011: MySQL Architectures for Oracle DBA's
UKOUG 2011: MySQL Architectures for Oracle DBA'sFromDual GmbH
 
MySQL 5.7 -- SCaLE Feb 2014
MySQL 5.7 -- SCaLE Feb 2014MySQL 5.7 -- SCaLE Feb 2014
MySQL 5.7 -- SCaLE Feb 2014Dave Stokes
 
MySQL Performance Tuning: The Perfect Scalability (OOW2019)
MySQL Performance Tuning: The Perfect Scalability (OOW2019)MySQL Performance Tuning: The Perfect Scalability (OOW2019)
MySQL Performance Tuning: The Perfect Scalability (OOW2019)Mirko Ortensi
 
MySQL :What's New #GIDS16
MySQL :What's New #GIDS16MySQL :What's New #GIDS16
MySQL :What's New #GIDS16Sanjay Manwani
 
Posscon my sql56
Posscon my sql56Posscon my sql56
Posscon my sql56Dave Stokes
 
MySQL For Oracle DBA's and Developers
MySQL For Oracle DBA's and DevelopersMySQL For Oracle DBA's and Developers
MySQL For Oracle DBA's and DevelopersRonald Bradford
 
MySQL Enterprise Backup (MEB)
MySQL Enterprise Backup (MEB)MySQL Enterprise Backup (MEB)
MySQL Enterprise Backup (MEB)Mydbops
 
MySQL 5.7 New Features to Exploit -- PHPTek/Chicago MySQL User Group May 2014
MySQL 5.7 New Features to Exploit -- PHPTek/Chicago MySQL User Group May 2014MySQL 5.7 New Features to Exploit -- PHPTek/Chicago MySQL User Group May 2014
MySQL 5.7 New Features to Exploit -- PHPTek/Chicago MySQL User Group May 2014Dave Stokes
 
MySQL Performance Best Practices
MySQL Performance Best PracticesMySQL Performance Best Practices
MySQL Performance Best PracticesOlivier DASINI
 
Scaling MySQl 1 to N Servers -- Los Angelese MySQL User Group Feb 2014
Scaling MySQl 1 to N Servers -- Los Angelese MySQL User Group Feb 2014Scaling MySQl 1 to N Servers -- Los Angelese MySQL User Group Feb 2014
Scaling MySQl 1 to N Servers -- Los Angelese MySQL User Group Feb 2014Dave Stokes
 
MySQL Performance Tuning Variables
MySQL Performance Tuning VariablesMySQL Performance Tuning Variables
MySQL Performance Tuning VariablesFromDual GmbH
 
MySQL 5.7 - What's new and How to upgrade
MySQL 5.7 - What's new and How to upgradeMySQL 5.7 - What's new and How to upgrade
MySQL 5.7 - What's new and How to upgradeAbel Flórez
 
MySQL 5.6 Updates
MySQL 5.6 UpdatesMySQL 5.6 Updates
MySQL 5.6 UpdatesDave Stokes
 
MySql's NoSQL -- best of both worlds on the same disks
MySql's NoSQL -- best of both worlds on the same disksMySql's NoSQL -- best of both worlds on the same disks
MySql's NoSQL -- best of both worlds on the same disksDave Stokes
 
What's New in MySQL 8.0 @ HKOSC 2017
What's New in MySQL 8.0 @ HKOSC 2017What's New in MySQL 8.0 @ HKOSC 2017
What's New in MySQL 8.0 @ HKOSC 2017Ivan Ma
 
MySQL Cloud Service Deep Dive
MySQL Cloud Service Deep DiveMySQL Cloud Service Deep Dive
MySQL Cloud Service Deep DiveMorgan Tocker
 
Perf Tuning Short
Perf Tuning ShortPerf Tuning Short
Perf Tuning ShortLigaya Turmelle
 
MySQL Performance Tuning. Part 1: MySQL Configuration (includes MySQL 5.7)
MySQL Performance Tuning. Part 1: MySQL Configuration (includes MySQL 5.7)MySQL Performance Tuning. Part 1: MySQL Configuration (includes MySQL 5.7)
MySQL Performance Tuning. Part 1: MySQL Configuration (includes MySQL 5.7)Aurimas Mikalauskas
 
Achieving Profitability on AWS
Achieving Profitability on AWSAchieving Profitability on AWS
Achieving Profitability on AWSAmazon Web Services
 
Serverless is a win for businesses, not just developers
Serverless is a win for businesses, not just developersServerless is a win for businesses, not just developers
Serverless is a win for businesses, not just developersYan Cui
 

More Related Content

What's hot

Moodle Moot Spain: Moodle Available and Scalable with MySQL HA - InnoDB Clust...
Moodle Moot Spain: Moodle Available and Scalable with MySQL HA - InnoDB Clust...Moodle Moot Spain: Moodle Available and Scalable with MySQL HA - InnoDB Clust...
Moodle Moot Spain: Moodle Available and Scalable with MySQL HA - InnoDB Clust...Keith Hollman
 
MySQL Best Practices - OTN
MySQL Best Practices - OTNMySQL Best Practices - OTN
MySQL Best Practices - OTNRonald Bradford
 
UKOUG 2011: MySQL Architectures for Oracle DBA's
UKOUG 2011: MySQL Architectures for Oracle DBA'sUKOUG 2011: MySQL Architectures for Oracle DBA's
UKOUG 2011: MySQL Architectures for Oracle DBA'sFromDual GmbH
 
MySQL 5.7 -- SCaLE Feb 2014
MySQL 5.7 -- SCaLE Feb 2014MySQL 5.7 -- SCaLE Feb 2014
MySQL 5.7 -- SCaLE Feb 2014Dave Stokes
 
MySQL Performance Tuning: The Perfect Scalability (OOW2019)
MySQL Performance Tuning: The Perfect Scalability (OOW2019)MySQL Performance Tuning: The Perfect Scalability (OOW2019)
MySQL Performance Tuning: The Perfect Scalability (OOW2019)Mirko Ortensi
 
MySQL :What's New #GIDS16
MySQL :What's New #GIDS16MySQL :What's New #GIDS16
MySQL :What's New #GIDS16Sanjay Manwani
 
Posscon my sql56
Posscon my sql56Posscon my sql56
Posscon my sql56Dave Stokes
 
MySQL For Oracle DBA's and Developers
MySQL For Oracle DBA's and DevelopersMySQL For Oracle DBA's and Developers
MySQL For Oracle DBA's and DevelopersRonald Bradford
 
MySQL Enterprise Backup (MEB)
MySQL Enterprise Backup (MEB)MySQL Enterprise Backup (MEB)
MySQL Enterprise Backup (MEB)Mydbops
 
MySQL 5.7 New Features to Exploit -- PHPTek/Chicago MySQL User Group May 2014
MySQL 5.7 New Features to Exploit -- PHPTek/Chicago MySQL User Group May 2014MySQL 5.7 New Features to Exploit -- PHPTek/Chicago MySQL User Group May 2014
MySQL 5.7 New Features to Exploit -- PHPTek/Chicago MySQL User Group May 2014Dave Stokes
 
MySQL Performance Best Practices
MySQL Performance Best PracticesMySQL Performance Best Practices
MySQL Performance Best PracticesOlivier DASINI
 
Scaling MySQl 1 to N Servers -- Los Angelese MySQL User Group Feb 2014
Scaling MySQl 1 to N Servers -- Los Angelese MySQL User Group Feb 2014Scaling MySQl 1 to N Servers -- Los Angelese MySQL User Group Feb 2014
Scaling MySQl 1 to N Servers -- Los Angelese MySQL User Group Feb 2014Dave Stokes
 
MySQL Performance Tuning Variables
MySQL Performance Tuning VariablesMySQL Performance Tuning Variables
MySQL Performance Tuning VariablesFromDual GmbH
 
MySQL 5.7 - What's new and How to upgrade
MySQL 5.7 - What's new and How to upgradeMySQL 5.7 - What's new and How to upgrade
MySQL 5.7 - What's new and How to upgradeAbel Flórez
 
MySQL 5.6 Updates
MySQL 5.6 UpdatesMySQL 5.6 Updates
MySQL 5.6 UpdatesDave Stokes
 
MySql's NoSQL -- best of both worlds on the same disks
MySql's NoSQL -- best of both worlds on the same disksMySql's NoSQL -- best of both worlds on the same disks
MySql's NoSQL -- best of both worlds on the same disksDave Stokes
 
What's New in MySQL 8.0 @ HKOSC 2017
What's New in MySQL 8.0 @ HKOSC 2017What's New in MySQL 8.0 @ HKOSC 2017
What's New in MySQL 8.0 @ HKOSC 2017Ivan Ma
 
MySQL Cloud Service Deep Dive
MySQL Cloud Service Deep DiveMySQL Cloud Service Deep Dive
MySQL Cloud Service Deep DiveMorgan Tocker
 
MySQL Performance Tuning. Part 1: MySQL Configuration (includes MySQL 5.7)
MySQL Performance Tuning. Part 1: MySQL Configuration (includes MySQL 5.7)MySQL Performance Tuning. Part 1: MySQL Configuration (includes MySQL 5.7)
MySQL Performance Tuning. Part 1: MySQL Configuration (includes MySQL 5.7)Aurimas Mikalauskas
 

What's hot (20)

Moodle Moot Spain: Moodle Available and Scalable with MySQL HA - InnoDB Clust...
Moodle Moot Spain: Moodle Available and Scalable with MySQL HA - InnoDB Clust...Moodle Moot Spain: Moodle Available and Scalable with MySQL HA - InnoDB Clust...
Moodle Moot Spain: Moodle Available and Scalable with MySQL HA - InnoDB Clust...
 
MySQL Best Practices - OTN
MySQL Best Practices - OTNMySQL Best Practices - OTN
MySQL Best Practices - OTN
 
UKOUG 2011: MySQL Architectures for Oracle DBA's
UKOUG 2011: MySQL Architectures for Oracle DBA'sUKOUG 2011: MySQL Architectures for Oracle DBA's
UKOUG 2011: MySQL Architectures for Oracle DBA's
 
MySQL 5.7 -- SCaLE Feb 2014
MySQL 5.7 -- SCaLE Feb 2014MySQL 5.7 -- SCaLE Feb 2014
MySQL 5.7 -- SCaLE Feb 2014
 
MySQL Performance Tuning: The Perfect Scalability (OOW2019)
MySQL Performance Tuning: The Perfect Scalability (OOW2019)MySQL Performance Tuning: The Perfect Scalability (OOW2019)
MySQL Performance Tuning: The Perfect Scalability (OOW2019)
 
MySQL :What's New #GIDS16
MySQL :What's New #GIDS16MySQL :What's New #GIDS16
MySQL :What's New #GIDS16
 
Posscon my sql56
Posscon my sql56Posscon my sql56
Posscon my sql56
 
MySQL For Oracle DBA's and Developers
MySQL For Oracle DBA's and DevelopersMySQL For Oracle DBA's and Developers
MySQL For Oracle DBA's and Developers
 
MySQL Enterprise Backup (MEB)
MySQL Enterprise Backup (MEB)MySQL Enterprise Backup (MEB)
MySQL Enterprise Backup (MEB)
 
MySQL 5.7 New Features to Exploit -- PHPTek/Chicago MySQL User Group May 2014
MySQL 5.7 New Features to Exploit -- PHPTek/Chicago MySQL User Group May 2014MySQL 5.7 New Features to Exploit -- PHPTek/Chicago MySQL User Group May 2014
MySQL 5.7 New Features to Exploit -- PHPTek/Chicago MySQL User Group May 2014
 
MySQL Performance Best Practices
MySQL Performance Best PracticesMySQL Performance Best Practices
MySQL Performance Best Practices
 
Scaling MySQl 1 to N Servers -- Los Angelese MySQL User Group Feb 2014
Scaling MySQl 1 to N Servers -- Los Angelese MySQL User Group Feb 2014Scaling MySQl 1 to N Servers -- Los Angelese MySQL User Group Feb 2014
Scaling MySQl 1 to N Servers -- Los Angelese MySQL User Group Feb 2014
 
MySQL Performance Tuning Variables
MySQL Performance Tuning VariablesMySQL Performance Tuning Variables
MySQL Performance Tuning Variables
 
MySQL 5.7 - What's new and How to upgrade
MySQL 5.7 - What's new and How to upgradeMySQL 5.7 - What's new and How to upgrade
MySQL 5.7 - What's new and How to upgrade
 
MySQL 5.6 Updates
MySQL 5.6 UpdatesMySQL 5.6 Updates
MySQL 5.6 Updates
 
MySql's NoSQL -- best of both worlds on the same disks
MySql's NoSQL -- best of both worlds on the same disksMySql's NoSQL -- best of both worlds on the same disks
MySql's NoSQL -- best of both worlds on the same disks
 
What's New in MySQL 8.0 @ HKOSC 2017
What's New in MySQL 8.0 @ HKOSC 2017What's New in MySQL 8.0 @ HKOSC 2017
What's New in MySQL 8.0 @ HKOSC 2017
 
MySQL Cloud Service Deep Dive
MySQL Cloud Service Deep DiveMySQL Cloud Service Deep Dive
MySQL Cloud Service Deep Dive
 
Perf Tuning Short
Perf Tuning ShortPerf Tuning Short
Perf Tuning Short
 
MySQL Performance Tuning. Part 1: MySQL Configuration (includes MySQL 5.7)
MySQL Performance Tuning. Part 1: MySQL Configuration (includes MySQL 5.7)MySQL Performance Tuning. Part 1: MySQL Configuration (includes MySQL 5.7)
MySQL Performance Tuning. Part 1: MySQL Configuration (includes MySQL 5.7)
 

Similar to Lessons Learned Managing Large AWS Environments

Serverless is a win for businesses, not just developers
Serverless is a win for businesses, not just developersServerless is a win for businesses, not just developers
Serverless is a win for businesses, not just developersYan Cui
 
AWS Cloud Kata | Manila - Getting to Profitability on AWS
AWS Cloud Kata | Manila - Getting to Profitability on AWSAWS Cloud Kata | Manila - Getting to Profitability on AWS
AWS Cloud Kata | Manila - Getting to Profitability on AWSAmazon Web Services
 
Architecture Best Practices: Practical Design Steps to Save Costs - Level 200
Architecture Best Practices: Practical Design Steps to Save Costs - Level 200Architecture Best Practices: Practical Design Steps to Save Costs - Level 200
Architecture Best Practices: Practical Design Steps to Save Costs - Level 200Amazon Web Services
 
Why Scale Matters and How the Cloud Really is Different
Why Scale Matters and How the Cloud Really is Different Why Scale Matters and How the Cloud Really is Different
Why Scale Matters and How the Cloud Really is Different Amazon Web Services
 
AWS Enterprise Day | Running Critical Business Applications on AWS
AWS Enterprise Day | Running Critical Business Applications on AWSAWS Enterprise Day | Running Critical Business Applications on AWS
AWS Enterprise Day | Running Critical Business Applications on AWSAmazon Web Services
 
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...Amazon Web Services
 
How to Reduce your Spend on AWS
How to Reduce your Spend on AWSHow to Reduce your Spend on AWS
How to Reduce your Spend on AWSJoseph K. Ziegler
 
Cloud Economics: The Financial Case for Cloud Migration
Cloud Economics: The Financial Case for Cloud MigrationCloud Economics: The Financial Case for Cloud Migration
Cloud Economics: The Financial Case for Cloud MigrationAmazon Web Services
 
Getting Started with Managed Database Services on AWS - AWS Summit Tel Aviv 2017
Getting Started with Managed Database Services on AWS - AWS Summit Tel Aviv 2017Getting Started with Managed Database Services on AWS - AWS Summit Tel Aviv 2017
Getting Started with Managed Database Services on AWS - AWS Summit Tel Aviv 2017Amazon Web Services
 
Get the Most Out of Amazon EC2: A Deep Dive on Reserved, On-Demand, and Spot ...
Get the Most Out of Amazon EC2: A Deep Dive on Reserved, On-Demand, and Spot ...Get the Most Out of Amazon EC2: A Deep Dive on Reserved, On-Demand, and Spot ...
Get the Most Out of Amazon EC2: A Deep Dive on Reserved, On-Demand, and Spot ...Amazon Web Services
 
MySQL Manchester TT - MySQL Enterprise Edition
MySQL Manchester TT - MySQL Enterprise EditionMySQL Manchester TT - MySQL Enterprise Edition
MySQL Manchester TT - MySQL Enterprise EditionMark Swarbrick
 
AWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWSAWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWSAmazon Web Services
 
Getting Started with Amazon Redshift
Getting Started with Amazon RedshiftGetting Started with Amazon Redshift
Getting Started with Amazon RedshiftAmazon Web Services
 
Getting Started with Amazon Redshift
Getting Started with Amazon RedshiftGetting Started with Amazon Redshift
Getting Started with Amazon RedshiftAmazon Web Services
 
Advanced cost management strategies in AWS
Advanced cost management strategies in AWSAdvanced cost management strategies in AWS
Advanced cost management strategies in AWSAWS User Group Bengaluru
 
AWS Cloud Kata | Bangkok - Getting to Profitability
AWS Cloud Kata | Bangkok - Getting to ProfitabilityAWS Cloud Kata | Bangkok - Getting to Profitability
AWS Cloud Kata | Bangkok - Getting to ProfitabilityAmazon Web Services
 
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your Business
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your BusinessAWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your Business
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your BusinessAmazon Web Services
 

Similar to Lessons Learned Managing Large AWS Environments (20)

Achieving Profitability on AWS
Achieving Profitability on AWSAchieving Profitability on AWS
Achieving Profitability on AWS
 
Serverless is a win for businesses, not just developers
Serverless is a win for businesses, not just developersServerless is a win for businesses, not just developers
Serverless is a win for businesses, not just developers
 
AWS Cloud Kata | Manila - Getting to Profitability on AWS
AWS Cloud Kata | Manila - Getting to Profitability on AWSAWS Cloud Kata | Manila - Getting to Profitability on AWS
AWS Cloud Kata | Manila - Getting to Profitability on AWS
 
Architecture Best Practices: Practical Design Steps to Save Costs - Level 200
Architecture Best Practices: Practical Design Steps to Save Costs - Level 200Architecture Best Practices: Practical Design Steps to Save Costs - Level 200
Architecture Best Practices: Practical Design Steps to Save Costs - Level 200
 
Why Scale Matters and How the Cloud Really is Different
Why Scale Matters and How the Cloud Really is Different Why Scale Matters and How the Cloud Really is Different
Why Scale Matters and How the Cloud Really is Different
 
Cost Optimization at Scale
Cost Optimization at ScaleCost Optimization at Scale
Cost Optimization at Scale
 
AWS Enterprise Day | Running Critical Business Applications on AWS
AWS Enterprise Day | Running Critical Business Applications on AWSAWS Enterprise Day | Running Critical Business Applications on AWS
AWS Enterprise Day | Running Critical Business Applications on AWS
 
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...
AWS Summit Auckland 2014 | Moving to the Cloud. What does it Mean to your Bus...
 
How to Reduce your Spend on AWS
How to Reduce your Spend on AWSHow to Reduce your Spend on AWS
How to Reduce your Spend on AWS
 
Cloud Economics: The Financial Case for Cloud Migration
Cloud Economics: The Financial Case for Cloud MigrationCloud Economics: The Financial Case for Cloud Migration
Cloud Economics: The Financial Case for Cloud Migration
 
Getting Started with Managed Database Services on AWS - AWS Summit Tel Aviv 2017
Getting Started with Managed Database Services on AWS - AWS Summit Tel Aviv 2017Getting Started with Managed Database Services on AWS - AWS Summit Tel Aviv 2017
Getting Started with Managed Database Services on AWS - AWS Summit Tel Aviv 2017
 
Get the Most Out of Amazon EC2: A Deep Dive on Reserved, On-Demand, and Spot ...
Get the Most Out of Amazon EC2: A Deep Dive on Reserved, On-Demand, and Spot ...Get the Most Out of Amazon EC2: A Deep Dive on Reserved, On-Demand, and Spot ...
Get the Most Out of Amazon EC2: A Deep Dive on Reserved, On-Demand, and Spot ...
 
MySQL Manchester TT - MySQL Enterprise Edition
MySQL Manchester TT - MySQL Enterprise EditionMySQL Manchester TT - MySQL Enterprise Edition
MySQL Manchester TT - MySQL Enterprise Edition
 
AWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWSAWS APAC Webinar Series: How to Reduce Your Spend on AWS
AWS APAC Webinar Series: How to Reduce Your Spend on AWS
 
Getting Started with Amazon Redshift
Getting Started with Amazon RedshiftGetting Started with Amazon Redshift
Getting Started with Amazon Redshift
 
Getting Started with Amazon Redshift
Getting Started with Amazon RedshiftGetting Started with Amazon Redshift
Getting Started with Amazon Redshift
 
Advanced cost management strategies in AWS
Advanced cost management strategies in AWSAdvanced cost management strategies in AWS
Advanced cost management strategies in AWS
 
AWS Cloud Kata | Bangkok - Getting to Profitability
AWS Cloud Kata | Bangkok - Getting to ProfitabilityAWS Cloud Kata | Bangkok - Getting to Profitability
AWS Cloud Kata | Bangkok - Getting to Profitability
 
Cost Optimization at Scale
Cost Optimization at ScaleCost Optimization at Scale
Cost Optimization at Scale
 
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your Business
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your BusinessAWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your Business
AWS Summit Sydney 2014 | Moving to the Cloud. What does it Mean to your Business
 

More from Ronald Bradford

My SQL Idiosyncrasies That Bite OTN
My SQL Idiosyncrasies That Bite OTNMy SQL Idiosyncrasies That Bite OTN
My SQL Idiosyncrasies That Bite OTNRonald Bradford
 
MySQL Best Practices - OTN LAD Tour
MySQL Best Practices - OTN LAD TourMySQL Best Practices - OTN LAD Tour
MySQL Best Practices - OTN LAD TourRonald Bradford
 
MySQL Idiosyncrasies That Bite SF
MySQL Idiosyncrasies That Bite SFMySQL Idiosyncrasies That Bite SF
MySQL Idiosyncrasies That Bite SFRonald Bradford
 
Successful MySQL Scalability
Successful MySQL ScalabilitySuccessful MySQL Scalability
Successful MySQL ScalabilityRonald Bradford
 
MySQL Idiosyncrasies That Bite 2010.07
MySQL Idiosyncrasies That Bite 2010.07MySQL Idiosyncrasies That Bite 2010.07
MySQL Idiosyncrasies That Bite 2010.07Ronald Bradford
 
Capturing, Analyzing and Optimizing MySQL
Capturing, Analyzing and Optimizing MySQLCapturing, Analyzing and Optimizing MySQL
Capturing, Analyzing and Optimizing MySQLRonald Bradford
 
MySQL Idiosyncrasies That Bite
MySQL Idiosyncrasies That BiteMySQL Idiosyncrasies That Bite
MySQL Idiosyncrasies That BiteRonald Bradford
 
10x Performance Improvements
10x Performance Improvements10x Performance Improvements
10x Performance ImprovementsRonald Bradford
 
LIFTOFF - MySQLCamp for the Oracle DBA
LIFTOFF - MySQLCamp for the Oracle DBALIFTOFF - MySQLCamp for the Oracle DBA
LIFTOFF - MySQLCamp for the Oracle DBARonald Bradford
 
IGNITION - MySQLCamp for the Oracle DBA
IGNITION - MySQLCamp for the Oracle DBAIGNITION - MySQLCamp for the Oracle DBA
IGNITION - MySQLCamp for the Oracle DBARonald Bradford
 
10x Performance Improvements - A Case Study
10x Performance Improvements - A Case Study10x Performance Improvements - A Case Study
10x Performance Improvements - A Case StudyRonald Bradford
 
Dolphins Now And Beyond - FOSDEM 2010
Dolphins Now And Beyond - FOSDEM 2010Dolphins Now And Beyond - FOSDEM 2010
Dolphins Now And Beyond - FOSDEM 2010Ronald Bradford
 
Drizzle - Status, Principles and Ecosystem
Drizzle - Status, Principles and EcosystemDrizzle - Status, Principles and Ecosystem
Drizzle - Status, Principles and EcosystemRonald Bradford
 
MySQL for the Oracle DBA - Object Management
MySQL for the Oracle DBA - Object ManagementMySQL for the Oracle DBA - Object Management
MySQL for the Oracle DBA - Object ManagementRonald Bradford
 
Know Your Competitor - Oracle 10g Express Edition
Know Your Competitor - Oracle 10g Express EditionKnow Your Competitor - Oracle 10g Express Edition
Know Your Competitor - Oracle 10g Express EditionRonald Bradford
 
MySQL For Oracle Developers
MySQL For Oracle DevelopersMySQL For Oracle Developers
MySQL For Oracle DevelopersRonald Bradford
 
The Ideal Performance Architecture
The Ideal Performance ArchitectureThe Ideal Performance Architecture
The Ideal Performance ArchitectureRonald Bradford
 
Getting started with MySQL on Amazon Web Services
Getting started with MySQL on Amazon Web ServicesGetting started with MySQL on Amazon Web Services
Getting started with MySQL on Amazon Web ServicesRonald Bradford
 

More from Ronald Bradford (20)

My SQL Idiosyncrasies That Bite OTN
My SQL Idiosyncrasies That Bite OTNMy SQL Idiosyncrasies That Bite OTN
My SQL Idiosyncrasies That Bite OTN
 
MySQL Best Practices - OTN LAD Tour
MySQL Best Practices - OTN LAD TourMySQL Best Practices - OTN LAD Tour
MySQL Best Practices - OTN LAD Tour
 
MySQL Idiosyncrasies That Bite SF
MySQL Idiosyncrasies That Bite SFMySQL Idiosyncrasies That Bite SF
MySQL Idiosyncrasies That Bite SF
 
Successful MySQL Scalability
Successful MySQL ScalabilitySuccessful MySQL Scalability
Successful MySQL Scalability
 
MySQL Idiosyncrasies That Bite 2010.07
MySQL Idiosyncrasies That Bite 2010.07MySQL Idiosyncrasies That Bite 2010.07
MySQL Idiosyncrasies That Bite 2010.07
 
Capturing, Analyzing and Optimizing MySQL
Capturing, Analyzing and Optimizing MySQLCapturing, Analyzing and Optimizing MySQL
Capturing, Analyzing and Optimizing MySQL
 
MySQL Idiosyncrasies That Bite
MySQL Idiosyncrasies That BiteMySQL Idiosyncrasies That Bite
MySQL Idiosyncrasies That Bite
 
10x Performance Improvements
10x Performance Improvements10x Performance Improvements
10x Performance Improvements
 
LIFTOFF - MySQLCamp for the Oracle DBA
LIFTOFF - MySQLCamp for the Oracle DBALIFTOFF - MySQLCamp for the Oracle DBA
LIFTOFF - MySQLCamp for the Oracle DBA
 
IGNITION - MySQLCamp for the Oracle DBA
IGNITION - MySQLCamp for the Oracle DBAIGNITION - MySQLCamp for the Oracle DBA
IGNITION - MySQLCamp for the Oracle DBA
 
10x Performance Improvements - A Case Study
10x Performance Improvements - A Case Study10x Performance Improvements - A Case Study
10x Performance Improvements - A Case Study
 
Dolphins Now And Beyond - FOSDEM 2010
Dolphins Now And Beyond - FOSDEM 2010Dolphins Now And Beyond - FOSDEM 2010
Dolphins Now And Beyond - FOSDEM 2010
 
Drizzle - Status, Principles and Ecosystem
Drizzle - Status, Principles and EcosystemDrizzle - Status, Principles and Ecosystem
Drizzle - Status, Principles and Ecosystem
 
SQL v No SQL
SQL v No SQLSQL v No SQL
SQL v No SQL
 
MySQL for the Oracle DBA - Object Management
MySQL for the Oracle DBA - Object ManagementMySQL for the Oracle DBA - Object Management
MySQL for the Oracle DBA - Object Management
 
Know Your Competitor - Oracle 10g Express Edition
Know Your Competitor - Oracle 10g Express EditionKnow Your Competitor - Oracle 10g Express Edition
Know Your Competitor - Oracle 10g Express Edition
 
MySQL For Oracle Developers
MySQL For Oracle DevelopersMySQL For Oracle Developers
MySQL For Oracle Developers
 
The Ideal Performance Architecture
The Ideal Performance ArchitectureThe Ideal Performance Architecture
The Ideal Performance Architecture
 
MySQL Monitoring 101
MySQL Monitoring 101MySQL Monitoring 101
MySQL Monitoring 101
 
Getting started with MySQL on Amazon Web Services
Getting started with MySQL on Amazon Web ServicesGetting started with MySQL on Amazon Web Services
Getting started with MySQL on Amazon Web Services
 

Recently uploaded

Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clashcharlottematthew16
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfAddepto
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxNavinnSomaal
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brandgvaughan
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):comworks
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxhariprasad279825
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfAlex Barbosa Coqueiro
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piececharlottematthew16
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...Fwdays
 

Recently uploaded (20)

Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time ClashPowerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Transcript: New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Gen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdfGen AI in Business - Global Trends Report 2024.pdf
Gen AI in Business - Global Trends Report 2024.pdf
 
SAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptxSAP Build Work Zone - Overview L2-L3.pptx
SAP Build Work Zone - Overview L2-L3.pptx
 
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your BrandWordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):CloudStudio User manual (basic edition):
CloudStudio User manual (basic edition):
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
Bun (KitWorks Team Study 노별마루 발표 2024.4.22)
 
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptxArtificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdfUnraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
 
Story boards and shot lists for my a level piece
Story boards and shot lists for my a level pieceStory boards and shot lists for my a level piece
Story boards and shot lists for my a level piece
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks..."LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
 

Lessons Learned Managing Large AWS Environments

  • 1. Lessons learned managing large AWS Environments Ronald Bradford http://ronaldbradford.com @RonaldBradford 2013.06
  • 2. SCOPE Consulting experiences with AWS Several different clients Largest - 500+ servers Some 40-50+ servers Some 2-5 servers LAMP/RoR/RDS/Windows EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 3. ABOUT MySELF Ronald BRADFORD Enterprise Data Architecture 24 years with RDBMS - 13 years with MySQL Using AWS 4+ years Published author - 4 books Accomplished presenter - 8 years Work at Independent MySQL Consultant EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 4. Covering 1. Products 5. Instrumentation 2. Cost 6. Failure 3. Web Scale 4. Security EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 5. 1 AWS Products & Ecosystem EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 6. ABOUT AWS AMAZON WEB SERVICES 30+ Many, many products and features EC2, S3, EBS, ELB, RDS, EMR,VPC, CDN, SWF, SQS, SES, SNS, IAM, ... Mechanical Turk Flexible Payments Service (FPS) EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 7. AWS CONSOLE May 2013 Aug 2012 EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 8. Announcements Product Announcements http://aws.amazon.com/about-aws/newsletters/ Pricing Changes New instance types New features (e.g. IOPS) New Products (e.g. Redshift/ OpsWorks) EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 9. Announcements Product Announcements Examples in presentation http://aws.amazon.com/about-aws/newsletters/ Pricing Changes New instance types New features (e.g. IOPS) New Products (e.g. Redshift/ OpsWorks) EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 11. Product growth When I started No RDS, In-memory Cache, DynamoDB, Glacier No Elastic Beanstalk, OpsWorks No management console EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 12. 2 AWS Costs EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 13. operating cost Are you monitoring your costs? Daily Hourly EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 15. Operating Cost $29,000 p.m. $ ec2_cost.sh https://github.com/ronaldbradford/aws EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 16. Your Money What is AWS costing you? Instance types/sizes http://aws.amazon.com/ec2/instance-types Cost options http://aws.amazon.com/ec2/pricing EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 18. $ Instance Prices Large Instance (m1.large) EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 19. $ Instance Prices Large Instance (m1.large) On Demand $0.24 Reserved $0.136 * + Annual contract ( +$ 0.043) Spot $0.03+ * Can be terminated (budget) Per hour investment EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 20. $ Instance Prices Large Instance (m1.large) On Demand $0.24 Reserved $0.136 * + Annual contract ( +$ 0.043) Spot $0.03+ * Can be terminated (budget) Per hour investment EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 21. $ Instance Prices Large Instance (m1.large) On Demand $0.24 Reserved $0.136 * + Annual contract ( +$ 0.043) Spot $0.03+ * Can be terminated (budget) Per hour investment EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 22. $ Instance Prices Large Instance (m1.large) Was $0.32 til 11/19/2012 Was $0.26 til 1/16/2013 On Demand $0.24 Reserved $0.136 * + Annual contract ( +$ 0.043) Spot $0.03+ * Can be terminated (budget) Light/Medium/Heavy utilization Per hour investment 40% saving up to 80+% saving EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 23. SPOT EXAMPLE One hour (24 cents) 1 x Large - Reserved 7.5G, 4 CPUs, 850G 8 x Large - Spot or 1 x Eight Extra Large - Spot (cc2.8xlarge) 60G, 88 CPUs, 3.4T,10Gb NIC EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 24. SPOT EXAMPLE One hour (24 cents) 1 x Large - Reserved 7.5G, 4 CPUs, 850G 8 x Large - Spot price has changed 3 times in 8 months or 1 x Eight Extra Large - Spot (cc2.8xlarge) 60G, 88 CPUs, 3.4T,10Gb NIC EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 25. SPOT HISTORY 3c to 10c Zone A 3c to 40c Zone B 2013 $ ec2-describe-spot-price-history -t m1.large -d Linux/UNIX SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE SPOTINSTANCEPRICE 0.030000 0.100000 0.030000 0.100000 0.030000 0.030000 0.100000 0.060000 0.030000 0.240000 0.030000 0.030000 0.045000 0.050000 0.400000 0.260000 0.030000 0.030000 0.026000 2013-05-28T17:20:41-0500 2013-05-28T17:07:02-0500 2013-05-28T16:37:51-0500 2013-05-28T16:31:03-0500 2013-05-28T16:24:48-0500 2013-05-28T16:24:48-0500 2013-05-28T16:15:03-0500 2013-05-28T16:08:34-0500 2013-05-28T16:01:59-0500 2013-05-28T15:55:12-0500 2013-05-28T15:48:32-0500 2013-05-28T15:42:07-0500 2013-05-28T15:35:47-0500 2013-05-28T15:35:47-0500 2013-05-28T15:29:15-0500 2013-05-28T15:22:47-0500 2013-05-28T15:16:01-0500 2013-05-28T15:16:01-0500 2013-05-28T15:09:30-0500 m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX us-east-1a us-east-1a us-east-1a us-east-1a us-east-1d us-east-1a us-east-1a us-east-1d us-east-1b us-east-1b us-east-1b us-east-1a us-east-1a us-east-1b us-east-1b us-east-1b us-east-1d us-east-1a us-east-1a EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 26. SPOT HISTORY 2.6c to 17c (1/2 of 34c) One AZ only 2012 $ ec2-describe-spot-price-history -t m1.large -d Linux/UNIX 0.0260 0.0260 0.0290 0.0370 0.0600 0.1700 0.1600 0.0600 0.0900 0.0260 0.0260 2012-09-27T09:45:46-0800 2012-09-27T09:45:46-0800 2012-09-27T09:38:37-0800 2012-09-27T09:38:37-0800 2012-09-27T09:31:29-0800 2012-09-27T09:31:29-0800 2012-09-27T09:24:20-0800 2012-09-27T09:17:11-0800 2012-09-27T09:17:11-0800 2012-09-27T09:09:55-0800 2012-09-27T09:09:55-0800 m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large m1.large Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX Linux/UNIX us-east-1b us-east-1d us-east-1b us-east-1d us-east-1b us-east-1d us-east-1d us-east-1b us-east-1d us-east-1c us-east-1b EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 27. Using SPOTS Is your volume predicable? Splitting on-demand/spot instances Can work be done asynchronously? i.e. can be queued Is work restartable? EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 28. Using SPOTS Is your volume predicable? Splitting on-demand/spot instances Can work be done asynchronously? i.e. can be queued Is work restartable? WARNING: Not for general workloads EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 29. Instance sizes Evaluating the right instance size What is your bottleneck? EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 30. Instance sizes Evaluating the right instance size What is your bottleneck? Developing a tool to recommend savings EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 31. TRUSTED ADVISOR AWS now offers Trusted Advisor Recommendations to save money Improve performance Close security problems http://aws.amazon.com/premiumsupport/trustedadvisor/ EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 33. OTHER COST SAvings CDN - Cloudfront Bandwidth http://aws.amazon.com/cloudfront/ Reduce response size (e.g. 10%) Storage old EBS snapshots Remove unused instances NEW: Announced 1/9/2103 CloudWatch Alarm Actions EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 34. 3 Web Scale (hint: no humans) EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 35. ABOUT WEB SCALE GUI = #FAIL CLI is necessary Manual CLI use is slow Automation in crucial Parallel EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 36. AWS CLI’s Different for EC2, ELB, RDS etc Updated frequently (i.e. monthly) $ git clone https://github.com/ronaldbradford/aws.git $ cd aws/scripts $ ./aws_cli_configure.sh EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 37. AWS CLI’s Different for EC2, ELB, RDS etc Updated frequently (i.e. monthly) Simple helper $ git clone https://github.com/ronaldbradford/aws.git $ cd aws/scripts $ ./aws_cli_configure.sh EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 39. Identifiers Access Key ID Private Access Key X.509 Certificates (2 of) Private (*) & Public AWS Account ID Canonical User ID https://portal.aws.amazon.com/gp/aws/securityCredentials EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 40. CLI Examples Launch Script Demand/Spot or switch between Verify SSH Verify MySQL Verify replication in sync Add to ELB EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 41. CLI Examples Audit Script Consolidates information Parallel operations Unused EC2/EBS etc Feeds reporting ELB/EC2 usage EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 42. CLI EXAMPLES Others Cost Measurement Cloning (optimizes scale-up) Move servers between load balancers Spot History graphing Spot History email alerts EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 43. 4 AWS Security EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 44. SECURITY Do not give away the front door keys Do not open all the windows EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 45. SECURITY OPTIONS Keypairs Learn the different benefits Security groups Virtual Private Cloud (VPC) Identity and Access Management (IAM) Multi-factor authentication http://aws.amazon.com/mfa/ EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 46. SECURITY TIPS Restrict open access to port 80/443 Jump box Restrict IP Access Additional authentication Per user SSH authentication Do not use keypair EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 47. products Many Others (AWS Summit 2013) Cloudaware Dome9 Enstratius SafeNet AlertLogic EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 48. 5 Instrumentation EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 49. Instrumentation EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 50. Instrumentation What is important to you? EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 51. Instrumentation What is important to you? All server stats EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 52. Instrumentation What is important to you? All server stats Sampling issues EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 53. Instrumentation What is important to you? All server stats Sampling issues Deceiving averages (frequency) EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 54. REQUESTS PER SEC 5 second averages, not 1 minute sample https://github.com/ronaldbradford/reqstat EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 55. REQUESTS PER SEC 5 second averages, not 1 minute sample https://github.com/ronaldbradford/reqstat EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 56. REQUESTS PER SEC -1,500 RPS 5 second averages, not 1 minute sample https://github.com/ronaldbradford/reqstat EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 57. outliers EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 58. outliers I care about these EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 59. TESTING End to end testing critical Network latency ELB performance EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 60. products AWS Cloudwatch Many Others (AWS Summit 2013) Datadog AppDynamics Boundary CopperEgg EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 61. products AWS Cloudwatch What features matter? Many Others (AWS Summit 2013) Datadog AppDynamics Boundary CopperEgg EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 62. 6 Failure EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 63. FAILURE EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 64. FAILURE Instances fail EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 65. FAILURE Instances fail Outages occur AWS scheduled reboots EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 66. FAILURE Instances fail Outages occur AWS scheduled reboots Be prepared Chaos Monkey http://www.codinghorror.com/blog/2011/04/working-with-the-chaos-monkey.html EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 67. CONCLUSION EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 68. CONCLUSION Cost Management (saving money) EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 69. CONCLUSION Cost Management (saving money) CLI automation EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 70. CONCLUSION Cost Management (saving money) CLI automation Instrumentation (inc business metrics) EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 71. CONCLUSION Cost Management (saving money) CLI automation Instrumentation (inc business metrics) Distribute your application & data EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 72. CONCLUSION Cost Management (saving money) CLI automation Instrumentation (inc business metrics) Distribute your application & data Disaster is inevitable EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 73. AWS for FREE http://aws.amazon.com/free/ Free EC2 t1.micro for a year Free RDS t1.micro for a year S3, DynamoDB, SimpleDB, +++ EffectiveMySQL.com - Performance, Scalability & Business Continuity
  • 74. Ronald Bradford http://effectiveMySQL.com EffectiveMySQL.com - Performance, Scalability & Business Continuity