SmartNews has evolved its use of AWS over time from a monolithic application to microservices as its scale increased. It now uses over 300 EC2 instances, 80 ELBs, and many other AWS services. Configuration management has moved from pull-style deploys to using tools like CodeDeploy, Auto Scaling Groups, and infrastructure as code. Future plans include further containerization and event aggregation to improve scalability, safety, and measureability across services.
33. ➡ ➡
• CodeDeploy was used to automate deployment tasks
• Operating an AWS ELB
• Fetching a new revision
• Restarting services with our custom program
• e.g. downloading machine learning model data,
precompiling assets and deploying Docker containers
34.
35. Auto Scaling Group
• There is an advantage even if you don't want to autoscaling
• Easy to dispose
• replace kernel, switch to other OS, ...
• Easy A/B testing
• change config only specific server
• tag:Attributes
• Instance Protection
36. ASG ! InstanceName
• We were stop using InstanceName
• Using tag:Group and tag:Env
37. Infrastructure as Code
• Route53 ➡ winebarrel/roadworker
• Security Group ➡ winebarrel/piculet
• Elastic IP Addresses ➡ winebarrel/eipmap
• Provisioning ➡ itamae-kitchen/itamae
• Datadog ➡ airbnb/interferon
38. DSL management
is not perfect
• Complicated automation
• ChatOps ➡ change code ➡ git add && git commit && git
push
• Too much hassle... !
39. Run Command
• Secure
• IAM, CloudTrail
• Easy CI integration w/o SSH
• be able to use EMR also
46. Events aggregator
• Events
• Deploy/Provision/Restart/Terminate etc.
• All events goes to SNS or Kinesis. Users will describe and
hook scripts
• Visualize via Datadog
• Notice to Slack
• Auto healing
48. Summary• AWS release new service continuously
• We ride on the shoulders of giants
• We will never forget that OSS helped us
49. We're hiring!
Only two people on
Site Reliability Engineering Team
http://about.smartnews.com/en/careers/
50.
51. Credit
https://flic.kr/p/hAcPRk taken by Niuton may
https://flic.kr/p/9UnRWS taken by Alberto G.
https://flic.kr/p/ydnEvw taken by ep_jhu
https://flic.kr/p/pyfnTV taken by Kevin Dooley
https://flic.kr/p/mtLpc4 taken by L1mey
https://flic.kr/p/fgG226 taken by Linux Screenshots
https://flic.kr/p/7DsuLz taken by Gloson Teh
https://flic.kr/p/jfGpn7 taken by julochka