AWS success stories the benefit for adopting AWS/Chef/sumologic in automation

1. 2014 AWS RE:INVENT
和我們的故事
Mmik Huang

2. MMIK HUANG
 6 years in Trend, 2 years in IT and 4 years in QA
 12 years IT industry
 2014 project: SecureCloud disk encryption service @ AWS
 Current project: Deep Security @ Azure

3. PAIN POINT FOR RD/QA
 在過去4年的測試經驗中，發現最花時間的幾件事情有以下幾點
 In the previous 4 years experience, the pain point from RD/QA
 New feature/OS support.
 Prepare New OS template
 Keep system up to date
 Lab testing environment
 GA Deploy
 Collect log

4.  Cloud Service 可以幫助你解決的問題有哪些 ?
 What kind of cloud services you can use ?

5.  新版本的作業系統
 New version of OS
 自動化服務
 Automatically services

6.  有哪些Cloud我們有使用過?
 What kind of cloud we have experience?
 Aws (Xen)
 Azure (hyper-v)
 ETS (vCloud)
 Terremark (cloudstack)
 Hpcloud (openstack)
 Rackspace (openstack)

7.  試試看AWS吧 !!!
 Try AWS !!!

8.  極低的入門門檻
 Easy to leverage
 Free tier, easy to pay
 Free support
 SQL Services, Auto scale Services, monitoring Services……
CLOUD JOURNEY

9.  如果已經有使用Cloud的經驗，想要改善現有的測試架構，要如何開始?

10.  換個方式問: 如果你想蓋個房子，有哪幾種選擇?
 What is the first thing you will do, if you want to build a house?

11.  方案1: 直接動作做，大不了拆了重蓋?
 方案2: 聽聽看別人怎麼做?
 Option1: just do it~
 Option2: get advice from expert.

12.  以宅宅工程師的個性，方案1 !!!
 As a geek, option1 !!!

13.  做中學，從錯誤中學到經驗
 Learning from failure is a good thing.

14.  不過，如果是蓋300億的巨蛋呢?
 But if you want to build a 30 billion Taipei Dome?

15.  方案2 !!!
 Option2 !!!

16.  方案1跟方案2的差別在於哪裡?
 What is the different between option1 and option2?

17.  架構規劃
 Good planning before starting

18.  如果你想參考別人在AWS的架構，要去哪裡獲得呢?
 If you want to get advice for AWS services, where you can go?

19.  AWS Re:Invent !!!

20.  Learning AWS 2014 Re:Invent on Youtube
https://www.youtube.com/channel/UCd6MoB9NC6uYN2grvUNT-Zg
 Slide share
http://www.slideshare.net/AmazonWebServices/presentations
AWS 2014 RE:INVENT

21. MLB
 7TB of data per game, 2340 games per session = 17PB of raw data
 How will statcast change baseball (5:21)
 https://www.youtube.com/watch?v=847HY-JATrs
SUCCESS STORIES

23.  Yelp
 http://www.yelp.com/
 http://www.businessinsider.com/pacific-trust-
thinks-yelp-is-deteriorating-2015-4
 Map of restaurants
 S3: 1.2TB log per day
 Hadoop
MapReduce job: 30TB / 250 jobs
SUCCESS STORIES

24. SUCCESS STORIES
 AdRoll
 https://www.adroll.com/
 Provide CRM Service
 S3: 1.5PB
 Physical Servers

25. SUCCESS STORIES
 Kellogg
 http://www.kelloggs.com/en_US/home.html
 Food provider
 SAP HANA on AWS
 S3: 16TB

26. SUCCESS STORIES
 Novartis
 https://www.adroll.com/
 EC2: 10,600 spot instance
 Datacenter cost down (Own -> Rent)
 39 years data under 9 hours

27.  另外，聽聽看我們使用AWS的故事
 Here is our story

28.  出發前，當時測試環境的狀態
 嘗試使用AWS做測試環境，beta site，staging site
 嘗試透過AWS 作環境自動化
 嘗試建立 log collect system
 The status before AWS Re:invent
 Try to use AWS as test lab, beta site and staing server
 Try to use 3rd party tool to build environment automatically
 Survey and build log collect system.

29.  出發前收到 AWS 2014 Re:invent 的重點項目
 The hightlights of AWS 2014 Re:invent
 Service
 App development & mgmt.
 Big data & DR
 Security
 AWS development tool
 All kind of architecture
 Success stories in different view
 AWS infra enhance

30.  了解自己的需求，跟看過重點項目後
 記得出發前的第一件事情是
 Remember, the first thing before going to AWS Re:invent is

31.  針對自己需求選課!!!!，四天可以聽的東西實在多到爆炸…
 Pick sessions online, there are too many thing need to share in 4 days

32.  很多想聽的會衝堂，要提早做決定
 Sometimes, the sessions you want to go will start in the same time, you need to pick one

33.  最好提早一天到飯店，到的時候放完行李，就去會場逛逛，熟悉一下
 Go to seminar before AWS Re:Invent, check the map and the room location before you
go

34.  早起的鳥兒 AWS 有得吃，準時開動準時開課，記得帶個水瓶去，沙漠水很貴
 Get up early, you can get breakfast from AWS ($0, $28.99)
 Water is free in AWS, but not free outside

35.  人實在太多，很多資源都是有限的，座位，食物，正妹解說員 : P
 Attend to any session on time, everything is limited, food , seats, even representative : P

36.  這次參加AWS Re:Invent最大的收穫，不是上課，是認識人
 問講師問題，快速判斷哪些自動化服務可用，跟講師留聯絡資訊
 吃飯時跟旁邊其他的公司員工打屁，順便 promote 一下自己的產品
 去 Booth 看哪些廠商的產品可以試用看看
 The best experience from AWS Re:Invent is not the sessions, is ….
 Asking questions to presenter, learning failure experience from them
 Talking to the people seat with you, lunch with you, get some feedback related
to your own product
 Going to booth and survey what you can use on the market

37.  要認識人，記得要帶名片，還有準備一個 twitter account
 Bring your name cards there!!! As possible as you can, left email to 3rd party venders and
get evaluate license for service you are interesting.
 People use twitter there, not facebook, not line, not skype

38.  四天吸收足夠的最新資訊後，就可以決定一下…..
 After 4 days, you will learn a lot of new technical knowledge

39.  要賭一把大的，還是回家繼續當宅宅工程師
 You can decide to use it in casino, or go home

40.  回去後，運用新知識，做出測試環境自動化
 把小範圍測試，擴大測試範圍到100個OS
 把python code 移植到 aws
 利用 chef 做到auto launch/purge vm
 利用 Sumologic 蒐集log
 After back home, we use knowledge to enhance QA testing
 Extend OS coverage to 100
 Use the same python code to test AWS, ETS lab vm
 Use chef to build environment on AWS
 Use Sumologic as log collect system

41.  改善環境自動化後，對我們的效益
 Benefit for our product

42.  過去，非常多的地方需要QA花時間，人力下去準備
 Too many human resource (QA) manually trigger script, maintain environment
 Phrase1 prepare environment
 [QA] Launch AWS instance
 [QA] install staff
 [QA] Setup related environment information (hosts, DNS, shell)
 [QA] Save as template
 [QA] Study AWS api, write code to handle instance (start,stop)
 Phrase 2 trigger test
 [QA] Launch AWS instance
 [QA] execute python + staff
 [staff] Deploy testing code
 [staff] Trigger testing and collect result/log
 Phrase 3 get log and test result
 [QA] check instance one by one, cost high for investigate

43.  經過環境自動化改善後，每個階段都大幅減少人力的時間
 After leverage new knowledge, we can do things smart than before
 Phrase1 prepare environment
 [AWS] leverage default aws template, no need to customize
 Phrase 2 trigger test
 [QA] Launch AWS instance
 [Chef] execute python + staff
 [staff] Deploy testing code
 [staff] Trigger testing and collect result/log
 Phrase 3 get log and test result
 [Sumologic] collect log to Lab server
 [QA] check log, reproduce fail case

44.  並且讓品質測試更穩定，涵蓋率更高，需要的人力更少
 Product background
 Support OS template on AWS: 58 (windows/linux)
 Support AWS 11 regions (different region with different AWS template)
 Aws will renew template every 6 months
 AWS templates/regions will increase day by day
 Old day:
 Prepare 58 template every 6 months (launch instance, implement staff, save as template)
 Maximum coverage will be 638 templates (58*11) * ? hours
 Can not collect log back to lab
 New way:
 No need to prepare template, use default AWS template
 Using chef to launch instance in 15 sec then deploy staf/python code to client
 Collect log back to lab for investigate.

45.  新架構的好處
 Benefit for new test framework
 Benefit – easy scale out
 CSP (HP/Azure/AWS/vCloud…….)
 Zone (public/VPC/US/JP…..)
 OS (RHEL/Cent/uBuntu….)
 Benefit – easy adopt current test script
 You can move any shell command into chef
 Benefit – efficient
 testing for 1 instance from [1 day ] to [10-15 min]
 Benefit – Cost
 No storage cost for keep customized templates
 Benefit – easy investigate
 reduce cost for keep AWS vm running
 Centralized console for log search

46.  讓品質更好，不一定要全部都自己來
 在AWS Re:invent的Booth 認識了Chef的TAM，他幫我們搭建了跟工程師的橋梁
 淘汰了Puppet
 找到了三家collect log的廠商，在後來的POC決定用sumologic

47. REFERENCE

48.  如果聽完後，如果你對chef有興趣
 If you are interesting about chef software

49.  Create your first cookbook
 http://learn.getchef.com/legacy/tutorials/create-your-first-cookbook/
 Learning Chef on Youtube
 http://www.youtube.com/channel/UCxEieNpB_tXiUBoF9zkPmAw
 http://nathenharvey.com/blog/2012/12/06/learning-chef-part-1/
 Example
 http://gettingstartedwithchef.com/first-steps-with-chef.html

50.  如果聽完後，如果你對sumologic有興趣
 If you are interesting about sumologic software

51.  Sumologic official site
 https://www.sumologic.com/

52.  如果你正要去Las Vegas
 If you are interesting about Las Vegas

53.  Vegas
 bus
http://www.lasvegas-how-to.com/strip-downtown-express.php
 Show
https://www.caesars.com/ballys-las-vegas/shows/jubilee#.VE3YavmUd8G
 Buffet
http://www.totalrewards.com/microsites/las-vegas/buffet-of-buffets/

54.  Q&A