Enabling Microservices @Orbitz - Velocity Conf 2015
•
9 likes•2,994 views
Slides from Orbitz's use case for microservices on docker & mesos at Velocity Santa Clara 2015 conference. Details: http://velocityconf.com/web-mobile-business-conf-2015/public/schedule/detail/40700
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (14)
Similar to Enabling Microservices @Orbitz - Velocity Conf 2015
Similar to Enabling Microservices @Orbitz - Velocity Conf 2015 (20)
More from Steve Hoffman
More from Steve Hoffman (6)
Recently uploaded
Recently uploaded (20)
Enabling Microservices @Orbitz - Velocity Conf 2015
- 1. Enabling Microservices @Orbitz Steve Hoffman Senior Principal Engineer @bacoboy Rick Fast Senior Principal Engineer @tortiepoint
- 5. #velocityconf 2015 Outline • Brief Architecture Overview/History • From Monolithic to Services to Microservices/Docker • Automated Pipelines • Questions
- 8. #velocityconf 2015 2000 Yes, we are STILL hiring!
- 9. #velocityconf 2015 2000 Yes, we are STILL hiring! @OrbitzTalent
- 25. #velocityconf 2015 2012 • Multiple Brands • Websites • Webservices • Multiple Backends • 500+ apps / thousands of instances • Deployments Daily (sometimes more)
- 26. #velocityconf 2015 2015 • Multiple Brands • Websites • Webservices • Multiple Backends • 500+ apps / thousands of instances • Deployments Daily (sometimes more)
- 29. #velocityconf 2015 Different Provisioning Tools DEV OPS Application Platform!=
- 30. #velocityconf 2015 A New Experiment • Microservices? • Decompose single “service” into the actual 40+ sub-services • Any change to sub-service was a deployment of many • Could it be a simple Spring Boot App in Docker (12 factor?) • Backward compatible with existing service infrastructure. • Code to Production w/o help from other Humans - Minutes not Days
- 31. #velocityconf 2015 The Docker Slave aka “The Rickbot”
- 32. #velocityconf 2015 The Docker Slave aka “The Rickbot” App App App
- 35. #velocityconf 2015 App App App Register & Lookup
- 69. #velocityconf 2015 Editorial Module A Continuously Deployed Microservice www.orbitz.com (scroll down)
- 71. #velocityconf 2015 Orbitz Content Orchestration Service Content (Solr) Editorial Module Search Module Hotel Module Hotel Team Search Team Content Team
- 74. #velocityconf 2015 Pre-Continuous Delivery 1.2-‐BETA-‐20150401-‐113002 Test Discard Test Discard 1.2-‐BETA-‐20150402-‐093002 Build Build And so on…
- 75. #velocityconf 2015 Pre-Continuous Delivery 1.2-‐BETA-‐20150401-‐113002 Test Discard Test Discard 1.2-‐BETA-‐20150402-‐093002 Build Build Test Deploy 1.2 Build
- 76. #velocityconf 2015 Continuous Delivery with Jenkins, Docker, and Ansible (And then Marathon)
- 77. #velocityconf 2015 rfast-mbp:git rfast$ yo microservice _-----_ | | .--------------------------. |--(o)--| | Welcome to the kickass | `---------´ | Microservice | ( _´U`_ ) | generator! | /___A___ '--------------------------' | ~ | __'.___.'__ ´ ` |° ´ Y ` ? Enter the name of your service. (E.G. "my-service") Yo
- 84. #velocityconf 2015 build unit test publish deploy dev acceptance tests deploy qa deploy staging open RFC deploy prod close RFC Pipeline (Simplified)
- 86. #velocityconf 2015 if(…) { x ++; } 1.2 Merge 1.2. editorial-module.jar ./gradlew build {BUILD_NUMBER} Build
- 88. #velocityconf 2015 1.2 Merge editorial-module.jar FROM orbitz/java-8 ADD build/editorial-module.jar /opt/orbitz CWD /opt/orbitz CMD java -jar editorial-module.jar if(…) { x ++; } 171.2. Build
- 89. #velocityconf 2015 1.2 Merge editorial-module.jar orbitz/editorial-module:1.2.17 if(…) { x ++; } 171.2. Build
- 91. #velocityconf 2015 - hosts: dev - tasks: - name: find previous images docker_facts: image=orbitz/{{application}} register: previous - name: deploy new image docker: image=orbitz/{{application}}:{{version}} … - name: wait for service wait_for: port={{port}} … - name: check health endpoint uri: url="http://{{fqdn}}:{{port}}/health" … - name: kill old image docker: {{previous}} git pull playbook.yml (abridged) Deploy
- 92. #velocityconf 2015 host-001 host-002 host-003 host-004 host-005 - hosts: dev Deploy
- 102. #velocityconf 2015 How to handle failure?
- 103. #velocityconf 2015 What happens when a VM is moved?
- 104. #velocityconf 2015 What if I need to add capacity?
- 105. #velocityconf 2015 - hosts: dev - tasks: - name: find previous images docker_facts: image=orbitz/{{application}} register: previous - name: deploy new image docker: image=orbitz/{{application}}:{{version}} … - name: wait for service wait_for: port={{port}} … - name: check health endpoint uri: url="http://{{fqdn}}:{{port}}/health" … - name: kill old image docker: {{previous}} git pull playbook.yml (abridged) Deploy
- 106. #velocityconf 2015 - hosts: dev - tasks: - name: find previous images docker_facts: image=orbitz/{{application}} register: previous - name: deploy new image docker: image=orbitz/{{application}}:{{version}} … - name: wait for service wait_for: port={{port}} … - name: check health endpoint uri: url="http://{{fqdn}}:{{port}}/health" … - name: kill old image git pull playbook.yml (abridged) - hosts: localhost - tasks: - name: marathon deploy marathon: image=orbitz/{{application}}:{{version}} instances=3 Deploy
- 107. #velocityconf 2015 git pull playbook.yml (abridged) - hosts: localhost - tasks: - name: marathon deploy marathon: image=orbitz/{{application}}:{{version}} instances=3 Deploy
- 109. #velocityconf 2015 Mesos Agent New host setup 1.2.16 Deploy
- 113. #velocityconf 2015 - tasks: marathon: … PUT /apps/editorial-module { “image”: “orbitz/editorial-module:1.2.17” … } 1.2.16 1.2.16 1.2.16 Deploy
- 114. #velocityconf 2015 Deploy PUT /apps/editorial-module { “image”: “orbitz/editorial-module:1.2.17” … } - tasks: marathon: … 1.2.16 1.2.16 1.2.16 app = GET /v2/apps/editorial-module if not app then deploy_id = POST /v2/apps { “image”: “orbitz/editorial-module:1.2.17”, “id”: “editorial-module” } else deploy_id = PUT /v2/apps/editorial-module { “image”: “orbitz/editorial-module:1.2.17” } end if while GET /v2/deployments contains deploy_id // still deploying end // deploy complete
- 115. #velocityconf 2015 - tasks: marathon: … PUT /apps/editorial-module { “image”: “orbitz/editorial-module:1.2.17” … } 1.2.16 1.2.16 1.2.16 Deploy
- 118. #velocityconf 2015 - tasks: marathon: … /health 1.2.16 1.2.16 1.2.16 1.2.17 1.2.17 1.2.17 Deploy
- 119. #velocityconf 2015 - tasks: marathon: … /health 200 OK 200 OK 200 OK 1.2.16 1.2.16 1.2.16 1.2.17 1.2.17 1.2.17 Deploy
- 121. #velocityconf 2015 And off to the next environment… 1.2.17 1.2.17 1.2.17 Deploy
- 133. #velocityconf 2015 What’s inside the containers? • Spring Boot • Dropwizard Metrics (formerly Coda Hale, Yammer) • Consul Registration/Discovery OrbitzWorldwide/consul-client • Logstash + Logback • Swagger • Hystrix • Retrofit + Consul
- 134. #velocityconf 2015 “Why didn’t you use {{.x}} ?”
- 135. #velocityconf 2015 Keeping an eye on… Kubernetes Amazon Elastic Container Service Docker Swarm
- 136. #velocityconf May 2015 Summary • Create a platform for docker deployments using shared and app-specific “localhost” helpers — this was ours, yours SHOULD look different — adapt to change, don’t fight it. • People don’t scale, use automation • Docker - repeatable applications (environment portable apps) • Chef - repeatable infrastructure (environment aware services) • Jenkins - repeatable releases (pipelines) • Delineate configuration concerns: • Known at Compile time — Bake into Docker image • Known at Boot time — Bake into Playbook/Launcher - parameter to Docker run • Changes Anytime — Externalize (consul K/V, etcd, zookeeper)