Cloudfoundry architecture

Cloud Foundry Architecture
Ramnivas Laddad
@ramnivas

© 2012 SpringOne 2GX. All rights reserved. Do not distribute without permission.

@ramnivas
•  Spring framework committer
•  Cloud Foundry committer
•  Main interests
–  Cloud computing
–  Aspect-oriented programming
–  Scala and functional programming
•  Author of books and articles
–  AspectJ in Action (1st and 2nd edition)
•  Speaker at many professional conferences
–  JavaOne, JavaPolis, SpringOne, Software Development, No Fluff Just Stuff, EclipseCon,
O’Reilly OSCON etc.
•  Active involvement in AspectJ, Spring, and Cloud Foundry since their
early form

Technologies “Я” Us
Closure Java
AMQP HTML5 Akka
Mongo Spring Scala
Redis JSF Grails
Hibernate node.js
RabbitMQ JDBC
Lift
Rails
JMS Ruby
Hadoop Sinatra
Batch Job Django
JTA Python
MySQL Web Services
JPA Caching LDAP
Postgres Scripting
Testing Security
Neo4j REST

Technologies “Я” Us
Access logs Network
Routing
Hardware failures DNS
Storage
Load balancing
Auditing Rolling Updates
User management

Security DoS
Backups DBA

OS Monitoring
Patches

Facets of complexity: Product
§  More functionality
§  Time to market pressure
§  Complex integration
§  Higher stake in quality

Facets of complexity: Development
§  Sound architecture: future proofing without overdoing
§  Unit and integration tests
§  Responding to changing business needs
§  Confusing technology landscape

Facets of complexity: Deployment and
operation
§  Choosing the right hardware, operating system, web server
§  Monitoring applications
§  Responding to scalability needs
§  Dealing with hardware- and system-level failures
§  Upgrading without substantial down time

Inherent vs. Apparent Complexity

Implementation


Implementation
Functional logic


Implementation
Functional logic Inherent
complexity


Implementation overhead
Implementation
complexity


Apparent
Implementation complexity

complexity


What can we do
about this?

Apparent
Implementation complexity

complexity

Three layers of Cloud Computing
SaaS
Software as a Service

PaaS
Platform as a Service

IaaS
Infrastructure as a Service

Cloud Foundry open PaaS - Choice of clouds

Data
Services Private

Clouds

Msg
Services
Public

Clouds

Other Micro

Services
Clouds


Data
Services Private

Clouds

Msg
Services
Public

Clouds

Other Micro

Services
Clouds

Apache2 license


Data
Services Private

Clouds

Partners

Msg
Services
Public

Clouds

Other Micro

Services
Clouds

Apache2 license

Architectural Goals
•  No single point of failure
•  Distributed state
•  Self healing
•  Horizontally scalable

Architectural Principles
•  Loose coupling
•  Event-driven
•  Asynchronous
•  Non-blocking
•  Idempotent
•  Eventually consistent
•  Language-independent communication

Cloud Foundry Layers

Clients
Inner Shell
Outer Shell
Infrastructure as a Service
Hardware (CPU, Memory, Storage, Network)

Cloud Foundry Core Components
The Inner Shell

Cloud Foundry Inner Shell and Up
Developers Users

Routers

CloudControllers Stagers App App

HealthManager
Execution Agents
Services
(DEA) Pool

Messaging

Zooming in…
App meta data

cloud
stager health
controller
manager
cc - db staging
jobs package
uaa - db cache
dea
dea
redis dea
dea
blobstore dea
uaa - AuthN dea
staging logs

© 2012 VMware, Inc. All rights reserved

Design Principles
•  Dynamically discoverable components
•  No inter-component dependencies
–  Launch in any order
–  Scale up and down independently
•  Monitor using HTTP end points

Cloud Controller
•  Interface with the clients
–  VMC
–  STS
–  Portal
•  Provides REST interface to domain objects
–  Apps
–  Services
–  Orgs
–  Spaces

Cloud Controller REST API

Demo

Stager
•  Responsible for morphing user app into executable
•  Pluggable architecture
–  Each plugin understands a framework or a runtime
•  Allow the DEA to view applications uniformly

Stager’s role

……………
……………
……………
Stager ……………
……………
…………… ……………
…………… ……………
…………… ……………
………….. ::::::::::
Spring Play Rails …

From bits to executable app

app.war

From bits to executable app

startup

app.war

stop

Developers Users

Routers


HealthManager
Services

Messaging

From bits to running app

startup

app.war

stop

From bits to running app

A startup
g
e app.war
n
t
stop

Droplet Execution Agent (DEA)
•  Responsible for running all apps
•  Monitors apps
–  Memory and disk quota
–  Stage changes
•  Uniform view of all apps
–  Runtime/framework differences sorted by the stager
•  Ensures app isolation

Application Isolation
DEA Container API

Host network

Private network

App
Private File System

Warden container

Router
•  Responsible to route requests to
–  User apps
–  External-facing components
•  Cloud Controller
•  UAA

Application Routing

Messaging

Application Routing

Router

Messaging

Application Routing

Router

url è host:port
DEA

Messaging

Application Routing
HTTP

Router

url è host:port
DEA

Messaging

Application Routing
HTTP

Nginx
(+Lua extension)

Locator Services

Router

url è host:port
DEA

Messaging

Developers Users

Routers


Execution Agents
Services
(DEA) Pool

Messaging

Health Manager
§  Expected state:
•  Cloud Controller
§  Current state:
•  DEAs

§  Current state ç Expected state

UAA
•  Centralized Identity Management
–  Authenticates users from multiple sources
–  Presents a single standard protocol for consumers
•  User Account Management
•  Client Application Registration
•  OpenID Connect and Oauth2 – delegated authorization
–  Uses Spring Security

Oauth2 for Cloud Foundry

CF Portal
Client

Cloud controller
User
Resource server
Resource owner

UAA
Identity provider

Who is this user
What is he/she requesting
Do I have the necessary authorization

Accesses the portal CF Portal
Client

Cloud controller
User
Resource server
Resource owner

UAA
Identity provider

Who is this user

Client

Authenticate me
Assert - Portal can only
Cloud controller
User read my apps
Authenticates user Resource server
Resource owner Issues authorization code

UAA
Identity provider

Who is this user

Client
Redirect user along
with the authcode

Authenticate me
Cloud controller
User read my apps

UAA
Identity provider

Who is this user

Client
Redirect user along
with the authcode Exchange authcode
for an access token
Authenticate me
Cloud controller
User read my apps
Issue access token scoped
to cloud_controller.apps.read
UAA
Identity provider

Who is this user
Present token containing
Accesses the portal CF Portal cloud_controller.apps.read
Client
Redirect user along
with the authcode Exchange authcode
for an access token
Authenticate me
Cloud controller
User read my apps
Issue access token scoped
to cloud_controller.apps.read
UAA
Identity provider

Developers Users

Routers


HealthManager
Execution Agents
(DEA) Pool

Messaging

Service Provisioning
•  Service Gateway
–  Provisions and unprovisions services
–  Advertise service availability to CloudController
•  Service Nodes
–  Runs actual services
–  Scale independently

Access to services info
VCAP_SERVICES: {!
"postgresql-9.0": [{!
"name": "env-postgresql",!
"label": "postgresql-9.0",!
"plan": "free",!
"credentials": {!
"name": "de24667f9344b4eeaad6b5a2326d52faa",!
"host": "172.30.48.122",!
"port": 5432,!
"user": "u50ce600bba434bacbc99e034bb415644",!
"password": "pf4dca5bd449d4732841f0c4ae3f299d0"!
}!
}]!
}!

Operating Cloud Foundry
The Outer Shell

Production Grade Cloud Foundry Clusters
cloudfoundry.com
§  500 – 5,000 VMs
§  40+ unique node types
§  75+ unique software packages
§  2x/week cf.com updates
§  24x7x365 non-stop operation
§  No-downtime deployments
§  Reliable, robust, repeatable
deployments, updates,
capacity adjustments
§  Small teams manage many production, staging, stress, qa,
instances dev

What is BOSH? github.com/cloudfoundry/bosh

Service Evolution Technology for
Operating Cloud Foundry in Production Environments

Automated Virtual Infrastructure
•  At Cloud Scale
•  Abstracted using a Cloud Provider Interface (CPI)
Software Deployment, Configuration and Updates
•  Optimized to Minimize Downtime
•  Support for multiple VM roles
Repeatable Process
•  Release Management with Versioning
Active Monitoring and Alerting
BOSH has been used to run CloudFoundry.com since launch

Cloud Foundry “BOSH” – Concepts

"BOSH"

Stemcell
• Base OS
• “BOSH” Agent

"BOSH"

Stemcell Release
• Base OS • Name
• “BOSH” Agent
Jobs
• Software Packages
• Configuration Templates
• Scripts
"BOSH" Software Packages
• Externally developed s/w
• Internally developed s/w

Deployment Manifest Stemcell Release
• Release name and version • Base OS • Name
• # VMs, params for each Job • “BOSH” Agent
• Stemcells to use Jobs
• Scripts

Deployment Manifest Stemcell Release
• Release name and version • Base OS • Name
• # VMs, params for each Job • “BOSH” Agent
• Stemcells to use Jobs
• Scripts

Environment
Configuration
Software Packages
Stemcell

Rolling Update of a Stateless Component
Incoming HTTP Incoming HTTP Incoming HTTP
Requests Requests Requests

Router Router Router

Create Create

Cloud Cloud Cloud Cloud Cloud
Controller Controller Controller Controller Controller
v1 v1 v2 v1 v2
Message Bus Message Bus Message Bus

Starting with v1 Deploy a v2 VM If it works, add more v2
VMs (canary) VMs...

Example: Rolling Update of a Stateless
Component
Incoming HTTP Incoming HTTP
Requests Router / LB Requests LB
Router /
End Result:
We upgraded from v1
Destroy Create
to v2 with no
downtime by
Cloud Cloud Cloud building new VMs and
Controller Controller Controller
v1 v2 v2
destroying old ones

Message Bus Message Bus

… while removing v1 … until all VMs are
VMs… v2

Deployment
§  Parallel
§  Canaries
§  Eventual consistency

Under the Hood
§  Components
•  Director
•  Agent
•  CLI
§  Stemcell

Cloud Provider Interface
•  Abstracts infrastructure
–  Stemcells
•  VM template
–  VMs
–  Disks
–  Networks

IaaS neutral by design
vSphere: battle tested implementation,
thousands of deployments
CPI: code complete
vCloud Director: “work in progress”, 2H 2012 functional status: “work in progress”

Cloud Foundry BOSH

Cloud Provider Interface (CPI)

contribute: github.com/cloudfoundry/bosh

Learn More. Stay Connected.
Twitter
•  http://twitter.com/cloudfoundry
•  http://twitter.com/ramnivas

Sign up online at cloudfoundry.com
•  Website: http://cloudfoundry.org
•  Blog: http://blog.cloudfoundry.com and http://blog.cloudfoundry.org
•  GitHub: http://github.com/cloudfoundry
•  YouTube: http://youtube.com/cloudfoundry

Cloudfoundry architecture

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Similar to Cloudfoundry architecture

Similar to Cloudfoundry architecture (20)

Recently uploaded

Recently uploaded (20)

Cloudfoundry architecture