Just some presentation I gave a few years ago.

1. Gary Berger
Technical Leader, Engineering
Office of the CTO, DSSG
Biggest Problems in Cloud Design Today
Source: http://visibleearth.nasa.gov

2. Internet being dominated by
real-time entertainment
Source: Sandia, 2010 Global Internet Phenomena Report

3. What is an Architect?
IMHOTEP
DOCTOR, ARCHITECT, HIGH PRIEST, SCRIBE
AND VIZIER TO KING DJOSER
“An architect does not arrive at his finished
product solely by a sequence of
rationalizations, like a scientist, or through the
workings of the Zeitgeist. Nor does he reach
them by uninhibited intuition, like a musician
or painter. He thinks of forms intuitively, and
then tries to justify them rationally. Peter
Collins 1966
“Good architecture has been seen largely as
either working within a context or
circumventing it, depending on which
principles are adopted and where the cutting
edge is perceived.” Theory of Architecture,
Paul-Alan Johnson, 1994

4. Neolithic Architecture
6800BCE– 3200BCE
Stonehenge Circa 3000BCE
Secrets of Stonehenge, Nova 2009

5. Neolithic Technology
The Lever Ball Bearings

6. Why is Architecture hard
to understand?
“Whereof one cannot speak, one must pass over in silence.”
Wittgenstein

7. Tacit Knowledge
(Informal Knowledge)
• Knowledge that is difficult to
transfer to another person by
means of writing it down or
verbalizing it.
• Knowledge which cannot be
codified, but can only be
transmitted via training or
gained through personal
experience.
• Inherent “know-how” -- as
opposed to “know-what”
(facts), “know-why”
(science), or “know-who”
(networking). It involves
learning and skill but not in a
way that can be written
down.
Source http://en.wikipedia.org/wiki/Tacit_knowledge adapted from 'The Tacit Dimension, philosopher-chemist Michael
Polanyi
W.T. Wallington walks a 21,600lb
stone

8. Explicit Knowledge

9. "Knowledge as the
Competitive Resource”
• "Knowledge is not just another resource alongside the
traditional factors of production --labor, capital and
land- but the only meaningful resource today” -
[Drucker, 1993]
• “Knowledge is the source of the highest quality power
and is the key to the power-shift that lies ahead.
knowledge is not merely an adjunct of money power
and muscle power but eventually will be the ultimate
replacement of other resource” -[Toffler, 1990]
• “The economic and producing power of a modern
corporation lies more in its intellectual and service
capabilities than in its hard assets such as land, plant
and equipment - [Quinn, 1992]

10. Caution low flying cloud..
…into the fog

11. Exalogic
VCE
XML
ESX
KVM
Linux 2.7
Fusion
IBM
R
Flash
FPGA
Websphere
HTML5
CLOS
Butterfly
Hypercube
Cayley Tree
SpringSource
Congestion
PUE
Cisco

12. Awesome Ladder!
Von Neuman
Architecture John Von Neumann
INPUT
/
OUTPUT
INSTRUCTION
&
DATA
MEMORY
ALU
REGISTERS
CONTROL
CPU
CONTROL & ADDRESS
DATA & INSTRUCTION BUS
1903-1957

13. Cloud ArchitectureAdrian Colyer, CTO Spring Source

14. Independent
Compute POD
Data Network
Unified I/O 10GE
Data Snooping/Migration
Capacity Scaling
Block Store
Data Center Blueprint
I/O Scaling
POD Services Tier
Client Access Tier
HTTP
Compute/Data Grid

15. Things we are going to
talk about
• Dealing with Scalability
• Dealing with Data
• Dealing with Security

16. Sumerian Architecture
3600BCE– 2300BCE
Pyramid of Djoser
2630BCE – 2611BCE

17. Sumerian Technology
The Wheel
circa 3500BCE
Adobe-brick

18. What is Scalability?
Mechanical and Biological systems all have limits
Scaling Factors
• All systems reach a limit
relative to their size.
• Understanding where
these limitations arise
gives us a clue where
to look for
performance
bottlenecks
• Architects typically find
limitations through trial
and error.
• Concurrency = The
interaction between
processors
• Contention = The degree
of serialization on shared
writeable data
• Coherency = Penalty
incurred for maintaining
consistency of shared
writable data

19. Processor Scalability
What happens when you break a bottleneck!

20. Nominal Computer
Access Times
Source; Analyzing Computer Systems with
Perl , Gunther
Source; Jeff Dean, Google

21. Scalability Can Be
Measured
Guerrilla Capacity Planning, Gunther, 2007
Universal Scalability Law
• C(p) = scaleup|scaleout
• p = number of processors
• a = serialized
fraction(contention)
• k = coherency k>=0
• Scalability is not infinite but a
concave function
We are making an
assumption here that we
have an exponentially
distributed load and service
rate (i.e. a Poisson
Distribution)

22. Why Scale-Up is Important
Beyond Wimpy Cores
Max Capacity p*
Asymptotic Maximum
ceiling
Coherency starts to dominate
k
Amdahl k=0

23. Conclusion
We Need Models Moore’s Impact[1]
• Effectively modeling some of
these characteristics are top of
mind problems for current
application architects
• Eric Brewers CAP Theorem
challenges architects to deal
with latency as a proxy for strong
consistency..
• Much work going on in
understanding these problems
and building a balance between
availability and consistency (i.e.
adaptive consistency)
• Some patterns make it difficult to
model mathematically
• Technologist’s Moore’s Law
o Double Transistors per Chip every 2
years
o Slows or stops: TBD
• Microarchitect’s Moore’s Law
o Double Performance per Core
every 2 years
o Slowed or stopped: Early 2000s
Multicore’s Moore’s
Law
o Double cores per chip every 2 years
• Double Parallelism per
Workload every 2 years
o Aided by Architectural
Support for Parallelism
o Double Performance per Chip
every 2 years
Or GAME OVER?1. Amdahl’s Law in the Multicore Era, Hill, Marty, Wisconsin Multifacet Project

24. Ancient Egyptian
Architecture
3000BCE– 300CE
Pyramids at Giza
2575BCE to 2150BCE
Hatshepsut’s Temple
Circa 1482BCE

25. Ancient Egyptian
Technology
Schematics
Denderah and the Temple of Hathor
being built by Cleopatra
Circa 30 BCE – 14CEzzz
Process Documentation
Rope Making

26. Data Management
Data management is the development, execution
and supervision of plans, policies, programs and
practices that control, protect, deliver and
enhance the value of data and information assets
What are the two most important commands in the
data center today?
(NFS Read/Write)
Source: Data Management International, dama.org

27. Data Management
Models Practices
• Request level parallelism
• Data level parallelism
• Persistence model
• Durable, Volatile,
Transient
• Caching Eviction Policies
• Synchronous/Asynchrono
us Updates
• Denormalization of data
• Caching Trees
o Anti-cache spoilers
• Distributed Hash Tables
(NOSQL)
o Key/value
o Column
o Document
o Graph
• Messaging and
Serialization(IPC)
o Lightweight interfaces (PB, Thrift,
HC)
• Distributed transactions
o Opportunistic locking
o Vector Clocks
o Paxos protocols

28. Jason McHugh, Principal Engineer, Amazon
Flash Crowds
Demand spike on singular resource
• 69.6 seconds receive
31K requests for a single
object
• Cache spoilers
• Cache trees and
coherency protocol
built into relax
consistency to protect
availability

29. Data Structures
Set Theory
Source Big Data in Real-Time at Twitter, Nick Kallen,
QCONSF, 2010

30. Classical Architecture
850BCE– 475CE
Parthenon

31. Classical Technology
150BCE– 100BCE
Antikythera Machine

32. The “Illusion” of Security
• Perimeter defense seals
off data center so
attack surface moves
to the client
• Attackers find path of
least resistance
o Email Addresses
o Social Websites
o Standard naming practices )i.e.
firtname.lastname@company.c
om
The Apple I,
Recently sold for $210,000
“Simply keeping out bad code is not sufficient to keep out bad
computation” Stefan Savage, UC San Diego

33. Modern Attacks
Easy to 0wn, Normal processing leads to code execution
Mitigation Strategies
• Memory Trespass
• Rogue AV through mass mailings
• Injection Flaws (SQL, OS, LDAP)
• Cross Site Scripting
• Broken Authentication and
Session Management
• Insecure Direct Object
References
• Cross-site Request Forgery
Summary
• Normal processing leads to code
execution
o Receive packet/request
o Parse display/data
• ASLR (Address Space
Layout Randomization)
• DEP (Data Execution
Prevention)
• Stack Cookies
• Sandboxing
• Need to understand
strategy more than
tactics
Examples

34. Source: Dino A. Dai Zovi, Memory Corruption, Exploitation and You
Workstation Attack
Surface

35. Zero Day Attacks
• The price of disclosure?
• There are 1419 Researchers working at ZDI?
• ZDI can be used to launch a new Aurora attack

36. Modern Browser Attack
Graph
Source: Dino A. Dai Zovi, Memory Corruption, Exploitation and You

37. Architectural Ladders
3000 BCE 300 CE
Neolithic Architecture
Sumerian Architecture
Ancient Egyptian
Architecture
Classical Architecture

38. Architecture
• Architecture is created to express
some intent but is not the purpose
itself, therefore architecture must
serve a purpose
• Architectures must evolve or die,
sometimes at the expense of the
intent and function
• Architectures can be rediscovered,
refactored and reused for a new
purpose or function
• Architectures may not realize their
full potential
• Architectures do not replace
fundamentals in engineering and
science but establish a pattern
from which to describe its
effectiveness
Foote, Yoder, 1999, The Big Ball of Mud
ZIGGURAT: Dubai’s Carbon Neutral Pyramid
Will House 1 Million

39. Conclusion
• Some of the problems today have been recognized over a
decade ago but lacked the economic justifications for
change
• History repeating as we move to refactoring architectures of
the past “Engineered Solutions” just at different scales
• New architectures being proposed based on empirical
evidence, prototyping and experimentation, others just a
horrible guess
• Architects need to quickly establish new patterns with the goal
of pushing the bottlenecks to the least cost contributor (i.e.
Energy Proportional Computing).
• Architecture should help us to describe intent of the product
or function not merely as a generalization
• Architectures today are agile
• Architecture for efficient computing which maximizes
processing power per joule of energy.

40. Uggh.. Predictions?
• By 2012, 20 percent of businesses will own no IT assets
• By 2012, India-centric IT services companies will represent 20
percent of the leading cloud aggregators in the market (through
cloud service offerings)
• By 2012, Facebook will become the hub for social network
integration and Web socialization
• By 2013, mobile phones will overtake PCs as the most common
Web access device worldwide
• By 2014, most IT business cases will include carbon remediation
cost
• By 2014, over 3 billion of the world's adult population will be able
to transact electronically via mobile or Internet technology
• By 2015, context will be as influential to mobile consumer services
and relationships as search engines are to the Web
• By 2016, all Global 2000 companies will use public cloud services.

41. Thank You

42. Backup

43. Stonehenge – Woodhenge - Bluehenge
Around 3 miles

44. Meta Structures to scale
Service Directory MetaDataMetaData
MetaData MetaData
MetaData MetaData
Content Content
Content
ContentContent
Content

45. Persistency
pNFS RFC5661 HoneyComb 2
• Parallel Opens by file
handle
• Asynchronous
notification on lock
availability
• Commands linearized
in slot table
• Support for File, Object
and Block targets
• Automated data management
• Extreme data mobility
• Ability to run 3rd party storage apps
• Highly Reliable with self healing
• Flat name space
• Single management entity
• Multi‐cell architecture
• Programmatic APIs
• Immutable
• Automatic load balancing
• Transparent node upgrades
• Meta‐data support
• Storage apps support
• Deferred maintenance model
• Open‐Source Software only

46. Clustered Scalability
Guerrilla Capacity Planning, Gunther, 2007
Universal Scalability Law
• C(p) = intranode scalability
• n = nodes
• p,n = processors/node
• az = global internode contention
• kz = global internode coherency

47. Impact on application
Source Big Data in Real-Time at Twitter, Nick Kallen, QCONSD, 2010