The 5 Pillars of Cloudiness

5 PILLARS OF
CLOUDINESS
wayne walls
cloud evangelist
alex brandt
sr developer
Wednesday, August 21, 13

FIVE PILLARS
OF CLOUDINESS
1 2 3 4 5
Parallel Modular Horizontal Agile Secure
2

Pillar #1:
Parallel

1M
Records
Answer
Node
4

1M
Records
Answer
Node
1-250K
Node
251K-500K
Node
501K-750K
Node
751K-1M
5

6
1M
Records
Answer
Node
1-250K
Node
251K-500K
Node
501K-750K
Node
751K-1M

DATA
CALCULATION
MAP
CALCULATION
REDUCE
DATA
CALC
D
C
R
D
D
C
R
D
D
C
R
D
SHUFFLE
DATA
7

Thread 1
Deadlock
9
Thread 2

File A
Thread 1
Deadlock
9
Thread 2

File A File B
Thread 1
Deadlock
9
Thread 2

File A File B
Thread 1
Deadlock
9
File B
Thread 2

File A File B
File A
Thread 1
Deadlock
9
File B
Thread 2

File A File B
File A
Thread 1
Deadlock
9
X
File B
Thread 2

File A File B
File A
Thread 1
Deadlock
9
X X
File B
Thread 2

Solution? Scheduling
Y
XA
B
A
B
Y
X
1
2
3
4
10

1M
records
Answer
Node
1M
records
Answer
Node
1-250K
Node
251K-500K
Node
501K-750K
Node
750K-1M
11

pillar #2:
modular

ONE PERSON BUILDS A CAR
15

CHASSIS ENGINE BODY INTERIOR
16

17

18

SEATS FLOOR
DASHBOARD
GAS
AND
BRAKE
PEDALS
18

19

20

defect
20

defect defect
20

defect defect defect
20

defect defect defect defect
20

defect defect defect defect LEMON
20

Pillar #3:
horizontal

2 GB
2 CORES
22
8 GB
4 CORES

2 GB
2 CORES
VERTICAL
22
8 GB
4 CORES

2 GB
2 CORES
VERTICAL
HORIZONTAL
22
8 GB
4 CORES

2 GB
2 CORES
2 GB
2 CORES
VERTICAL
HORIZONTAL
22
8 GB
4 CORES

2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
VERTICAL
HORIZONTAL
22
8 GB
4 CORES

2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
VERTICAL
HORIZONTAL
22
8 GB
4 CORES

2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
VERTICAL
HORIZONTAL
22
8 GB
4 CORES

2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
VERTICAL
HORIZONTAL
22
8 GB
4 CORES

2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
VERTICAL
HORIZONTAL
22
8 GB
4 CORES

2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
VERTICAL
HORIZONTAL
SHARED NOTHING THROUGH STATELESSNESS
22
8 GB
4 CORES

2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
VERTICAL
HORIZONTAL
22
8 GB
4 CORES

2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
2 GB
2 CORES
VERTICAL
HORIZONTAL
2 GB
2 CORES
22
8 GB
4 CORES

ONE
SERVER
NEAR
CAPACITY
24

ONE
SERVER
NEAR
CAPACITY
ADD
ANOTHER
SERVER
24

ONE
SERVER
NEAR
CAPACITY
ADD
ANOTHER
SERVER
25

1234 MESSAGE QUEUE
26

1234MESSAGE QUEUE
27

1
2
3
4
28
MESSAGE QUEUE

1
2
3
4
28
56789101112 MESSAGE QUEUE

29
5678 9101112MESSAGE QUEUE
1
2
3
4

29
5678 9101112
ADD MORE SERVERS
BASED ON
MESSAGE QUEUE
MESSAGE QUEUE
1
2
3
4

MESSAGE QUEUE
30
5
6
7
8
9
10
11
12
13141516
ADD MORE SERVERS
BASED ON
MESSAGE QUEUE
1
2
3
4

31
5678 9101112
13141516
ADD MORE SERVERS
BASED ON
MESSAGE QUEUE
1234
MESSAGE QUEUE

32
5678 9101112
13141516
ADD MORE SERVERS
BASED ON
MESSAGE QUEUE
1234
MESSAGE QUEUE

33
5678 9101112
13141516
ADD MORE SERVERS
BASED ON
MESSAGE QUEUE
1234
MESSAGE QUEUE

33
5678 9101112
13141516
ADD MORE SERVERS
BASED ON
MESSAGE QUEUE
1234
MESSAGE QUEUE
DECREASE SERVERS
BASED ON
MESSAGE QUEUE

MESSAGE QUEUE
34
5678 9101112
13
14
15
16
ADD MORE SERVERS
BASED ON
MESSAGE QUEUE
1234
DECREASE SERVERS
BASED ON
MESSAGE QUEUE

Pillar #4:
agile

Features In Progress Blocked Tabled Testing Complete
Feature A
Feature B
Feature C
37
Monday

Feature A
Feature B
Feature C
38
Tuesday

Feature A
Feature B
Feature C
Feature E
Feature D
38
Tuesday

Feature AFeature BFeature C
Feature E
Feature G
39
Wednesday

Feature AFeature BFeature C
Feature E
Feature D
Feature F
Feature G
39
Wednesday

Feature A
Feature B
Feature C
Feature E
Feature D
Feature F
Feature G
40
Friday

Feature A
Feature B
Feature C
Feature E
Feature D
Feature F
Feature G
Feature H
Feature I
40
Friday

Feature A
Feature B
Feature C
Feature EFeature D
Feature F
Feature G
Feature H
Feature I
41
Friday - WK 2

57%
14%
29%
Failed Successful Challenged
49%
42%
9%
Waterfall Agile
Source: The CHAOS Manifesto, The Standish Group, 2012
42

43
Continuous Integration/Continuous Delivery

44
Quality

45
Release Cycle

IMAGE: blogs.bu.edu
46

47
Lint Testing
Test Driven Development
Functional Testing
Black Box
Integration Testing
Unit Testing
Behavior Driven Development
White Box
Smoke Testing
Acceptance Testing

ENSURES QUALITY
47
Lint Testing
Functional Testing
Black Box
Integration Testing
Unit Testing
White Box
Smoke Testing
Acceptance Testing

48
Lint Testing
Functional Testing
Black Box
Integration Testing
Unit Testing
White Box
Smoke Testing
Acceptance Testing

ENSURES CONFIDENCE
48
Lint Testing
Functional Testing
Black Box
Integration Testing
Unit Testing
White Box
Smoke Testing
Acceptance Testing

Pillar #5:
secure

51
PRESENTATION
APPLICATION
STORAGE

51
PRESENTATION
APPLICATION
STORAGE
INTERFACE
SECURITY
ACROSS ALL LAYERS

53
Host-based Authentication

54
User Authentication

55
Hybrid Cloud

56
Trustworthiness as an Organization

The 5 Pillars of Cloudiness

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (15)

More from Wayne Walls

More from Wayne Walls (10)

Recently uploaded

Recently uploaded (20)

The 5 Pillars of Cloudiness