As we start to go toward cloud-native infrastructure and build our applications out of microservices, we must fully face the drawbacks and challenges to doing so. Some of these challenges include how to consistently monitor and collect statistics, tracing, and another telemetry, how to add resiliency in the face of unexpected failure, how to do powerful feature routing (ie feature graduation, tap compare) and much more like securing your services correctly. Service mesh, in general, helps developers solve this in a non-invasive way. In this session, we'll show how you can take advantage of these capabilities and show you some patterns that you can implement easily with a service mesh to make your delivery to production smoothly and without surprises. We expect most developers haven't adequately solved for these issues, so we'll take it step by step and build up a strong understanding of Istio and its patterns, harness its power in your production services architecture.

1. Service Mesh Patterns
Alex Soto
Red Hat Engineer
@alexsotob

2. @alexsotob2

3. @alexsotob3
MyApp
Monolith

4. @alexsotob4
Modules

5. @alexsotob5
Components

6. @alexsotob6
Microservices

7. @alexsotob7
Microservices

8. @alexsotob8
Microservices

9. @alexsotob9
Network of Services

10. @alexsotob10
Microservices Own Their Data

11. @alexsotob11
Multiple Points of Entry

12. @alexsotob12
Microservices == Distributed Computing
OS
JVM
Service A
OS
JVM
Service B
OS
JVM
Service C

13. @alexsotob13
It means no worries
(…)
It's our problem-free
philosophy
Hakuna Matata.
— Simba
“

14. @alexsotob14
▪ The network is reliable
▪ Latency is zero
▪ Bandwidth is infinite
▪ The network is secure
https://en.wikipedia.org/wiki/Fallacies_of_distributed_computing
▪ Topology does not change
▪ There is one administrator
▪ Transport cost is zero
▪ The network is homogeneous
Fallacies of Distributed Computing

15. @alexsotob15
Failure of a Service

16. @alexsotob16
Cascading Failure

17. @alexsotob17
Done properly
(Networking)
is a heroic art.
Done properly !
— Edna
“

18. @alexsotob18
Microservices’ilities
MyService
Monitoring
Tracing
API
Discovery
Invocation
Resilience
Pipeline
Authentication
Logging Elasticity

19. @alexsotob19
Hmmm. Really?
I’d say (water)
is half full.
— Dory
“

20. @alexsotob20

21. @alexsotob21
Microservices’ilities + OpenShift
MyService
Monitoring
Tracing
API
Discovery
Invocation
Resilience
Pipeline
Authentication
Logging Elasticity

22. @alexsotob22
Container
JVM
Service B
Discovery
Load-balancer
Resiliency
Metrics
Tracing
Container
JVM
Service A
Discovery
Load-balancer
Resiliency
Metrics
Tracing
Container
JVM
Service C
Discovery
Load-balancer
Resiliency
Metrics
Tracing
Microservices Embedding Capabilities

23. @alexsotob23
Fairy tales can come true.
You gotta make them happen,
it all depends on you
— Tiana
“

24. @alexsotob24
Pod
Container
JVM
Service A
Pod
Container
JVM
Service C
Pod
Container
JVM
Service B
Microservices Externalizing Capabilities
The service mesh intercepts all network
traffic

25. @alexsotob25
A hundred thousand things to see
(Hold your breath, it gets better)
— Jasmine & Aladdin
“

26. @alexsotob26

27. @alexsotob27
Blue - Green
X v1
X v2
Canary Release
X v1
X v2
90%
10%
Dark Canaries
X v1
X v2
*
[10.0.X.Y]
Shadowing Traffic
X v1
X v2

28. @alexsotob28
Feature Graduation
X v1
X v2
X v3
Features Opt-in
experim
ental
beta
production
Multi-Tenancy
DB’
DB’’
DB’’’
X
user
user
user

29. @alexsotob29

30. @alexsotob30
Retry
Bulkhead
Circuit Breaker
Pool Ejection
Request Timeout
+

31. @alexsotob31

32. @alexsotob32
mutual TLS Authorization for services
Rate Limits
anonymous
Black/White Lists

33. @alexsotob33

34. @alexsotob34
Metrics
X v1 X v2
Unified Logs
X v1 Y v1
The Mesh
X v1 Y v1
Z v1 W v1
Distributed Tracing
X v1 Y v1

35. @alexsotob35

36. @alexsotob36
Pod Virtualization
X v1 Y v1 Z v1 W v1
Y v2 Z virtual
X v1
DB Virtualization
Y v1 DB
Y v2
Throwaway DBVirtual DB
Fault Injection
10%
X v1 Y v1
5%
Multi-Environment qa
prod
user=dev123

37. @alexsotob37
If I go there is just no telling
how far I’ll go.
— Moana
“

38. @alexsotob38
Istio — ‘Sail’
(Kubernetes — the ‘Helmsman’)

39. @alexsotob39
It's time to see
what I can do
To test the limits
and break through.
— Elsa
“

40. @alexsotob40
Put on your Sunday clothes
there's lots of world
out there.
— Wall-E
“
[http://bit.ly/istio-tutorial]
[http://bit.ly/istio-cheat-sheet]
[https://developers.redhat.com]

41. @alexsotob
Hay un amigo en mí,
cuando salgan a volar,
hay un amigo en mí
— Toy Story
“
@alexsotob
asotobue@redhat.com
http://www.lordofthejars.com/
lordofthejars

42. Rate today’s session
Session page on conference website O’Reilly Events App