Slides from the VoxxedDays Singapore 2019 talk about Resilient Microservices Architecture with Kubernetes

1. Resilient Microservices Architecture with
Nilesh Gule
@nileshgule | www.HandsOnArchitect.com

3. $whoami
{
“name” : “Nilesh Gule”,
“website” : “https://www.HandsOnArchitect.com",
“github” : “https://github.com/NileshGule"
“twitter” : “@nileshgule”,
“linkedin” : “https://www.linkedin.com/in/nileshgule”,
“email” : “nileshgule@gmail.com",
“likes” : “Technical Evangelism, Cricket”
}

5. Autonomous work together

6. https://samnewman.io/talks/principles-of-microservices/

7. https://microservices.io/patterns/microservices.html

8. https://github.com/dotnet-architecture/eShopOnContainers

9. https://github.com/NileshGule/AKS-learning-series

11. Software infrastructure layer for controlling and monitoring internal, service-to-
service traffic in Microservice application

13. No code changes

15. Recover from failure continue to function

17. handle transient failures

18. https://docs.microsoft.com/en-sg/azure/architecture/patterns/retry

19. .HandleTransientHttpError()
.OrResult(msg => msg.StatusCode == System.Net.HttpStatusCode.NotFound)
.WaitAndRetryAsync(6, retryAttempt => TimeSpan.FromSeconds(Math.Pow(2,
retryAttempt)));
.AddPolicyHandler(GetRetryPolicy());

20. http://goupaz.com/docs/reference/config/traffic-rules/routing-rules.html#httpretry
httpReqRetries:
simpleRetry:
attempts: 3
perTryTimeout: 2s

21. Don’t wait forever

23. Policy timeoutPolicy = Policy.TimeoutAsync(30, TimeoutStrategy.Optimistic);
await timeoutPolicy
.ExecuteAsync(

24. https://istio.io/docs/tasks/traffic-management/request-timeouts/
timeout: 0.5s

25. Provide graceful degradation in event of failure

27. Don’t let one fault sink the whole ship

28. https://docs.microsoft.com/en-sg/azure/architecture/patterns/bulkhead

29. requests:
memory: "64Mi"
cpu: "250m"
limits:
memory: "128Mi"
cpu: "1“

30. repeated retries likely to fail

31. https://docs.microsoft.com/en-sg/azure/architecture/patterns/circuit-breaker

32. .CircuitBreakerAsync(5, TimeSpan.FromSeconds(30));
.AddPolicyHandler(GetCircuitBreakerPolicy()

33. @EnableHystrixDashboard
@EnableCircuitBreaker

34. circuitBreaker:
simpleCb:
maxConnections: 100
httpMaxRequests: 1000
httpMaxRequestsPerConnection: 10
httpConsecutiveErrors: 7
sleepWindow: 15m
httpDetectionInterval: 5m
Istio Cirtcuit Breaker

35. https://developers.redhat.com/blog/2017/05/16/it-takes-more-than-a-circuit-breaker-to-create-a-resilient-application/

37. eShopOnContainers
Resiliency Patterns
8 fallacies of Distributed
Computing
12 factor apps
Polly
Istio
Istio Service Mesh
Hystrix patterns
History of Service Mesh
Rise of Service Mesh Architecture

42. Thank you very much
Code with Passion and Strive for Excellence
https://github.com/NileshGule/AKS-learning-series
https://github.com/NileshGule/eShopOnContainers
https://gist.github.com/NileshGule/61492f039a390b62d9c088c1643884e2
https://www.slideshare.net/nileshgule/presentations
https://speakerdeck.com/nileshgule/

43. Feedback

44. Q&A