Presentation of my talk about Spring Cloud features that can integrate with AWS, GCP and Azure turning Spring Cloud into a distributed platform that is capable to work with different environments like Kubernetes, Cloud or Local with adoption of Spring abstractions.

1. Cloud Native Spring

2. Orkhan Gasimov
Digital Transformation Architect, GlobalLogic
15 years of software engineering;
training & mentorship;
2Speaker

3. Kubernetes 3

4.  Why do we need Spring Cloud if we have Kubernetes?
4Agenda

5.  Why do we need Spring Cloud if we have Kubernetes?
 What is the role of Spring Cloud if Kubernetes does is better?
5Agenda

6. Spring Boot
Microservice Chassis Framework

15. Spring Cloud
Orchestration & Choreography

16. 16Spring Cloud

17. 17Spring Cloud

18. 18Spring Cloud

19. 19Spring Cloud
• Configuration
Management

20. 20Configuration Management
App
(Config Client)
Config Repo

21. 21Configuration Management
App
(Config Client)
Config
Server
Config Repo

22. 22Configuration Management
App
(Config Client)
Config
Server
Config Repo
Cloud Bus

23. 23Configuration Management
App
(Config Client)
Config
Server
Config Repo
Cloud Bus

24. 24Configuration Management
App
(Config Client)
Config
Server
Config Repo
Cloud Bus

25. 25Configuration Management
App
(Config Client)
Config
Server
Config Repo
Cloud Bus

26. • @Value & @RefreshScope.
26Configuration Management
App
(Config Client)
Config
Server
Config Repo
Cloud Bus

27. • @Value & @RefreshScope.
• Spring Boot Actuator /refresh endpoint.
27Configuration Management
App
(Config Client)
Config
Server
Config Repo
Cloud Bus

28. • @Value & @RefreshScope.
• Spring Boot Actuator /refresh endpoint.
• Spring Cloud Config Monitor for push notifications.
28Configuration Management
App
(Config Client)
Config
Server
Config Repo
Cloud Bus

29. • @Value & @RefreshScope.
• Spring Boot Actuator /refresh endpoint.
• Spring Cloud Config Monitor for push notifications.
• Spring Cloud Bus for app refresh notifications.
29Configuration Management
App
(Config Client)
Config
Server
Config Repo
Cloud Bus

30. Config client: spring-cloud-starter-config
• requires a bootstrap.yml file.
• Supports fail-fast & retry:
30Configuration Management
spring:
application.name: AppName
cloud.config.uri: http://host:8182
spring.cloud.config.failFast: true
spring.cloud.config.retry.initialInterval: 1000
spring.cloud.config.retry.maxAttempts: 6
spring.cloud.config.retry.maxInterval: 2000
spring.cloud.config.retry.multiplier: 1.1

31. 31Spring Cloud
• Configuration
Management
• Service Discovery

32. 32Service Discovery
Consumer Producer
Producer
Producer
Service Coordination:
• Dynamic locations.

33. 33Service Discovery
Consumer Producer
Producer
Producer
Service
Registry
Register / HeartbeatFetch
Service Coordination:
• Dynamic locations.
• On-demand scalability.

34. 34Service Discovery
Service
Registry
Consumer Producer
Benefits:
• Dynamic service locations.

35. 35Service Discovery
Service
Registry
Consumer Producer
Producer
Producer
Benefits:
• Dynamic service locations.
• Scale horizontally on demand.

36. 36Service Discovery
Service
Registry
Consumer Producer
Producer
Producer
LB
Benefits:
• Dynamic service locations.
• Scale horizontally on demand.
• Client-side load balancing on the fly.

37. 37Discovery Server
Service
Registry
Consumer Producer
Producer
Producer
LB
Possible drawbacks:
• Maintenance and support.

38. 38Discovery Server
Service
Registry
Consumer Producer
Producer
Producer
LB
Possible drawbacks:
• Maintenance and support.
• Single point of failure.

39. 39Discovery Client
@SpringBootApplication
@EnableDiscoveryClient
public class Eureka {
public static void main(String[] args) {
SpringApplication.run(Eureka.class, args);
}
}

40. 40Discovery Client
public interface DiscoveryClient {
String description();
@Deprecated
ServiceInstance getLocalServiceInstance();
List<ServiceInstance> getInstances(String var1);
List<String> getServices();
}

41. 41Discovery Client
public interface ServiceInstance {
String getServiceId();
String getHost();
int getPort();
boolean isSecure();
URI getUri();
Map<String, String> getMetadata();
}

42. 42Spring Cloud
• Configuration
Management
• Service Discovery
• Load Balancing

43. Use service-name instead of hostname, e.g. http://ServiceName/foo/bar/
43Load Balancing
@Bean
@LoadBalanced
public RestTemplate restTemplate() {
return new RestTemplate();
}

44. 44Spring Cloud
• Configuration
Management
• Service Discovery
• Load Balancing
• Circuit Breaking

45. Circuit Breaker 45
Service ServiceService Service Service

46. Circuit Breaker
Service ServiceService Service Service
46

47. Circuit Breaker
DBService
API
DBService
DBService
DBService
Web
API
Mobile
API
47

48. Circuit Breaker
Closed – watch requests, keep track of errors.
48
Closed
Success

49. Circuit Breaker
Closed – watch requests, keep track of errors.
Open – if there are too many errors, fast fail to a default value.
49
Closed
Open
Success
Too many fails
Fast Fail

50. Circuit Breaker
Closed – watch requests, keep track of errors.
Open – if there are too many errors, fast fail to a default value.
Half-Open – try one request some time later.
50
Closed
Open
Half-Open
Success
Too many fails
Fast Fail
Try one request
Fail
Success

51. Circuit Breaker 51
DBService
API
DBService
DBService
DBService
Web
API
Mobile
APICB
CB

52. 52Spring Cloud
• Configuration
Management
• Service Discovery
• Load Balancing
• Circuit Breaking
• Distributed Tracing

53. Distributed Tracing 53

54. 54Spring Cloud
• Configuration
Management
• Service Discovery
• Load Balancing
• Circuit Breaking
• Distributed Tracing
• Application Metrics

55. Metrics
Micrometer
SignalFx
StatsD
New Relix
Influx/Telegraf
JMXPrometheus
Netflix Atlas
CloudWatch
Datadog
Graphite
Ganglia Wavefront

56. 56Spring Cloud

57. 57API Gateway
DBService
API
DBService
DBService

58. 58API Services
DBService
API
DBService
DBService
Web
API
Mobile
API

59. 59API Versioning
DBService
API
DBService
DBService
Mobile
API
Web API
v2
Web API
v1

60. 60Zuul (Spring Cloud Netflix)
“pre” filters “routing” filter(s) “post” filters
“error” filters
“custom” filters
zuul:
ignored-services: '*'
routes:
api-v2:
path: /api/v2/**
stripPrefix: true
serviceId: apiService
api-v1:
path: /api/v1/**
stripPrefix: true
url: http://service.old
@SpringBootApplication
@EnableZuulProxy
public class ApiGateway {
public static void main(String[] args) {
SpringApplication.run(ApiGateway.class, args);
}
}

61. 61Spring Cloud Gateway
Client
Gateway
Proxied
Service
Predicates
Filters
spring:
cloud:
gateway:
routes:
- id: test_route
uri: http://example.org #lb://serviceId
predicates:
- Method=GET
- Path=/foo/{segment}
- Query=baz
filters:
- AddRequestHeader=X-Request-Foo, Bar
- AddRequestParameter=foo, bar
- AddResponseHeader=X-Response-Foo, Bar

62. 62Spring Cloud

63. 63Spring Cloud

64. Spring Cloud Stream

65. Binders:
• RabbitMQ
• Apache Kafka
• Amazon Kinesis
• Google PubSub
• Solace PubSub+
• Azure Event Hubs
Spring Cloud Stream

66. Development is simplified down to three simple annotations:
• @EnableBinding - activate connectivity to a message broker.
• @StreamListener - receive data from a channel.
• @SendTo - stream data to a channel.
Spring Cloud Stream

67. The basic channel abstractions are provided by three interfaces:
• Sink – input message channel.
• Source – output message channel.
• Processor – extends Sink and Source.
Spring Cloud Stream

68. Source code for Sink, Source and Processor interfaces:
Spring Cloud Stream
public interface Source {
String OUTPUT = "output";
@Output(Source.OUTPUT)
MessageChannel output();
}
public interface Processor extends Source, Sink {
}
public interface Sink {
String INPUT = "input";
@Input(Sink.INPUT)
SubscribableChannel input();
}

69. Spring Cloud Stream
@Component
public class MyPublisher {
@Autowired
@Qualifier("myOutput")
private MessageChannel output;
public void publish(String s) {
output.send(MessageBuilder.withPayload(s).build());
}
}
public interface MyOutput {
@Input("myOutput")
MessageChannel output();
}

70. Spring Cloud Stream
@Component
public class MyConsumer {
@StreamListener(Sink.INPUT)
public void consume(String s) {
System.out.println(s);
}
}
@Component
public class MyProcessor {
@StreamListener(Processor.INPUT)
@SendTo(Processor.OUTPUT)
public Integer process(String s) {
return s.length();
}
}

71. Spring Cloud Stream
Producer
Consumer
spring:
application.name: WordNumFilter
cloud.stream.bindings:
input:
destination: wordNumFilter
output:
destination: words

72. Spring Cloud Stream
spring:
application.name: WordNumFilter
cloud.stream.bindings:
input:
destination: wordNumFilter
group: WordNumFilters
consumer:
instanceCount: 2
instanceIndex: 0
output:
destination: words
Consumer
Producer Producer
Consumer

73. Spring Cloud Stream
spring:
application.name: WordNumFilter
cloud.stream.bindings:
input:
destination: wordNumFilter
group: WordNumFilters
consumer:
partitioned: true
instanceCount: 2
instanceIndex: 0
output:
destination: words
producer:
partitionCount: 2
Consumer
Producer Producer
Consumer

74. Spring Cloud Function

75. 75Functions
Function

76. 76Functions
Supplier Function

77. 77Functions
Supplier ConsumerFunction

78. 78Beans
Declare function as beans
@SpringBootApplication
public class TestApp {

79. 79Beans
Declare function as beans
@SpringBootApplication
public class TestApp {
@Bean
public Function<Flux<String>, Flux<String>> upperCase() {
return flux -> flux.map(String::toUpperCase);
}

80. 80Beans
Declare function as beans
@SpringBootApplication
public class TestApp {
@Bean
public Function<Flux<String>, Flux<String>> upperCase() {
return flux -> flux.map(String::toUpperCase);
}
@Bean
public Supplier<String> helloWorld() {
return () -> "Hello World";
}

81. 81Beans
Declare function as beans
@SpringBootApplication
public class TestApp {
@Bean
public Function<Flux<String>, Flux<String>> upperCase() {
return flux -> flux.map(String::toUpperCase);
}
@Bean
public Supplier<String> helloWorld() {
return () -> "Hello World";
}
public static void main(String[] args) {
SpringApplication.run(TestApp.class, args);
}
}

82. 82Beans
@Component
public class HelloWorld implements Supplier<String> {
@Override
public String get() {
return "Hello World";
}
}

83. 83Beans
@Component
public class HelloWorld implements Supplier<String> {
@Override
public String get() {
return "Hello World";
}
}
@Component
public class UpperCase implements Function<Flux<String>, Flux<String>> {
@Override
public Flux<String> apply(Flux<String> flux) {
return flux.map(String::toUpperCase);
}
}

84. 84Beans
@SpringBootApplication
public class TestApp {
public static void main(String[] args) {
SpringApplication.run(TestApp.class, args);
}
}
@Component
public class HelloWorld implements Supplier<String> {
@Override
public String get() {
return "Hello World";
}
}
@Component
public class UpperCase implements Function<Flux<String>, Flux<String>> {
@Override
public Flux<String> apply(Flux<String> flux) {
return flux.map(String::toUpperCase);
}
}

85. Deploy functions as HTTP Endpoints
Web
<dependency>
<groupId>org.springframework.cloud</groupId>
<artifactId>spring-cloud-starter-function-web</artifactId>
</dependency>

86. 86Endpoints
Method Path Request Response Status
GET /{supplier} - Items from the
named supplier
200 OK
POST /{consumer} JSON object or text Mirrors input and
pushes request body
into consumer
202 Accepted
POST /{consumer} JSON array or text
with new lines
Mirrors input and
pushes body into
consumer one by one
202 Accepted
POST /{function} JSON object or text The result of applying
the named function
200 OK
POST /{function} JSON array or text
with new lines
The result of applying
the named function
200 OK
GET /{function}/{item} - Convert the item into
an object and return
the result of applying
the function
200 OK

87. Deploy functions as Stream handlers
<dependency>
<groupId>org.springframework.cloud</groupId>
<artifactId>spring-cloud-function-stream</artifactId>
</dependency>
<dependency>
<groupId>org.springframework.cloud</groupId>
<artifactId>spring-cloud-stream-binder-{rabbit/kafka/...}</artifactId>
</dependency>
Stream

88. spring:
profiles: upper
cloud:
stream:
bindings:
input:
destination: hello
output:
destination: upper
function:
stream:
sink:
name: upperCase
source:
name: upperCase
Stream

89. Stream
spring:
profiles: hello
cloud:
stream:
bindings:
output:
destination: hello
function:
stream:
sink:
enabled: false
source:
name: helloWorld

90. Example
90

91. 91Reference Architecture
91

92. 92Reference Architecture

93. 93Reference Architecture

94. 94Reference Architecture

95. 95Reference Architecture

96. 96Reference Architecture

97. Cloud Providers

98. • Amazon Web Services
98Cloud Providers

99. • Amazon Web Services
• Google Cloud Platform
99Cloud Providers

100. • Amazon Web Services
• Google Cloud Platform
• Microsoft Azure
100Cloud Providers

101. Amazon Web Services

102. 102Amazon Web Services

103. • Configuration
• Environment configuration based on EC2 & CloudFormation metadata
Spring Cloud AWS 103

104. • Configuration
• Environment configuration based on EC2 & CloudFormation metadata
• Parameter Store & Secrets Manager as a bootstrap property source
Spring Cloud AWS 104

105. • Configuration
• Environment configuration based on EC2 & CloudFormation metadata
• Parameter Store & Secrets Manager as a bootstrap property source
• Abstraction
• S3 through Spring ResourceLoader
Spring Cloud AWS 105

106. • Configuration
• Environment configuration based on EC2 & CloudFormation metadata
• Parameter Store & Secrets Manager as a bootstrap property source
• Abstraction
• S3 through Spring ResourceLoader
• SES through Spring Email
Spring Cloud AWS 106

107. • Configuration
• Environment configuration based on EC2 & CloudFormation metadata
• Parameter Store & Secrets Manager as a bootstrap property source
• Abstraction
• S3 through Spring ResourceLoader
• SES through Spring Email
• ElastiCache through Spring Cache
Spring Cloud AWS 107

108. • Configuration
• Environment configuration based on EC2 & CloudFormation metadata
• Parameter Store & Secrets Manager as a bootstrap property source
• Abstraction
• S3 through Spring ResourceLoader
• SES through Spring Email
• ElastiCache through Spring Cache
• Integration
• RDS – automatic data source lookup
Spring Cloud AWS 108

109. • Configuration
• Environment configuration based on EC2 & CloudFormation metadata
• Parameter Store & Secrets Manager as a bootstrap property source
• Abstraction
• S3 through Spring ResourceLoader
• SES through Spring Email
• ElastiCache through Spring Cache
• Integration
• RDS – automatic datasource lookup
• SQS – point-to-point messaging
Spring Cloud AWS 109

110. • Configuration
• Environment configuration based on EC2 & CloudFormation metadata
• Parameter Store & Secrets Manager as a bootstrap property source
• Abstraction
• S3 through Spring ResourceLoader
• SES through Spring Email
• ElastiCache through Spring Cache
• Integration
• RDS – automatic data source lookup
• SQS – point-to-point messaging
• SNS – Pub/sub messaging
Spring Cloud AWS 110

111. • Configuration
• Environment configuration based on EC2 & CloudFormation metadata
• Parameter Store & Secrets Manager as a bootstrap property source
• Abstraction
• S3 through Spring ResourceLoader
• SES through Spring Email
• ElastiCache through Spring Cache
• Integration
• RDS – automatic data source lookup
• SQS – point-to-point messaging
• SNS – Pub/sub messaging
• Kinesis – Spring Cloud Stream
Spring Cloud AWS 111

112. • Configuration
• Environment configuration based on EC2 & CloudFormation metadata
• Parameter Store & Secrets Manager as a bootstrap property source
• Abstraction
• S3 through Spring ResourceLoader
• SES through Spring Email
• ElastiCache through Spring Cache
• Integration
• RDS – automatic data source lookup
• SQS – point-to-point messaging
• SNS – Pub/sub messaging
• Kinesis – Spring Cloud Stream
• Lambda – Spring Cloud Function
Spring Cloud AWS 112

113. Google Cloud Platform

114. 114Google Cloud Platform

115. • Configuration
• Google Cloud Config
Spring Cloud GCP 115

116. • Configuration
• Google Cloud Config
• Abstraction
• Spring Resource Abstraction for Google Cloud Storage
Spring Cloud GCP 116

117. • Configuration
• Google Cloud Config
• Abstraction
• Spring Resource Abstraction for Google Cloud Storage
• Google Cloud Stackdrive Logging & Tracing
Spring Cloud GCP 117

118. • Configuration
• Google Cloud Config
• Abstraction
• Spring Resource Abstraction for Google Cloud Storage
• Google Cloud Stackdrive Logging & Tracing
• Google Cloud Vision API Template
Spring Cloud GCP 118

119. • Configuration
• Google Cloud Config
• Abstraction
• Spring Resource Abstraction for Google Cloud Storage
• Google Cloud Stackdrive Logging & Tracing
• Google Cloud Vision API Template
• Integration
• Spring Data Cloud SQL
Spring Cloud GCP 119

120. • Configuration
• Google Cloud Config
• Abstraction
• Spring Resource Abstraction for Google Cloud Storage
• Google Cloud Stackdrive Logging & Tracing
• Google Cloud Vision API Template
• Integration
• Spring Data Cloud SQL
• Spring Data Cloud Spanner
Spring Cloud GCP 120

121. • Configuration
• Google Cloud Config
• Abstraction
• Spring Resource Abstraction for Google Cloud Storage
• Google Cloud Stackdrive Logging & Tracing
• Google Cloud Vision API Template
• Integration
• Spring Data Cloud SQL
• Spring Data Cloud Spanner
• Spring Data Cloud Datastore
Spring Cloud GCP 121

122. • Configuration
• Google Cloud Config
• Abstraction
• Spring Resource Abstraction for Google Cloud Storage
• Google Cloud Stackdrive Logging & Tracing
• Google Cloud Vision API Template
• Integration
• Spring Data Cloud SQL
• Spring Data Cloud Spanner
• Spring Data Cloud Datastore
• Spring Cloud GCP Pub/Sub
Spring Cloud GCP 122

123. Microsoft Azure

124. 124Microsoft Azure

125. • Configuration
• Azure Key Vault
Spring Cloud Azure 125

126. • Configuration
• Azure Key Vault
• Abstraction
• Azure Storage – Spring Resource
Spring Cloud Azure 126

127. • Configuration
• Azure Key Vault
• Abstraction
• Azure Storage – Spring Resource
• Azure AD –Spring Security & OAuth2
Spring Cloud Azure 127

128. • Configuration
• Azure Key Vault
• Abstraction
• Azure Storage – Spring Resource
• Azure AD –Spring Security & OAuth2
• Integration
• Spring Data Azure Data Services
Spring Cloud Azure 128

129. • Configuration
• Azure Key Vault
• Abstraction
• Azure Storage – Spring Resource
• Azure AD –Spring Security & OAuth2
• Integration
• Spring Data Azure Data Services
• Spring Data Azure Redis Cache
Spring Cloud Azure 129

130. • Configuration
• Azure Key Vault
• Abstraction
• Azure Storage – Spring Resource
• Azure AD –Spring Security & OAuth2
• Integration
• Spring Data Azure Data Services
• Spring Data Azure Redis Cache
• Spring Data Azure Cosmos DB SQL API
Spring Cloud Azure 130

131. • Configuration
• Azure Key Vault
• Abstraction
• Azure Storage – Spring Resource
• Azure AD –Spring Security & OAuth2
• Integration
• Spring Data Azure Data Services
• Spring Data Azure Redis Cache
• Spring Data Azure Cosmos DB SQL API
• Spring Data Gremlin for Azure Cosmos DB Graph API
Spring Cloud Azure 131

132. • Configuration
• Azure Key Vault
• Abstraction
• Azure Storage – Spring Resource
• Azure AD –Spring Security & OAuth2
• Integration
• Spring Data Azure Data Services
• Spring Data Azure Redis Cache
• Spring Data Azure Cosmos DB SQL API
• Spring Data Gremlin for Azure Cosmos DB Graph API
• Spring Cloud Stream Azure Event Hub
Spring Cloud Azure 132

133. Summary

134. • Configuration
• PropertySource based on ConfigMaps & Secrets with configuration reload upon
changes available
Kubernetes 134

135. • Configuration
• PropertySource based on ConfigMaps & Secrets with configuration reload upon
changes available
• Asbtraction
• DiscoveryClient abstraction
Kubernetes 135

136. • Configuration
• PropertySource based on ConfigMaps & Secrets with configuration reload upon
changes available
• Asbtraction
• DiscoveryClient abstraction
• Client-side load balancing with Ribbon integration
Kubernetes 136

137. • Configuration
• PropertySource based on ConfigMaps & Secrets with configuration reload upon
changes available
• Asbtraction
• DiscoveryClient abstraction
• Client-side load balancing with Ribbon integration
• Integration
• HealthIndicator integration
Kubernetes 137

138. • Configuration
• PropertySource based on ConfigMaps & Secrets with configuration reload upon
changes available
• Asbtraction
• DiscoveryClient abstraction
• Client-side load balancing with Ribbon integration
• Integration
• HealthIndicator integration
• Kubernetes & Istio awareness through corresponding spring profiles
Kubernetes 138

139. 139Platform

140. Thank You!
http://orkhan.io
http://fb.com/groups/reactive.distributed