The document discusses serverless architectures using AWS Lambda and Amazon Kinesis. It describes how DAZN uses a serverless-first approach with services like API Gateway, SQS, SNS, Step Functions, and Kinesis. It provides examples of using Kinesis as a task queue, transaction log, and for building analytics pipelines. It also covers best practices for streaming data, security, observability, and challenges of building distributed systems with streams.
7. “Netflix for sports”
offices in London, Leeds, Katowice and Amsterdam
We’re hiring! Visit
engineering.dazn.com to
learn more.
follow @DAZN_ngnrs for
updates about the
engineering team.
44. ordering
replay events
Kinesis SQS SNS
by shard
none (standard)
global (FIFO)
none
mode
retry
concurrency
subscribers many one-to-one many
45. ordering
replay events
Kinesis SQS SNS
by shard
none (standard)
global (FIFO)
none
up to 7 days none none
mode
retry
concurrency
subscribers many one-to-one many
46. ordering
replay events
Kinesis SQS SNS
by shard
none (standard)
global (FIFO)
none
up to 7 days none none
mode
retry
batched batched (up to 10) singular
concurrency
subscribers many one-to-one many
47. ordering
replay events
Kinesis SQS SNS
by shard
none (standard)
global (FIFO)
none
up to 7 days none none
mode
retry
batched batched (up to 10) singular
retried until
success
retry + DLQ retry + DLQ
concurrency
subscribers many one-to-one many
48. ordering
replay events
Kinesis SQS SNS
by shard
none (standard)
global (FIFO)
none
up to 7 days none none
mode
retry
batched batched (up to 10) singular
retried until
success
retry + DLQ retry + DLQ
concurrency 1 per shard auto-scaled fan-out!!!
subscribers many one-to-one many
49. ordering
replay events
Kinesis SQS SNS
by shard
none (standard)
global (FIFO)
none
up to 7 days none none
mode
retry
batched batched (up to 10) singular
retried until
success
retry + DLQ retry + DLQ
concurrency 1 per shard auto-scaled fan-out!!!
subscribers many one-to-one many
53. 1 msg/s for a month, 1KB per msg
1 x 60s x 60m x 24hr x 30days
@ $0.014 per mil
+
24hrs x 30days
@ $0.015 per hr
$10.836
1 x 60s x 60m x 24hr x 30days
@ $0.5 per mil
$1.296
1 x 60s x 60m x 24hr x 30days
@ $0.4 per mil (send)
+
1 x 60s x 60m x 24hr x 30days
@ 10 batch
@ 20s long polling
@ $0.4 per mil (receive)
$1.089
54. 1K msg/s for a month, 1KB per msg
1k x 60s x 60m x 24hr x 30days
@ $0.014 per mil
+
24hrs x 30days
@ $0.015 per hr
$47.088
1k x 60s x 60m x 24hr x 30days
@ $0.5 per mil
$1296.00
1k x 60s x 60m x 24hr x 30days
@ $0.4 per mil (send)
+
1k x 60s x 60m x 24hr x 30days
@ 10 batch
@ 20s long polling
@ $0.4 per mil (receive)
$1041.98