SlideShare a Scribd company logo
1 of 47
Download to read offline
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Handle massive traffic
from the beginning
with Serverless
Danggeun Market Inc.
Byun Kyuhyun
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
BYUN Kyuhyun
Software Engineer at Dangguen Market. Inc
AWS Serverless Hero
AWSKRUG Organizer
CircleCI UG Organizer
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Letโ€™s talk about startup
Ref. https://limwonki.com/771
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
We donโ€™t have enough time,
and engineers.
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
However....
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Our startup wants to grow
faster than others.
Ref. https://www.edaily.co.kr/news/read?newsId=01308726622722456
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Let's take a look at
the practical architecture
for Serverless
to become a Unicorn.
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
First step
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Single web server
API Gateway - Lambda - DynamoDB or RDS
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Second step
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Scheduled jobs
for querying statistically or analysing.
CloudWatch Timebase Trigger with Lambda
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
This is a simple architecture.
There is no need to maintain infrastructure.
But it requires monitoring.
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Monitor serverless services
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Build GUI Dashboard on CloudWatch
Ref. https://sinovi.uk/articles/web-application-dashboards-in-aws-cloudwatch
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Grafana with cloudwatch logs
Ref. https://jamesthom.as/2018/01/visualising-serverless-metrics-with-grafana-dashboards/
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Datadog with cloudwatch logs
Ref. https://www.datadoghq.com/blog/aws-1-click-integration/
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
But, weโ€™re working at an enterprise.
We need to handle more traffic.
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Itโ€™s good enough if youโ€™re using DynamoDB.
But RDB isnโ€™t so good with Lambda
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
How to handle RDB connections?
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
First,
Using a global variable to hold DB connections
can be a solution on Lambda.
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
What if thereโ€™s 10 times traffic within a minute?
Ref. https://www.ireckon.com/web-dev/how-do-you-cope-when-your-site-traffic-doesnt-just-spike-it-explodes/
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
There will be a CPU or Memory spike on RDB
because of many connections.
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
How to handle it?
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
RDS Proxy
holds RDB connections and passes queries.
Ref. https://aws.amazon.com/ko/rds/proxy/
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
How to handle insertions on Databases?
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
You may consider
the throttling issue on DynamoDB,
and the scaling issue on RDB.
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Letโ€™s adopt
the eventually consistent model
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
SQS with Lambda
Automactically triggered Lambda by SQS events
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
SNS + HTTP notification
Automatically send http requests by SNS
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Letโ€™s see Scheduled job again.
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Becoming an enterprise service means we have Big data.
We can not handle data on Lambda.
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Long period job,
just run code on Fargate
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Build docker image with your code
and run on ECS or EKS(not yet Seoul)
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
But, if you want to do full-scan on
DynamoDB or RDB...
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
First,
RDS Exports and
Glue with Athena can be a solution
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Run RDS exports to S3 via Lambda
Ref. https://docs.aws.amazon.com/ko_kr/AmazonRDS/latest/UserGuide/USER_ExportSnapshot.html
RDS Export
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Second,
letโ€™s see DynamoDB with Glue
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
DynamoDB - Glue - S3
then, read schema using Crawler, register data catalog on Glue
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
But, DynamoDB is expensive when extracting all data.
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Turn on DynamoDB Stream
and save all of the histories on S3.
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Query via Athena, visualize via BI tools
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Data is always matters!
With this journey,
we can consider less about service architecture.
Focus on your business.
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
The architecture of todayโ€™s journey
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
We are hiring!
bit.ly/dangguen
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
Serverless is more.
2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
THANK YOU !
Email: novemberde1@gmail.com
Blog: https://novemberde.github.io
Github:https://github.com/novemberde

More Related Content

More from Kyuhyun Byun

More from Kyuhyun Byun (8)

Serverless websocket ํ†บ์•„๋ณด๊ธฐ
Serverless websocket ํ†บ์•„๋ณด๊ธฐServerless websocket ํ†บ์•„๋ณด๊ธฐ
Serverless websocket ํ†บ์•„๋ณด๊ธฐ
ย 
Native addon์„ ํฌํ•จํ•˜์—ฌ Node.js + Typescript + Serverless ๋นŒ๋“œ ๋ฐ ๋ฐฐํฌํ•˜๊ธฐ
Native addon์„ ํฌํ•จํ•˜์—ฌ Node.js + Typescript + Serverless ๋นŒ๋“œ ๋ฐ ๋ฐฐํฌํ•˜๊ธฐNative addon์„ ํฌํ•จํ•˜์—ฌ Node.js + Typescript + Serverless ๋นŒ๋“œ ๋ฐ ๋ฐฐํฌํ•˜๊ธฐ
Native addon์„ ํฌํ•จํ•˜์—ฌ Node.js + Typescript + Serverless ๋นŒ๋“œ ๋ฐ ๋ฐฐํฌํ•˜๊ธฐ
ย 
0์›์œผ๋กœ ์‹œ์ž‘ํ•˜๋Š” ์„œ๋ฒ„๋ฆฌ์Šค ๋ฐ์ดํ„ฐ ์ˆ˜์ง‘ ๋ฐ ๋ถ„์„
0์›์œผ๋กœ ์‹œ์ž‘ํ•˜๋Š” ์„œ๋ฒ„๋ฆฌ์Šค ๋ฐ์ดํ„ฐ ์ˆ˜์ง‘ ๋ฐ ๋ถ„์„0์›์œผ๋กœ ์‹œ์ž‘ํ•˜๋Š” ์„œ๋ฒ„๋ฆฌ์Šค ๋ฐ์ดํ„ฐ ์ˆ˜์ง‘ ๋ฐ ๋ถ„์„
0์›์œผ๋กœ ์‹œ์ž‘ํ•˜๋Š” ์„œ๋ฒ„๋ฆฌ์Šค ๋ฐ์ดํ„ฐ ์ˆ˜์ง‘ ๋ฐ ๋ถ„์„
ย 
ํฌํ„ธ ๊ฒ€์ƒ‰์–ด ์ˆœ์œ„ ์ˆ˜์ง‘ ๋ฐ ๋ถ„์„ ํ›„๊ธฐ
ํฌํ„ธ ๊ฒ€์ƒ‰์–ด ์ˆœ์œ„ ์ˆ˜์ง‘ ๋ฐ ๋ถ„์„ ํ›„๊ธฐํฌํ„ธ ๊ฒ€์ƒ‰์–ด ์ˆœ์œ„ ์ˆ˜์ง‘ ๋ฐ ๋ถ„์„ ํ›„๊ธฐ
ํฌํ„ธ ๊ฒ€์ƒ‰์–ด ์ˆœ์œ„ ์ˆ˜์ง‘ ๋ฐ ๋ถ„์„ ํ›„๊ธฐ
ย 
ALB+EC2 to API gateway + Lambda
ALB+EC2 to API gateway + LambdaALB+EC2 to API gateway + Lambda
ALB+EC2 to API gateway + Lambda
ย 
Serverless framework์™€ CircleCI๋ฅผ ํ†ตํ•œ NoOps ๋ง›๋ณด๊ธฐ
Serverless framework์™€ CircleCI๋ฅผ ํ†ตํ•œ NoOps ๋ง›๋ณด๊ธฐServerless framework์™€ CircleCI๋ฅผ ํ†ตํ•œ NoOps ๋ง›๋ณด๊ธฐ
Serverless framework์™€ CircleCI๋ฅผ ํ†ตํ•œ NoOps ๋ง›๋ณด๊ธฐ
ย 
Docker์™€ DevOps์—์„œ Serverless์™€ NoOps๋กœ์˜ ์—ฌ์ •
Docker์™€ DevOps์—์„œ Serverless์™€ NoOps๋กœ์˜ ์—ฌ์ •Docker์™€ DevOps์—์„œ Serverless์™€ NoOps๋กœ์˜ ์—ฌ์ •
Docker์™€ DevOps์—์„œ Serverless์™€ NoOps๋กœ์˜ ์—ฌ์ •
ย 
Ec2 docker docker-compose
Ec2 docker docker-composeEc2 docker docker-compose
Ec2 docker docker-compose
ย 

Recently uploaded

CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kakori Lucknow best sexual service Online โ˜‚๏ธ
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kakori Lucknow best sexual service Online  โ˜‚๏ธCALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kakori Lucknow best sexual service Online  โ˜‚๏ธ
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kakori Lucknow best sexual service Online โ˜‚๏ธ
anilsa9823
ย 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
Health
ย 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
mohitmore19
ย 
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Badshah Nagar Lucknow best Female service
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Badshah Nagar Lucknow best Female serviceCALL ON โžฅ8923113531 ๐Ÿ”Call Girls Badshah Nagar Lucknow best Female service
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Badshah Nagar Lucknow best Female service
anilsa9823
ย 

Recently uploaded (20)

How To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected WorkerHow To Troubleshoot Collaboration Apps for the Modern Connected Worker
How To Troubleshoot Collaboration Apps for the Modern Connected Worker
ย 
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdfThe Ultimate Test Automation Guide_ Best Practices and Tips.pdf
The Ultimate Test Automation Guide_ Best Practices and Tips.pdf
ย 
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AISyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
SyndBuddy AI 2k Review 2024: Revolutionizing Content Syndication with AI
ย 
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kakori Lucknow best sexual service Online โ˜‚๏ธ
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kakori Lucknow best sexual service Online  โ˜‚๏ธCALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kakori Lucknow best sexual service Online  โ˜‚๏ธ
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Kakori Lucknow best sexual service Online โ˜‚๏ธ
ย 
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
The Real-World Challenges of Medical Device Cybersecurity- Mitigating Vulnera...
ย 
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlanโ€™s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlanโ€™s ...Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlanโ€™s ...
Tech Tuesday-Harness the Power of Effective Resource Planning with OnePlanโ€™s ...
ย 
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
+971565801893>>SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHAB...
ย 
Software Quality Assurance Interview Questions
Software Quality Assurance Interview QuestionsSoftware Quality Assurance Interview Questions
Software Quality Assurance Interview Questions
ย 
Microsoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdfMicrosoft AI Transformation Partner Playbook.pdf
Microsoft AI Transformation Partner Playbook.pdf
ย 
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdfLearn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
Learn the Fundamentals of XCUITest Framework_ A Beginner's Guide.pdf
ย 
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time ApplicationsUnveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
Unveiling the Tech Salsa of LAMs with Janus in Real-Time Applications
ย 
5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf5 Signs You Need a Fashion PLM Software.pdf
5 Signs You Need a Fashion PLM Software.pdf
ย 
How To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.jsHow To Use Server-Side Rendering with Nuxt.js
How To Use Server-Side Rendering with Nuxt.js
ย 
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
Try MyIntelliAccount Cloud Accounting Software As A Service Solution Risk Fre...
ย 
TECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service providerTECUNIQUE: Success Stories: IT Service provider
TECUNIQUE: Success Stories: IT Service provider
ย 
HR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.comHR Software Buyers Guide in 2024 - HRSoftware.com
HR Software Buyers Guide in 2024 - HRSoftware.com
ย 
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Badshah Nagar Lucknow best Female service
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Badshah Nagar Lucknow best Female serviceCALL ON โžฅ8923113531 ๐Ÿ”Call Girls Badshah Nagar Lucknow best Female service
CALL ON โžฅ8923113531 ๐Ÿ”Call Girls Badshah Nagar Lucknow best Female service
ย 
Shapes for Sharing between Graph Data Spacesย - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spacesย - and Epistemic Querying of RDF-...Shapes for Sharing between Graph Data Spacesย - and Epistemic Querying of RDF-...
Shapes for Sharing between Graph Data Spacesย - and Epistemic Querying of RDF-...
ย 
Diamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with PrecisionDiamond Application Development Crafting Solutions with Precision
Diamond Application Development Crafting Solutions with Precision
ย 
call girls in Vaishali (Ghaziabad) ๐Ÿ” >เผ’8448380779 ๐Ÿ” genuine Escort Service ๐Ÿ”โœ”๏ธโœ”๏ธ
call girls in Vaishali (Ghaziabad) ๐Ÿ” >เผ’8448380779 ๐Ÿ” genuine Escort Service ๐Ÿ”โœ”๏ธโœ”๏ธcall girls in Vaishali (Ghaziabad) ๐Ÿ” >เผ’8448380779 ๐Ÿ” genuine Escort Service ๐Ÿ”โœ”๏ธโœ”๏ธ
call girls in Vaishali (Ghaziabad) ๐Ÿ” >เผ’8448380779 ๐Ÿ” genuine Escort Service ๐Ÿ”โœ”๏ธโœ”๏ธ
ย 

Handle massive traffic with serverless

  • 1. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Handle massive traffic from the beginning with Serverless Danggeun Market Inc. Byun Kyuhyun
  • 2. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun BYUN Kyuhyun Software Engineer at Dangguen Market. Inc AWS Serverless Hero AWSKRUG Organizer CircleCI UG Organizer
  • 3. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Letโ€™s talk about startup Ref. https://limwonki.com/771
  • 4. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun We donโ€™t have enough time, and engineers.
  • 5. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun However....
  • 6. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Our startup wants to grow faster than others. Ref. https://www.edaily.co.kr/news/read?newsId=01308726622722456
  • 7. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Let's take a look at the practical architecture for Serverless to become a Unicorn.
  • 8. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun First step
  • 9. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Single web server API Gateway - Lambda - DynamoDB or RDS
  • 10. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Second step
  • 11. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Scheduled jobs for querying statistically or analysing. CloudWatch Timebase Trigger with Lambda
  • 12. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun This is a simple architecture. There is no need to maintain infrastructure. But it requires monitoring.
  • 13. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Monitor serverless services
  • 14. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Build GUI Dashboard on CloudWatch Ref. https://sinovi.uk/articles/web-application-dashboards-in-aws-cloudwatch
  • 15. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Grafana with cloudwatch logs Ref. https://jamesthom.as/2018/01/visualising-serverless-metrics-with-grafana-dashboards/
  • 16. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Datadog with cloudwatch logs Ref. https://www.datadoghq.com/blog/aws-1-click-integration/
  • 17. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun But, weโ€™re working at an enterprise. We need to handle more traffic.
  • 18. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Itโ€™s good enough if youโ€™re using DynamoDB. But RDB isnโ€™t so good with Lambda
  • 19. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun How to handle RDB connections?
  • 20. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun First, Using a global variable to hold DB connections can be a solution on Lambda.
  • 21. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun What if thereโ€™s 10 times traffic within a minute? Ref. https://www.ireckon.com/web-dev/how-do-you-cope-when-your-site-traffic-doesnt-just-spike-it-explodes/
  • 22. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun There will be a CPU or Memory spike on RDB because of many connections.
  • 23. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun How to handle it?
  • 24. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun RDS Proxy holds RDB connections and passes queries. Ref. https://aws.amazon.com/ko/rds/proxy/
  • 25. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun How to handle insertions on Databases?
  • 26. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun You may consider the throttling issue on DynamoDB, and the scaling issue on RDB.
  • 27. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Letโ€™s adopt the eventually consistent model
  • 28. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun SQS with Lambda Automactically triggered Lambda by SQS events
  • 29. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun SNS + HTTP notification Automatically send http requests by SNS
  • 30. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Letโ€™s see Scheduled job again.
  • 31. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Becoming an enterprise service means we have Big data. We can not handle data on Lambda.
  • 32. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Long period job, just run code on Fargate
  • 33. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Build docker image with your code and run on ECS or EKS(not yet Seoul)
  • 34. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun But, if you want to do full-scan on DynamoDB or RDB...
  • 35. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun First, RDS Exports and Glue with Athena can be a solution
  • 36. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Run RDS exports to S3 via Lambda Ref. https://docs.aws.amazon.com/ko_kr/AmazonRDS/latest/UserGuide/USER_ExportSnapshot.html RDS Export
  • 37. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Second, letโ€™s see DynamoDB with Glue
  • 38. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun DynamoDB - Glue - S3 then, read schema using Crawler, register data catalog on Glue
  • 39. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun But, DynamoDB is expensive when extracting all data.
  • 40. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Turn on DynamoDB Stream and save all of the histories on S3.
  • 41. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Query via Athena, visualize via BI tools
  • 42. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Data is always matters! With this journey, we can consider less about service architecture. Focus on your business.
  • 43. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun The architecture of todayโ€™s journey
  • 44. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun
  • 45. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun We are hiring! bit.ly/dangguen
  • 46. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun Serverless is more.
  • 47. 2020.07.08 | AWS Dev Alliance Meetup | Handling mssive traffic with Serverless | Byun Kyuhyun THANK YOU ! Email: novemberde1@gmail.com Blog: https://novemberde.github.io Github:https://github.com/novemberde