Submit Search
Upload
EC2とVarnishで画像配信
•
11 likes
•
7,858 views
Issei Naruta
Follow
どうも、クックパッドの画像配信野郎mirakuiです。Varnish 3 のリリースに合わせて行われたVarnish勉強会「Tokyo.vcl」の第一回で発表したスライドです。
Read less
Read more
Technology
Report
Share
Report
Share
1 of 43
Download now
Download to read offline
Recommended
料理を楽しくする画像配信システム
料理を楽しくする画像配信システム
Issei Naruta
Basics of Ansible - Sahil Davawala
Basics of Ansible - Sahil Davawala
Sahil Davawala
Cloud meets Fog & Puppet A Story of Version Controlled Infrastructure
Cloud meets Fog & Puppet A Story of Version Controlled Infrastructure
Habeeb Rahman
Continuous Deployment at Spreaker
Continuous Deployment at Spreaker
Marco Pracucci
ILM - Pipeline in the cloud
ILM - Pipeline in the cloud
Aaron Carey
持续交付 - 使用云计算和虚拟化技术
持续交付 - 使用云计算和虚拟化技术
foxgem
Advance discussion on Ansible - Rahul Inti
Advance discussion on Ansible - Rahul Inti
Sahil Davawala
Doc
Doc
freynaud
Recommended
料理を楽しくする画像配信システム
料理を楽しくする画像配信システム
Issei Naruta
Basics of Ansible - Sahil Davawala
Basics of Ansible - Sahil Davawala
Sahil Davawala
Cloud meets Fog & Puppet A Story of Version Controlled Infrastructure
Cloud meets Fog & Puppet A Story of Version Controlled Infrastructure
Habeeb Rahman
Continuous Deployment at Spreaker
Continuous Deployment at Spreaker
Marco Pracucci
ILM - Pipeline in the cloud
ILM - Pipeline in the cloud
Aaron Carey
持续交付 - 使用云计算和虚拟化技术
持续交付 - 使用云计算和虚拟化技术
foxgem
Advance discussion on Ansible - Rahul Inti
Advance discussion on Ansible - Rahul Inti
Sahil Davawala
Doc
Doc
freynaud
Elixir at Evercam (By Milos Mosic)
Elixir at Evercam (By Milos Mosic)
Evercam - Construction Time-lapse & Project Management Cameras
Virtualize and automate your development environment for fun and profit
Virtualize and automate your development environment for fun and profit
Andreas Heim
Shrink to grow
Shrink to grow
Daniel Bovensiepen
Automating Kubernetes Environments with Ansible
Automating Kubernetes Environments with Ansible
Timothy Appnel
Deployment with Fabric
Deployment with Fabric
andymccurdy
Scaling to Millions of Concurrent SPARQL Queries on the Cloud
Scaling to Millions of Concurrent SPARQL Queries on the Cloud
Marin Dimitrov
DEPLOYING WORDPRESS BLOG USING DOCKER COMPOSE & ANSIBLE ON AWS
DEPLOYING WORDPRESS BLOG USING DOCKER COMPOSE & ANSIBLE ON AWS
Ramit Surana
Fake IT, until you make IT
Fake IT, until you make IT
Bas Meijer
AnsibleFest 2014 - Role Tips and Tricks
AnsibleFest 2014 - Role Tips and Tricks
jimi-c
docker build with Ansible
docker build with Ansible
Bas Meijer
Debian Cloud - building the Debian AMIs
Debian Cloud - building the Debian AMIs
James Bromberger
Fabric - a server management tool from Instagram
Fabric - a server management tool from Instagram
Jay Ren
Ansible, best practices
Ansible, best practices
Bas Meijer
プラットフォーム分科会_20100804
プラットフォーム分科会_20100804
Yoshiki Ushida
[AWS KR UG 1회 세미나] AWS 배포전략 @ 정민영
[AWS KR UG 1회 세미나] AWS 배포전략 @ 정민영
AWSKRUG - AWS한국사용자모임
VPC by Default時代のアクセス制御
VPC by Default時代のアクセス制御
真吾 吉田
Ansible 202
Ansible 202
Sebastian Montini
AWS ECSを用いてbatchを動かそう
AWS ECSを用いてbatchを動かそう
taisho2
Stupid Video Tricks, CocoaConf Seattle 2014
Stupid Video Tricks, CocoaConf Seattle 2014
Chris Adamson
tofu - COOKPAD's image system
tofu - COOKPAD's image system
Issei Naruta
Bare Metal Cloud: 実マシンを提供するクラウドサービス (SWoPP 2010)
Bare Metal Cloud: 実マシンを提供するクラウドサービス (SWoPP 2010)
Yasuhito Takamiya
Using Oracle Database with Amazon Web Services
Using Oracle Database with Amazon Web Services
guest484c12
More Related Content
What's hot
Elixir at Evercam (By Milos Mosic)
Elixir at Evercam (By Milos Mosic)
Evercam - Construction Time-lapse & Project Management Cameras
Virtualize and automate your development environment for fun and profit
Virtualize and automate your development environment for fun and profit
Andreas Heim
Shrink to grow
Shrink to grow
Daniel Bovensiepen
Automating Kubernetes Environments with Ansible
Automating Kubernetes Environments with Ansible
Timothy Appnel
Deployment with Fabric
Deployment with Fabric
andymccurdy
Scaling to Millions of Concurrent SPARQL Queries on the Cloud
Scaling to Millions of Concurrent SPARQL Queries on the Cloud
Marin Dimitrov
DEPLOYING WORDPRESS BLOG USING DOCKER COMPOSE & ANSIBLE ON AWS
DEPLOYING WORDPRESS BLOG USING DOCKER COMPOSE & ANSIBLE ON AWS
Ramit Surana
Fake IT, until you make IT
Fake IT, until you make IT
Bas Meijer
AnsibleFest 2014 - Role Tips and Tricks
AnsibleFest 2014 - Role Tips and Tricks
jimi-c
docker build with Ansible
docker build with Ansible
Bas Meijer
Debian Cloud - building the Debian AMIs
Debian Cloud - building the Debian AMIs
James Bromberger
Fabric - a server management tool from Instagram
Fabric - a server management tool from Instagram
Jay Ren
Ansible, best practices
Ansible, best practices
Bas Meijer
プラットフォーム分科会_20100804
プラットフォーム分科会_20100804
Yoshiki Ushida
[AWS KR UG 1회 세미나] AWS 배포전략 @ 정민영
[AWS KR UG 1회 세미나] AWS 배포전략 @ 정민영
AWSKRUG - AWS한국사용자모임
VPC by Default時代のアクセス制御
VPC by Default時代のアクセス制御
真吾 吉田
Ansible 202
Ansible 202
Sebastian Montini
AWS ECSを用いてbatchを動かそう
AWS ECSを用いてbatchを動かそう
taisho2
Stupid Video Tricks, CocoaConf Seattle 2014
Stupid Video Tricks, CocoaConf Seattle 2014
Chris Adamson
What's hot
(19)
Elixir at Evercam (By Milos Mosic)
Elixir at Evercam (By Milos Mosic)
Virtualize and automate your development environment for fun and profit
Virtualize and automate your development environment for fun and profit
Shrink to grow
Shrink to grow
Automating Kubernetes Environments with Ansible
Automating Kubernetes Environments with Ansible
Deployment with Fabric
Deployment with Fabric
Scaling to Millions of Concurrent SPARQL Queries on the Cloud
Scaling to Millions of Concurrent SPARQL Queries on the Cloud
DEPLOYING WORDPRESS BLOG USING DOCKER COMPOSE & ANSIBLE ON AWS
DEPLOYING WORDPRESS BLOG USING DOCKER COMPOSE & ANSIBLE ON AWS
Fake IT, until you make IT
Fake IT, until you make IT
AnsibleFest 2014 - Role Tips and Tricks
AnsibleFest 2014 - Role Tips and Tricks
docker build with Ansible
docker build with Ansible
Debian Cloud - building the Debian AMIs
Debian Cloud - building the Debian AMIs
Fabric - a server management tool from Instagram
Fabric - a server management tool from Instagram
Ansible, best practices
Ansible, best practices
プラットフォーム分科会_20100804
プラットフォーム分科会_20100804
[AWS KR UG 1회 세미나] AWS 배포전략 @ 정민영
[AWS KR UG 1회 세미나] AWS 배포전략 @ 정민영
VPC by Default時代のアクセス制御
VPC by Default時代のアクセス制御
Ansible 202
Ansible 202
AWS ECSを用いてbatchを動かそう
AWS ECSを用いてbatchを動かそう
Stupid Video Tricks, CocoaConf Seattle 2014
Stupid Video Tricks, CocoaConf Seattle 2014
Similar to EC2とVarnishで画像配信
tofu - COOKPAD's image system
tofu - COOKPAD's image system
Issei Naruta
Bare Metal Cloud: 実マシンを提供するクラウドサービス (SWoPP 2010)
Bare Metal Cloud: 実マシンを提供するクラウドサービス (SWoPP 2010)
Yasuhito Takamiya
Using Oracle Database with Amazon Web Services
Using Oracle Database with Amazon Web Services
guest484c12
Fisl - Deployment
Fisl - Deployment
Fabio Akita
4K Media Workflows on AWS
4K Media Workflows on AWS
Amazon Web Services
Deployment de Rails
Deployment de Rails
elliando dias
Magento Imagine 2013: Fabrizio Branca - Learning To Fly: How Angry Birds Reac...
Magento Imagine 2013: Fabrizio Branca - Learning To Fly: How Angry Birds Reac...
AOE
4K Media Workflows on AWS By Usman Shakeel of Amzaon AWS
4K Media Workflows on AWS By Usman Shakeel of Amzaon AWS
ETCenter
Golang Performance : microbenchmarks, profilers, and a war story
Golang Performance : microbenchmarks, profilers, and a war story
Aerospike
Lessons learned scaling big data in cloud
Lessons learned scaling big data in cloud
Vijay Rayapati
Cloudpack
Cloudpack
awsadvantageseminar
MongoDB: How it Works
MongoDB: How it Works
Mike Dirolf
Apache Sling - The whys and the hows
Apache Sling - The whys and the hows
Robert Munteanu
ドワンゴでのScala活用事例「ニコニコandroid」
ドワンゴでのScala活用事例「ニコニコandroid」
Satoshi Goto
Day of Cloud: Amazon EC2
Day of Cloud: Amazon EC2
cmcavoy
Jazoon 2011 - Smart EAI with Apache Camel
Jazoon 2011 - Smart EAI with Apache Camel
Kai Wähner
Minio ♥ Go
Minio ♥ Go
Minio
Perf Vsphere Storage Protocols
Perf Vsphere Storage Protocols
Yanghua Zhang
SouJava May 2020: Apache Camel 3 - the next generation of enterprise integration
SouJava May 2020: Apache Camel 3 - the next generation of enterprise integration
Claus Ibsen
Using apache spark for processing trillions of records each day at Datadog
Using apache spark for processing trillions of records each day at Datadog
Vadim Semenov
Similar to EC2とVarnishで画像配信
(20)
tofu - COOKPAD's image system
tofu - COOKPAD's image system
Bare Metal Cloud: 実マシンを提供するクラウドサービス (SWoPP 2010)
Bare Metal Cloud: 実マシンを提供するクラウドサービス (SWoPP 2010)
Using Oracle Database with Amazon Web Services
Using Oracle Database with Amazon Web Services
Fisl - Deployment
Fisl - Deployment
4K Media Workflows on AWS
4K Media Workflows on AWS
Deployment de Rails
Deployment de Rails
Magento Imagine 2013: Fabrizio Branca - Learning To Fly: How Angry Birds Reac...
Magento Imagine 2013: Fabrizio Branca - Learning To Fly: How Angry Birds Reac...
4K Media Workflows on AWS By Usman Shakeel of Amzaon AWS
4K Media Workflows on AWS By Usman Shakeel of Amzaon AWS
Golang Performance : microbenchmarks, profilers, and a war story
Golang Performance : microbenchmarks, profilers, and a war story
Lessons learned scaling big data in cloud
Lessons learned scaling big data in cloud
Cloudpack
Cloudpack
MongoDB: How it Works
MongoDB: How it Works
Apache Sling - The whys and the hows
Apache Sling - The whys and the hows
ドワンゴでのScala活用事例「ニコニコandroid」
ドワンゴでのScala活用事例「ニコニコandroid」
Day of Cloud: Amazon EC2
Day of Cloud: Amazon EC2
Jazoon 2011 - Smart EAI with Apache Camel
Jazoon 2011 - Smart EAI with Apache Camel
Minio ♥ Go
Minio ♥ Go
Perf Vsphere Storage Protocols
Perf Vsphere Storage Protocols
SouJava May 2020: Apache Camel 3 - the next generation of enterprise integration
SouJava May 2020: Apache Camel 3 - the next generation of enterprise integration
Using apache spark for processing trillions of records each day at Datadog
Using apache spark for processing trillions of records each day at Datadog
Recently uploaded
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
charlottematthew16
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
Fwdays
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
BookNet Canada
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
ScyllaDB
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
Dubai Multi Commodity Centre
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
RankYa
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
Rizwan Syed
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
Miki Katsuragi
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
Lonnie McRorey
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
Fwdays
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
gvaughan
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
Pixlogix Infotech
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
DianaGray10
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
Manik S Magar
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
Alex Barbosa Coqueiro
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
2toLead Limited
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
Alan Dix
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
hariprasad279825
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
Mattias Andersson
Recently uploaded
(20)
Powerpoint exploring the locations used in television show Time Clash
Powerpoint exploring the locations used in television show Time Clash
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
"LLMs for Python Engineers: Advanced Data Analysis and Semantic Kernel",Oleks...
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
Search Engine Optimization SEO PDF for 2024.pdf
Search Engine Optimization SEO PDF for 2024.pdf
Scanning the Internet for External Cloud Exposures via SSL Certs
Scanning the Internet for External Cloud Exposures via SSL Certs
Vertex AI Gemini Prompt Engineering Tips
Vertex AI Gemini Prompt Engineering Tips
TeamStation AI System Report LATAM IT Salaries 2024
TeamStation AI System Report LATAM IT Salaries 2024
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
TrustArc Webinar - How to Build Consumer Trust Through Data Privacy
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
WordPress Websites for Engineers: Elevate Your Brand
WordPress Websites for Engineers: Elevate Your Brand
The Ultimate Guide to Choosing WordPress Pros and Cons
The Ultimate Guide to Choosing WordPress Pros and Cons
Take control of your SAP testing with UiPath Test Suite
Take control of your SAP testing with UiPath Test Suite
Anypoint Exchange: It’s Not Just a Repo!
Anypoint Exchange: It’s Not Just a Repo!
Unraveling Multimodality with Large Language Models.pdf
Unraveling Multimodality with Large Language Models.pdf
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
From Family Reminiscence to Scholarly Archive .
From Family Reminiscence to Scholarly Archive .
Artificial intelligence in cctv survelliance.pptx
Artificial intelligence in cctv survelliance.pptx
Are Multi-Cloud and Serverless Good or Bad?
Are Multi-Cloud and Serverless Good or Bad?
EC2とVarnishで画像配信
1.
EC2 Varnish
2.
@mirakui
3.
※
4.
BEFORE TOFU
app app app apache apache
5.
tofu
6.
AFTER TOFU
app app app tofu apache
7.
http://tofu/recipes/1237075/100x141c/ 0b9c3ad1cba65869058e17cf78988bcb.jpg
8.
http://tofu/recipes/
1237075/100x141c/ 0b9c3ad1cba65869058e17cf78988bcb.jpg
9.
‘100’ ‘100x100’ ‘100x100c’ ‘100x100c40_198_137_104_300’
10.
DEMO
11.
12.
! Apache module
(mod_tofu.so) ! ImageMagick(Wand) ! Amazon S3
13.
akamai (cdn)
ELB Apache Apache Apache (mod_tofu) (mod_tofu) … (mod_tofu) S3
14.
Akamai
15.
7000rps
akamai (cdn) hit90% 700rps ELB Apache Apache Apache (mod_tofu) (mod_tofu) … (mod_tofu) S3
16.
akamai (cdn)
hit90% ELB 24 CACHE(?) hit60% Apache Apache Apache (mod_tofu) (mod_tofu) … (mod_tofu) S3
17.
akamai (cdn)
ELB Varnish Varnish Apache Apache Apache (mod_tofu) (mod_tofu) … (mod_tofu) S3
18.
EC2+ Varnish
19.
1st challenge
20.
1st challenge
EC2 m2.xlarge EBS (17.1GB mem) 100GB swap Varnish 2.1.5 storage: malloc, 100GB
21.
m2.xlarge(17.1GB) varnish 2 +
EBS(100GB swap) 300req/s 17.1GB + EBS100G 110GB 60% OS SWAP
22.
23.
24.
17.1GB
Varnish swap LoadAverage →Varnish
25.
26.
2nd challenge
27.
2nd challenge
EC2 m2.xlarge EBS (17.1GB mem) 100GB ext3 Varnish 2.1.5 storage: file, 100GB
28.
29.
30.
file storage OS
31.
32.
file storage OS
restart
33.
34.
35.
EC2 Varnish I/O
36.
37.
Varnish3 persistent storage restart
file storage hash director varnish consistent hashing
38.
…
39.
instance
cores memory price m1.large 2 7.5gb 23,904/ m1.xlarge 4 15gb 47,808/ c1.xlarge 8 7gb 47,808/ m2.xlarge 2 17.1gb 35,868/ m2.2xlarge 4 34.2gb 71,712/ m2.4xlarge 8 68.48gb 142,826/ ……
40.
akamai (cdn)
tofu ELB Varnish Varnish Apache Apache ApacheApache ApacheApache (mod_tofu) (mod_tofu) … (mod_tofu) (mod_tofu) (mod_tofu) (mod_tofu) S3
41.
cache
…
42.
43.
DISK I/O EC2
varnish m2.2xlarge file storage varnish
Download now