What's behind facebook

•

5 likes•5,748 views

Ajen 陳

Technology

• font-end
o HipHop
o BigPipe
• back-end outline
o Thrift
o Scribe
o Tornado
• data persistence
• other

font-end
Linux & Apache
PHP + HipHop
BigPipe

HipHop
• PHP complier developed by Facebook.
• Convert PHP code to C ++.
• Compiled by gcc.
• CPU usage recudes 50%.
• Git Hub

BigPipe
• It’s a fundamental redesign of the dynamic web.
page serving system.
• Decomposing web pages into 「pagelets」.
• Implemented by ONLY PHP + JavaScript!
• Link

Thrift
• Cross-language services development.
• Code generation engine.
• Sample Code

definition file thrift complier source code

Scribe
• Distributed Loggin System.
• git hub

Tornado
• Web Server written by python.
• For real-time web services
• non-blocking web service.
• git hub
• show case
• link

data persistence
MySQL
Hive + Hadoop + Hbase + HDFS
Memcache
Haystack

MySQL
• It’s still backbon of database infra.
• How ?
o Learn more : link
o facebook patches

Hive + hadoop + Hbase +
HDFS
Hive

hadoop

Hbase

HDFS

Memcache
• Distributed memory object caching system
• MySQL Cache
• General purpose cache
• Link

Haystack
• Efficient storage of billions of photos.
• Reducing Disk I/O.
• Components
o Haystack Diretory
o Haystack Store
o Haystack Cache

• Link

Other
• Chat
o Epoll Server using Erlang
o Accessed using thrift

• Message Search
o Inverted index stored in HBase

What's hot

Hadoop World 2011: Apache HBase Road Map - Jonathan Gray - FacebookCloudera, Inc.

Qconadityaagarwal

Qcon 090408233824-phpapp01jgregory1234

High Scalability by Example – How can Web-Architecture scale like Facebook, T...Robert Mederer

RBS in SharePointMiguel Tabera

Storage Infrastructure Behind Facebook Messagesfeng1212

How facebook works and function- a complete approachPrakhar Gethe

Remote Blog Storage (RBS) Best Practices in SharePoint 2010 - EPC GroupEPC Group

Yahoo Communities Architecture Unlikely BedfellowsConSanFrancisco123

Yahoo Pipes Middleware In The CloudConSanFrancisco123

BRAINREPUBLIC - Powered by no-SQLAndreas Jung

LAMPtutorialsruby

PUBLISHED: Facebook Cloud ComputingRichardBatka

Introduction To Web Development & The New Digital WorkplaceJen Wei Lee

Produce & Publish Authoring Environment V 2.0 (english version)Andreas Jung

NOSQL, CouchDB, and the Cloudboorad

Open Ap Is State Of The MarketConSanFrancisco123

What's hot (17)

Hadoop World 2011: Apache HBase Road Map - Jonathan Gray - Facebook

Qcon

Qcon 090408233824-phpapp01

High Scalability by Example – How can Web-Architecture scale like Facebook, T...

RBS in SharePoint

Storage Infrastructure Behind Facebook Messages

How facebook works and function- a complete approach

Remote Blog Storage (RBS) Best Practices in SharePoint 2010 - EPC Group

Yahoo Communities Architecture Unlikely Bedfellows

Yahoo Pipes Middleware In The Cloud

BRAINREPUBLIC - Powered by no-SQL

LAMP

PUBLISHED: Facebook Cloud Computing

Introduction To Web Development & The New Digital Workplace

Produce & Publish Authoring Environment V 2.0 (english version)

NOSQL, CouchDB, and the Cloud

Open Ap Is State Of The Market

Viewers also liked

Facebook architecturemysqlops

Facebook architecture presentation: scalability challengeCristina Munoz

thrift-20070401Hiroshi Ono

Python at FacebookAngelo Failla

Big Data in Real-Time at Twitternkallen

Social and-psychological-impact-of-social-networking-sitesSumit Malhotra

Social network architecture - Part 2. News feedPhu Luong Trong

Social network architecture - Part 1. Core userPhu Luong Trong

Social network architecture - Part 3. Big data - Machine learningPhu Luong Trong

Social Media, Cloud Computing and architectureRick Mans

Researching Social Media – Big Data and Social Media AnalysisFarida Vis

Network Security July 1Jd Mercado

Collapse of angolan banking system copyEduardo Cambinda

Open Source Software ConceptsJITENDRA LENKA

Cyberpunkhidralisko

Yii Framework SecurityIlko Kacharov

Informatics Practices Chapter 2 Open Source Software Concepts Class 12thHarsh Mathur

CyberPunkFabio Silva

Social networkingvishnukdixit

Social Networking: Past, Present & FutureMark Suster

Viewers also liked (20)

Facebook architecture

Facebook architecture presentation: scalability challenge

thrift-20070401

Python at Facebook

Big Data in Real-Time at Twitter

Social and-psychological-impact-of-social-networking-sites

Social network architecture - Part 2. News feed

Social network architecture - Part 1. Core user

Social network architecture - Part 3. Big data - Machine learning

Social Media, Cloud Computing and architecture

Researching Social Media – Big Data and Social Media Analysis

Network Security July 1

Collapse of angolan banking system copy

Open Source Software Concepts

Cyberpunk

Yii Framework Security

Informatics Practices Chapter 2 Open Source Software Concepts Class 12th

CyberPunk

Social networking

Social Networking: Past, Present & Future

Similar to What's behind facebook

Big Data and Hadoop - History, Technical Deep Dive, and Industry TrendsEsther Kundin

HBase app HUG talkKevin (Xi Zhao) Wang

CIS13: Big Data Platform Vendor’s Perspective: Insights from the Bleeding EdgeCloudIDSummit

Building Google-in-a-box: using Apache SolrCloud and Bigtop to index your big...rhatr

Infrastructure, Hiphop for PHP, deploy @ HyvesMarco Londero

Big data and hadoop anupamaAnupama Prabhudesai

Intro to HBase - Lars GeorgeJAX London

HyperDB, MySQL Performance, & Flavors of MySQLEvan Volgas

IPFS: The Permanent WebSivachandran Paramsivam

Big Data in the Microsoft PlatformJesus Rodriguez

Trend Micro Big Data Platform and Apache BigtopEvans Ye

High Voltage - Building Static Sites With Wordpress-Managed ContentNicolle Morton

Hp hadoop platformAkshat Thakar

Tcloud Computing Hadoop Family and Ecosystem Service 2013.Q2tcloudcomputing-tw

List of Engineering Colleges in UttarakhandRoorkee College of Engineering, Roorkee

Hadoop.pptxarslanhaneef

Hadoop.pptxsonukumar379092

Apache Giraph: start analyzing graph relationships in your bigdata in 45 minu...rhatr

Concepts on HadoopChristopher Sharkey

Similar to What's behind facebook (20)

Big Data and Hadoop - History, Technical Deep Dive, and Industry Trends

HBase app HUG talk

CIS13: Big Data Platform Vendor’s Perspective: Insights from the Bleeding Edge

Building Google-in-a-box: using Apache SolrCloud and Bigtop to index your big...

Infrastructure, Hiphop for PHP, deploy @ Hyves

Big data and hadoop anupama

Intro to HBase - Lars George

HyperDB, MySQL Performance, & Flavors of MySQL

IPFS: The Permanent Web

Big Data in the Microsoft Platform

Trend Micro Big Data Platform and Apache Bigtop

High Voltage - Building Static Sites With Wordpress-Managed Content

Hp hadoop platform

Tcloud Computing Hadoop Family and Ecosystem Service 2013.Q2

List of Engineering Colleges in Uttarakhand

Hadoop.pptx

Apache Giraph: start analyzing graph relationships in your bigdata in 45 minu...

Concepts on Hadoop

Recently uploaded

Story boards and shot lists for my a level piececharlottematthew16

"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays

Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106

Vertex AI Gemini Prompt Engineering TipsMiki Katsuragi

Bun (KitWorks Team Study 노별마루 발표 2024.4.22)Wonjun Hwang

Streamlining Python Development: A Guide to a Modern Project SetupFlorian Wilhelm

The Future of Software Development - Devin AI Innovative Approach.pdfSeasiaInfotech2

Powerpoint exploring the locations used in television show Time Clashcharlottematthew16

My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer

DevEX - reference for building teams, processes, and platformsSergiu Bodiu

E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptxnull - The Open Security Community

What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett

Artificial intelligence in cctv survelliance.pptxhariprasad279825

Anypoint Exchange: It’s Not Just a Repo!Manik S Magar

Designing IA for AI - Information Architecture Conference 2024Enterprise Knowledge

Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz

"Federated learning: out of reach no matter how close",Oleksandr LapshynFwdays

Commit 2024 - Secret Management made easyAlfredo García Lavilla

Scanning the Internet for External Cloud Exposures via SSL CertsRizwan Syed

Gen AI in Business - Global Trends Report 2024.pdfAddepto

Recently uploaded (20)

Story boards and shot lists for my a level piece

"Debugging python applications inside k8s environment", Andrii Soldatenko

Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics

Vertex AI Gemini Prompt Engineering Tips

Bun (KitWorks Team Study 노별마루 발표 2024.4.22)

Streamlining Python Development: A Guide to a Modern Project Setup

The Future of Software Development - Devin AI Innovative Approach.pdf

Powerpoint exploring the locations used in television show Time Clash

My INSURER PTE LTD - Insurtech Innovation Award 2024

DevEX - reference for building teams, processes, and platforms

E-Vehicle_Hacking_by_Parul Sharma_null_owasp.pptx

What's New in Teams Calling, Meetings and Devices March 2024

Artificial intelligence in cctv survelliance.pptx

Anypoint Exchange: It’s Not Just a Repo!

Designing IA for AI - Information Architecture Conference 2024

Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost

"Federated learning: out of reach no matter how close",Oleksandr Lapshyn

Commit 2024 - Secret Management made easy

Scanning the Internet for External Cloud Exposures via SSL Certs

Gen AI in Business - Global Trends Report 2024.pdf

What's behind facebook

1. What’s behind facebook A Jen

2. • font-end o HipHop o BigPipe • back-end outline o Thrift o Scribe o Tornado • data persistence • other

3. font-end Linux & Apache PHP + HipHop BigPipe

4. HipHop • PHP complier developed by Facebook. • Convert PHP code to C ++. • Compiled by gcc. • CPU usage recudes 50%. • Git Hub

5. BigPipe • It’s a fundamental redesign of the dynamic web. page serving system. • Decomposing web pages into 「pagelets」. • Implemented by ONLY PHP + JavaScript! • Link

6. back-end Thrift Scribe Tornado

7. Thrift • Cross-language services development. • Code generation engine. • Sample Code definition file thrift complier source code

8. Scribe • Distributed Loggin System. • git hub

9. Tornado • Web Server written by python. • For real-time web services • non-blocking web service. • git hub • show case • link

10. data persistence MySQL Hive + Hadoop + Hbase + HDFS Memcache Haystack

11. MySQL • It’s still backbon of database infra. • How ? o Learn more : link o facebook patches

12. Hive + hadoop + Hbase + HDFS Hive hadoop Hbase HDFS

13. Memcache • Distributed memory object caching system • MySQL Cache • General purpose cache • Link

14. Haystack • Efficient storage of billions of photos. • Reducing Disk I/O. • Components o Haystack Diretory o Haystack Store o Haystack Cache • Link

15. Other • Chat o Epoll Server using Erlang o Accessed using thrift • Message Search o Inverted index stored in HBase

16. Thank you A Jen

What's behind facebook

Recommended

Recommended

More Related Content

What's hot

What's hot (17)

Viewers also liked

Viewers also liked (20)

Similar to What's behind facebook

Similar to What's behind facebook (20)

More from Ajen 陳

More from Ajen 陳 (6)

Recently uploaded

Recently uploaded (20)

What's behind facebook