4. Why NFS?
Which is suitable storage
for storing the media files?
?
Low ROI
Possibility of SPOF
Storage Expansion is difficult during increasing data
4
9. System Layout
Request from Web Application(s)
Load Balancer
LeoFS-Manager
S3-API
REST over HTTP
LeoFS-Gateway
RPC
w/Cache Server
SNMP
RPC
LeoFS-Storage
Storage Engine/Router
Storage Engine/Router
Storage Engine/Router
WEB Console
META
Object Store
META
Object Store
META
Object Store
9
10. System Layout
Request from Web Application(s)
Load Balancer
Gateway
Manager
LeoFS-Manager
HTTP
Cluster
Request/Response Handling
S3-API
Management
REST over HTTP
LeoFS-Gateway
+
RPC
w/Object Cache
w/Cache Server
Ring Watcher
(AWS S3-API)
Node Watcher
SNMP
RPC
LeoFS-Storage
Storage
GUI Console
Object Storage, Meta data Storage
Storage Engine/Router
Storage Engine/Router
Storage Engine/Router
+
META
Replicator/Recoverer
Object Store
META
META
Object Store
Object Store
10
16. Three “HIGH”
High Cost Performance
Monolithic Storage System
Storage Engine For Unstructured Files
Traffic Restrain Mechanism
> File Cache System (Gateway Plugin)
16
17. Three “HIGH”
High Reliability
NO SPOF
Split Brain Measure
“Erlang OTP” > Nine Nines (99.9999999%)
17
18. Three “HIGH”
High Scalability
Elastic Storage System
> Able to dynamic attach/detach nodes
> Able to over 100-nodes
> NOT Mesh-connected Mutual Servers
18
22. Storage Engine
Metadata + Object Storage
LeoFS-Storage
Storage Engine / Replicator / Recoverer
Object’s Attribute Storage
(metadata)
Object Storage
Metadata : Keeps an in-memory index of all data.
Object Storage : Log structured (append-only) object store.
22
23. Storage Engine
Retrieve an object from Storage
Storage Engine
< META DATA >
ID
Filename
Offset
Size
Checksum
Data
Header
Metadata
File
Footer
Object Container
23
24. Storage Engine
Insert an object into Storage
Storage Engine
Add a Metadata
Meta Data Server
Data
Append a File 24