NTTPC is a strategic technology company within the large NTT group in Japan. They have been evaluating and contributing to the open source distributed file system GlusterFS since 2007, developing tools, documentation, and introducing it into their products and services. After diving deeply into GlusterFS, they see potential to expand its capabilities to integrate cloud and on-premise storage as well as block storage interfaces. They also recognize a need for features like thin provisioning and want to focus on growing the GlusterFS community in Japan.
2. Agenda
! About NTTPC
! GlusterFS Challenges and Achievements by NTTPC
! After Diving into GlusterFS
! Some kind of ULTIMATE GlusterFS which I devise
! Focus on the community
Me ->
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 2
3. About!
NTTPC
NTTPCについて
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 3
4. About NTTPC
NTT was originally a part of the Japanese Government, and has dealt with
telephone and telegram service for a long period.
Now, NTT forms a large telephony and IT related group that more than 500
companies are included.
The major companies are the followings;
As a group, about $100bil.
NTT Co. revenue in fiscal year 2009
(Stock Holding Company) (2009/4-2010/3) The biggest ISP
in Japan
$13.5bil.
NTT EAST NTT WEST NTT
(Regional (Regional NTT Communications NTT Data
(Long Distance & docomo (SI)
Carrier) Carrier) International Carrier) (Mobile)
NTTPC Communications
The strategic technology company of the group
- The 1st ISP of the NTT group (InfoSphere was established in 1995)
- The 1st iDC in Japan (WebArena was released in 1997)
- Import Foreign Hardware and Software as a Reseller of NTT Group
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 4
5. GlusterFS!
Challenges!
and!
Achievements!
by NTTPC!
GlusterFSに関するNTTPCのチャレンジと成果
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 5
6. Challenges and Achievements in 2007
! Evaluating distributed storage software
GlusterFS 1.3.7
Gfarm
Red Hat Global File System
Ceph
MogileFS
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 6
7. Challenges and Achievements in 2008
! Field service trial
! Evaluating GlusterFS 1.3.12
! Developing
tools for operation
RESTful API
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 7
8. Challenges and Achievements in 2009
! Evaluating
GlusterFS 2.0.2
GlusterFS 2.0.8
GlusterFS on KVM guests
! Developing
an alternative tool for self-heal feature
mobile front-end application for iPhone and feature
phone
! Authoring Japanese documents of
GlusterFS
! Getting supported by Gluster,Inc.
! Introducing GlusterFS into
Master’s ONE Mobile Folder service
an enterprise e-mail service (for archive storage)
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 8
9. Challenges and Achievements in 2010
! Evaluating InfiniBand for GlusterFS
! Visiting Gluster,Inc.
! Developing
entire-self-heal, a tool for running self-heal quietly
an original thin-provisioning module (just as a
prototype)
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 9
10. Challenges and Achievements in 2011
! Evaluating GlusterFS 3.2.x
! Trying iSCSI target on GlusterFS
! Distributor contract
! Co-working with Mr. Kenta Takahashi
! Speech at
the 1st GlusterFS round-table talk
the 4th Cloud Storage Conference
Internet Week 2012 Virtualization Day
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 10
11. Challenges and Achievements in 2012
! Approached by a few companies for
GlusterFS
! Writing an article in our company
portal
! Speech at InfiniBand DAY 05
! Evaluating Red Hat Storage 2.0 Beta2
! Introducing GlusterFS into
our e-mail service
a cloud storage service
! And Today!
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 11
13. I like ...
! Module architecture
Clean, beautiful and pluggable
! Elastic Hashing Algorithm
The best way at present
! Performance translators
Ingenious attempt as an userspace filesystem
! The community!
Many tough developers and cool hackers!
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 13
14. But we also need ...
! Thin-provisioning feature
For capital spending cuts
! Cleaning 0 byte sparse files
For inode shortage avoidance
! Controlling silent data corruption
For long term service providing
! REST API for operation and monitoring
Can oVirt do it?
! libglusterfsclient again!
Be lost to the history (available until 3.0.x)
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 14
15. Some kind of!
ULTIMATE GlusterFS!
which I devise
ぼくのかんがえたさいきょうのGlusterFS
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 15
16. Some kind of ULTIMATE GlusterFS which I devise
GlusterFS’ front-end is enough cool. But rather back-end
can be expanded. Simply mix cloud and on premise
storages to provide services in a good balance.
cluster/dht
Distributing data
Between local file
system and Amazon S3
cluster/afr cluster/afr
storage/posix storage/posix storage/s3 storage/s3
cluster/afr
One of paired
replicas is saved in
storage/posix storage/s3 S3
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 16
17. Some kind of ULTIMATE GlusterFS which I devise
File storage and object storage are both achieved.
To become truly unified storage,
block storage interface should be implemented.
FUSE NFS swift iSCSI target
cluster/dht
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 17
18. Focus!
on the!
Community
コミュニティについて
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 18
19. Focus on the community
! High interests in Japan, not only English-
speaking countries
About 30 cutting-edge engineers had a discussion
in GlusterFS round-table talk.
Engaging in a heated Qs and As in front of 100
people in Cloud Storage Conference.
Regardless of professions or places of employment,
about 6 of 45 already had experiences with
GlusterFS in InfiniBand DAY 05.
A few companies ask us consult as to GlusterFS.
! But Japanese are ...
Not good at English (especially speaking and listening)
Shy
GMT+9 (a long time distance on the earth far, far away ....)
Japanese localized community is important.
Let’s get it started! 19
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved.
20. Focus on the community
I would like
to enlighten
NTT (Com)
group to
join in the
GlusterFS
Advisory
Board!
http://www.slideshare.net/johnmarkorg/the-future-of-glusterfs-and-glusterorg
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 20
21. To contact us, e-mail here -> storage-contact@nttpc.co.jp
Copyright (C) 2012, NTTPC Communications, Inc. All Rights Reserved. 21