2016年9月30日に開催した「IIJ GIOアカデミー ～サービス開発者が語る！詳解オブジェクトストレージ～ 」の講演資料です。

2. •
–
•
–
–
•
–
–
•
–
•
–
–
•
•
•
–
–
1

3. •
–
–
–
–
•
–
–
–
–
2

4. 3

5. •
–
•
•
–
–
•
•
© 2016 Internet Initiative Japan Inc. 4
pictures/dog.jpg
PUT https://storage-dag.iijgio.com/mybucket/pictures/dog.jpg
GET https://storage-dag.iijgio.com/mybucket/pictures/dog.jpg

6. •
–
–
•
•
–
•
•
–
–
•
–
•
•
•
–
•
•
•
–
•
–
–
–
–
•
–
•
© 2016 Internet Initiative Japan Inc. 5

7. •
–
–
–
•
–
•
•
–
–
pictures/dog.jpg
PUT https://storage-dag.iijgio.com/mybucket/pictures/dog.jpg
GET https://storage-dag.iijgio.com/mybucket/pictures/dog.jpg
mybucket
6

8. •
–
–
–
•
•
–
–
•
•
–
•
–
–
•
–
7

9. •
–
•
–
•
–
•
•
–
•
–
–
•
–
•
–
•
•
オブジェクト
バケット
サービス
https://storage-dag.iijgio.com/
https://storage-dag.iijgio.com/{バケット名}
https://storage-dag.iijgio.com/{バケット名}/{オブジェクトキー}
or https://{バケット名}.storage-dag.iijgio.com/
8

10. •
–
•
–
•
–
•
–
•
–
•
•
–
•
/{バケット名}?acl
/{バケット名}?policy
/{バケット名}?website
/{バケット名}?cors
/{バケット名}/{オブジェクトキー}?acl
9

11. •
–
pictures/dog.jpg
PUT https://storage-dag.iijgio.com/mybucket/pictures/dog.jpg
GET https://storage-dag.iijgio.com/mybucket/pictures/dog.jpg
mybucket
DELETE https://storage-dag.iijgio.com/mybucket/pictures/dog.jpg
HEAD https://storage-dag.iijgio.com/mybucket/pictures/dog.jpg
10

12. •
–
11

13. •
$ http -v https://storage-dag.iijgio.com/mybucket/foo/bar/sample.txt
GET /mybucket/foo/bar/sample.txt HTTP/1.1
Accept: */*
Accept-Encoding: gzip, deflate
Connection: keep-alive
Host: storage-dag.iijgio.com
User-Agent: HTTPie/0.9.6
HTTP/1.1 200 OK
Connection: close
Content-Length: 12
Content-Type: text/plain
Date: Tue, 27 Sep 2016 05:24:29 GMT
ETag: "5c0acad898aa9ad1f6414fe89cbf11e9"
Last-Modified: Tue, 27 Sep 2016 05:24:24 GMT
Server: dag.iijgio.com
x-amz-id-2: 44E9B8F6FCEA4D9FA518BC0718905680
x-amz-meta-sample: metadata sample value
x-amz-request-id: 44E9B8F6FCEA4D9FA518BC0718905680
x-amz-version-id: null
x-iijgio-id-2: 44E9B8F6FCEA4D9FA518BC0718905680
x-iijgio-meta-sample: metadata sample value
x-iijgio-request-id: 44E9B8F6FCEA4D9FA518BC0718905680
x-iijgio-version-id: null
sample data
12

14. •
•
–
•
–
•
•
–
•
–
•
–
–
–
–
•
13

15. •
Authorization = “IIJGIO” + “ ” + アクセスキーID + ":" + Signature
Signature = Base64(HMAC-SHA1(UTF-8-Encoding-Of(シークレットアクセスキー, StringToSign)))
StringToSign = HTTP-Verb + "n" +
Content-MD5 + "n" +
Content-Type + "n" +
Date + "n" +
CanonicalizedHeaders +
CanonicalizedResource
CanonicalizedResource = [ "/" + Bucket ] +
<HTTP-Request-URI, from the protocol name up to the query string> + [ sub-resource, if present. ]
CanonicalizedHeaders = [ User metadata, if present. ]
⾯倒くさいので SDK やライブラリの利⽤をオススメします
14

16. •
$ http --debug -v --auth-type dag -a "EALI0XQJWQCBASHAKJYV" https://storage-dag.iijgio.com/mybucket/foo/bar/sample.txt
[httpie-dag] Canonicalized Headers: ''
[httpie-dag] Canonicalized Resource: '/mybucket/foo/bar/sample.txt'
[httpie-dag] String To Sign: 'GETnnnTue, 27 Sep 2016 06:52:01 GMTn/mybucket/foo/bar/sample.txt'
[httpie-dag] Signature: 'IIJGIO EALI0XQJWQCBASHAKJYV:xo1p83TiGP90PdjxCEzJ01EN71c='
GET /mybucket/foo/bar/sample.txt HTTP/1.1
Accept: */*
Accept-Encoding: gzip, deflate
Authorization: IIJGIO EALI0XQJWQCBASHAKJYV:xo1p83TiGP90PdjxCEzJ01EN71c=
Connection: keep-alive
Date: Tue, 27 Sep 2016 06:52:01 GMT
Host: storage-dag.iijgio.com
User-Agent: HTTPie/0.9.6
HTTP/1.1 200 OK
Connection: close
Content-Length: 12
Content-Type: text/plain
Date: Tue, 27 Sep 2016 06:52:02 GMT
ETag: "5c0acad898aa9ad1f6414fe89cbf11e9"
Last-Modified: Tue, 27 Sep 2016 05:24:24 GMT
Server: dag.iijgio.com
x-iijgio-id-2: CEF8DE1AAA754A6C81393E8D5EB78BBB
x-iijgio-meta-sample: metadata sample value
x-iijgio-request-id: CEF8DE1AAA754A6C81393E8D5EB78BBB
x-iijgio-version-id: null
sample data
15

17. •
–
•
–
–
–
16

18. 17

19. •
$ dagtools ls
owner created name
yosinobu@iij.ad.jp 2016-01-27 12:53:04 yosinobu
yosinobu@iij.ad.jp 2014-12-18 15:46:49 mybucket
$ dagtools ls mybucket
[mybucket:]
owner size last-modified name
- - - foo/
- - - pictures/
$ dagtools ls mybucket:foo/bar/
[mybucket:foo/bar/]
owner size last-modified name
yosinobu@iij.ad.jp 12 2016-09-27 14:24:24 sample.txt
$ dagtools cat mybucket:foo/bar/sample.txt
sample data
#!/bin/bash
mysqldump -u root -x --all-databases | dagtools put mybucket:backups/mysqldump.$(date +'%Y%m%d')
•
18

20. •
•
public class HelloObjectStorage {
public static void main(String ...args) throws IOException {
IIJGIOCredentials credentials = new BasicIIJGIOCredentials("AccessKeyId", "SecretAccessKey");
StorageClient client = new StorageClient(credentials);
// GET Service (List Buckets)
List<Bucket> buckets = client.listBuckets();
for (Bucket bucket : buckets) {
System.out.printf("Bucket: %sn", bucket.getName());
}
// GET Bucket (List Objects)
ObjectListing listing = client.listObjects("mybucket");
List<StorageObjectSummary> summaries = listing.getObjectSummaries();
for (StorageObjectSummary summary : summaries) {
System.out.printf("Object: %s, %d bytesn", summary.getKey(), summary.getSize());
}
// GET Object
StorageObject object = client.getObject("mybucket", "foo/bar/sample.txt");
StorageObjectInputStream stream = object.getObjectContent();
int size = (int) object.getObjectMetadata().getContentLength();
byte[] body = new byte[size];
stream.read(body, 0, size);
System.out.println(new String(body));
}
}
HelloObjectStorage.java
19

21. •
<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd">
<modelVersion>4.0.0</modelVersion>
<groupId>com.iijgio.sample</groupId>
<artifactId>object-storage-sample</artifactId>
<version>1.0</version>
<repositories>
<repository>
<id>iijgio-dag</id>
<url>http://support.storage-dag.iijgio.com/libs/maven2</url>
</repository>
</repositories>
<dependencies>
<dependency>
<groupId>com.iijgio.dag.client</groupId>
<artifactId>iijgio-dag-client-core</artifactId>
<version>1.1.0</version>
</dependency>
</dependencies>
</project>
pom.xml
20

22. •
–
–
•
–
•
•
•
–
–
–
21

23. •
–
•
•
– ☓ "GETnnnWed, 28 Sep 2016 09:42:18 GMTn/mybucket/foo/bar/sample.txt?acl="
•
– "x-iijgio-meta-username: fred"
– "x-iijgio-meta-username: barney"
– → "x-iijgio-meta-username: fred,barney”
•
–
–
© 2016 Internet Initiative Japan Inc. 22

24. •
–
•
–
•
–
•
–
•
–
–
•
•
–
•
–
•
© 2016 Internet Initiative Japan Inc. 23

25. •
–
•
–
•
–
•
–
–
•
•
•
–
•
•
–
•
•
–
•
© 2016 Internet Initiative Japan Inc. 24

26. •
•
–
–
–
•
•
–
–
•
–
–
$ sudo ngrep -W byline -d any port 80 and host storage-dag.iijgio.com
25

27. •
–
•
–
•
–
•
26

28. 27

29. •
–
•
•
–
•
–
•
–
•
–
•
•
–
•
28

30. •
–
•
•
–
–
•
•
–
•
•
•
•
–
•
•
29

31. © 2016 Internet Initiative Japan Inc. 30

32. •
–
–
•
–
•
–
© 2016 Internet Initiative Japan Inc. 31

33. •
–
–
–
•
•
•
–
•
–
–
•
•
•
–
•
•
–
•
–
•
–
–
–
–
•
–
© 2016 Internet Initiative Japan Inc. 32
IN A <Server1>
IN A <Server2>
IN A <Server3>

34. •
–
•
–
–
© 2016 Internet Initiative Japan Inc. 33

35. •
–
•
•
–
•
•
•
–
•
–
–
•
–
–
•
–
–
–
–
–
•
•
© 2016 Internet Initiative Japan Inc. 34

36. •
–
•
•
•
–
•
•
–
•
•
–
•
35
/{version}/{collection}/{item}/{sub-resource collection}/{sub-resource item}...

37. •
36
/projects
/projects/{project name}
(例: /projects/gio-academy)
/projects/{project name}/tasks
/projects/{project name}/tasks/{task id}
(例: /projects/gio-academy/tasks/5de31a80)

38. •
–
•
–
•
•
•
–
•
•
•
•
•
–
•
–
© 2016 Internet Initiative Japan Inc. 37

39. •
–
•
•
–
–
–
•
•
•
•
–
•
•
–
–
38

40. •
–
•
•
–
–
–
•
–
•
–
–
»
–
•
–
•
–
39

41. •
–
•
•
–
–
–
•
•
–
•
–
•
•
–
•
•
–
•
•
40