More Related Content
More from SATOSHI TAGOMORI
More from SATOSHI TAGOMORI (20)
LDeNA 峠とログ収集・集計の話
- 19. (2000 2011)
1. scp
/URL
(bot/ PV )
2. 1
3. gluster
fs (gluster)
12 1 30
- 24. (2011)
1. scribe
push
( )
(scribed)
2. HDFS
3. parse
Shib
Hadoop
Hadoop Hadoop Hive
(scribed) Hadoop
Cluster
Hadoop
Cluster
Hadoop
RAID Cluster
Hadoop
(scribed) Cluster
Cluster
RAID Cluster
4.
12 1 30
- 30. (NOW!)
(scribed)
(scribed) RAID
(scribed)
(scribed) RAID
Fluentd
Hadoop
Hadoop Hadoop
Hadoop Hadoop
Hadoop Shib
Cluster
Hadoop
Cluster
Hadoop Cluster
Hadoop
Cluster
Fluentd Cluster
Hadoop
Cluster
Hadoop Hadoop Hive
Cluster
Cluster Cluster
Cluster Cluster
Cluster
HDFS
12 1 30
- 31. Shirahne -> Shib
(scribed)
(scribed) RAID
(scribed)
(scribed) RAID
Hadoop
Hadoop Hadoop
Hadoop Hadoop
Hadoop Shib
Cluster
Hadoop
Cluster
Hadoop Cluster
Hadoop
Cluster
Fluentd Cluster
Hadoop
Cluster
Hadoop Hadoop Hive
Cluster
Cluster Cluster
Cluster Cluster
Cluster
Shirahne
12 1 30
- 33. Yahoo!
HTTP
parse
Fluentd
IRC
12 1 30