Fluentd Meetup 2015 夏 発表資料

2. About Me
> Eduardo Silva
● Github & Twitter: @edsiper
● Personal Blog : http://edsiper.linuxchile.cl
> Treasure Data, Inc.
● Open Source Engineer
Fluentd / FluentBit
> Projects
● Monkey Server / monkey-project.com
● Duda I/O / duda.io

3. Logging

4. Logging Matters
● Applications status
● Debugging
● Record specific events
● General information about anomalies: errors
● Troubleshooting / Support
● Local or Remote (network)
Pros

5. Logging and other
use cases

6. Logging
More use cases
● Internet of Things (IoT)
● Embedded Applications
When resources are available, Logging can be done
pretty straightforward with professional solutions such as
Fluentd, but in more restrictive environments the
scenario is quite different:
The fun begins ;)

7. Internet of Things
(IoT)

8. Internet of Things
Facts
● IoT will grow to many billions of devices over the next
decade.
● Now it's about device to device connectivity.
● Different frameworks and protocols are emerging.
● It needs Logging.

9. Internet of Things
Frameworks
In order to solve the device to device connectivity and
proper messaging, multiple framework/stacks are
emerging, all of them backed by different companies
and vendors. The most remarkable at the moment are:
Brillo, by Google
Just announced, no logo..sorry!

10. Internet of Things
Logging
● How do we approach data collection for IoT ?
● How can we improve our IoT based product if we
have data from thousand of devices with multiple
sensors (many inputs) ?

11. Fluentd
for Embedded ?

13. Fluent Bit
Objective
● Sensors
● Services
● Signals / Radios
● Operating System Info
● Automotive / Telematics
Open Source data collection tool for Embedded Linux:

14. Fluent Bit
Requirements
● Lightweight
● Written in C Language.
● Customizable, pluggable architecture.
● Integrate with Fluentd
An Embedded environment requires special handling,
specifically on performance and resources utilization, for
hence it needs to be:

15. Fluent Bit
Requirements
● Support custom Inputs
● Support custom Outputs
● Use Binary Serialization (MsgPack)
● Configurable (though file system files)

16. Features

17. Fluent Bit
Features
● Collection & Distribution.
● Built-in system metrics.
● C API for Developers (WIP).
● Integration with third party services.
● Open Source / Apache License v2.0

18. Fluentd Integration

19. Fluent Bit
Fluentd Integration

20. Direct Output

21. Fluent Bit
Fluentd Integration

22. Examples

23. Fluent Bit
Built-in Metrics: CPU usage

24. Fluent Bit
Kernel Log Messages

25. Fluent Bit
Configuration Example

26. Roadmap

27. Fluent Bit
Roadmap
● Library mode.
● Support a stock of sensors (inputs).
● HTTP input.
● Release first stable version.
● Documentation.

28. Fluent Bit
More information
● http://fluentbit.io (official web site)
● http://github.com/fluent/fluent-bit
For more details about Fluent Bit please refer to the
following links:
Thanks!
For more details about Fluent Bit please refer to the
following links:
Eduardo Silva, @edsiper
eduardo@treasure-data.com