Cloud Foundry Logging and Metrics - talk from the CF Summit 2015. Watch the talk here: https://www.youtube.com/watch?v=jTxnCV7wjeA.

1. Cloud Foundry
Logging and Metrics
CF Summit 2015

2. About Us
CloudCredo

3. The Problem

4. Component Overview
Loggregator and the Firehose

5. Loggregator
● Sources, metron, doppler and traffic controller
● Provides `cf logs my-app` functionality
● Allows forwarding to 3rd party syslog drains
● doppler stores data in temporary buffers
● NB: Does not provide long-term storage
● The traffic controller handles client requests

6. Source: http://github.com/cloudfoundry/loggregator

7. The Firehose
● The firehose is a relatively new feature
● It’s a stream of every app’s logs, plus metrics
data from Cloud Foundry’s components
● The traffic controllers expose the /firehose
websocket endpoint
● nozzles attach to the firehose, parse out relevant
data and forward it to other 3rd parties (e.g.
syslog and Graphite)

8. Logs?

9. Integrating ELK with
Cloud Foundry
logsearch

10. Integrating ELK with Cloud Foundry
● logsearch
● Packages the ELK stack as a BOSH release
● It’s completely open source and free!
● www.logsearch.io

11. Integrating ELK with Cloud Foundry
● logsearch-for-cloudfoundry
● Customises logsearch to work with Cloud
Foundry data
● Consumes data from both the firehose and the
syslog component log
● Provides log dashboards for CF developers1
and as CF operators2
[1] https://www.youtube.com/watch?v=M-ODQwm98YM
[2] https://www.youtube.com/watch?v=gWfoHCQUixM

13. Logsearch Overview

14. Logsearch Overview
● Ingests logs
● syslog (+tls) and relp
● firehose via logsearch-for-cloudfoundry

15. Logsearch Overview
● Redis
● Helps to keep the system stable
● Helps to prevent message loss

16. Logsearch Overview
● Provides filtering and parsing of logs
● Apply your own custom filters

17. Logsearch Overview
● Provides storage and indexing

18. Logsearch Overview
● Provides front-end web UI
● Dashboards
● Read-only Elasticsearch API exposed
alongside Kibana

19. Logsearch Overview

20. Integrating ELK with Cloud Foundry
● upload bosh releases
○ logsearch-boshrelease
○ logsearch-for-cloudfoundry-boshrelease
● configure properties
○ syslog_daemon_config
○ ingestor_cloudfoundry-firehose
● deploy
○ bosh -n deploy
● cloudfoundry-community/logsearch-boshworkspace

21. Integrating ELK with Cloud Foundry
● Why should you choose
logsearch?
● It’s open source
● Extracts the complexity
of managing the ELK
stack
● Easy to scale

22. Metrics?

23. Integrating Graphite
with Cloud Foundry
Graphite historian and graphite-nozzle

24. Integrating Graphite with Cloud Foundry
● Approach 1 - Using the collector
● An optional Cloud Foundry component
● Soon to be deprecated in favour of the firehose
● Queries CF components’ /healthz and /varz
endpoints
● Provides a Graphite historian to send data to
Graphite

25. Integrating Graphite with Cloud Foundry
properties:
collector:
use_graphite: true
graphite:
address: <IP address of Graphite server>
port: 2003

26. Integrating Graphite with Cloud Foundry
● Approach 2 - Using graphite-nozzle
● Attaches to the firehose and extracts metrics
Events
● Parses the metrics Events into a format that can
be sent to StatsD
● Available on the CloudCredo Github page

28. Goodbye!
Thank you for listening
Colin Humphreys @hatofmonkeys
Ed King @edking2
@CloudCredo