Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
LogStash: Concept Run-Through
What is LogStash?
What is LogStash?
Definition
Logstash is an open
source, server-side data
processing pipeline that
ingests data from a
mul...
What is LogStash?
Definition
Jordan Sissel created the first version of LogStash in 2013, when he frequently found himself...
What is LogStash?
Importance of LogStash
Open source data collection engine
Centralize data processing of all types
Normal...
History of LogStash
What is LogStash?
What Can LogStash Do?
Core Features
What Can LogStash Do?
Data ingestion
workhorse
Events enrichment
and transformation
Extensible plugin
ecosys...
LogStash Versatility
What Can LogStash Do?
Analysis
Archiving
Monitoring
Alerting
Search
What Constitutes LogStash?
Key Components and Terminology
What Constitutes LogStash?
INPUTS
FILTERS
OUTPUTS
Specify the source of events
LogStash can handle variety of
sources
Most common ones are:
Logs
Network
Web
Data stores and...
Key Components and Terminology
What Constitutes LogStash?
FILTERS
Responsible for parsing the
incoming events
May enrich t...
Key Components and Terminology
What Constitutes LogStash?
OUTPUTS
Final stage of the pipeline
Sends the enriched output to...
How Does LogStash Work?
Files
AWS S3
Elastic Search
Grok
GeoIP
Drop
Anonymize
Inputs Filters Outputs
LogStash Pipeline
How Does LogStash Work?
LogStash: Concept Run-Through
LogStash: Concept Run-Through
Upcoming SlideShare
Loading in …5
×

LogStash: Concept Run-Through

An overview, features and the key components of LogStash. https://goo.gl/oZIrwS

  • Be the first to comment

  • Be the first to like this

LogStash: Concept Run-Through

  1. 1. LogStash: Concept Run-Through
  2. 2. What is LogStash?
  3. 3. What is LogStash? Definition Logstash is an open source, server-side data processing pipeline that ingests data from a multitude of sources simultaneously, transforms it, and then sends it to a specified output.
  4. 4. What is LogStash? Definition Jordan Sissel created the first version of LogStash in 2013, when he frequently found himself in the thick of aggregating and managing log files. Logstash continued to grow with the other components of the ELK stack and is now part of a comprehensive platform for log data and analysis, providing companies with valuable insights into how their customers interact with support system, e-commerce sites and so on.
  5. 5. What is LogStash? Importance of LogStash Open source data collection engine Centralize data processing of all types Normalized varying schema for business critical data Support for multiple and custom formats Extensibility via plugins
  6. 6. History of LogStash What is LogStash?
  7. 7. What Can LogStash Do?
  8. 8. Core Features What Can LogStash Do? Data ingestion workhorse Events enrichment and transformation Extensible plugin ecosystem It is highly available, scalable and elastic in nature. Pluggable pipeline architecture Horizontally scalable data processing pipeline Strong Elasticsearch and Kibana synergy Handles data of all shapes and sizes
  9. 9. LogStash Versatility What Can LogStash Do? Analysis Archiving Monitoring Alerting Search
  10. 10. What Constitutes LogStash?
  11. 11. Key Components and Terminology What Constitutes LogStash? INPUTS FILTERS OUTPUTS
  12. 12. Specify the source of events LogStash can handle variety of sources Most common ones are: Logs Network Web Data stores and streams Sensors and IoT Key Components and Terminology What Constitutes LogStash? INPUTS
  13. 13. Key Components and Terminology What Constitutes LogStash? FILTERS Responsible for parsing the incoming events May enrich the events Most common ones are: grok mutate drop
  14. 14. Key Components and Terminology What Constitutes LogStash? OUTPUTS Final stage of the pipeline Sends the enriched output to a specified destination LogStash can handle variety of destinations ElasticSearch AWS S3 buckets Files
  15. 15. How Does LogStash Work?
  16. 16. Files AWS S3 Elastic Search Grok GeoIP Drop Anonymize Inputs Filters Outputs LogStash Pipeline How Does LogStash Work?

×