SlideShare a Scribd company logo
1 of 29
Download to read offline
Log management ELISA controlled by
Zabbix
Lukáš Malý
Lukáš Malý
IT consultant – security and
monitoring
I work as an IT consultant at Datasys. Datasys company is involved in the
development and implementation of log management ELISA, which integrates
several well-known Open Source projects. I participate in the implementation of
Zabbix.
A Little About Me:
Hi, Every One!
maly@datasys.cz
www.datasys.cz
www.logmanagement.cz
@SmEjDiL – linkedin.com/in/smejdil
22 years of experience - comprehensive implementation and integration services
in IT, telecommunications and customized development
Czech private company
Dynamism and innovation
Strategic vision
Real customers' needs
Long-term cooperation
Quality control
ISO 9001 - Quality Management
ISO / IEC 20000-1 - IT Service Management
ISO 27001 – Information Security Management System
ISO 14001 - Environmental Management
ISO 10006 – Quality Management in Projects
BS OHSAS 18001 – Occupational Health and Safety Management Systems
NBÚ (National Security Authority)
4
DATASYS in figures
Employees Turnover in 2015: CZK 750 million
85
Strategic areas
10 750
Over 50 projects implemented in the
year 2015
50
4 branch offices
4
5
Company's areas of interest
Security and
monitoring
Microsoft
And Virtualization
Storage
and Backup
Networking Application
development
Documents Innovation USM ServiceDesk
/HelpDesk
Infrastructure
6
Security and monitoring
Risk analysis, we use a fully localised tool "verinice”
Security-related documentation, compliance with regulations
Cyber-security legislation
Premium quality open source solutions Datasys ELISA and
top program McAfee SIEM
Video logs ObserveIT
Solution for Log Management and SIEM
Risk analysis, security-related documentation
Ensuring compliance with the legal requirements for cyber-security
References: Data boxes, Prague Castle Administration,
Administration of State Material Reserves, Ministry of Foreign Affairs
of the Czech Republic
Expert services of security specialists
Certified ZABBIX partner
Robust, straightforward, easy-to-customize system
Free license without functional restrictions
Operation monitoring, SLA evaluation
* SIEM – Security Information an Event Management
7
Security and monitoring - references
Czech Statistical Office
Česká pošta (Czech Post)
Český aeroholding (Czech Aeroholding)
ČEZ (energy/utility operator and provider)
Data box information system (Ministry of
the Interior of the Czech Republic)
Ministry of Foreign Affairs of the Czech
Republic
Administration of State Material Reserves
Monitoring system ZABBIX
Artesa, saving and loan cooperative
Česká pošta (Czech Post)
Ministry of Regional Development
Ministry of Foreign Affairs of the Czech
Republic
Log management and SIEM
8
ELISA is log management and security monitoring tool
ELISA is logmanagement
Event Log Interception Storage and Analysis
Free software
with support from the producer
Preserves the structure of the original event
uses several components
Extreme scalability and high availability
attractive web user interface Kibana
High performance ( up to 5 000 eps )
9
The main input channels of the ELISA
Input protocols
binary ... (agents) protocol for transmission of structured events
syslog (TCP, UDP or TLS/SSL)
SNMP traps
Microsoft Windows Eventing
Netflow datagrams
10
Enhanced Kibana as a frontend for data analysis
Kibana is used for viewing log data
11
Kibana is a very flexible interface
Dashboard can be modified and stored
12
Extended ZABBIX frontend for administration
Zabbix 'NXlog templates' for central management of agents
13
ELISA Open Source component
Used projects
Elasticsearch, Logstash, Kibana
Open source product of the 'Elastic' company.
NXLog (Community or Enterprice edition)
In concept NXLog is similar to syslog-ng or rsyslog but it is not limited to unix and syslog only. It supports different platforms, log sources and
formats so nxlog can be an ideal choice to implement a centralized logging system.
Zabbix, Xlog, HTTPd Apache with mod_authnz_external.
Zabbix serves several major functions in ELISA. Datasys component Xlog uses Zabbix API.
JasperReport Server with plugin ElasticJasper, Snmptrapd
ELISA provides various opportunities to report information about stored events
14
Zabbix integration with ELISA
ELISA combines many features
ELISA utilizes ZABBIX features
User authentication (internal or LDAP)
Role based access control (flexible log data access restrictions, RW or RO access to dashboards)
Notifications
Self-monitoring – ELK, NXlog
ELISA utilizes Elasticsearch features
Robustness
Scalability
Dashboards – Kibana
Logstash – GeoIP, Netflow
15
Zabbix integration with ELISA
ELISA roles features
ELISA heavily utilizes ZABBIX for user authentication and role based access control.
16
Zabbix integration with ELISA
ELISA roles features
ELISA heavily utilizes ZABBIX for user authentication and role based access control.
17
Zabbix integration with ELISA
ELISA roles features
ELISA heavily utilizes ZABBIX for user authentication and role based access control.
18
Zabbix integration with ELISA
ELISA roles features
ELISA heavily utilizes ZABBIX for user authentication and role based access control.
19
Zabbix integration with ELISA
Use of Zabbix features
ELISA heavily utilizes ZABBIX for user authentication and role based access control, notifications and self-monitoring.
Elasticsearch indices are managed right in ZABBIX Frontend.
20
Zabbix integration with ELISA
DB Indices features
Elasticsearch indices are managed right in ZABBIX Frontend.
21
Zabbix integration with ELISA
DB Indices features
Elasticsearch indices are managed right in ZABBIX Frontend.
22
Zabbix integration with ELISA
Use of Zabbix features
ELISA heavily utilizes ZABBIX for user authentication and role based access control, notifications and self-monitoring.
Elasticsearch indices are managed right in ZABBIX Frontend.
ZABBIX "trapper" items and monitoring templates are used to centrally manage configuration of distributed environment of NXlog agents.
23
Zabbix integration with ELISA
ELISA configuration by Zabbix Templates-Xlog
ZABBIX "trapper" items and monitoring templates are used to centrally manage configuration of distributed environment of NXlog agents.
Template-DS-Xlog_Base_LINUX_LAN for Nxlog agent
24
Zabbix integration with ELISA
NXlog configuration in Templates-Xlog
ZABBIX "trapper" items - The field 'Description' contains NXlog configuration directives.
xlog.config[AGENT,Input,InBinarySyslog,170,Rules-UniFi]
25
Zabbix integration with ELISA
NXlog configuration
ZABBIX "trapper" items - The field 'Description' contains NXlog configuration directives.
NXlog basic modules
• im_tcp - This module accepts TCP connections on the address and port specified in the configuration. It can handle multiple simultaneous
connections. The TCP transfer protocol provides more reliable log transmission than UDP. If security is a concern, consider using the
im_ssl module instead.
• im_udp - This module accepts UDP datagrams on the address and port specified in the configuration. UDP is the transport protocol of the
old BSD syslog standard as described in RFC 3164
• im_file - This module can be used to read log messages from files.
• om_file - This module can be used to write log messages to a file.
• xm_csv - This module provides functions and procedures to process data formatted as comma separated values (CSV) and allows to
convert to CSV and parse CSV into fields.
http://nxlog-ce.sourceforge.net/nxlog-docs/en/nxlog-reference-manual.pdf
26
Zabbix integration with ELISA
Use of Zabbix features
ELISA heavily utilizes ZABBIX for user authentication and role based access control, notifications and self-monitoring.
Elasticsearch indices are managed right in ZABBIX Frontend.
ZABBIX "trapper" items and monitoring templates are used to centrally manage configuration of distributed environment of NXlog agents.
NXlog Agents are capable to securely auto-register as ZABBIX "hosts".
27
Zabbix integration with ELISA
Host configuration
NXlog Agents are capable to securely auto-register as ZABBIX "hosts".
curl -k "https://elisa:10443/xlog/getRuleset.php?&hostname=elisa&label=AGENT&auth=DEFAULT&platform=LINUX_LAN"
28
ELISA Virtual Appliance
General Availability in November 2016
Thank you
for your attention

More Related Content

What's hot

What's hot (20)

Trouble Ticket Integration with Zabbix in Large Environment
Trouble Ticket Integration with Zabbix in Large EnvironmentTrouble Ticket Integration with Zabbix in Large Environment
Trouble Ticket Integration with Zabbix in Large Environment
 
Breaking the Monolith - Microservice Extraction at SoundCloud
Breaking the Monolith - Microservice Extraction at SoundCloudBreaking the Monolith - Microservice Extraction at SoundCloud
Breaking the Monolith - Microservice Extraction at SoundCloud
 
OSMC 2021 | Monitoring Open Infrastructure Logs – With Real Life Examples
OSMC 2021 | Monitoring Open Infrastructure Logs – With Real Life ExamplesOSMC 2021 | Monitoring Open Infrastructure Logs – With Real Life Examples
OSMC 2021 | Monitoring Open Infrastructure Logs – With Real Life Examples
 
PyCon India 2012: Celery Talk
PyCon India 2012: Celery TalkPyCon India 2012: Celery Talk
PyCon India 2012: Celery Talk
 
Monitoring and Scaling Redis at DataDog - Ilan Rabinovitch, DataDog
 Monitoring and Scaling Redis at DataDog - Ilan Rabinovitch, DataDog Monitoring and Scaling Redis at DataDog - Ilan Rabinovitch, DataDog
Monitoring and Scaling Redis at DataDog - Ilan Rabinovitch, DataDog
 
Elk ruminating on logs
Elk ruminating on logsElk ruminating on logs
Elk ruminating on logs
 
"How about no grep and zabbix?". ELK based alerts and metrics.
"How about no grep and zabbix?". ELK based alerts and metrics."How about no grep and zabbix?". ELK based alerts and metrics.
"How about no grep and zabbix?". ELK based alerts and metrics.
 
Introducing Venice
Introducing VeniceIntroducing Venice
Introducing Venice
 
Using ELK-Stack (Elasticsearch, Logstash and Kibana) with BizTalk Server
Using ELK-Stack (Elasticsearch, Logstash and Kibana) with BizTalk ServerUsing ELK-Stack (Elasticsearch, Logstash and Kibana) with BizTalk Server
Using ELK-Stack (Elasticsearch, Logstash and Kibana) with BizTalk Server
 
Reactive Database Access With Slick 3
Reactive Database Access With Slick 3Reactive Database Access With Slick 3
Reactive Database Access With Slick 3
 
Elastic v5.0.0 Update uptoalpha3 v0.2 - 김종민
Elastic v5.0.0 Update uptoalpha3 v0.2 - 김종민Elastic v5.0.0 Update uptoalpha3 v0.2 - 김종민
Elastic v5.0.0 Update uptoalpha3 v0.2 - 김종민
 
OSDC 2017 | Lessons from database failures by Colin Charles
OSDC 2017 | Lessons from database failures by Colin CharlesOSDC 2017 | Lessons from database failures by Colin Charles
OSDC 2017 | Lessons from database failures by Colin Charles
 
Monitoring, Hold the Infrastructure - Getting the Most out of AWS Lambda – Da...
Monitoring, Hold the Infrastructure - Getting the Most out of AWS Lambda – Da...Monitoring, Hold the Infrastructure - Getting the Most out of AWS Lambda – Da...
Monitoring, Hold the Infrastructure - Getting the Most out of AWS Lambda – Da...
 
The ELK Stack - Get to Know Logs
The ELK Stack - Get to Know LogsThe ELK Stack - Get to Know Logs
The ELK Stack - Get to Know Logs
 
NetflixOSS Meetup season 3 episode 1
NetflixOSS Meetup season 3 episode 1NetflixOSS Meetup season 3 episode 1
NetflixOSS Meetup season 3 episode 1
 
JavaCro'14 - Continuous deployment tool – Aleksandar Dostić and Emir Džaferović
JavaCro'14 - Continuous deployment tool – Aleksandar Dostić and Emir DžaferovićJavaCro'14 - Continuous deployment tool – Aleksandar Dostić and Emir Džaferović
JavaCro'14 - Continuous deployment tool – Aleksandar Dostić and Emir Džaferović
 
Bitsy graph database
Bitsy graph databaseBitsy graph database
Bitsy graph database
 
OSMC 2018 | Scaling Icinga2 with many heterogeneous projects – and still pres...
OSMC 2018 | Scaling Icinga2 with many heterogeneous projects – and still pres...OSMC 2018 | Scaling Icinga2 with many heterogeneous projects – and still pres...
OSMC 2018 | Scaling Icinga2 with many heterogeneous projects – and still pres...
 
GlobalsDB: Its significance for Node.js Developers
GlobalsDB: Its significance for Node.js DevelopersGlobalsDB: Its significance for Node.js Developers
GlobalsDB: Its significance for Node.js Developers
 
TW SEAT - DevOps: Security 干我何事?
TW SEAT - DevOps: Security 干我何事?TW SEAT - DevOps: Security 干我何事?
TW SEAT - DevOps: Security 干我何事?
 

Viewers also liked

General Bare-metal Provisioning Framework.pdf
General Bare-metal Provisioning Framework.pdfGeneral Bare-metal Provisioning Framework.pdf
General Bare-metal Provisioning Framework.pdf
OpenStack Foundation
 
Zabbix visión general del sistema - 04.12.2013
Zabbix   visión general del sistema - 04.12.2013Zabbix   visión general del sistema - 04.12.2013
Zabbix visión general del sistema - 04.12.2013
Emmanuel Arias
 

Viewers also liked (20)

Dimitri Bellini and Pietro Antonacci - Manage Zabbix Proxies in Remote Networ...
Dimitri Bellini and Pietro Antonacci - Manage Zabbix Proxies in Remote Networ...Dimitri Bellini and Pietro Antonacci - Manage Zabbix Proxies in Remote Networ...
Dimitri Bellini and Pietro Antonacci - Manage Zabbix Proxies in Remote Networ...
 
Rihards Olups - Zabbix at Nokia - Case Study
Rihards Olups - Zabbix at Nokia - Case StudyRihards Olups - Zabbix at Nokia - Case Study
Rihards Olups - Zabbix at Nokia - Case Study
 
Zabbix Conference LatAm 2016 - Jorge Pretel - Low Level Discovery for ODBC an...
Zabbix Conference LatAm 2016 - Jorge Pretel - Low Level Discovery for ODBC an...Zabbix Conference LatAm 2016 - Jorge Pretel - Low Level Discovery for ODBC an...
Zabbix Conference LatAm 2016 - Jorge Pretel - Low Level Discovery for ODBC an...
 
Raymond Kuiper - Zen and The Art of Zabbix Template Design | ZabConf2016
Raymond Kuiper - Zen and The Art of Zabbix Template Design | ZabConf2016Raymond Kuiper - Zen and The Art of Zabbix Template Design | ZabConf2016
Raymond Kuiper - Zen and The Art of Zabbix Template Design | ZabConf2016
 
Zabbix Conference LatAm 2016 - Daniel Nasiloski - Extending Zabbix - Interact...
Zabbix Conference LatAm 2016 - Daniel Nasiloski - Extending Zabbix - Interact...Zabbix Conference LatAm 2016 - Daniel Nasiloski - Extending Zabbix - Interact...
Zabbix Conference LatAm 2016 - Daniel Nasiloski - Extending Zabbix - Interact...
 
Zabbix Conference LatAm 2016 - Jessian Ferreira - Wireless with Zabbix
Zabbix Conference LatAm 2016 - Jessian Ferreira - Wireless with ZabbixZabbix Conference LatAm 2016 - Jessian Ferreira - Wireless with Zabbix
Zabbix Conference LatAm 2016 - Jessian Ferreira - Wireless with Zabbix
 
Alexei Vladishev - Zabbix - Monitoring Solution for Everyone
Alexei Vladishev - Zabbix - Monitoring Solution for EveryoneAlexei Vladishev - Zabbix - Monitoring Solution for Everyone
Alexei Vladishev - Zabbix - Monitoring Solution for Everyone
 
Openstack高度自动化持续交付
Openstack高度自动化持续交付Openstack高度自动化持续交付
Openstack高度自动化持续交付
 
OpenStack Marketing Meeting Oct 2
OpenStack Marketing Meeting Oct 2OpenStack Marketing Meeting Oct 2
OpenStack Marketing Meeting Oct 2
 
General Bare-metal Provisioning Framework.pdf
General Bare-metal Provisioning Framework.pdfGeneral Bare-metal Provisioning Framework.pdf
General Bare-metal Provisioning Framework.pdf
 
OpenStack Day CEE 2015: Real-World Use Cases
OpenStack Day CEE 2015: Real-World Use CasesOpenStack Day CEE 2015: Real-World Use Cases
OpenStack Day CEE 2015: Real-World Use Cases
 
Nagios Conference 2014 - Mike Weber - Nagios Rapid Deployment Options
Nagios Conference 2014 - Mike Weber - Nagios Rapid Deployment OptionsNagios Conference 2014 - Mike Weber - Nagios Rapid Deployment Options
Nagios Conference 2014 - Mike Weber - Nagios Rapid Deployment Options
 
Vladimir Ulogov - Large Scale Simulation | ZabConf2016 Lightning Talk
Vladimir Ulogov - Large Scale Simulation | ZabConf2016 Lightning TalkVladimir Ulogov - Large Scale Simulation | ZabConf2016 Lightning Talk
Vladimir Ulogov - Large Scale Simulation | ZabConf2016 Lightning Talk
 
Oleg Ivanivskyi - Lessons Learned While Being On-Site | ZabConf2016
Oleg Ivanivskyi - Lessons Learned While Being On-Site | ZabConf2016Oleg Ivanivskyi - Lessons Learned While Being On-Site | ZabConf2016
Oleg Ivanivskyi - Lessons Learned While Being On-Site | ZabConf2016
 
Inaba Kazuhiko - Ahiruyaki Zabbix in Japan Part 2 | ZabConf2016 Lightning Talk
Inaba Kazuhiko - Ahiruyaki Zabbix in Japan Part 2 | ZabConf2016 Lightning TalkInaba Kazuhiko - Ahiruyaki Zabbix in Japan Part 2 | ZabConf2016 Lightning Talk
Inaba Kazuhiko - Ahiruyaki Zabbix in Japan Part 2 | ZabConf2016 Lightning Talk
 
Rafael Martinez Guerrero Zabbix CLI | ZabConf2016 Lightning Talk
Rafael Martinez Guerrero Zabbix CLI | ZabConf2016 Lightning TalkRafael Martinez Guerrero Zabbix CLI | ZabConf2016 Lightning Talk
Rafael Martinez Guerrero Zabbix CLI | ZabConf2016 Lightning Talk
 
Wolfgang Alper - Zabbix Meets OPS Control / Rundeck | ZabConf2016
Wolfgang Alper - Zabbix Meets OPS Control / Rundeck | ZabConf2016Wolfgang Alper - Zabbix Meets OPS Control / Rundeck | ZabConf2016
Wolfgang Alper - Zabbix Meets OPS Control / Rundeck | ZabConf2016
 
Zabbix Conference LatAm 2016 - Paulo Deolindo - Case Study_BBTS and Zabbix
Zabbix Conference LatAm 2016 - Paulo Deolindo - Case Study_BBTS and ZabbixZabbix Conference LatAm 2016 - Paulo Deolindo - Case Study_BBTS and Zabbix
Zabbix Conference LatAm 2016 - Paulo Deolindo - Case Study_BBTS and Zabbix
 
Zabbix visión general del sistema - 04.12.2013
Zabbix   visión general del sistema - 04.12.2013Zabbix   visión general del sistema - 04.12.2013
Zabbix visión general del sistema - 04.12.2013
 
Wolfgang Alper - Zabbix Meets OPS Control / Rundeck | ZabConf2016
Wolfgang Alper - Zabbix Meets OPS Control / Rundeck | ZabConf2016Wolfgang Alper - Zabbix Meets OPS Control / Rundeck | ZabConf2016
Wolfgang Alper - Zabbix Meets OPS Control / Rundeck | ZabConf2016
 

Similar to Lukáš Malý - Log management ELISA controlled by Zabbix | ZabConf2016

Cisco Application eXtension Platform (AXP) - James Weathersby, Cisco
Cisco Application eXtension Platform (AXP) - James Weathersby, CiscoCisco Application eXtension Platform (AXP) - James Weathersby, Cisco
Cisco Application eXtension Platform (AXP) - James Weathersby, Cisco
mfrancis
 

Similar to Lukáš Malý - Log management ELISA controlled by Zabbix | ZabConf2016 (20)

Elasticsearch features and ecosystem
Elasticsearch features and ecosystemElasticsearch features and ecosystem
Elasticsearch features and ecosystem
 
What's new in Elasticsearch v5
What's new in Elasticsearch v5What's new in Elasticsearch v5
What's new in Elasticsearch v5
 
Crypt tech technical-presales
Crypt tech technical-presalesCrypt tech technical-presales
Crypt tech technical-presales
 
CRYPTTECH PRODUCTS
CRYPTTECH PRODUCTSCRYPTTECH PRODUCTS
CRYPTTECH PRODUCTS
 
2015 03-16-elk at-bsides
2015 03-16-elk at-bsides2015 03-16-elk at-bsides
2015 03-16-elk at-bsides
 
Centralization of all log (application, docker, security, ...)
Centralization of all log (application, docker, security, ...)Centralization of all log (application, docker, security, ...)
Centralization of all log (application, docker, security, ...)
 
MUM Middle East 2016 - System Integration Analyst
MUM Middle East 2016 - System Integration AnalystMUM Middle East 2016 - System Integration Analyst
MUM Middle East 2016 - System Integration Analyst
 
Flink in Zalando's world of Microservices
Flink in Zalando's world of Microservices   Flink in Zalando's world of Microservices
Flink in Zalando's world of Microservices
 
Flink in Zalando's World of Microservices
Flink in Zalando's World of Microservices  Flink in Zalando's World of Microservices
Flink in Zalando's World of Microservices
 
SnapLogic- iPaaS (Elastic Integration Cloud and Data Integration)
SnapLogic- iPaaS (Elastic Integration Cloud and Data Integration) SnapLogic- iPaaS (Elastic Integration Cloud and Data Integration)
SnapLogic- iPaaS (Elastic Integration Cloud and Data Integration)
 
Introduction to Kong API Gateway
Introduction to Kong API GatewayIntroduction to Kong API Gateway
Introduction to Kong API Gateway
 
A Big Data Lake Based on Spark for BBVA Bank-(Oscar Mendez, STRATIO)
A Big Data Lake Based on Spark for BBVA Bank-(Oscar Mendez, STRATIO)A Big Data Lake Based on Spark for BBVA Bank-(Oscar Mendez, STRATIO)
A Big Data Lake Based on Spark for BBVA Bank-(Oscar Mendez, STRATIO)
 
What's New in LabVIEW 2017
What's New in LabVIEW 2017What's New in LabVIEW 2017
What's New in LabVIEW 2017
 
Cisco Application eXtension Platform (AXP) - James Weathersby, Cisco
Cisco Application eXtension Platform (AXP) - James Weathersby, CiscoCisco Application eXtension Platform (AXP) - James Weathersby, Cisco
Cisco Application eXtension Platform (AXP) - James Weathersby, Cisco
 
CoreOS and cloud provider integration: simple cloud-init example at Exoscale
CoreOS and cloud provider integration: simple cloud-init example at ExoscaleCoreOS and cloud provider integration: simple cloud-init example at Exoscale
CoreOS and cloud provider integration: simple cloud-init example at Exoscale
 
IBM BP Session - Multiple CLoud Paks and Cloud Paks Foundational Services.pptx
IBM BP Session - Multiple CLoud Paks and Cloud Paks Foundational Services.pptxIBM BP Session - Multiple CLoud Paks and Cloud Paks Foundational Services.pptx
IBM BP Session - Multiple CLoud Paks and Cloud Paks Foundational Services.pptx
 
Current & Future Use-Cases of OpenDaylight
Current & Future Use-Cases of OpenDaylightCurrent & Future Use-Cases of OpenDaylight
Current & Future Use-Cases of OpenDaylight
 
Vladimir_Ulogov_Resume
Vladimir_Ulogov_ResumeVladimir_Ulogov_Resume
Vladimir_Ulogov_Resume
 
Connector/J Beyond JDBC: the X DevAPI for Java and MySQL as a Document Store
Connector/J Beyond JDBC: the X DevAPI for Java and MySQL as a Document StoreConnector/J Beyond JDBC: the X DevAPI for Java and MySQL as a Document Store
Connector/J Beyond JDBC: the X DevAPI for Java and MySQL as a Document Store
 
Logging using ELK Stack for Microservices
Logging using ELK Stack for MicroservicesLogging using ELK Stack for Microservices
Logging using ELK Stack for Microservices
 

More from Zabbix

More from Zabbix (14)

Zabbix Conference LatAm 2016 - Andre Deo - Zabbix Brazil Community
Zabbix Conference LatAm 2016 - Andre Deo - Zabbix Brazil CommunityZabbix Conference LatAm 2016 - Andre Deo - Zabbix Brazil Community
Zabbix Conference LatAm 2016 - Andre Deo - Zabbix Brazil Community
 
Zabbix Conference LatAm 2016 - Andre Deo - SNMP and Zabbix
Zabbix Conference LatAm 2016 - Andre Deo - SNMP and ZabbixZabbix Conference LatAm 2016 - Andre Deo - SNMP and Zabbix
Zabbix Conference LatAm 2016 - Andre Deo - SNMP and Zabbix
 
Zabbix Conference LatAm 2016 - Marcio Prop - Monitoring Complex Environments ...
Zabbix Conference LatAm 2016 - Marcio Prop - Monitoring Complex Environments ...Zabbix Conference LatAm 2016 - Marcio Prop - Monitoring Complex Environments ...
Zabbix Conference LatAm 2016 - Marcio Prop - Monitoring Complex Environments ...
 
Zabbix Conference LatAm 2016 - Filipe Paternot - Zbx@Globo Automation+Integra...
Zabbix Conference LatAm 2016 - Filipe Paternot - Zbx@Globo Automation+Integra...Zabbix Conference LatAm 2016 - Filipe Paternot - Zbx@Globo Automation+Integra...
Zabbix Conference LatAm 2016 - Filipe Paternot - Zbx@Globo Automation+Integra...
 
Zabbix Conference LatAm 2016 - Douglas Esteves - Zabbix at UNICAMP
Zabbix Conference LatAm 2016 - Douglas Esteves - Zabbix at UNICAMPZabbix Conference LatAm 2016 - Douglas Esteves - Zabbix at UNICAMP
Zabbix Conference LatAm 2016 - Douglas Esteves - Zabbix at UNICAMP
 
Ryan Armstrong - Monitoring More Than 6000 Devices in Zabbix | ZabConf2016
Ryan Armstrong - Monitoring More Than 6000 Devices in Zabbix | ZabConf2016Ryan Armstrong - Monitoring More Than 6000 Devices in Zabbix | ZabConf2016
Ryan Armstrong - Monitoring More Than 6000 Devices in Zabbix | ZabConf2016
 
Rafael Martinez Guerrero - Zabbix at the University of Oslo | ZabConf2016
Rafael Martinez Guerrero - Zabbix at the University of Oslo | ZabConf2016Rafael Martinez Guerrero - Zabbix at the University of Oslo | ZabConf2016
Rafael Martinez Guerrero - Zabbix at the University of Oslo | ZabConf2016
 
Sumit Goel - Monitoring Cloud Applications Using Zabbix | ZabConf2016
Sumit Goel - Monitoring Cloud Applications Using Zabbix | ZabConf2016Sumit Goel - Monitoring Cloud Applications Using Zabbix | ZabConf2016
Sumit Goel - Monitoring Cloud Applications Using Zabbix | ZabConf2016
 
Erik Skytthe - Monitoring Mesos, Docker, Containers with Zabbix | ZabConf2016
Erik Skytthe - Monitoring Mesos, Docker, Containers with Zabbix | ZabConf2016Erik Skytthe - Monitoring Mesos, Docker, Containers with Zabbix | ZabConf2016
Erik Skytthe - Monitoring Mesos, Docker, Containers with Zabbix | ZabConf2016
 
Konstantin Yakovlev - Event Analysis Toolset | ZabConf2016
Konstantin Yakovlev - Event Analysis Toolset | ZabConf2016Konstantin Yakovlev - Event Analysis Toolset | ZabConf2016
Konstantin Yakovlev - Event Analysis Toolset | ZabConf2016
 
Ingus Vilnis - Benefits of Zabbix Training | ZabConf2016
Ingus Vilnis -  Benefits of Zabbix Training | ZabConf2016Ingus Vilnis -  Benefits of Zabbix Training | ZabConf2016
Ingus Vilnis - Benefits of Zabbix Training | ZabConf2016
 
Alexei Vladishev - Opening Speech | ZabConf2016
Alexei Vladishev - Opening Speech | ZabConf2016Alexei Vladishev - Opening Speech | ZabConf2016
Alexei Vladishev - Opening Speech | ZabConf2016
 
Alain Ganuchaud - Trouble Ticket Integration with Zabbix in Large Environment...
Alain Ganuchaud - Trouble Ticket Integration with Zabbix in Large Environment...Alain Ganuchaud - Trouble Ticket Integration with Zabbix in Large Environment...
Alain Ganuchaud - Trouble Ticket Integration with Zabbix in Large Environment...
 
Rihards Olups - Zabbix log management
Rihards Olups - Zabbix log managementRihards Olups - Zabbix log management
Rihards Olups - Zabbix log management
 

Recently uploaded

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 

Recently uploaded (20)

EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
Automating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps ScriptAutomating Google Workspace (GWS) & more with Apps Script
Automating Google Workspace (GWS) & more with Apps Script
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Real Time Object Detection Using Open CV
Real Time Object Detection Using Open CVReal Time Object Detection Using Open CV
Real Time Object Detection Using Open CV
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot ModelNavi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Navi Mumbai Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024FWD Group - Insurer Innovation Award 2024
FWD Group - Insurer Innovation Award 2024
 
A Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source MilvusA Beginners Guide to Building a RAG App Using Open Source Milvus
A Beginners Guide to Building a RAG App Using Open Source Milvus
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 

Lukáš Malý - Log management ELISA controlled by Zabbix | ZabConf2016

  • 1. Log management ELISA controlled by Zabbix Lukáš Malý
  • 2. Lukáš Malý IT consultant – security and monitoring I work as an IT consultant at Datasys. Datasys company is involved in the development and implementation of log management ELISA, which integrates several well-known Open Source projects. I participate in the implementation of Zabbix. A Little About Me: Hi, Every One! maly@datasys.cz www.datasys.cz www.logmanagement.cz @SmEjDiL – linkedin.com/in/smejdil
  • 3. 22 years of experience - comprehensive implementation and integration services in IT, telecommunications and customized development Czech private company Dynamism and innovation Strategic vision Real customers' needs Long-term cooperation Quality control ISO 9001 - Quality Management ISO / IEC 20000-1 - IT Service Management ISO 27001 – Information Security Management System ISO 14001 - Environmental Management ISO 10006 – Quality Management in Projects BS OHSAS 18001 – Occupational Health and Safety Management Systems NBÚ (National Security Authority)
  • 4. 4 DATASYS in figures Employees Turnover in 2015: CZK 750 million 85 Strategic areas 10 750 Over 50 projects implemented in the year 2015 50 4 branch offices 4
  • 5. 5 Company's areas of interest Security and monitoring Microsoft And Virtualization Storage and Backup Networking Application development Documents Innovation USM ServiceDesk /HelpDesk Infrastructure
  • 6. 6 Security and monitoring Risk analysis, we use a fully localised tool "verinice” Security-related documentation, compliance with regulations Cyber-security legislation Premium quality open source solutions Datasys ELISA and top program McAfee SIEM Video logs ObserveIT Solution for Log Management and SIEM Risk analysis, security-related documentation Ensuring compliance with the legal requirements for cyber-security References: Data boxes, Prague Castle Administration, Administration of State Material Reserves, Ministry of Foreign Affairs of the Czech Republic Expert services of security specialists Certified ZABBIX partner Robust, straightforward, easy-to-customize system Free license without functional restrictions Operation monitoring, SLA evaluation * SIEM – Security Information an Event Management
  • 7. 7 Security and monitoring - references Czech Statistical Office Česká pošta (Czech Post) Český aeroholding (Czech Aeroholding) ČEZ (energy/utility operator and provider) Data box information system (Ministry of the Interior of the Czech Republic) Ministry of Foreign Affairs of the Czech Republic Administration of State Material Reserves Monitoring system ZABBIX Artesa, saving and loan cooperative Česká pošta (Czech Post) Ministry of Regional Development Ministry of Foreign Affairs of the Czech Republic Log management and SIEM
  • 8. 8 ELISA is log management and security monitoring tool ELISA is logmanagement Event Log Interception Storage and Analysis Free software with support from the producer Preserves the structure of the original event uses several components Extreme scalability and high availability attractive web user interface Kibana High performance ( up to 5 000 eps )
  • 9. 9 The main input channels of the ELISA Input protocols binary ... (agents) protocol for transmission of structured events syslog (TCP, UDP or TLS/SSL) SNMP traps Microsoft Windows Eventing Netflow datagrams
  • 10. 10 Enhanced Kibana as a frontend for data analysis Kibana is used for viewing log data
  • 11. 11 Kibana is a very flexible interface Dashboard can be modified and stored
  • 12. 12 Extended ZABBIX frontend for administration Zabbix 'NXlog templates' for central management of agents
  • 13. 13 ELISA Open Source component Used projects Elasticsearch, Logstash, Kibana Open source product of the 'Elastic' company. NXLog (Community or Enterprice edition) In concept NXLog is similar to syslog-ng or rsyslog but it is not limited to unix and syslog only. It supports different platforms, log sources and formats so nxlog can be an ideal choice to implement a centralized logging system. Zabbix, Xlog, HTTPd Apache with mod_authnz_external. Zabbix serves several major functions in ELISA. Datasys component Xlog uses Zabbix API. JasperReport Server with plugin ElasticJasper, Snmptrapd ELISA provides various opportunities to report information about stored events
  • 14. 14 Zabbix integration with ELISA ELISA combines many features ELISA utilizes ZABBIX features User authentication (internal or LDAP) Role based access control (flexible log data access restrictions, RW or RO access to dashboards) Notifications Self-monitoring – ELK, NXlog ELISA utilizes Elasticsearch features Robustness Scalability Dashboards – Kibana Logstash – GeoIP, Netflow
  • 15. 15 Zabbix integration with ELISA ELISA roles features ELISA heavily utilizes ZABBIX for user authentication and role based access control.
  • 16. 16 Zabbix integration with ELISA ELISA roles features ELISA heavily utilizes ZABBIX for user authentication and role based access control.
  • 17. 17 Zabbix integration with ELISA ELISA roles features ELISA heavily utilizes ZABBIX for user authentication and role based access control.
  • 18. 18 Zabbix integration with ELISA ELISA roles features ELISA heavily utilizes ZABBIX for user authentication and role based access control.
  • 19. 19 Zabbix integration with ELISA Use of Zabbix features ELISA heavily utilizes ZABBIX for user authentication and role based access control, notifications and self-monitoring. Elasticsearch indices are managed right in ZABBIX Frontend.
  • 20. 20 Zabbix integration with ELISA DB Indices features Elasticsearch indices are managed right in ZABBIX Frontend.
  • 21. 21 Zabbix integration with ELISA DB Indices features Elasticsearch indices are managed right in ZABBIX Frontend.
  • 22. 22 Zabbix integration with ELISA Use of Zabbix features ELISA heavily utilizes ZABBIX for user authentication and role based access control, notifications and self-monitoring. Elasticsearch indices are managed right in ZABBIX Frontend. ZABBIX "trapper" items and monitoring templates are used to centrally manage configuration of distributed environment of NXlog agents.
  • 23. 23 Zabbix integration with ELISA ELISA configuration by Zabbix Templates-Xlog ZABBIX "trapper" items and monitoring templates are used to centrally manage configuration of distributed environment of NXlog agents. Template-DS-Xlog_Base_LINUX_LAN for Nxlog agent
  • 24. 24 Zabbix integration with ELISA NXlog configuration in Templates-Xlog ZABBIX "trapper" items - The field 'Description' contains NXlog configuration directives. xlog.config[AGENT,Input,InBinarySyslog,170,Rules-UniFi]
  • 25. 25 Zabbix integration with ELISA NXlog configuration ZABBIX "trapper" items - The field 'Description' contains NXlog configuration directives. NXlog basic modules • im_tcp - This module accepts TCP connections on the address and port specified in the configuration. It can handle multiple simultaneous connections. The TCP transfer protocol provides more reliable log transmission than UDP. If security is a concern, consider using the im_ssl module instead. • im_udp - This module accepts UDP datagrams on the address and port specified in the configuration. UDP is the transport protocol of the old BSD syslog standard as described in RFC 3164 • im_file - This module can be used to read log messages from files. • om_file - This module can be used to write log messages to a file. • xm_csv - This module provides functions and procedures to process data formatted as comma separated values (CSV) and allows to convert to CSV and parse CSV into fields. http://nxlog-ce.sourceforge.net/nxlog-docs/en/nxlog-reference-manual.pdf
  • 26. 26 Zabbix integration with ELISA Use of Zabbix features ELISA heavily utilizes ZABBIX for user authentication and role based access control, notifications and self-monitoring. Elasticsearch indices are managed right in ZABBIX Frontend. ZABBIX "trapper" items and monitoring templates are used to centrally manage configuration of distributed environment of NXlog agents. NXlog Agents are capable to securely auto-register as ZABBIX "hosts".
  • 27. 27 Zabbix integration with ELISA Host configuration NXlog Agents are capable to securely auto-register as ZABBIX "hosts". curl -k "https://elisa:10443/xlog/getRuleset.php?&hostname=elisa&label=AGENT&auth=DEFAULT&platform=LINUX_LAN"
  • 28. 28 ELISA Virtual Appliance General Availability in November 2016
  • 29. Thank you for your attention