Have you ever wondered what technology stack does professional cloud SaaS companies use for log management and analysis?
In this session, we cover a logging stack that can be considered for professional SaaS deployments. We compare log management tools for applications deployed in Cloud. We will dive deep into one such tool called SumoLogic.
2. ยฉ 2014 Progress Software Corporation. All rights reserved.2
Agenda
๏ง Why do we need logging?
๏ง Centralized Logging
๏ง What to look for while choosing Logging
Tools?
๏ง Best Practices
๏ง Tools Comparison
๏ง Analytics and Performance Management
๏ง Saas Logger demo
3. ยฉ 2014 Progress Software Corporation. All rights reserved.3
Need for Logging
๏ง Production Monitoring
๏ง Production troubleshooting
๏ง Debugging
๏ง Analytics
๏ง Security Auditing and Compliance
๏ง Application Performance Management
๏ง Alerts
4. ยฉ 2014 Progress Software Corporation. All rights reserved.4
Traditional Logging
5. ยฉ 2014 Progress Software Corporation. All rights reserved.5
Log Aggregator
6. ยฉ 2014 Progress Software Corporation. All rights reserved.6
OpenSource Stack
7. ยฉ 2014 Progress Software Corporation. All rights reserved.7
Saas Tools
8. ยฉ 2014 Progress Software Corporation. All rights reserved.8
Best Practices
๏ง Use UUID - Stored in threadLocal (MDC if using slf4j )
๏ง AspectJ for logging
๏ง Obfuscate sensitive information and PII in logs (logentries
datahug, Logstash filters)
๏ง Capture console logs
๏ง Log user identity wherever possible
9. ยฉ 2014 Progress Software Corporation. All rights reserved.9
What to look for while choosing Logging Tools?
๏ง Website Integrity โ
๏ง Whitelist options
๏ง User roles and permissions
๏ง Option to filter data before shipping
๏ง Where is the data residing
๏ง Is your data encrypted on the wire?
๏ง Is the Provider SOC2 compliant?
๏ง Is Data encrypted on Providers Disk?
10. ยฉ 2014 Progress Software Corporation. All rights reserved.10
Tools Comparison
๏ง Splunk
โข Pros: Feature rich, Market Leader, Excelent Search and charting
tools
โข Cons: Onpremise, Expensive
๏ง SumoLogic
โข Pros: Feature rich, alerts
โข Cons: As a developer, if youโre logging sensitive or PII you need to
make sure itโs redacted, Tiem Lag, Upload overhead
๏ง PapperTrails
โข Pros: Affordable
โข Cons: too basic
๏ง LogStash
โข Pros: Opensource
โข Cons: Itโs a stack of three products
11. ยฉ 2014 Progress Software Corporation. All rights reserved.11
Log Management Landscape
12. ยฉ 2014 Progress Software Corporation. All rights reserved.12
Analytics - Logins
13. ยฉ 2014 Progress Software Corporation. All rights reserved.13
Geo Analytics
๏ง _sourceCategory=*demo*tomcat*access | parse regex "(?<remote_ip>d{1,3}.d{1,3}.d{1,3}.d{1,3})" | lookup latitude, longitude,
country_code, country_name, region, city, postal_code, area_code, metro_code from geo://default on ip = remote_ip | count by latitude,
longitude, country_code, country_name, region, city, postal_code, area_code, metro_code | sort _count
14. ยฉ 2014 Progress Software Corporation. All rights reserved.14
Response time
15. ยฉ 2014 Progress Software Corporation. All rights reserved.15
APM