Splunk, a smorgasboard for developing big data solutions
•Download as PPTX, PDF•
1 like•917 views
My oredev talk on the Splunk developer platform
Recommended
Recommended
More Related Content
Similar to Splunk, a smorgasboard for developing big data solutions
Similar to Splunk, a smorgasboard for developing big data solutions (20)
More from Glenn Block
More from Glenn Block (16)
Recently uploaded
Recently uploaded (20)
Splunk, a smorgasboard for developing big data solutions
- 1. A smörgåsbord for developing BIG DATA solutions Glenn Block 1 CC Image Smograbord! by Charles Roffey Flickr
- 2. “I should be tweeting" My Background and Role https://github.com/glennblock https://twitter.com/gblock
- 3. Oreilly - DEWANET 3
- 4. What is Splunk? Any Machine Data Search and Investigation HA Indexes and Storage Proactive Monitoring Operational Visibility Real-time Business Insights Commodity Servers Online Services Web Services Servers Security GPS Location Storage Desktops Networks Packaged Applications Custom Messaging Applications Telecoms Online Shopping Cart Web Clickstreams Databases Energy Meters Call Detail Records Smartphones and Devices RFID
- 5. THE SPLUNK DEVELOPER PLATFORM Build Splunk Apps Extend and Integrate Splunk REST API 5 Simple XML HTML5 JavaScript Web Framework Java JavaScript Python Ruby C# PHP Data Models Search Extensibility Modular Inputs SDKs
- 6. Searching against Splunk Data 6
- 7. .NET is not the same platform you remember CC image Dorothy… not in Kansas by Alex Beattie Flickr 7
- 8. IOS, Android, Linux and Mac via Xamarin 8 Screenshot from Xamarin.com
- 9. Sending data to Splunk 9
- 11. Splunk and Hadoop 11 CC Image Elephant by guido da rozze Flickr
- 12. Where to go for More Info • Tutorials, Code Samples, Getting Started, Downloads – http://dev.splunk.com/ • Support – https://www.splunk.com/page/submit_issue • GitHub – https://github.com/splunk/ • Twitter – https://twitter.com/splunkdev or follow me: https://twitter.com/gblock • Blog – http://blogs.splunk.com/dev/ 12
- 13. THANK YOU
Editor's Notes
- Splunk is the leading platform for machine data analytics with over 5,200 organizations using Splunk (as of 7/1/13) – from tens of GB to many tens of TBs of data PER DAY. Splunk software is optimized for real-time, low latency and interactivity. Splunk software reliably collects and indexes all the streaming data from IT systems and technology devices in real-time - tens of thousands of sources in unpredictable formats and types. The value from Splunking machine data is described as Operational Intelligence. This enables organizations to: 1. Find and fix problems dramatically faster 2. Automatically monitor to identify issues, problems and attacks 3. Gain end-to-end visibility to track and deliver on IT KPIs and make better-informed IT decisions 4. Gain real-time insight from operational data to make better-informed business decisions
- Splunk Enterprise is a robust, fully-integrated platform that enables developers to INTEGRATE data and functionality from Splunk software into applications across the organization using Software Development Kits (SDKs) for Java, JavaScript, C#, Python, PHP and Ruby. These SDKs make it easier to code to the open REST API that sits on top of the Splunk Engine. With almost 200 endpoints, the REST API lets developers do programmatically what any end user can do in the UI and more. The Splunk SDKs include documentation, code samples, resources and tools to make it faster and more efficient to program against the Splunk REST API using constructs and syntax familiar to developers experienced with Java, Python, JavaScript, PHP, Ruby and C#. Developers can easily manage HTTP access, authentication and namespaces in just a few lines of code. Developers can use the Splunk SDKs to: - Run real-time searches and retrieve Splunk data from line-of-business systems like Customer Service applications - Integrate data and visualizations (charts, tables) from Splunk into BI tools and reporting dashboards - Build mobile applications with real-time KPI dashboards and alerts powered by Splunk - Log directly to Splunk from remote devices and applications via TCP, UDP and HTTP - Build customer-facing dashboards in your applications powered by user-specific data in Splunk - Manage a Splunk instance, including adding and removing users as well as creating data inputs from an application outside of Splunk - Programmatically extract data from Splunk for long-term data warehousing Developers can EXTEND the power of Splunk software with programmatic control over search commands, data sources and data enrichment. Splunk Enterprise offers search extensibility through: - Custom Search Commands - developers can add a custom search script (in Python) to Splunk to create own search commands. To build a search that runs recursively, developers need to make calls directly to the REST API - Scripted Lookups: developers can programmatically script lookups via Python. - Scripted Alerts: can trigger a shell script or batch file (we provide guidance for Python and PERL). - Search Macros: make chunks of a search reuseable in multiple places, including saved and ad hoc searches. Splunk also provides developers with other mechanisms to extend the power of the platform. - Data Models: allow developers to abstract away the search language syntax, making Splunk queries (and thus, functionality) more manageable and portable/shareable. - Modular Inputs: allow developers to extend Splunk to programmatically manage custom data input functionality via REST.