Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.

Neo4j GraphTalks Zurich - Taming the Complexity of Network & IT Ops

Stefan Kolmar, Neo4j
Neo4j GraphTalks Zürich

  • Login to see the comments

  • Be the first to like this

Neo4j GraphTalks Zurich - Taming the Complexity of Network & IT Ops

  1. 1. Taming the Complexity of Network & IT Ops Improving Network Operations With Neo4j & Graphs Stefan Kolmar" Vice President Field Engineering
  2. 2. Agenda •  Networks are Graphs! •  Network & IT-Operations with Graphs ! •  Network Upgrade and Helpdesk Scenarios! •  Why Neo4j! •  References and Resources! •  Q&A!
  3. 3. Networks are Graphs
  4. 4. network topology
  5. 5. Mesh Router Gatew ay Router Router Router Mesh Router Router Router Mesh Router Gatew ay Access Point CPU CPU CPU CPU Mobile Mobile Mobile Mobile Base Station CPU CPU CPU CPU Access Point
  6. 6. Relational Database
  7. 7. This is data modelled as graph! Graph Database
  8. 8. Network & IT-Operations with Graphs
  9. 9. Typical IT organization
  10. 10. Sys Admins Servers, on-premise virtual machines, cloud virtual machines, etc. Network Admins Switches, Routers, Egress Points App Admins I.e. Salesforce, Marketo, SAP, Oracle Apps, Tableau, SharePoint, DBA’s etc. Internal Users HR, Sales, Marketing, Data Analysts, E-staff etc. Numerous Customers & Partners
  11. 11. Router Servers Servers Apps FirewallCloud Switch Apps Network Admins Switches, Routers, Egress Points Sys Admins Servers, on-premise virtual machines, cloud virtual machines, etc. App Admins I.e. Salesforce, Marketo, SAP, Oracle Apps, Tableau, SharePoint, DBA’s etc. Internal Users HR, Sales, Marketing, Data Analysts, E-staff etc.
  12. 12. Router Servers Servers Apps FirewallCloud Switch Apps Network Admins Switches, Routers, Egress Points Sys Admins Servers, on-premise virtual machines, cloud virtual machines, etc. App Admins I.e. Salesforce, Marketo, SAP, Oracle Apps, Tableau, SharePoint, DBA’s etc. Internal Users HR, Sales, Marketing, Data Analysts, E-staff etc.
  13. 13. Router Servers Servers Apps FirewallCloud Switch Apps Network Admins Switches, Routers, Egress Points Sys Admins Servers, on-premise virtual machines, cloud virtual machines, etc. App Admins I.e. Salesforce, Marketo, SAP, Oracle Apps, Tableau, SharePoint, DBA’s etc. Internal Users HR, Sales, Marketing, Data Analysts, E-staff etc.
  14. 14. Router Servers Servers Apps FirewallCloud Switch Apps Network Admins Switches, Routers, Egress Points Sys Admins Servers, on-premise virtual machines, cloud virtual machines, etc. App Admins I.e. Salesforce, Marketo, SAP, Oracle Apps, Tableau, SharePoint, DBA’s etc. Internal Users HR, Sales, Marketing, Data Analysts, E-staff etc.
  15. 15. Router Servers Servers Apps FirewallCloud Switch Apps Network Admins Switches, Routers, Egress Points Sys Admins Servers, on-premise virtual machines, cloud virtual machines, etc. App Admins I.e. Salesforce, Marketo, SAP, Oracle Apps, Tableau, SharePoint, DBA’s etc. Internal Users HR, Sales, Marketing, Data Analysts, E-staff etc.
  16. 16. Network & IT operations Proactive! Reactive!
  17. 17. Proactive Scenario:! Dependency Analysis
  18. 18. Best, John Lewis Network Administrator Email #newyork #london #funstuff #graphicdesign #product_team #marketing #staff_info #IT_maintenance Slack Premise: We are the Network admins at the company ACME and we’re planning on doing maintenance on a switch on a Friday afternoon. Network Admins Sys Admins Notify! Hi, maintenance scheduled for Switch IP 10.2.5 on Rack 5 on Friday, May 28 @ 3-4pm. @channel Hi, maintenance scheduled for Switch IP 10.2.5 on Rack 5 on Friday, May 28 @ 3-4pm.
  19. 19. Premise: We are the Network admins at the company ACME and we’re planning on doing maintenance on a switch on a Friday afternoon. Sys Admins (Servers & Other Hardware)! Network Admins (In Charge of Switch)! The Telephone Game
  20. 20. Premise: We are the Network admins at the company ACME and we’re planning on doing maintenance on a switch on a Friday afternoon. Network Admins Sys Admins App Admins 10+ (Marketo, SalesForce, Publishing Tools etc.)! (Servers & Other Hardware)! (In Charge of Switch)! The Telephone Game
  21. 21. Premise: We are the Network admins at the company ACME and we’re planning on doing maintenance on a switch on a Friday afternoon. Network Admins Sys Admins App Admins Internal Users 10+ (Marketo, SalesForce, Publishing Tools etc.)! (Employees in Sales, Marketing, Legal, HR, etc)! (Servers & Other Hardware)! (In Charge of Switch)! 500+ The Telephone Game
  22. 22. Network Admins Sys Admins App Admins Customers Internal Users 10+ (Marketo, SalesForce, Publishing Tools etc.)! (Employees in Sales, Marketing, Legal, HR, etc)! (Servers & Other Hardware)! (In Charge of Switch)! 500+ 10’000+ The Telephone Game Premise: We are the Network admins at the company ACME and we’re planning on doing maintenance on a switch on a Friday afternoon.
  23. 23. Dependency Analysis Demo
  24. 24. Reactive Scenario:! Root Cause Analysis
  25. 25. Helpdesk Customers App Admins Internal Users Sys Admins Network Admins Organization Hierarchy
  26. 26. Premise: It’s 5 pm on a Friday in the summer. Most staff have left for the day, but the Helpdesk remain on call. The staff starts receiving numerous complaints.
  27. 27. Premise: It’s 5 pm on a Friday in the summer. Most staff have left for the day, but the Helpdesk remain on call. The staff starts receiving numerous complaints. CRM system Oracle Financials Tableau
  28. 28. Premise: App Admins 6-6.45pm Starts investigating 8pm Oracle App Admin On-call Sys Admin Slow fiber connection to the SAN detected 5pm Complaints begin Helpdesk Network Admin 9pm Issue is a bad fiber connector 10pm System operational Helpdesk It’s 5 pm on a Friday in the summer. Most staff have left for the day, but the Helpdesk remain on call. The staff starts receiving numerous complaints.
  29. 29. Premise: Impact: •  Outage lasted 5 hours •  3 helpdesk staff involved •  3 on-call app admins •  3 on-call sysadmins •  2 on-call network admins return to the office •  Total people time until resolution: 55 hours It’s 5 pm on a Friday in the summer. Most staff have left for the day, but the Helpdesk remain on call. The staff starts receiving numerous complaints.
  30. 30. Helpdesk Root Cause Demo
  31. 31. Premise: Impact after switching to graph: •  Outage lasts 45 min •  3 helpdesk staff involved •  2 on-call network admins are involved •  Total people time until resolution: 3.75 hours It’s 5 pm on a Friday in the summer. Most staff have left for the day, but the Helpdesk remain on call. The staff starts receiving numerous complaints.
  32. 32. Exploring the Graph
  33. 33. Data Model!
  34. 34. Who’s using Neo4j?
  35. 35. Government Commercial clients Who’s Using Neo4j? Institutions Local Governments Law Enforcement Military & Intelligence
  36. 36. ! Background •  World’s largest provider of IT infrastructure, software and services •  Unified Correlation Analyzer (UCA) helps comms operators manage large networks ! with carrier-class resource and service management, root cause and impact analysis Business Problem •  Use network topology to identify root problems causes on the network •  Simplify and speed alarm handling by operators •  Automate handling of certain types of alarms •  Filter/group/eliminate redundant alarms via event correlation Solution and Benefits •  Accelerated product development time •  Extremely fast network-topology queries •  Graph representation a perfect domain fit •  24x7 carrier-grade reliability with Neo4j High Availability clustering •  Met objective in under six months Hewlett Packard WEB/ISV COMMUNICATIONS! Network and IT Operations !37!
  37. 37. !Internet of Things! Business Problem •  Support complex operational infrastructure collects, records and manages weather data across a wide network •  Integrate with Splunk system that monitors remote instruments •  Use graphs to query instrument network Solution and Benefits •  Neo4j analyzes dependency graphs to produce exception reports •  Neo4j and SPLUNK integrated tightly •  Solution has enabled KNMI to re-architect and rebuild their entire operational infrastructure Background •  The Royal Netherlands Meteorological Institute (KNMI) •  Dutch national service with 1100+ weather measurement locations •  Monitors and forecasts weather, climate, air quality and seismic activity Royal Netherlands Meteorological Institute SCIENCES! 38!
  38. 38. ! Background! •  Leaders in model-driven engineering! •  Founded in 2004 in France! •  Source code cartography software used at over 100 sites! Business Problem! •  Reaching the limits of legacy OODB technology! •  Find new data platform well suited for storing software dependency graph! •  Perform rapid,efficient dependency mapping and impact analysis across Java, .NET, Flex, HTML, COBOL, DB2, Oracle and more! Solution and Benefits! •  Moved to modern graph platform with more readily- available skills and expertise! •  Strong domain fit has accelerated development! •  Enabled new impact analysis features not possible in the previous technology! Sodifrance SOFTWARE! Impact Analysis!39!
  39. 39. ! Background! •  One of the world’s oldest and largest banks! •  100+ year-old bank with more than 1000 predecessor institutions! •  500,000 employees and contractors! •  Needed to manage and visualize ~50,000 Unix servers in its network! Business Problem! •  Original RDBMS solution could handle only 5,000 servers! •  Improve net performance company-wide! •  Leverage M&A legacy systems with no room ! for error! Solution and Benefits! •  Store UNIX server and network config in Neo4j! •  Combine Splunk log data into an application ! that visualizes events on the network! •  Neo4j vastly improved app performance! •  New apps built much faster with Neo4j than SQL! Large Investment Bank FINANCIAL SERVICES! Network and IT Operations!40!
  40. 40. Neo4j Adoption by Selected Verticals SOFTWARE FINANCIAL SERVICES RETAIL MEDIA & OTHER SOCIAL NETWORKS TELECOM HEALTHCAR E
  41. 41. Thank you!

×