GraphConnect Europe 2016 Neo Technology

1. NoSQL Polyglot Persistence
Neo4j Tools and Integrations
William Lyon
@lyonwj

2. William Lyon
Developer Relations @neo4j
will@neo4j.com
@lyonwj
lyonwj.com

3. Does Neo4j work with ______ ?
Languages, frameworks, databases…

4. Does Neo4j work with ______ ?
Languages

5. Does Neo4j work with ______ ?
Frameworks

6. Does Neo4j work with ______ ?
Databases

7. Does Neo4j work with ______ ?
Deployment

8. Does Neo4j work with ______ ?
Frameworks

9. Does Neo4j work with ______ ?
Languages, frameworks, databases…

10. Polyglot Persistence

11. Data Storage and
Business Rules Execu5on
Data Mining
and Aggrega5on
Applica'on
Graph Database Cluster
Neo4j Neo4j Neo4j
Ad Hoc
Analysis
Bulk Analy'c
Infrastructure
Hadoop, EDW …
Data
Scien'st
End User
Databases
Rela5onal
NoSQL
Hadoop

12. Polyglot Persistence
• Different types of data in different ways
• Take advantage of strengths of different databases
http://martinfowler.com/bliki/PolyglotPersistence.html

13. Polyglot Persistence
Functionality Database type
Shopping Cart Rapid session
reads / writes
Key-value store
Orders / Product
Catalog
Frequent reads Document
Customer social
graph
Recommendation Graph
http://www.jamesserra.com/archive/2015/07/what-is-polyglot-persistence/

14. Added Complexity

15. Challenge #1: Data Sync

16. MIGRATE
ALL DATA
MIGRATE
SUBSET
DUPLICATE
SUBSET
Non-Graph Queries Graph Queries
Graph Queries Non-Graph Queries
All Queries
Rela3onal
Database
Graph
Database
Application
Application
Application
Non Graph
Data
All Data
?

19. Course Catalog
Browse & Search
• Good use-case for a document
database

23. ?

24. Tool #1: Neo4j Doc Manager
• Automatically sync documents from MongoDB to Neo4j
• Convert BSON documents into graph model
• Initial version available
• Feedback welcome!
http://neo4j.com/developer/mongodb/

25. Neo4j Doc Manager
Automatically sync documents from MongoDB to Neo4j

26. Document to property graph
{
"session": {
"title": "12 Years of Spring: An Open Source
Journey",
"abstract": "Spring emerged as a core open source
project in early 2003 and evolved to a broad portfolio of
open source projects up until 2015."
},
"topics": [
"keynote",
"spring"
],
"room": "Auditorium",
"timeslot": "Wed 29th, 09:30-10:30",
"speaker": {
"name": "Juergen Hoeller",
"bio": "Juergen Hoeller is co-founder of the Spring
Framework open source project.",
"twitter": "https://twitter.com/springjuergen",
"picture": "http://www.springio.net/wp-content/
uploads/2014/11/juergen_hoeller-220x220.jpeg"
}
}

27. {
"session": {
"title": "12 Years of Spring: An Open Source
Journey",
"abstract": "Spring emerged as a core open source
project in early 2003 and evolved to a broad portfolio
of open source projects up until 2015."
},
"topics": [
"keynote",
"spring"
],
"room": "Auditorium",
"timeslot": "Wed 29th, 09:30-10:30",
"speaker": {
"name": "Juergen Hoeller",
"bio": "Juergen Hoeller is co-founder of the Spring
Framework open source project.",
"twitter": "https://twitter.com/springjuergen",
"picture": "http://www.springio.net/wp-content/
uploads/2014/11/juergen_hoeller-220x220.jpeg"
}
}
Document to property graph

28. https://github.com/neo4j-contrib/neo4j_doc_manager

29. Neo4j + MongoDB Webinar
http://neo4j.com/webinars/
Building a polyglot application with Neo4j and MongoDB

30. http://neo4j.com/blog/couchbase-jdbc-integrations-neo4j-3-0/
Couchbase + Neo4j integration

31. Challenge #2: Operations

32. http://neo4j.com/developer/docker/

33. https://hub.docker.com/_/neo4j/
docker pull neo4j
Tool #2: Official Neo4j Docker Image

34. https://www.docker.com/products/docker-compose

35. docker-compose.yml

37. Challenge #3: Data Models

39. Tool #3: Neo4j Cassandra Data Import Tool
http://neo4j.com/developer/cassandra/
• Python command line app
• Uses Python Neo4j and Cassandra drivers

40. Neo4j Cassandra Data Import Tool
Cassandra schema metadata
python connector.py parse -k playlist

41. Tables become nodes
Artist
Track
Column family to property graph

42. What’s that?
Neo4j Cassandra Data Import Tool
User defined data model mappings

43. Neo4j Cassandra Data Import Tool
{p}, node property
{r}, relationship
{u}, unique constraint field
{i}, create index
User defined data model mappings

44. Neo4j Cassandra Data Import Tool
User defined data model mappings

45. Neo4j Cassandra Data Import Tool
Generates LOAD CSV Cypher
python connector.py export -k playlist -t track_by_id,artists_by_first_letter

46. Neo4j 3.0

47. Neo4j 3.0
Bolt Stored ProceduresDrivers

48. Neo4j 3.0 Stored procedures
User-defined procedures are written in Java,
deployed into the database, and called from Cypher.
http://neo4j.com/docs/java-reference/current/#procedures

50. https://github.com/neo4j-contrib/neo4j-apoc-procedures

52. https://github.com/neo4j-contrib/neo4j-apoc-procedures/blob/master/readme.adoc

53. Northwind

54. Northwind

63. Bolt and Neo4j 3.0 Drivers
Binary protocol for Neo4j
http://neo4j.com/docs/developer-manual/current/#driver

64. https://github.com/jexp/neo4j-spark-connector
Neo4j Spark Connector
Using Neo4j 3.0 Java Driver with Bolt

65. https://github.com/johnymontana/neovis.js
neovis.js
Embeddable graph visualization powered by Neo4j 3.0 Bolt Javascript driver

66. Resources
http://neo4j.com/developer/
Neo4j Developer Resources

67. Questions?
@lyonwj
will@neo4j.com