SlideShare a Scribd company logo
1 of 27
Natural Language
Search
...using Neo4j
We’ll be covering...
What is natural language search?
What do brains and graphs have in common?
How do you model time as a graph?
How do you model time-based events on a graph?
How do you anticipate natural language queries and
map those to results?
How do you transform answers into questions?
What is Natural
Language Search?
Natural language search is like querying a
database using your own natural language.
In a way, it is kind of like programming a
person with words (Teaching, Evangelism,
Sales Pitches, Planning, etc.)
Progress
What is natural language search?
What do brains and graphs have in common?
How do you model time as a graph?
How do you model time-based events on a graph?
How do you anticipate natural language queries and
map those to results?
How do you transform answers into questions?
What do brains and
graphs have in common?
Networks condense a lot of information into
small points.
These small points help us understand or
interpret a lot of information by exploring the
world from many different small points.
Graphs, like brains, help us explore a lot of
information from relative points.
But what is a network?
A network is a representation or model of the
interconnectedness of information.
A graph is the de facto mathematical
component that defines the level of
interconnectivity in a network.
A graph database merges these two concepts
into a persistent storage medium.

Networks (Information) + Graph (Mathematics) = Neo4j
Graph of people meeting people

Anne met Pam
Pam met Sally
Sally met Anne
John met Sally
Path Finding = Searching
The key component when using a graph
database is traversals.
Traversals model the pathways in a network
by enumerating over all possibilities.
Possibilities that meet a criteria are returned
by a query.
(Neo4j’s Cypher Query Language)
Progress
What is natural language search?
What do brains and graphs have in common?
How do you model time as a graph?
How do you model time-based events on a graph?
How do you anticipate natural language queries and
map those to results?
How do you transform answers into questions?
Time based traversals
Time is a hierarchical method of categorizing
the linearity of global events.
Hours, minutes, seconds...
“Neo4j Meetup is at 6:00 PM on October 29th”
Time Scale Event Meta Model

Modeling events over time is easy in Neo4j
Let’s go over the GraphGist for the Time Scale
Event Meta Model
http://gist.neo4j.org/?github-kbastani%2Fgists%2F%2Fmeta%2FTimeScaleEventMetaModel.adoc
ac
Progress
What is natural language search?
What do brains and graphs have in common?
How do you model time as a graph?
How do you model time-based events on a
graph?
How do you anticipate natural language queries and
map those to results?
How do you transform answers into questions?
Progress
What is natural language search?
What do brains and graphs have in common?
How do you model time as a graph?
How do you model time-based events on a graph?
How do you anticipate natural language
queries and map those to results?
How do you transform answers into questions?
Neo4j allows you to store information as a
series of paths, and that is really valuable for
giving a user options when it comes to search.
It starts with something I call
“Search Cache”
Search Cache
A search cache is a repository of all relevant paths condensed into
a hierarchical data store.
A hierarchical data store is like folder paths that model a storage
collection into a linear path. (Dimensionality Reduction)
An address is a hierarchy, revealing a path.
ex. http://www.neo4j.com/download
ex. > rootneo4j-communitybinneo4j.sh
Natural language path:
> what is the matrix?
Type Ahead / Autocomplete
For search it comes down to enumerating over
all possibilities and then mapping those paths
to an action.
http://kbastani.github.io/predictive-autocomplete
Never do real time processing for natural
language search (It is a hard problem -which means it will take time*)
Distributed Caching Frameworks
Take a distributed approach to building out
your search cache.
Use Neo4j to model your network and then
enumerate over all possibilities as a query and
add each possibility to a search cache.
Distribute the load to a network of compute
instances like MapReduce.
In C# at
http://kbastani.github.io/predictive-autocomplete
How do I build a search cache?
The best way to do this is using blob storage.
I use Windows Azure, but you can use any
data storage as long as it maps to a JSON
file via HTTP GET request.
ex. HTTP GET
../natural/language/search/is/cool

.. Working on open source project using C#
Progress
What is natural language search?
What do brains and graphs have in common?
How do you model time as a graph?
How do you model time-based events on a graph?
How do you anticipate natural language queries and
map those to results?
How do you transform answers into
questions?
How to transform answers into
questions?
You have a bunch of answers already in natural
language.
Each language has a specific template that allows you
to transform an answer into a question.
“X is Y” -> “What is X?”
Is X a Person? Then “Who is X?”
Add “What is X?” to the search cache.
Example: http://www.arktera.com/
Questions?

MATCH questions-[:without]->answers
RETURN *
0 Results Found
Neo4j Events
http://www.graphconnect.com
New York: November 5-6
London: November 18-19
http://www.graphconnect.com/videos
Watch the videos! Very valuable insights
from our community
Neo4j Trainings

Interested in Neo4j training?
Talk to me after!
Thanks!
Follow me on Twitter!
@kennybastani
Connect with me on LinkedIn
/in/kennybastani

More Related Content

Similar to Natural Language Search with Neo4j - Kenny Bastani @ GraphConnect NY 2013

Text-mining and Automation
Text-mining and AutomationText-mining and Automation
Text-mining and Automationbenosteen
 
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (pdf)
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (pdf)Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (pdf)
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (pdf)PiLNAfrica
 
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (pdf)
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (pdf)Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (pdf)
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (pdf)Saide OER Africa
 
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (w...
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (w...Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (w...
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (w...PiLNAfrica
 
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (w...
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (w...Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (w...
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (w...Saide OER Africa
 
Hacking and mash-ups for beginners at MCN2011
Hacking and mash-ups for beginners at MCN2011Hacking and mash-ups for beginners at MCN2011
Hacking and mash-ups for beginners at MCN2011Mia
 
Genomics data insights
Genomics data insightsGenomics data insights
Genomics data insightsVishwas N
 
Applications of Large Language Models in Materials Discovery and Design
Applications of Large Language Models in Materials Discovery and DesignApplications of Large Language Models in Materials Discovery and Design
Applications of Large Language Models in Materials Discovery and DesignAnubhav Jain
 
ExperTwin: An Alter Ego in Cyberspace for Knowledge Workers
ExperTwin: An Alter Ego in Cyberspace for Knowledge WorkersExperTwin: An Alter Ego in Cyberspace for Knowledge Workers
ExperTwin: An Alter Ego in Cyberspace for Knowledge WorkersCarlos Toxtli
 
Week1- Introduction.pptx
Week1- Introduction.pptxWeek1- Introduction.pptx
Week1- Introduction.pptxfahmi324663
 
Breaking Through The Challenges of Scalable Deep Learning for Video Analytics
Breaking Through The Challenges of Scalable Deep Learning for Video AnalyticsBreaking Through The Challenges of Scalable Deep Learning for Video Analytics
Breaking Through The Challenges of Scalable Deep Learning for Video AnalyticsJason Anderson
 
Data science presentation
Data science presentationData science presentation
Data science presentationMSDEVMTL
 
Real-time Generation of Topic Maps from Speech Streams
Real-time Generation of Topic Maps from Speech StreamsReal-time Generation of Topic Maps from Speech Streams
Real-time Generation of Topic Maps from Speech Streamstmra
 
Azure cognitive service
Azure cognitive serviceAzure cognitive service
Azure cognitive serviceVishwas N
 
Riding The Semantic Wave
Riding The Semantic WaveRiding The Semantic Wave
Riding The Semantic WaveKaniska Mandal
 
Building a Semantic search Engine in a library
Building a Semantic search Engine in a libraryBuilding a Semantic search Engine in a library
Building a Semantic search Engine in a librarySEECS NUST
 
MongoDB & Machine Learning
MongoDB & Machine LearningMongoDB & Machine Learning
MongoDB & Machine LearningTom Maiaroto
 
Data Science Accelerator Program
Data Science Accelerator ProgramData Science Accelerator Program
Data Science Accelerator ProgramGoDataDriven
 

Similar to Natural Language Search with Neo4j - Kenny Bastani @ GraphConnect NY 2013 (20)

Text-mining and Automation
Text-mining and AutomationText-mining and Automation
Text-mining and Automation
 
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (pdf)
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (pdf)Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (pdf)
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (pdf)
 
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (pdf)
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (pdf)Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (pdf)
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (pdf)
 
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (w...
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (w...Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (w...
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (w...
 
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (w...
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (w...Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (w...
Ace Maths Solutions Unit Five Reading: Exercises on Teaching Data Handling (w...
 
Hacking and mash-ups for beginners at MCN2011
Hacking and mash-ups for beginners at MCN2011Hacking and mash-ups for beginners at MCN2011
Hacking and mash-ups for beginners at MCN2011
 
Genomics data insights
Genomics data insightsGenomics data insights
Genomics data insights
 
Applications of Large Language Models in Materials Discovery and Design
Applications of Large Language Models in Materials Discovery and DesignApplications of Large Language Models in Materials Discovery and Design
Applications of Large Language Models in Materials Discovery and Design
 
ExperTwin: An Alter Ego in Cyberspace for Knowledge Workers
ExperTwin: An Alter Ego in Cyberspace for Knowledge WorkersExperTwin: An Alter Ego in Cyberspace for Knowledge Workers
ExperTwin: An Alter Ego in Cyberspace for Knowledge Workers
 
Week1- Introduction.pptx
Week1- Introduction.pptxWeek1- Introduction.pptx
Week1- Introduction.pptx
 
Breaking Through The Challenges of Scalable Deep Learning for Video Analytics
Breaking Through The Challenges of Scalable Deep Learning for Video AnalyticsBreaking Through The Challenges of Scalable Deep Learning for Video Analytics
Breaking Through The Challenges of Scalable Deep Learning for Video Analytics
 
Data science presentation
Data science presentationData science presentation
Data science presentation
 
How to supervise a thesis in NLP in the ChatGPT era? By Laure Soulier
How to supervise a thesis in NLP in the ChatGPT era? By Laure SoulierHow to supervise a thesis in NLP in the ChatGPT era? By Laure Soulier
How to supervise a thesis in NLP in the ChatGPT era? By Laure Soulier
 
Real-time Generation of Topic Maps from Speech Streams
Real-time Generation of Topic Maps from Speech StreamsReal-time Generation of Topic Maps from Speech Streams
Real-time Generation of Topic Maps from Speech Streams
 
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Azure cognitive service
Azure cognitive serviceAzure cognitive service
Azure cognitive service
 
Riding The Semantic Wave
Riding The Semantic WaveRiding The Semantic Wave
Riding The Semantic Wave
 
Building a Semantic search Engine in a library
Building a Semantic search Engine in a libraryBuilding a Semantic search Engine in a library
Building a Semantic search Engine in a library
 
MongoDB & Machine Learning
MongoDB & Machine LearningMongoDB & Machine Learning
MongoDB & Machine Learning
 
Data Science Accelerator Program
Data Science Accelerator ProgramData Science Accelerator Program
Data Science Accelerator Program
 

More from Neo4j

LARUS - Galileo.XAI e Gen-AI: la nuova prospettiva di LARUS per il futuro del...
LARUS - Galileo.XAI e Gen-AI: la nuova prospettiva di LARUS per il futuro del...LARUS - Galileo.XAI e Gen-AI: la nuova prospettiva di LARUS per il futuro del...
LARUS - Galileo.XAI e Gen-AI: la nuova prospettiva di LARUS per il futuro del...Neo4j
 
GraphSummit Milan - Visione e roadmap del prodotto Neo4j
GraphSummit Milan - Visione e roadmap del prodotto Neo4jGraphSummit Milan - Visione e roadmap del prodotto Neo4j
GraphSummit Milan - Visione e roadmap del prodotto Neo4jNeo4j
 
GraphSummit Milan - Neo4j: The Art of the Possible with Graph
GraphSummit Milan - Neo4j: The Art of the Possible with GraphGraphSummit Milan - Neo4j: The Art of the Possible with Graph
GraphSummit Milan - Neo4j: The Art of the Possible with GraphNeo4j
 
LARUS - Galileo.XAI e Gen-AI: la nuova prospettiva di LARUS per il futuro del...
LARUS - Galileo.XAI e Gen-AI: la nuova prospettiva di LARUS per il futuro del...LARUS - Galileo.XAI e Gen-AI: la nuova prospettiva di LARUS per il futuro del...
LARUS - Galileo.XAI e Gen-AI: la nuova prospettiva di LARUS per il futuro del...Neo4j
 
UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale Ibrida
UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale IbridaUNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale Ibrida
UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale IbridaNeo4j
 
CERVED e Neo4j su una nuvola, migrazione ed evoluzione di un grafo mission cr...
CERVED e Neo4j su una nuvola, migrazione ed evoluzione di un grafo mission cr...CERVED e Neo4j su una nuvola, migrazione ed evoluzione di un grafo mission cr...
CERVED e Neo4j su una nuvola, migrazione ed evoluzione di un grafo mission cr...Neo4j
 
From Knowledge Graphs via Lego Bricks to scientific conversations.pptx
From Knowledge Graphs via Lego Bricks to scientific conversations.pptxFrom Knowledge Graphs via Lego Bricks to scientific conversations.pptx
From Knowledge Graphs via Lego Bricks to scientific conversations.pptxNeo4j
 
Novo Nordisk: When Knowledge Graphs meet LLMs
Novo Nordisk: When Knowledge Graphs meet LLMsNovo Nordisk: When Knowledge Graphs meet LLMs
Novo Nordisk: When Knowledge Graphs meet LLMsNeo4j
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j
 
QIAGEN: Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
QIAGEN: Biomedical Knowledge Graphs for Data Scientists and BioinformaticiansQIAGEN: Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
QIAGEN: Biomedical Knowledge Graphs for Data Scientists and BioinformaticiansNeo4j
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityNeo4j
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphNeo4j
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Neo4j
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfNeo4j
 
ISDEFE - GraphSummit Madrid - ARETA: Aviation Real-Time Emissions Token Accre...
ISDEFE - GraphSummit Madrid - ARETA: Aviation Real-Time Emissions Token Accre...ISDEFE - GraphSummit Madrid - ARETA: Aviation Real-Time Emissions Token Accre...
ISDEFE - GraphSummit Madrid - ARETA: Aviation Real-Time Emissions Token Accre...Neo4j
 
BBVA - GraphSummit Madrid - Caso de éxito en BBVA: Optimizando con grafos
BBVA - GraphSummit Madrid - Caso de éxito en BBVA: Optimizando con grafosBBVA - GraphSummit Madrid - Caso de éxito en BBVA: Optimizando con grafos
BBVA - GraphSummit Madrid - Caso de éxito en BBVA: Optimizando con grafosNeo4j
 
Graph Everywhere - Josep Taruella - Por qué Graph Data Science en tus modelos...
Graph Everywhere - Josep Taruella - Por qué Graph Data Science en tus modelos...Graph Everywhere - Josep Taruella - Por qué Graph Data Science en tus modelos...
Graph Everywhere - Josep Taruella - Por qué Graph Data Science en tus modelos...Neo4j
 
GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4j
GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4jGraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4j
GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4jNeo4j
 
Neo4j_Exploring the Impact of Graph Technology on Financial Services.pdf
Neo4j_Exploring the Impact of Graph Technology on Financial Services.pdfNeo4j_Exploring the Impact of Graph Technology on Financial Services.pdf
Neo4j_Exploring the Impact of Graph Technology on Financial Services.pdfNeo4j
 

More from Neo4j (20)

LARUS - Galileo.XAI e Gen-AI: la nuova prospettiva di LARUS per il futuro del...
LARUS - Galileo.XAI e Gen-AI: la nuova prospettiva di LARUS per il futuro del...LARUS - Galileo.XAI e Gen-AI: la nuova prospettiva di LARUS per il futuro del...
LARUS - Galileo.XAI e Gen-AI: la nuova prospettiva di LARUS per il futuro del...
 
GraphSummit Milan - Visione e roadmap del prodotto Neo4j
GraphSummit Milan - Visione e roadmap del prodotto Neo4jGraphSummit Milan - Visione e roadmap del prodotto Neo4j
GraphSummit Milan - Visione e roadmap del prodotto Neo4j
 
GraphSummit Milan - Neo4j: The Art of the Possible with Graph
GraphSummit Milan - Neo4j: The Art of the Possible with GraphGraphSummit Milan - Neo4j: The Art of the Possible with Graph
GraphSummit Milan - Neo4j: The Art of the Possible with Graph
 
LARUS - Galileo.XAI e Gen-AI: la nuova prospettiva di LARUS per il futuro del...
LARUS - Galileo.XAI e Gen-AI: la nuova prospettiva di LARUS per il futuro del...LARUS - Galileo.XAI e Gen-AI: la nuova prospettiva di LARUS per il futuro del...
LARUS - Galileo.XAI e Gen-AI: la nuova prospettiva di LARUS per il futuro del...
 
UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale Ibrida
UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale IbridaUNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale Ibrida
UNI DI NAPOLI FEDERICO II - Il ruolo dei grafi nell'AI Conversazionale Ibrida
 
CERVED e Neo4j su una nuvola, migrazione ed evoluzione di un grafo mission cr...
CERVED e Neo4j su una nuvola, migrazione ed evoluzione di un grafo mission cr...CERVED e Neo4j su una nuvola, migrazione ed evoluzione di un grafo mission cr...
CERVED e Neo4j su una nuvola, migrazione ed evoluzione di un grafo mission cr...
 
From Knowledge Graphs via Lego Bricks to scientific conversations.pptx
From Knowledge Graphs via Lego Bricks to scientific conversations.pptxFrom Knowledge Graphs via Lego Bricks to scientific conversations.pptx
From Knowledge Graphs via Lego Bricks to scientific conversations.pptx
 
Novo Nordisk: When Knowledge Graphs meet LLMs
Novo Nordisk: When Knowledge Graphs meet LLMsNovo Nordisk: When Knowledge Graphs meet LLMs
Novo Nordisk: When Knowledge Graphs meet LLMs
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
Neo4j - How KGs are shaping the future of Generative AI at AWS Summit London ...
 
QIAGEN: Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
QIAGEN: Biomedical Knowledge Graphs for Data Scientists and BioinformaticiansQIAGEN: Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
QIAGEN: Biomedical Knowledge Graphs for Data Scientists and Bioinformaticians
 
EY_Graph Database Powered Sustainability
EY_Graph Database Powered SustainabilityEY_Graph Database Powered Sustainability
EY_Graph Database Powered Sustainability
 
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge GraphSIEMENS: RAPUNZEL – A Tale About Knowledge Graph
SIEMENS: RAPUNZEL – A Tale About Knowledge Graph
 
Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024Build your next Gen AI Breakthrough - April 2024
Build your next Gen AI Breakthrough - April 2024
 
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdfConnecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdf
 
ISDEFE - GraphSummit Madrid - ARETA: Aviation Real-Time Emissions Token Accre...
ISDEFE - GraphSummit Madrid - ARETA: Aviation Real-Time Emissions Token Accre...ISDEFE - GraphSummit Madrid - ARETA: Aviation Real-Time Emissions Token Accre...
ISDEFE - GraphSummit Madrid - ARETA: Aviation Real-Time Emissions Token Accre...
 
BBVA - GraphSummit Madrid - Caso de éxito en BBVA: Optimizando con grafos
BBVA - GraphSummit Madrid - Caso de éxito en BBVA: Optimizando con grafosBBVA - GraphSummit Madrid - Caso de éxito en BBVA: Optimizando con grafos
BBVA - GraphSummit Madrid - Caso de éxito en BBVA: Optimizando con grafos
 
Graph Everywhere - Josep Taruella - Por qué Graph Data Science en tus modelos...
Graph Everywhere - Josep Taruella - Por qué Graph Data Science en tus modelos...Graph Everywhere - Josep Taruella - Por qué Graph Data Science en tus modelos...
Graph Everywhere - Josep Taruella - Por qué Graph Data Science en tus modelos...
 
GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4j
GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4jGraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4j
GraphSummit Madrid - Product Vision and Roadmap - Luis Salvador Neo4j
 
Neo4j_Exploring the Impact of Graph Technology on Financial Services.pdf
Neo4j_Exploring the Impact of Graph Technology on Financial Services.pdfNeo4j_Exploring the Impact of Graph Technology on Financial Services.pdf
Neo4j_Exploring the Impact of Graph Technology on Financial Services.pdf
 

Recently uploaded

Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdfSandro Moreira
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfOrbitshub
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontologyjohnbeverley2021
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...apidays
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamUiPathCommunity
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsNanddeep Nachan
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityWSO2
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...apidays
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelDeepika Singh
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWERMadyBayot
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxRemote DBA Services
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherRemote DBA Services
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Zilliz
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoffsammart93
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FMESafe Software
 

Recently uploaded (20)

Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdfRising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
Rising Above_ Dubai Floods and the Fortitude of Dubai International Airport.pdf
 
Six Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal OntologySix Myths about Ontologies: The Basics of Formal Ontology
Six Myths about Ontologies: The Basics of Formal Ontology
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Platformless Horizons for Digital Adaptability
Platformless Horizons for Digital AdaptabilityPlatformless Horizons for Digital Adaptability
Platformless Horizons for Digital Adaptability
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot ModelMcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
Mcleodganj Call Girls 🥰 8617370543 Service Offer VIP Hot Model
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Vector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptxVector Search -An Introduction in Oracle Database 23ai.pptx
Vector Search -An Introduction in Oracle Database 23ai.pptx
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)Introduction to Multilingual Retrieval Augmented Generation (RAG)
Introduction to Multilingual Retrieval Augmented Generation (RAG)
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 

Natural Language Search with Neo4j - Kenny Bastani @ GraphConnect NY 2013

  • 2. We’ll be covering... What is natural language search? What do brains and graphs have in common? How do you model time as a graph? How do you model time-based events on a graph? How do you anticipate natural language queries and map those to results? How do you transform answers into questions?
  • 3. What is Natural Language Search? Natural language search is like querying a database using your own natural language. In a way, it is kind of like programming a person with words (Teaching, Evangelism, Sales Pitches, Planning, etc.)
  • 4. Progress What is natural language search? What do brains and graphs have in common? How do you model time as a graph? How do you model time-based events on a graph? How do you anticipate natural language queries and map those to results? How do you transform answers into questions?
  • 5. What do brains and graphs have in common? Networks condense a lot of information into small points. These small points help us understand or interpret a lot of information by exploring the world from many different small points. Graphs, like brains, help us explore a lot of information from relative points.
  • 6. But what is a network? A network is a representation or model of the interconnectedness of information. A graph is the de facto mathematical component that defines the level of interconnectivity in a network. A graph database merges these two concepts into a persistent storage medium. Networks (Information) + Graph (Mathematics) = Neo4j
  • 7. Graph of people meeting people Anne met Pam Pam met Sally Sally met Anne John met Sally
  • 8. Path Finding = Searching The key component when using a graph database is traversals. Traversals model the pathways in a network by enumerating over all possibilities. Possibilities that meet a criteria are returned by a query. (Neo4j’s Cypher Query Language)
  • 9. Progress What is natural language search? What do brains and graphs have in common? How do you model time as a graph? How do you model time-based events on a graph? How do you anticipate natural language queries and map those to results? How do you transform answers into questions?
  • 10. Time based traversals Time is a hierarchical method of categorizing the linearity of global events. Hours, minutes, seconds... “Neo4j Meetup is at 6:00 PM on October 29th”
  • 11. Time Scale Event Meta Model Modeling events over time is easy in Neo4j Let’s go over the GraphGist for the Time Scale Event Meta Model http://gist.neo4j.org/?github-kbastani%2Fgists%2F%2Fmeta%2FTimeScaleEventMetaModel.adoc ac
  • 12.
  • 13. Progress What is natural language search? What do brains and graphs have in common? How do you model time as a graph? How do you model time-based events on a graph? How do you anticipate natural language queries and map those to results? How do you transform answers into questions?
  • 14.
  • 15. Progress What is natural language search? What do brains and graphs have in common? How do you model time as a graph? How do you model time-based events on a graph? How do you anticipate natural language queries and map those to results? How do you transform answers into questions?
  • 16. Neo4j allows you to store information as a series of paths, and that is really valuable for giving a user options when it comes to search. It starts with something I call “Search Cache”
  • 17. Search Cache A search cache is a repository of all relevant paths condensed into a hierarchical data store. A hierarchical data store is like folder paths that model a storage collection into a linear path. (Dimensionality Reduction) An address is a hierarchy, revealing a path. ex. http://www.neo4j.com/download ex. > rootneo4j-communitybinneo4j.sh Natural language path: > what is the matrix?
  • 18.
  • 19. Type Ahead / Autocomplete For search it comes down to enumerating over all possibilities and then mapping those paths to an action. http://kbastani.github.io/predictive-autocomplete Never do real time processing for natural language search (It is a hard problem -which means it will take time*)
  • 20. Distributed Caching Frameworks Take a distributed approach to building out your search cache. Use Neo4j to model your network and then enumerate over all possibilities as a query and add each possibility to a search cache. Distribute the load to a network of compute instances like MapReduce. In C# at http://kbastani.github.io/predictive-autocomplete
  • 21. How do I build a search cache? The best way to do this is using blob storage. I use Windows Azure, but you can use any data storage as long as it maps to a JSON file via HTTP GET request. ex. HTTP GET ../natural/language/search/is/cool .. Working on open source project using C#
  • 22. Progress What is natural language search? What do brains and graphs have in common? How do you model time as a graph? How do you model time-based events on a graph? How do you anticipate natural language queries and map those to results? How do you transform answers into questions?
  • 23. How to transform answers into questions? You have a bunch of answers already in natural language. Each language has a specific template that allows you to transform an answer into a question. “X is Y” -> “What is X?” Is X a Person? Then “Who is X?” Add “What is X?” to the search cache. Example: http://www.arktera.com/
  • 25. Neo4j Events http://www.graphconnect.com New York: November 5-6 London: November 18-19 http://www.graphconnect.com/videos Watch the videos! Very valuable insights from our community
  • 26. Neo4j Trainings Interested in Neo4j training? Talk to me after!
  • 27. Thanks! Follow me on Twitter! @kennybastani Connect with me on LinkedIn /in/kennybastani