Nuxeo World Session: Semantic Technologies - Update on Recent Research

Nov. 17 2010 - S. Fermigier & O. Grisel, Nuxeo

Towards semantic ECM:
report on the IKS and Scribo projects

Monday, November 22, 2010

Outline

• Introduction to semantic technologies
• Collaborative R&D within the Scribo and
IKS projects
• Fise & Apache Stanbol / Nuxeo Integration


1. Introduction to semantic
technologies


Illustration source: Mills Davis, “Semantic Social Computing”, sept. 2007

Photo source: http://www.ﬂickr.com/photos/pixelydixel/

Invented the web in 1989
(yeah!)


Invented the web in 1989
(yeah!)

Invented the semantic
web in 1999 (duh?)


Historical perspective

• From web 1.0: web of pages, aka the
World Wide Web
• To web 2.0: web of people and of
participation, aka the Social Web
• To web 3.0: web of data, of meaning
and of connected knowledge, aka the
Semantic Web


Picture source: http://www.ﬂickr.com/photos/pixelydixel/

A “layer cake” of
technologies


Linked Online Data in 2007

“Linking Open Data cloud diagram, by Richard Cyganiak and Anja Jentzsch. http://lod-cloud.net/”

2008


2009


2010


Good for Enterprise apps too!

Diagram source: http://www.w3.org/2007/Talks/0130-sb-W3CTechSemWeb/

Key Enablers
• Open Data and Linked Online Data
• Advances in automatic content analysis
(linguistics, image processing)
• Computing power (Moore’s law +
MapReduce)
• Classical logic and classical AI


The technologies and data
are available,

let’s put them to use!


Semantic ECM

Metadata
Text
Sound Tags Entities
Image Relations
Video
Reasoning

Content Meaning


Goals for Semantic ECM
(& Nuxeo)
• Repurpose existing content
• Improve search and collaboration
• Make information contextual
• Extract and use information from your
content
• Make your content smarter!

Challenges

• Extract meaning from content
• Enrich content with knowledge
• Enhance interaction with content thanks to
added meaning


Business value
from semantic ECM

• Efﬁciency gains: 20% to 90% (ex: in
search, collaboration)
• Effectiveness gains: better returns from
your assets (ex: news and images from AFP)
• Strategic edge: growth, value capture,
new services, gain unfair strategic advantage
(ex: vertical ontologies for CEVAs / CCAs)


2. SCRIBO and IKS


• Project under the french FUI program, with
9 partners, and a budget of 4.7 M€
• Goal: to develop algorithms and collaborative
tools for extracting knowledge from
unstructured documents and images
• Started in 2008, ﬁnishing in Dec. 2010, with
results already integrated as a Nuxeo plugin


• European project under the FP7, with 13
partners (6 SMEs) and a 8.5 M€ budget
• Goal: create a semantic software “stack” that
will be used by CMS vendors to add semantic
features to their products
• Started in Jan. 2009, will last until Dec. 2012
• First tangible result: FISE, already integrated
in a Nuxeo plugin


3. Linking Semantic Entities
Apache Stanbol - Nuxeo integration


What are entities?

27


28


What is wrong with tags?

• Many terms for same meaning
• NYC, New York, New York City

• Many meanings for same terms
• Need context to remove any ambiguity

29


Washington is...

30


Tagging with Entities

• Global namespace / universal meaning context

• Interoperability across domains

• Interoperability across applications

31


Demo time!

Screencast online at http://blogs.nuxeo.com/dev

32


How does this work?

33


34


• Open Source Semantic Engine
• HTTP Services
• For content driven applications
• OSGi: loosely coupled components
• Analysis Engines
• Knowledge RDF vocabularies
35


What is a semantic engine?

• Unstructured content => Knowledge

• Language guessing
• Topic classiﬁcation (Business, Sports, Media, ...)
• Named Entities extraction and linking
• Relationships and properties extraction

36


37


38


RESTful
is
Beautiful

39


curl -X POST
-H "Accept: application/json"
-H "Content-type: text/plain"
--data "John Smith works at Smith Consulting in Paris."
http://fise.demo.nuxeo.com/engines

{
"urn:enhancement-1564680b-861c-df6f-fdf9-d34a75d68dfe": {
"http://ﬁse.iks-project.eu/ontology/selected-text": [
{
"datatype": "http://www.w3.org/2001/XMLSchema#string",
"type": "literal",
"value": "Paris"
}
],
"http://ﬁse.iks-project.eu/ontology/selection-context": [
{
"datatype": "http://www.w3.org/2001/XMLSchema#string",
"type": "literal",
"value": "John Smith works at Smith Consulting Paris."
}
],
"http://purl.org/dc/terms/type": [
{
"type": "uri",
"value": "http://dbpedia.org/ontology/Place"
}
] 40
},
…


41


42


=
ﬁse
+
fast Linked Data local index
+
semantic rule engine
+
more ? 43


Apache Stanbol / Nuxeo
integration

44


Apache Stanbol

Engine 1 DBpedia
Engine 2

2
1 Engine 3

Freebase

Nuxeo DM
3
addon
Geonames
LDAP
Local IT infrastructure (LAN) 45


• Implemented as an Operation for Studio

• Entities & Relationships stored in Nuxeo Core

• CMIS interoperability

46


Soon available on
marketplace.nuxeo.com

47


Questions?

• http://iks-project.eu

• http://ﬁse.demo.nuxeo.com

• http://scribo.ws

• http://incubator.apache.org/stanbol

• http://blogs.nuxeo.com/dev

48


Nuxeo World Session: Semantic Technologies - Update on Recent Research

Recommended

Recommended

More Related Content

Viewers also liked

Viewers also liked (9)

Similar to Nuxeo World Session: Semantic Technologies - Update on Recent Research

Similar to Nuxeo World Session: Semantic Technologies - Update on Recent Research (20)

More from Nuxeo

More from Nuxeo (20)

Recently uploaded

Recently uploaded (20)

Nuxeo World Session: Semantic Technologies - Update on Recent Research