The general aim of LinkedCulture is to describe how the information need of the Tussen Kunst & Kitsch (Antiques Roadshow) viewers can be satisfied from both their couch and on-the-go, supporting both passive and more active needs. Linking to external information and content, such as Europeana, museum collections but also auction information has been incorporated in these scenarios
FIAT-IFTA 2013 - Television linked to the web: the case for audiovisual arch...
LinkedTV Europeana tech 2015 ignite talk
1. LinkedCulture
Linking related art objects with a cultural heritage
TV programme using the Europeana API
Source: http://arstechnica.com/tech-policy/2010/05/ralph-124c-41-a-century-later/. Original photo: Life.com
Johan Oomen | Netherlands Institute for Sound and Vision - presenting on behalf of:
Lyndon Nixon | MODUL University Vienna GmbH
Lotte Belice Baltussen | Sound and Vision
Europeana Tech | 12 February 2015 |
2. Forbes Magazine, 7 October 2014.
http://www.forbes.com/sites/jeffbercovici/2014/07/10/using-a-second-screen-while-watching-tv-is-now-the-
Evert F. Baumgardner. Family watching television, c. 1958. NARA. Rights: Public domain.
http://commons.wikimedia.org/wiki/File:Family_watching_television_1958.jpg
then... ...now
15. Art object description model
ATTRIBUTES OBJECT: SILVER
TEA JAR
DISAMBIGUATION
Creator Unknown ULAN
Type Container DBpedia
Material Silver AAT
Creation location Leeuwarden Geonames
Period 18th century Wikidata
Style Frisian Silver DBpedia
16. Creating Europeana API queries
ATTRIBUTES OBJECT: SILVER
TEA JAR
QUERY
EXPANSION
Creator Unknown
Type Container
Material Silver
Creation location Leeuwarden
Period 18th century
Style Frisian Silver
proxy_dc_format:zilver
YEAR:[1701+TO+1800]
where:(Leeuwarden+OR+Friesland)
what:(container+OR+houder+OR+bak+O
tank+OR+blik)
Context of this work are trends in viewing behavior
Viewers look up information about what they’re seeing on tv while and after they’re watching.
Despite these trends, TV is often still presented a passive medium. But consumers are used to the interactivity of the Web.
This is where the LinkedTV project comes in. LinkedTV. combines TV and information found on the Web.
Use case
Within the project, Sound and Vision collaborated with Dutch public broadcaster AVROTROS.
AVROTROS allowed us to use their show Tussen Kunst & Kitsch. It is similar to the Antiques Roadshow. On the show, different unique art objects are brought in by people, which are then discussed and valued by experts.
Viewers often want to know more about these objects.
The most common approach by viewers is to use search engines. However, they might not know how to spell terms or forgot specifics. The idea is to present contextual information semi automatically.
How we do this? We use video analysis techniques to split the programme into meaningful fragments. We also use visual concept detection.
In the subtitles, we find relevant Entities (distinct concepts), which relate to mentioned locations, persons, organisations, objects.
NERD Eurecom.
Green entities = very relevant. Red entities = not really relevant.
Based on these annotations, related content is found on the web and is then linked to the programme fragments.
A Web-based curation tool allows programme editors to verify these enrichments and pick the most relevant to present to users.
After curation in the Editor Tool, data is ready to be used in the LinkedCulture application. This is the home screen in which users can choose fragments of recent episodes. Each fragment is about a specific art object.
For each fragment about a specific art object, the user is presented with general information about the object, background info like articles and videos, related art objects and related fragments from the archive of the show.
In the related artworks part, we show related objects from Europeana. In this case, the object on the show was a silver tea jar from Friesland from the 18th century.
Words can have have different meanings, so we need to be able to disambiguate search terms.
Therefore, we’ve created an art object description model that captures their unique identity in terms of a set of properties and their values. These are e.g. creator, type and material. We use existing LOD vocabularies to disambiguate the terms.
Based on this model, we can formulate smart queries for retrieving through the Europeana API.
To find as many relevant objects in Europeana as possible, we have to deal with metadata which is natural language (ambiguous), localized (in the local language), and inconsistent (in the specificity of property values). So our API wrapper can find (i) synonyms and alternative forms of the concept, (ii) converted into the local language and (iii) at different levels of specificity when a taxonomy is available (e.g. in geographical models)
Come chat to us during the poster sessions, in which we can also show the LinkedCulture demo. Lyndon from LinkedTV is there tomorrow for more in-depth technical questions.