5. We
need
more
of
this
SMART
CONNECTED
OPEN
Johan
Oomen,
Lora
Aroyo
(2011).
Crowdsourcing
in
the
Cultural
Heritage
Domain:
OpportuniCes
and
Challenges,
hDp://www.iisi.de/fileadmin/IISI/upload/2011/p138_oomen.pdf
6. Smart
new technologies for indexing, retrieval & linking
link to the workflows of creative industries
distribution over various devices & platforms
Connected
Open
to users
between collections
to distributed content
“For
content
to
be
truly
accessible,
it
needs
to
be
where
the
users
are,
embedded
in
their
daily
networked
lives.” (Wabel,
2009)
to stimulate collaboration & creativity
7. “Enabling
anything
like
seamless
access
to
the
cultural
record
will
require
developing
tools
to
navigate
among
vast
catalogs
of
born-‐digital
and
digiCzed
materials
[…]
The
return
on
this
investment
will
be
a
humaniCes
and
social
science
cyberinfrastructure
that
will
allow
new
quesCons
to
be
asked,
new
paDerns
and
relaCons
to
be
discerned,
and
deep
structures
in
language,
society,
and
culture
to
be
exposed
and
explored.”
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
8. Digital
Humani>es
perform
interpreta(on
of
texts
and
other
media
interpretaCons
deal
with
perspecCves
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
9. we
need
….
support
of
mulKple
perspecKves
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
10. Peter
Singer
we
have
….
altruism-‐driven
crowds
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
11. …
and
because
“the
best
collecKve
decisions
are
result
of
disagreement,
not
consensus”
James
Surowiecki
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
12. …
and
because
“we
[can]
treat
human
brains
as
processors
in
a
distributed
system
each
performing
a
small
part
of
a
massive
computaKon”,
aka
Human
CompuKng
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
13. we
can
achieve
“the
wise
crowd”,
which
is
diversity
of
opinion
Independent
decentralized
aggregated
James
Surowiecki
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
14. the
main
ques>on
is:
How
does
the
combinaKon
of
online
access
to
collecKons
&
parKcipatory
culture
shape
the
future
of
engagement
with
cultural
heritage?
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
23. Na>onal
Library
of
Australia
Within
one
year:
hRp://trove.nla.gov.au/
“6.000
members
of
the
public
had
already
enhanced
the
data
significantly
by
correcCng
over
7
million
lines
of
text
in
320.000
arCcles,
and
adding
200
000
tags
and
4600comments
to
arCcles”
32. UK
SoundMap
“What
does
the
UK
sound
like
today?
What
impact
do
these
sounds
have
on
our
lives?”
hRp://sounds.bl.uk/sound-‐maps/uk-‐soundmap
33. Steve.museum
“Steve
is
dedicated
to
exploring
the
effecCveness
of
social
tagging
for
accessing
art
museum
collecCons
online
and
engaging
audiences.”
35. 1
Million
Euro’s…
dona>ons
from
a
euro
to
40,000
euros
($52,700),
with
the
average
about
150
euros
($195).
French
companies
founda>ons
a
notes
expressing
apprecia>on
and
offering
money
to
honor
loved
ones.
45. – The
Results
of
First
Pilot
first
6
months:
• 44.362
pageviews
• 12.279
visits
(3+
min
online)
• 555
registered
players
(thousands
anonymous
players!)
– 340.551
tags
added
to
602
items
– 137.421
matches
46. First
two
years
(2006-‐2008)
• 11
Q: Why did you tag?
PartcipaKng
Museums
• 1,782
Works
of
Art
in
the
Research
to help museums document art work
• 36,981
Tags
for fun
collected
to improve search for other users
• 2,017
Users
who
tagged
to learn about art
other (please specify)
so that I could find works again later
Museum
professionals
found
88%
of
the
tags
useful
0% 20% 40% 60% 80% 100%
to connect with others
don't remember
Public
MMA
47. Tags
by
Documentalists
• Tags
describe
mainly
short
segments
• Tags
are
ojen
not
very
specific
• Tags
not
describe
programmes
as
a
whole
• User
tags
were
useful
&
specific
-‐-‐>
domain
dependent
48. Use
Case
2:
Crowdsourcing
&
Nichesourcing
@Rijksmuseum
Accurator
ask the right crowd, enrich your collection
hRp://2-‐dot-‐rma-‐accurator.appspot.com/
50. however, only a small fraction of about
8000 items are currently on display
51. … and present the collection online. 125.000
artworks are already available, and another
40.000 are added every year
52. the expertise of museum professionals lies in
describing & annotating collection with art-historical
information, thus for most artworks,
we know when they were created, by whom
53. detailed information about the depicted
objects, e.g. which species the animal or plant
belongs to, is in most cases not available
54. the need for more detailed annotations:
this painting is annotated only with “bird with
blue head near branch with red leaf”, and the
species of the bird and the plant are missing
55. by involving people from outside the
museum in annotation process, we support
museum professionals in their annotation task
56. we use crowdsourcing to get more
annotations. we use nichesourcing, i.e. niches
of people with the right expertise, to add more
specific information
57. we use sources like Twitter to find experts or
groups of experts on certain areas, e.g. bird
lovers, ornithologists or people who enjoy bird-watching
in their spare time
58. we have developed a platform where users can enter
tags, either by using terms from a structured
vocabulary or by adding free text
59. for tasks that are too difficult, we developed a game in
which players can carry out an expert annotation task
with some assistance
60. to evaluate the correctness of annotations they are
reviewed & rated by other experts who have expertise
in the same topic
61. Sound
&
Vision
and
Royal
Library
In
Digital
Event-‐centric
ExploraKon
Hermeneu>cs
Use
Case
3:
dive.beeldengeluid.nl
63. OPENIMAGES.EU
• 3000
videos
• NL
InsKtute
for
Sound
&
Vision
• mostly
news
broadcasts
DELPHER.NL
• 1.5
Million
Scans
of
• Radio
bulleKns
• (hand
annotated)
• 1937
–
1984
64. Erp,
M.
van;
Oomen,
J.;
Segers,
R.;
Akker,
C.
van
de;
Aroyo,
L.;
Jacobs,
G.;
Legêne,
S;
Meij,
L.
van
der;O
ssenbruggen,
J.R.
van;
Schreiber,
G.
AutomaKc
Heritage
Metadata
Enrichment
with
Historic
Events
Museums
and
the
Web
2011
h]p://www.museumsandtheweb.com/mw2011/
papers/automaKc_heritage_metadata_enrichment_with_hi
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
66. Informa(on:
Museums
&
Archives
as
Inventories
of
the
World
André
Malraux,
The
Imaginary
Museum
of
World
Sculpture,
1953
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
68. Digital
Hermeneu(cs
• a
theory
of
interpretaCon
of
informaCon
• bringing
people
and
technology
together
to
explore:
– how
to
model
and
represent
informaKon
– how
to
provide
engaging
interacKon
– how
to
support
interpretaKon
“Digital
HermeneuCcs:
Agora
and
the
online
understanding
of
cultural
heritage”
In
proceedings
of
Web
Science
Conference,
(ACM:
New
York,
2011)
Chiel
van
den
Akker,
Marieke
van
Erp,
Lora
Aroyo,
Ardjan
van
Nuland,
Lourens
van
der
Meij,
Susan
Lêgene,
and
Guus
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo
Schreiber
(2013).
Evalua>ng
Cultural
Heritage
Access
on
the
Web:
From
Informa>on
Delivery
to
Interpreta>on
Support
(WebSci’13)
72. DIVE
Team:
Victor
de
Boer,
Oana
Inel,
Lora
Aroyo,
Johan
Oomen,
Elco
Van
Staveren,
Werner
Helmich
&
Dennis
De
Beurs
dive.beeldengeluid.nl
73. Agora
Team:
Lora
Aroyo,
Guus
Schreiber,
Lourens
van
der
Meij,
Marieke
van
Erp,
Chiel
van
den
Akker,
Susan
Legêne,
Geertje
Jacobs,
Johan
Oomen
agora.cs.vu.nl
74. CrowdTruth
Team:
Lora
Aroyo,
Chris
Welty
Robert-‐Jan
Sips,
Carlos
Mar>nez
Or>z,
Anca
Dumitrache,
Oana
Inel,
Benjamin
Timmermans,
Susanna
van
de
Ven,
Merel
van
Empel,
Jelle
v.d.
Ploeg,
TaKana
Cristea,
Khalid
Khamkham,
Harrië]e
Smook,
Rens
van
Honschooten,
Arne
Rutjes
CrowdTruth.org
github.com/CrowdTruth
75. Links
On
the
Web
• http://waida.nl
• http://prestoprime.org
• http://agora.cs.vu.nl
• http://sealincmedia.wordpress.com
• http://dive.beeldengeluid.nl
• http://crowdtruth.org
• http://game.crowdtruth.org
• http://wm.cs.vu.nl
On
TwiRer
@waisda
@agora-‐project
@sealincmedia
@prestocenter
@vistatv
#CrowdTruth
http://lora-aroyo.org ! http://slideshare.net/laroyo ! @laroyo