histograph is our experimental app to enhance data exploration and enable crowd-based indexation for multimedia collections. We tried to create something new by combining existing technologies and applying image analysis, named entity recognition (NER) and network visualisation to the humanities. This talk is about our Histograph adventure – its ups and downs, joys and sorrows: a dialogue on how the humanities and their traditions/ways of thinking can influence technological development. Check histograph.eu for more info!

1. A la découverte d'histograph
histograph.eu
Lars Wieneke / lars.wieneke@uni.lu
Marten Düring / @martenduering
Daniele Guido / @danieleguido
University of Luxembourg

2. 1. What is histograph?
A tool for the exploraGon of mul3media
datasets
An indexaGon pipeline for different document types
building on a set of en33es
A graph-based visual explora3on tool
A collaboraGve data curaGon pla<orm
An open-source pla<orm

3. The Big Three at Yalta
The Na.onal Archives UK
2. What to we do with pictures?

4. Président Delors. Lambiotte, Christian. (c) European Union
Robert Schumann. (c) European community

5. The Big Three at Yalta
The Na.onal Archives UK
DESCRIBES
image annotaGon #1
proprietary so7ware
region: {
left: 95.3547,
top: 62.6837,
right: 157.901,
bottom: 147.796
}

6. DESCRIBES
image annotaGon #1
proprietary so7ware
APPEARS_IN
APPEARS_IN
APPEARS_IN

7. DESCRIBES
image annotaGon #1
proprietary so7ware
APPEARS_IN
APPEARS_IN
APPEARS_IN
Winston
Churchill

8. DESCRIBES
image annotaGon #2
Microso7 Computer Vision API
APPEARS_IN
APPEARS_IN
APPEARS_IN
DESCRIBES

9. DESCRIBES
image annotaGon #2
Microso7 Computer Vision API
APPEARS_IN
APPEARS_IN
APPEARS_IN
Winston
Churchill
DESCRIBES
APPEARS_IN
high scored relaGonship
2 of 2 services, same ID
unknown
weak relaGonship
1 of 2 services, no ID

10. DESCRIBES
image annotaGon #2
Microso7 Computer Vision API
APPEARS_IN
APPEARS_IN
APPEARS_IN
Winston
Churchill
DESCRIBES
APPEARS_IN
high scored relaGonship
2 of 2 services, same ID
unknown
weak relaGonship
1 of 2 services, no ID

11. The Big Three at Yalta
The Na.onal Archives UK
3. Named enGGes recogniGon
USA C-543 (Color): Yalta Conference, February
1945 Allied leaders pose in the courtyard of
Livadia Palace, Yalta, during the conference.
Those seated are (from leP to right): Prime
Minister Winston Churchill (UK); President
Franklin D. Roosevelt (USA); and Premier Josef
Stalin (USSR). Also present are USSR Foreign
Minister Vyacheslav Molotov (far leP); Admiral
of the Fleet Sir Andrew Cunningham, R.N., and
Air Chief Marshall Sir Charles Portal, R.A.F.
(both standing behind Churchill); and Fleet
Admiral William D. Leahy, USN, (standing
behind Roosevelt). Note ornate carpets under
the chairs. Photograph from the Army Signal
Corps Collec3on in the U.S. Na3onal Archives.
(2016/03/14).
Q=2

14. DESCRIBES
NER annotaGon #1
YAGO-AIDA, <English>
APPEARS_IN
APPEARS_IN
DESCRIBES
DESCRIBES
APPEARS_IN
USA C-543 (Color): Yalta Conference, February 1945 Allied
leaders pose in the courtyard of Livadia Palace, Yalta, during
the conference. Those seated are (from leP to right): Prime
Minister Winston Churchill (UK); President Franklin D.
Roosevelt (USA); and Premier Josef Stalin (USSR). Also
present are USSR Foreign Minister Vyacheslav Molotov (far
leP); Admiral of the Fleet Sir Andrew Cunningham, R.N., [ … ]
APPEARS_IN
Livadia Palace, Yalta
loca.on, <lat>, <lng>
Winston
Churchill
person
APPEARS_IN

15. DESCRIBES
NER annotaGon #1
YAGO-AIDA, <English>
APPEARS_IN
APPEARS_IN
DESCRIBES
DESCRIBES
APPEARS_IN
APPEARS_IN
Livadia Palace, Yalta
loca.on, <lat>, <lng>
Winston
Churchill
person
APPEARS_IN
Q=2, services=3
Q=1, services=1
USA C-543 (Color): Yalta Conference, February 1945 Allied
leaders pose in the courtyard of Livadia Palace, Yalta, during
the conference. Those seated are (from leP to right): Prime
Minister Winston Churchill (UK); President Franklin D.
Roosevelt (USA); and Premier Josef Stalin (USSR). Also
present are USSR Foreign Minister Vyacheslav Molotov (far
leP); Admiral of the Fleet Sir Andrew Cunningham, R.N., [ … ]

16. 4. BiparGte network projecGon
APPEARS_IN
agent smith
@yomguithereal

17. LIKES
5. CollaboraGve
data curaGon
researcher #1
user

18. CURATES
PERFO
RM
S
LIKES
5. CollaboraGve
data curaGon
acGon:issue #1
ac.on

19. APPEARS_IN
MENTIONS
MENTIONS
CURATES
PERFO
RM
S
LIKES
5. CollaboraGve
data curaGon
this is not a person
person
researcher #2
user

20. APPEARS_IN
MENTIONS
MENTIONS
CURATES
PERFO
RM
S
LIKES
5. CollaboraGve
data curaGon
downvote[]/upvote[]
score++/score--
downvote[]/upvote[]
:downvote
:upvote
:issue
:create

21. 5. Future challenges
Integra3on with
biographical data
Addi3onal data sources
and en3ty extrac3on
components (video!)
Handling “unknown” enGGes,
Propaga3ng changes (e.g. subscrip3on service)
SpaGal analysis (PoC exisGng)
Data provenance in distributed seengs

22. Check out histograph.eu
or the demo on histograph.cvce.eu
and join us on GitHub
github.com/CVCEeu-dh/histograph
Merci!
Lars Wieneke / lars.wieneke@uni.lu
Marten Düring / @martenduering
Daniele Guido / @danieleguido
University of Luxembourg