SlideShare a Scribd company logo
1 of 34
Download to read offline
Canvases as First Class Citizens
David Newbury, Head of Software, Getty
IIIF Working Session, Fall 2020
1
Background
The Getty is a multifaceted institution, but all of our
facets create and use images. We're:
— A Museum
— A Library
— An Archive
— A Publisher
— A Website
— A Conservator
2
Some facets deal with objects.
All of them deal with images.
3
Often the same image.
4
Getty is all-in on IIIF.
This means that we're
running into interesting
edge cases.
5
Everything I want to talk
about is possible in the spec.
It's a question of practice.
6
7
Manifests are proxies
for objects
Canvases are proxies
for views
8
A Book
The sequence of images is a proxy for the book.
9
A Painting
The "main" image can be a proxy, other images are
o!en documentation.
10
A Sculpture
Images are different representations of the object.
11
An Archival Folder
Images are proxies for the contents of a folder, but are
not a proxy for the objects within the folder.
12
Publication comp. figures
An aggregation of images that
are conceptually related
13
Search results
Images are proxies for web
pages that describe objects.
14
A Image Carousel
A carousel is a presentation of images that are
conceptually related, but not a proxy for a "real" object.
15
A website hero
A image that is not a proxy for any object: editorial
content.
16
Novel Experiences
Images used as "just images" or as collections of pixels.
17
IIIF can be used in all of these
use cases.
18
Manifests make sense for
some of these contexts.
19
We have the Image API and
the Presentation API.
20
The problem is annotations.
21
The problem is annotations
and reuse.
22
Observation #1
Manifests are o!en transient presentations:
objects presented in a specific context.
23
Shopping Cart interface
Use case: Select and order a
series of images for download
or view.
Manifests fit this role nicely—
but should include (some of?)
the annotations associated with
those images.
24
What we've heard is a desire
to collect images, not objects.
25
Observation #2
A given image may appear in many contexts, and may
be part of many objects—either "real" or "contextual".
Annotations (particularly computationally-generated
annotations) are o!en about the image, not the object.
26
27
28
Observation #3
Metadata is o!en related to the "View", and varies
across images within the context of an "Object"
— Visual description
— Photography Credit
— Alt Text
29
Observation #4
Some annotations are related to the image-in-context,
and other are intrinsic to the image-as-content.
— OCR
— Conservation Reporting
— CV Tagging
30
Canvases are a conceptual
space that contains
annotations that present a
specific collection of content.
31
My Questions:
How do we handle interactions with images +
annotations, not just manifests-as-object-proxies?
What's intrinsic to the object and what's to the image
or view?
Does a canvas change impacts several manifests?
Should we think about the Canvas a first-class resource
within the IIIF environment?
32
How do we manage this?:
— From an authorship perspective?
— From a technical perspective?
— From a UX perspective?
33
Discussion!
34

More Related Content

More from David Newbury

IIIF For Small Projects
IIIF  For Small ProjectsIIIF  For Small Projects
IIIF For Small Projects
David Newbury
 
Authority Cascades: A presentation strategy for Linked Open Data
Authority Cascades: A presentation strategy for Linked Open DataAuthority Cascades: A presentation strategy for Linked Open Data
Authority Cascades: A presentation strategy for Linked Open Data
David Newbury
 
Art Tracks: Museums & the Web 2015
Art Tracks: Museums & the Web 2015Art Tracks: Museums & the Web 2015
Art Tracks: Museums & the Web 2015
David Newbury
 

More from David Newbury (20)

Extending IIIF 3.0
Extending IIIF 3.0Extending IIIF 3.0
Extending IIIF 3.0
 
NDSR Learning Enrichment: Data Models and Linked Data
NDSR Learning Enrichment: Data Models and Linked DataNDSR Learning Enrichment: Data Models and Linked Data
NDSR Learning Enrichment: Data Models and Linked Data
 
Fuzzy Dates & the Digital Humanities
Fuzzy Dates & the Digital HumanitiesFuzzy Dates & the Digital Humanities
Fuzzy Dates & the Digital Humanities
 
Telling Stories with Data: Class Notes 2
Telling Stories with Data:  Class Notes 2Telling Stories with Data:  Class Notes 2
Telling Stories with Data: Class Notes 2
 
Telling Stories With Data: Class 1
Telling Stories With Data: Class 1Telling Stories With Data: Class 1
Telling Stories With Data: Class 1
 
21st Century Provenance: Lessons Learned Building Art Tracks
21st Century Provenance:  Lessons Learned Building Art Tracks21st Century Provenance:  Lessons Learned Building Art Tracks
21st Century Provenance: Lessons Learned Building Art Tracks
 
Art Tracks: From Provenance to Structured Data
Art Tracks: From Provenance to Structured DataArt Tracks: From Provenance to Structured Data
Art Tracks: From Provenance to Structured Data
 
Linked Data: Worse is Better
Linked Data:  Worse is BetterLinked Data:  Worse is Better
Linked Data: Worse is Better
 
Understanding D3
Understanding D3Understanding D3
Understanding D3
 
Art Tracks: A technical deep dive.
Art Tracks:  A technical deep dive.Art Tracks:  A technical deep dive.
Art Tracks: A technical deep dive.
 
Using Linked Data: American Art Collaborative, Oct. 3, 2016
Using Linked Data:  American Art Collaborative, Oct. 3, 2016Using Linked Data:  American Art Collaborative, Oct. 3, 2016
Using Linked Data: American Art Collaborative, Oct. 3, 2016
 
Data 101: Making Charts from Spreadsheets
Data 101: Making Charts from SpreadsheetsData 101: Making Charts from Spreadsheets
Data 101: Making Charts from Spreadsheets
 
IIIF For Small Projects
IIIF  For Small ProjectsIIIF  For Small Projects
IIIF For Small Projects
 
Authority Cascades: A presentation strategy for Linked Open Data
Authority Cascades: A presentation strategy for Linked Open DataAuthority Cascades: A presentation strategy for Linked Open Data
Authority Cascades: A presentation strategy for Linked Open Data
 
Data 101: Introduction to Data Visualization
Data 101:  Introduction to Data VisualizationData 101:  Introduction to Data Visualization
Data 101: Introduction to Data Visualization
 
Art Tracks: Presentation to the imProvenance Group
Art Tracks: Presentation to the imProvenance GroupArt Tracks: Presentation to the imProvenance Group
Art Tracks: Presentation to the imProvenance Group
 
How To Internet: The Magic Words
How To Internet:  The Magic WordsHow To Internet:  The Magic Words
How To Internet: The Magic Words
 
Data Visualization for Journalists and Media
Data Visualization for Journalists and MediaData Visualization for Journalists and Media
Data Visualization for Journalists and Media
 
Art Tracks: Museums & the Web 2015
Art Tracks: Museums & the Web 2015Art Tracks: Museums & the Web 2015
Art Tracks: Museums & the Web 2015
 
The Gulf Tower project
The Gulf Tower projectThe Gulf Tower project
The Gulf Tower project
 

Recently uploaded

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 

Recently uploaded (20)

presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
Ransomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdfRansomware_Q4_2023. The report. [EN].pdf
Ransomware_Q4_2023. The report. [EN].pdf
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
Emergent Methods: Multi-lingual narrative tracking in the news - real-time ex...
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024Manulife - Insurer Transformation Award 2024
Manulife - Insurer Transformation Award 2024
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 

IIIF Canvases as First Class Citizens

  • 1. Canvases as First Class Citizens David Newbury, Head of Software, Getty IIIF Working Session, Fall 2020 1
  • 2. Background The Getty is a multifaceted institution, but all of our facets create and use images. We're: — A Museum — A Library — An Archive — A Publisher — A Website — A Conservator 2
  • 3. Some facets deal with objects. All of them deal with images. 3
  • 4. Often the same image. 4
  • 5. Getty is all-in on IIIF. This means that we're running into interesting edge cases. 5
  • 6. Everything I want to talk about is possible in the spec. It's a question of practice. 6
  • 7. 7
  • 8. Manifests are proxies for objects Canvases are proxies for views 8
  • 9. A Book The sequence of images is a proxy for the book. 9
  • 10. A Painting The "main" image can be a proxy, other images are o!en documentation. 10
  • 11. A Sculpture Images are different representations of the object. 11
  • 12. An Archival Folder Images are proxies for the contents of a folder, but are not a proxy for the objects within the folder. 12
  • 13. Publication comp. figures An aggregation of images that are conceptually related 13
  • 14. Search results Images are proxies for web pages that describe objects. 14
  • 15. A Image Carousel A carousel is a presentation of images that are conceptually related, but not a proxy for a "real" object. 15
  • 16. A website hero A image that is not a proxy for any object: editorial content. 16
  • 17. Novel Experiences Images used as "just images" or as collections of pixels. 17
  • 18. IIIF can be used in all of these use cases. 18
  • 19. Manifests make sense for some of these contexts. 19
  • 20. We have the Image API and the Presentation API. 20
  • 21. The problem is annotations. 21
  • 22. The problem is annotations and reuse. 22
  • 23. Observation #1 Manifests are o!en transient presentations: objects presented in a specific context. 23
  • 24. Shopping Cart interface Use case: Select and order a series of images for download or view. Manifests fit this role nicely— but should include (some of?) the annotations associated with those images. 24
  • 25. What we've heard is a desire to collect images, not objects. 25
  • 26. Observation #2 A given image may appear in many contexts, and may be part of many objects—either "real" or "contextual". Annotations (particularly computationally-generated annotations) are o!en about the image, not the object. 26
  • 27. 27
  • 28. 28
  • 29. Observation #3 Metadata is o!en related to the "View", and varies across images within the context of an "Object" — Visual description — Photography Credit — Alt Text 29
  • 30. Observation #4 Some annotations are related to the image-in-context, and other are intrinsic to the image-as-content. — OCR — Conservation Reporting — CV Tagging 30
  • 31. Canvases are a conceptual space that contains annotations that present a specific collection of content. 31
  • 32. My Questions: How do we handle interactions with images + annotations, not just manifests-as-object-proxies? What's intrinsic to the object and what's to the image or view? Does a canvas change impacts several manifests? Should we think about the Canvas a first-class resource within the IIIF environment? 32
  • 33. How do we manage this?: — From an authorship perspective? — From a technical perspective? — From a UX perspective? 33