SlideShare a Scribd company logo
1 of 17
Assessment Practices
and Metrics in a 21st
Century Pandemic
Thursday, October 9, 2020
10:15 a.m. CT
Denise Stephens
Vice Provost and University Librarian
Libraries’ Assessment Practices Describe
Value to Mission – NOT Return on
Investment.
• Essential to capture effectiveness
• Identifies areas for improvement
• Opportunity to discuss performance
• What did we do well?
• What could we have done differently?
Washington University Libraries
COVID: Pivoting to Meet User Needs
Washington University Libraries
• Assessments & Metrics that Document the Impacts
• eBook purchases
• EZ Proxy (off-campus) access
• Individual Interactions - Virtual
• Ask Us - Chats
• Technology for remote work
• Curbside Pickup
The response to COVID
impacts and reshapes a
number of services.
• How do these adaptations
influence our assessment
programming?
COVID-19 Resources
Buildings and Access
Remote Resources
Curbside Pickup
Interlibrary Loan and
MOBIUS
Materials and
Services
Returns
Instruction and
Consultations
Washington University Libraries
eBooks purchased
2019 2020 % change
March 51 127 149.0%
April 86 147 70.9%
May 101 539 433.7%
June 11 32 190.9%
Total: 249 845 239.4%
Washington University Libraries
EZ Proxy (off-campus access)
2019 2020 % change
March 25,363 32,580 28.5%
April 28,628 55,980 95.5%
May 19,222 34,266 78.3%
June 18,578 28,115 51.3%
July 18,169 28,421 56.4%
August 20,603 27,031 31.2%
September 27,391 37,609 37.3%
Total: 157,954 244,002 54.5%
Washington University Libraries
Individual Interactions – Virtual
2019 2020 % change
Transactions Reference
Consultations
Transactions Reference
Consultations
Transactions Reference
Consultations
March 154 83 261 385 69.5% 363.9%
April 140 114 266 458 90.0% 301.8%
May 92 55 204 171 121.7% 210.9%
June 103 64 280 223 171.8% 248.4%
July 128 123 178 232 39.1% 88.6%
August 133 148 269 269 102.3% 81.8%
September 160 150 319 226 99.4% 50.7%
Total: 910 737 1777 1964 95.3% 166.5%
Grand Total: 1647 3741 127.1%
Washington University Libraries
Ask Us – Chats
2019 2020 % change
March 155 176 13.5%
April 233 211 -9.4%
May 96 125 30.2%
June 94 136 44.7%
July 93 238* 155.9%
August 128 334* 160.9%
September 173 558* 222.5%
Total: 972 1778 82.9%
*Switched to 24/7 chat in July. This number includes chats answered by co-op operators.
Washington University Libraries
Ask Us – Tickets/Emails
2019 2020 % change
March 166 253 52.4%
April 252 299 18.7%
May 139 294 111.5%
June 134 323 141.0%
July 133 281 111.3%
August 205 356 73.7%
September 218 553 153.7%
TOTAL 1247 2359 89.2%
Washington University Libraries
Curbside Pickup
June 235 pickups
July 377 pickups
August 280 pickups
September 928 pickups
COVID Opens Opportunity to Assess
Crisis Value of Response Outcomes
• We can identify and measure how stakeholders adopt
and value the iterative changes made to deliver
Libraries’ services under a protracted period of
alternative operations due to COVID.
Washington University Libraries
Assessment & Analytics Programming
Integrates COVID Services Adaptations into
the Framework for Libraries
Washington University Libraries
• Supports development & implementation of strategic assessment framework
• Coordinates assessment activities
• Develops recommendations for improve metrics
• Advises on assessment tools
• Provides advisory to how data impacts strategy
• Organizes data collection activities
Assessment & Analytics Programming
Washington University Libraries
• Determines:
• Methods of collecting data
• Communication methods
• Creating timelines and protocols
Assessing the Libraries’ Impact on
Institutional COVID Planning & Response
• New Collaborations/Partnerships
• Shared Expertise
• Iterative Uses of Space and Infrastructure
• Emergent Strategies for Content Delivery and Creation
Washington University Libraries
With Increased Visibility, How to Understand
& Assess the Outcomes?
• How can we capture the relationship between emergent
outcomes compared to pre-COVID conditions?
• How does the response impact equity while increasing
access and delivering reliance on technology?
• How do stakeholders perceive the efficacy and value of
services impacted by COVID conditions?
Washington University Libraries
With Increased Visibility, How to Understand
& Assess the Outcomes?
• How to capture and evaluate potentially transformative
change that may persist beyond COVID?
• Which future metrics may be necessary to effectively
understand Value post-COVID?
Washington University Libraries
THANK YOU!
Washington University Libraries

More Related Content

What's hot

Indicators affecting student success in online learning. 
Indicators affecting student success in online learning.  Indicators affecting student success in online learning. 
Indicators affecting student success in online learning. 
Tanya Joosten
 
Reaching Out To Work Together
Reaching Out To Work TogetherReaching Out To Work Together
Reaching Out To Work Together
Amy Vecchione
 

What's hot (20)

UKSG webinar: Digital resources and library services: meeting the challenge o...
UKSG webinar: Digital resources and library services: meeting the challenge o...UKSG webinar: Digital resources and library services: meeting the challenge o...
UKSG webinar: Digital resources and library services: meeting the challenge o...
 
Brown apr20-3
Brown apr20-3Brown apr20-3
Brown apr20-3
 
Fransen apr20-5
Fransen apr20-5Fransen apr20-5
Fransen apr20-5
 
Institutional stakeholders in open access workflows - RLUK conference 160309
Institutional stakeholders in open access workflows - RLUK conference 160309Institutional stakeholders in open access workflows - RLUK conference 160309
Institutional stakeholders in open access workflows - RLUK conference 160309
 
Indicators affecting student success in online learning. 
Indicators affecting student success in online learning.  Indicators affecting student success in online learning. 
Indicators affecting student success in online learning. 
 
The Library Platform & Altmetrics
The Library Platform & AltmetricsThe Library Platform & Altmetrics
The Library Platform & Altmetrics
 
Holmes apr20-post
Holmes apr20-postHolmes apr20-post
Holmes apr20-post
 
UKSG Conference 2017 Breakout - User Engagement Analytics: measuring and driv...
UKSG Conference 2017 Breakout - User Engagement Analytics: measuring and driv...UKSG Conference 2017 Breakout - User Engagement Analytics: measuring and driv...
UKSG Conference 2017 Breakout - User Engagement Analytics: measuring and driv...
 
UKSG 2017 Conference Breakout - What does it mean to be a competent bibliomet...
UKSG 2017 Conference Breakout - What does it mean to be a competent bibliomet...UKSG 2017 Conference Breakout - What does it mean to be a competent bibliomet...
UKSG 2017 Conference Breakout - What does it mean to be a competent bibliomet...
 
Hoffman apr20-7
Hoffman apr20-7Hoffman apr20-7
Hoffman apr20-7
 
LibGuiding the way - Northern Collaboration 2017 Conference
LibGuiding the way - Northern Collaboration 2017 ConferenceLibGuiding the way - Northern Collaboration 2017 Conference
LibGuiding the way - Northern Collaboration 2017 Conference
 
101 Uses For Autolib
101 Uses For Autolib101 Uses For Autolib
101 Uses For Autolib
 
From Bean Counting to Adding Value: Using Statistics to Transform Services
From Bean Counting to Adding Value: Using Statistics to Transform ServicesFrom Bean Counting to Adding Value: Using Statistics to Transform Services
From Bean Counting to Adding Value: Using Statistics to Transform Services
 
The Case for Power Librarianship
The Case for Power LibrarianshipThe Case for Power Librarianship
The Case for Power Librarianship
 
Creating Alliances: Inside and Out
Creating Alliances: Inside and OutCreating Alliances: Inside and Out
Creating Alliances: Inside and Out
 
The School Librarian Effectiveness Instrument: Now In Action!
The School Librarian Effectiveness Instrument: Now In Action!The School Librarian Effectiveness Instrument: Now In Action!
The School Librarian Effectiveness Instrument: Now In Action!
 
Reaching Out To Work Together
Reaching Out To Work TogetherReaching Out To Work Together
Reaching Out To Work Together
 
The case for learning analytics - Jisc Digifest 2016
The case for learning analytics - Jisc Digifest 2016The case for learning analytics - Jisc Digifest 2016
The case for learning analytics - Jisc Digifest 2016
 
Embracing Undergraduate Research; Creating the 'Arsenal'
Embracing Undergraduate Research; Creating the 'Arsenal'Embracing Undergraduate Research; Creating the 'Arsenal'
Embracing Undergraduate Research; Creating the 'Arsenal'
 
Implementing analytics - Rob Wyn Jones, Shri Footring and Rebecca Davies
Implementing analytics - Rob Wyn Jones, Shri Footring and Rebecca DaviesImplementing analytics - Rob Wyn Jones, Shri Footring and Rebecca Davies
Implementing analytics - Rob Wyn Jones, Shri Footring and Rebecca Davies
 

Similar to Stephens "Planning, Managing, and Assessing Library Needs During COVID-19"

Vts Lilac 09
Vts Lilac 09Vts Lilac 09
Vts Lilac 09
Intute
 
Cainet Meeting August 20 2014 (2).pptx
Cainet Meeting August 20 2014 (2).pptxCainet Meeting August 20 2014 (2).pptx
Cainet Meeting August 20 2014 (2).pptx
Yosef Gamble
 
Library as Publisher: New Publishing Ecosystems
Library as Publisher: New Publishing Ecosystems Library as Publisher: New Publishing Ecosystems
Library as Publisher: New Publishing Ecosystems
John Warren
 
MTL Presentation to TWP committee 2016_final May 24, 2016
MTL Presentation to TWP committee 2016_final May 24, 2016MTL Presentation to TWP committee 2016_final May 24, 2016
MTL Presentation to TWP committee 2016_final May 24, 2016
Bonnie Mangold
 

Similar to Stephens "Planning, Managing, and Assessing Library Needs During COVID-19" (20)

Vts Lilac 09
Vts Lilac 09Vts Lilac 09
Vts Lilac 09
 
BOT 3 Oct.pptx
BOT 3 Oct.pptxBOT 3 Oct.pptx
BOT 3 Oct.pptx
 
Buying and decision making behaviour of a student while selecting a college.
Buying and decision making behaviour of a student while selecting a college.�Buying and decision making behaviour of a student while selecting a college.�
Buying and decision making behaviour of a student while selecting a college.
 
Cainet Meeting August 20 2014 (2).pptx
Cainet Meeting August 20 2014 (2).pptxCainet Meeting August 20 2014 (2).pptx
Cainet Meeting August 20 2014 (2).pptx
 
THE IMPACT OF ELECTRONIC WORD OF MOUTH ON TOURISTS’ INTENTION OF DESTINATION ...
THE IMPACT OF ELECTRONIC WORD OF MOUTH ON TOURISTS’ INTENTION OF DESTINATION ...THE IMPACT OF ELECTRONIC WORD OF MOUTH ON TOURISTS’ INTENTION OF DESTINATION ...
THE IMPACT OF ELECTRONIC WORD OF MOUTH ON TOURISTS’ INTENTION OF DESTINATION ...
 
Teaching internet research skills - new directions for the Intute: Virtual Tr...
Teaching internet research skills - new directions for the Intute: Virtual Tr...Teaching internet research skills - new directions for the Intute: Virtual Tr...
Teaching internet research skills - new directions for the Intute: Virtual Tr...
 
But Were We Successful: Using Online Asynchronous Focus Groups to Evaluate Li...
But Were We Successful: Using Online Asynchronous Focus Groups to Evaluate Li...But Were We Successful: Using Online Asynchronous Focus Groups to Evaluate Li...
But Were We Successful: Using Online Asynchronous Focus Groups to Evaluate Li...
 
Budgets, Services, and Technology Driving Change: How Librarians, Publishers ...
Budgets, Services, and Technology Driving Change: How Librarians, Publishers ...Budgets, Services, and Technology Driving Change: How Librarians, Publishers ...
Budgets, Services, and Technology Driving Change: How Librarians, Publishers ...
 
Advancing the National Digital Platform: Survey Findings
Advancing the National Digital Platform: Survey FindingsAdvancing the National Digital Platform: Survey Findings
Advancing the National Digital Platform: Survey Findings
 
Advancing the National Digital Platform: Survey Findings
Advancing the National Digital Platform: Survey FindingsAdvancing the National Digital Platform: Survey Findings
Advancing the National Digital Platform: Survey Findings
 
Bridging the Gap: Providing Equal Access of Library Resources and Services to...
Bridging the Gap: Providing Equal Access of Library Resources and Services to...Bridging the Gap: Providing Equal Access of Library Resources and Services to...
Bridging the Gap: Providing Equal Access of Library Resources and Services to...
 
Hiller and Kyrillidou, "Measuring Use, Assessing Success, Part One: Measure, ...
Hiller and Kyrillidou, "Measuring Use, Assessing Success, Part One: Measure, ...Hiller and Kyrillidou, "Measuring Use, Assessing Success, Part One: Measure, ...
Hiller and Kyrillidou, "Measuring Use, Assessing Success, Part One: Measure, ...
 
Big Talk From Small Libraries 2018: Small Data Can Still Be Smart Data: How O...
Big Talk From Small Libraries 2018: Small Data Can Still Be Smart Data: How O...Big Talk From Small Libraries 2018: Small Data Can Still Be Smart Data: How O...
Big Talk From Small Libraries 2018: Small Data Can Still Be Smart Data: How O...
 
MN libraries and Broadband
MN libraries and Broadband MN libraries and Broadband
MN libraries and Broadband
 
Library as Publisher: New Publishing Ecosystems
Library as Publisher: New Publishing Ecosystems Library as Publisher: New Publishing Ecosystems
Library as Publisher: New Publishing Ecosystems
 
Brantford pl (2)
Brantford pl (2)Brantford pl (2)
Brantford pl (2)
 
Why students use university libraries and what they use them for
Why students use university libraries and what they use them forWhy students use university libraries and what they use them for
Why students use university libraries and what they use them for
 
Leveraging data driven decision making to drive student success, retention, a...
Leveraging data driven decision making to drive student success, retention, a...Leveraging data driven decision making to drive student success, retention, a...
Leveraging data driven decision making to drive student success, retention, a...
 
PatrickCarr_CollaboratingtoAnalyze
PatrickCarr_CollaboratingtoAnalyzePatrickCarr_CollaboratingtoAnalyze
PatrickCarr_CollaboratingtoAnalyze
 
MTL Presentation to TWP committee 2016_final May 24, 2016
MTL Presentation to TWP committee 2016_final May 24, 2016MTL Presentation to TWP committee 2016_final May 24, 2016
MTL Presentation to TWP committee 2016_final May 24, 2016
 

More from National Information Standards Organization (NISO)

More from National Information Standards Organization (NISO) (20)

Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
Mattingly "AI & Prompt Design: Structured Data, Assistants, & RAG"
 
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"Mattingly "AI & Prompt Design: The Basics of Prompt Design"
Mattingly "AI & Prompt Design: The Basics of Prompt Design"
 
Bazargan "NISO Webinar, Sustainability in Publishing"
Bazargan "NISO Webinar, Sustainability in Publishing"Bazargan "NISO Webinar, Sustainability in Publishing"
Bazargan "NISO Webinar, Sustainability in Publishing"
 
Rapple "Scholarly Communications and the Sustainable Development Goals"
Rapple "Scholarly Communications and the Sustainable Development Goals"Rapple "Scholarly Communications and the Sustainable Development Goals"
Rapple "Scholarly Communications and the Sustainable Development Goals"
 
Compton "NISO Webinar, Sustainability in Publishing"
Compton "NISO Webinar, Sustainability in Publishing"Compton "NISO Webinar, Sustainability in Publishing"
Compton "NISO Webinar, Sustainability in Publishing"
 
Mattingly "AI & Prompt Design: Large Language Models"
Mattingly "AI & Prompt Design: Large Language Models"Mattingly "AI & Prompt Design: Large Language Models"
Mattingly "AI & Prompt Design: Large Language Models"
 
Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...
Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...
Hazen, Morse, and Varnum "Spring 2024 ODI Conformance Statement Workshop for ...
 
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
Mattingly "AI & Prompt Design" - Introduction to Machine Learning"
 
Mattingly "Text and Data Mining: Building Data Driven Applications"
Mattingly "Text and Data Mining: Building Data Driven Applications"Mattingly "Text and Data Mining: Building Data Driven Applications"
Mattingly "Text and Data Mining: Building Data Driven Applications"
 
Mattingly "Text and Data Mining: Searching Vectors"
Mattingly "Text and Data Mining: Searching Vectors"Mattingly "Text and Data Mining: Searching Vectors"
Mattingly "Text and Data Mining: Searching Vectors"
 
Mattingly "Text Mining Techniques"
Mattingly "Text Mining Techniques"Mattingly "Text Mining Techniques"
Mattingly "Text Mining Techniques"
 
Mattingly "Text Processing for Library Data: Representing Text as Data"
Mattingly "Text Processing for Library Data: Representing Text as Data"Mattingly "Text Processing for Library Data: Representing Text as Data"
Mattingly "Text Processing for Library Data: Representing Text as Data"
 
Carpenter "Designing NISO's New Strategic Plan: 2023-2026"
Carpenter "Designing NISO's New Strategic Plan: 2023-2026"Carpenter "Designing NISO's New Strategic Plan: 2023-2026"
Carpenter "Designing NISO's New Strategic Plan: 2023-2026"
 
Ross and Clark "Strategic Planning"
Ross and Clark "Strategic Planning"Ross and Clark "Strategic Planning"
Ross and Clark "Strategic Planning"
 
Mattingly "Data Mining Techniques: Classification and Clustering"
Mattingly "Data Mining Techniques: Classification and Clustering"Mattingly "Data Mining Techniques: Classification and Clustering"
Mattingly "Data Mining Techniques: Classification and Clustering"
 
Straza "Global collaboration towards equitable and open science: UNESCO Recom...
Straza "Global collaboration towards equitable and open science: UNESCO Recom...Straza "Global collaboration towards equitable and open science: UNESCO Recom...
Straza "Global collaboration towards equitable and open science: UNESCO Recom...
 
Lippincott "Beyond access: Accelerating discovery and increasing trust throug...
Lippincott "Beyond access: Accelerating discovery and increasing trust throug...Lippincott "Beyond access: Accelerating discovery and increasing trust throug...
Lippincott "Beyond access: Accelerating discovery and increasing trust throug...
 
Kriegsman "Integrating Open and Equitable Research into Open Science"
Kriegsman "Integrating Open and Equitable Research into Open Science"Kriegsman "Integrating Open and Equitable Research into Open Science"
Kriegsman "Integrating Open and Equitable Research into Open Science"
 
Mattingly "Ethics and Cleaning Data"
Mattingly "Ethics and Cleaning Data"Mattingly "Ethics and Cleaning Data"
Mattingly "Ethics and Cleaning Data"
 
Mercado-Lara "Open & Equitable Program"
Mercado-Lara "Open & Equitable Program"Mercado-Lara "Open & Equitable Program"
Mercado-Lara "Open & Equitable Program"
 

Recently uploaded

Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
ciinovamais
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
MateoGardella
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
MateoGardella
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
kauryashika82
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
Chris Hunter
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdf
SanaAli374401
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
PECB
 

Recently uploaded (20)

Holdier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdfHoldier Curriculum Vitae (April 2024).pdf
Holdier Curriculum Vitae (April 2024).pdf
 
PROCESS RECORDING FORMAT.docx
PROCESS      RECORDING        FORMAT.docxPROCESS      RECORDING        FORMAT.docx
PROCESS RECORDING FORMAT.docx
 
Unit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptxUnit-IV; Professional Sales Representative (PSR).pptx
Unit-IV; Professional Sales Representative (PSR).pptx
 
Class 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdfClass 11th Physics NEET formula sheet pdf
Class 11th Physics NEET formula sheet pdf
 
Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.Gardella_Mateo_IntellectualProperty.pdf.
Gardella_Mateo_IntellectualProperty.pdf.
 
Gardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch LetterGardella_PRCampaignConclusion Pitch Letter
Gardella_PRCampaignConclusion Pitch Letter
 
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
Ecological Succession. ( ECOSYSTEM, B. Pharmacy, 1st Year, Sem-II, Environmen...
 
Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17Advanced Views - Calendar View in Odoo 17
Advanced Views - Calendar View in Odoo 17
 
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in DelhiRussian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
Russian Escort Service in Delhi 11k Hotel Foreigner Russian Call Girls in Delhi
 
Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..Sports & Fitness Value Added Course FY..
Sports & Fitness Value Added Course FY..
 
Making and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdfMaking and Justifying Mathematical Decisions.pdf
Making and Justifying Mathematical Decisions.pdf
 
How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17How to Give a Domain for a Field in Odoo 17
How to Give a Domain for a Field in Odoo 17
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
An Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdfAn Overview of Mutual Funds Bcom Project.pdf
An Overview of Mutual Funds Bcom Project.pdf
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Beyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global ImpactBeyond the EU: DORA and NIS 2 Directive's Global Impact
Beyond the EU: DORA and NIS 2 Directive's Global Impact
 
Key note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdfKey note speaker Neum_Admir Softic_ENG.pdf
Key note speaker Neum_Admir Softic_ENG.pdf
 
Unit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptxUnit-V; Pricing (Pharma Marketing Management).pptx
Unit-V; Pricing (Pharma Marketing Management).pptx
 

Stephens "Planning, Managing, and Assessing Library Needs During COVID-19"

  • 1. Assessment Practices and Metrics in a 21st Century Pandemic Thursday, October 9, 2020 10:15 a.m. CT Denise Stephens Vice Provost and University Librarian
  • 2. Libraries’ Assessment Practices Describe Value to Mission – NOT Return on Investment. • Essential to capture effectiveness • Identifies areas for improvement • Opportunity to discuss performance • What did we do well? • What could we have done differently? Washington University Libraries
  • 3. COVID: Pivoting to Meet User Needs Washington University Libraries • Assessments & Metrics that Document the Impacts • eBook purchases • EZ Proxy (off-campus) access • Individual Interactions - Virtual • Ask Us - Chats • Technology for remote work • Curbside Pickup
  • 4. The response to COVID impacts and reshapes a number of services. • How do these adaptations influence our assessment programming? COVID-19 Resources Buildings and Access Remote Resources Curbside Pickup Interlibrary Loan and MOBIUS Materials and Services Returns Instruction and Consultations
  • 5. Washington University Libraries eBooks purchased 2019 2020 % change March 51 127 149.0% April 86 147 70.9% May 101 539 433.7% June 11 32 190.9% Total: 249 845 239.4%
  • 6. Washington University Libraries EZ Proxy (off-campus access) 2019 2020 % change March 25,363 32,580 28.5% April 28,628 55,980 95.5% May 19,222 34,266 78.3% June 18,578 28,115 51.3% July 18,169 28,421 56.4% August 20,603 27,031 31.2% September 27,391 37,609 37.3% Total: 157,954 244,002 54.5%
  • 7. Washington University Libraries Individual Interactions – Virtual 2019 2020 % change Transactions Reference Consultations Transactions Reference Consultations Transactions Reference Consultations March 154 83 261 385 69.5% 363.9% April 140 114 266 458 90.0% 301.8% May 92 55 204 171 121.7% 210.9% June 103 64 280 223 171.8% 248.4% July 128 123 178 232 39.1% 88.6% August 133 148 269 269 102.3% 81.8% September 160 150 319 226 99.4% 50.7% Total: 910 737 1777 1964 95.3% 166.5% Grand Total: 1647 3741 127.1%
  • 8. Washington University Libraries Ask Us – Chats 2019 2020 % change March 155 176 13.5% April 233 211 -9.4% May 96 125 30.2% June 94 136 44.7% July 93 238* 155.9% August 128 334* 160.9% September 173 558* 222.5% Total: 972 1778 82.9% *Switched to 24/7 chat in July. This number includes chats answered by co-op operators.
  • 9. Washington University Libraries Ask Us – Tickets/Emails 2019 2020 % change March 166 253 52.4% April 252 299 18.7% May 139 294 111.5% June 134 323 141.0% July 133 281 111.3% August 205 356 73.7% September 218 553 153.7% TOTAL 1247 2359 89.2%
  • 10. Washington University Libraries Curbside Pickup June 235 pickups July 377 pickups August 280 pickups September 928 pickups
  • 11. COVID Opens Opportunity to Assess Crisis Value of Response Outcomes • We can identify and measure how stakeholders adopt and value the iterative changes made to deliver Libraries’ services under a protracted period of alternative operations due to COVID. Washington University Libraries
  • 12. Assessment & Analytics Programming Integrates COVID Services Adaptations into the Framework for Libraries Washington University Libraries • Supports development & implementation of strategic assessment framework • Coordinates assessment activities • Develops recommendations for improve metrics • Advises on assessment tools • Provides advisory to how data impacts strategy • Organizes data collection activities
  • 13. Assessment & Analytics Programming Washington University Libraries • Determines: • Methods of collecting data • Communication methods • Creating timelines and protocols
  • 14. Assessing the Libraries’ Impact on Institutional COVID Planning & Response • New Collaborations/Partnerships • Shared Expertise • Iterative Uses of Space and Infrastructure • Emergent Strategies for Content Delivery and Creation Washington University Libraries
  • 15. With Increased Visibility, How to Understand & Assess the Outcomes? • How can we capture the relationship between emergent outcomes compared to pre-COVID conditions? • How does the response impact equity while increasing access and delivering reliance on technology? • How do stakeholders perceive the efficacy and value of services impacted by COVID conditions? Washington University Libraries
  • 16. With Increased Visibility, How to Understand & Assess the Outcomes? • How to capture and evaluate potentially transformative change that may persist beyond COVID? • Which future metrics may be necessary to effectively understand Value post-COVID? Washington University Libraries

Editor's Notes

  1. Maintaining Access to Our Collections In March, the Washington University Libraries entered alternate operations, with staff working remotely and our libraries closed, removing access to our physical collections. The University Libraries worked to maintain e-resource-based ILL and reserves activity, expanded available e-content, and participated in HathiTrust’s Emergency Temporary Access Service, providing access to digital surrogates of almost 50% of our print titles. Due dates for existing loans were extended to September 1.
  2. Some of the services that increased during this time included purchasing more eBooks (239.4% increase)
  3. supporting EZ Proxy for off-campus access to databases and other resources (54.5% increase)
  4. remote support of users including virtual transactions and reference consultations (127.1% increase)
  5. Subject librarians have provided additional support via chat (82.9% increase)
  6. tickets/emails sent to our staff working remotely (89.2% increase).
  7. Contact-free curbside pickup, by appointment.
  8. Washington University’s Assessment and Analytics Committee: Supports the development and implementation of a strategic assessment framework that monitors the performance of the organization and communicates the accomplishments of the strategic objectives in collaboration with the ULC. Coordinates various assessment activities across various committees and working groups such as the Web Committee, Space Assessment Activities, Instruction related activities, etc. Develops recommendations for improvements in the user experience across physical and digital environments, collections, and services. Advises on the selection and implementation of appropriate assessment tools and services. Provides timely advisory to how the organization’s data might have impacts for strategic and operational activity Organizes all data collection activities across the organization in a visible and easily accessible manner with the development of dashboards and user-friendly interfaces and processes.
  9. Decision-making authority: The committee will make decisions regarding methods for collecting data; Communication methods and engagement with relevant, authorized internal and external stakeholders for applicable data collection and reporting; Creating timelines and protocols. Major decisions and recommendations with organization wide impact will be submitted to ULC for review and approval.