This document discusses the evolution of research assessment and reviews globally and nationally over time. It outlines key assessment frameworks used in the UK, New Zealand, Australia and other countries from the 1980s to present day. These frameworks typically involve peer review of research outputs and environments or bibliometric analysis. The document also examines the roles and relationships between universities, researchers, research funders, and librarians in the research process and assessment. It envisions an expanded future role for librarians beyond traditional services.

1. The Big Picture
3 June 2015
Keith Webster
Dean of University Libraries
@cmkeithw
www.libraryofthefuture.org

2. @cmkeithw

3. We
do
not
do
everything,
but
at
what
we
do
we
aim
to
be
the
best
in
the
world.

6. Timeline
1986 1992
RAE RAE
1996
RAE

7. 2002 2006 2007
RAE
2003
PBRF PBRF
2004

8. 2010 2012 2014
REFPBRFERA
ERA
RAE
2008

10. THE
RESEARCH
WORLD

11. PATHWAY

13. ASSESSMENT AND REVIEW

15. NATIONAL/GLOBAL ASSESSMENT

17. Assessment was by means of informed peer review by a
number of specialist panels, drawing on information provided
by HEIs. (UK Research Assessment Exercise 1992)
The Quality Evaluation process rests on the submission and
evaluation of Evidence Portfolios (EPs). Specialist peer-review
panels, assess and evaluate EPs. (NZ Performance Based
Research Fund)

18. ERA uses a number of bibliometric
tools for the citation analysis
indicators. Two broad types of
citation analysis are used in ERA:
Relative Citation Impact (RCI) and
the distribution of publications
based on comparisons with field-
specific benchmarks.
REF will assess universities on the
basis of the quality of research
outputs, the vitality of the research
environment and the wider impact
of research.

20. Our research influence
indicator is the flagship.
Weighted at 30 per cent of
the overall score, it is the
single most influential of the
13 indicators.
We examine research
influence by capturing the
number of times a
university's published work
is cited by scholars
globally.

21. RESEARCH FUNDERS

22. Aims of research funders
• Broader Economic Benefits
• Health and Health Sector
Benefits
• Informing Policy or Product
Development
• Knowledge Production
• Research Targeting,
Capacity Building
• Build National Infrastructure

24. http://scimaps.org/mapdetail/chemical_rd_powers_t_89

27. UNIVERSITIES

28. http://www.mis.admin.uq.edu.au/Content/Dashboards/GroupofEightExecutiveDashboard/Research.aspx

29. Resource allocation
EAB Optimizing Institutional Budget Models 2014

34. RESEARCHERS

40. RESOURCE DISCOVERY

48. From Information to Knowledge:
Identify the Rising Stars of Tomorrow
He performed very
well since 2002 (after
he joins I2R)!!!

50. THE SCHOLARLY RECORD

51. http://figshare.com/articles/101_Innovations_in_Scholarly_Communication_the_Changing_Research_Workflow/1286826

52. Traditional workflow
All of these tools licensed by institution

53. Open Science
All of these tools accessible by researcher

63. THE LIBRARIAN

64. The role of librarians
Current state
Many libraries retain large
numbers of librarians to catalogue
and count
Even more librarians wait at
service desks ‘just in case’
Few librarians leave the library
building
Future state
Librarians embedded in research
and teaching activities
Librarians become campus
specialists in areas such as e-
science, academic technology and
research evaluation
Librarians have meaningful impact
Current barriers
Many librarians lack skills and useful qualifications
Many librarians are resistant to change
Academics do not believe librarians are useful or credible
partners

67. SUCCESS

75. uqkeithw
Keith Webster
k.webster@library.uq.edu.au
kgw@cmu.edu
cmkeithw
Keith Webster
cmkeithw