Choosing the Right CBSE School A Comprehensive Guide for Parents
Open research in REF 2021 - Claire Fraser
1. Open research in REF 2021
Claire Fraser
Senior Policy Adviser, Research England
26 June 2018
2. The Research Excellence Framework (REF)
2021 and open research
Overall quality
Outputs
Outputs required
Impact
Impact case studies
Environment
Environment data
and template
60% 25% 15%
To be eligible for
assessment journal
articles and conference
contributions must be
deposited and available
OA
‘Within the context of the
institution’s strategy, how
the submitting unit is
progressing towards an
open research
environment, including
where this goes above
and beyond the REF open
access policy
requirements, and wider
activity to encourage the
effective sharing and
management of research
data, as appropriate to
the discipline’
3. REF policy compliance
• For the 1st year of the policy (1
April 2016 – 31 March 2017):
• 61% of eligible outputs meet the
full policy requirements
• 20% of outputs have exceptions
• 86% of exceptions are the deposit
exception for ‘gold’
• 19% do not meet requirements
Research England (2018) Monitoring sector progress towards compliance with funder open access policies https://re.ukri.org/news-events-publications/publications/monitoring-sector-progress-towards-compliance-
with-funder-open-access-policies/
4. REF policy compliance
• 19% of outputs are not meeting the
REF 2021 policy requirements/have an
exception
• outputs already determined as not being
submitted for assessment
• disciplinary differences
• institutional approaches
• tools
• Varied compliance across HEIs
Research England (2018) Monitoring sector progress towards compliance with funder open access policies https://re.ukri.org/news-events-publications/publications/monitoring-sector-progress-towards-compliance-
with-funder-open-access-policies/
6. REF 2021 Guidance on submissions
• The draft guidance clarifies aspects of the policy, but does not change the
key requirements
• We are not consulting on the open access policy requirements
• We welcome consultation responses about the clarity of the guidance
provided (Q2 and Q8) by noon on 15 October
7. REF 2021 open access flexibility
• For each submission, a maximum of five per cent of in-scope outputs that
do not meet the policy requirement or do not have an exception applied
can be submitted (additional flexibility)
• Exceptions to the policy
• Pre-prints:
• the ‘accepted for publication’ text, or near final version, is available on the pre-print
service
• the output upload date of the pre-print is prior to the date of output publication
8. Next steps
• REF 2021
• REF 2021 Guidance on submissions published in winter 2018-2019
• Audit procedures 2019
• UKRI Review
• A policy for UK Research and Innovation
• REF 202X
• OA monographs policy development
• Broader context
Increased open access to research is resulting from considerable effort on the part of researchers, libraries, research offices
Met, or expected to meet the requirements.. Half of institutions surveyed indicated that 56 to 82 per cent of in-scope outputs are expected to meet REF 2021 OA requirements. That the highest and lowest values are 100 and 32 per cent respectively demonstrates varying institutional progress. Both measures of central tendency in this category fall around 69 per cent.
b. Outputs with a known exception. Half of institutions surveyed are reporting that five to 22 per cent of in-scope outputs are known to have an exception attributed. 26 Responses here are skewed towards lower values, reflected by a difference in the mean and median values, with the median number of in-scope outputs with an attributed exception being 10 per cent. While lying within an expected range, one institution reported that 55 per cent of outputs have a known exception.
c. Do not meet the requirements and not known to be covered by an exception. Half of institutions surveyed reported that eight to 20 per cent (a narrower range than previously) of in-scope outputs neither meet the OA requirements nor are covered by an exception. Responses are skewed to lower values of non-compliant outputs, reflected in a slightly lower median than mean value. Three outliers are present beyond the uppermost expected range of values (43 per cent).
REF aims to assess excellent research
REF OA policy is not there to catch institutions out
Intent and ‘rules’
The REF2021 draft guidance on submissions has been published today. The REF2021 open access policy is included in this document, and is provided in the following sections:
Paragraphs 107 – 116 REF2021 Open Access policy intent
Paragraphs 213 – 245 REF2021 Open Access policy guidance
It can be found at: http://www.ref.ac.uk/publications/2018/draftguidanceonsubmissions201801.html
The draft guidance clarifies aspects of the policy, but does not change the key requirements.
HEFCE pages will be archived. Once the final guidance on submissions is published, the research England webapges will point to this.
Gold, other, and three months after publication 1 April 2016 – 1 April 2018.