SlideShare a Scribd company logo
1 of 112
Download to read offline
Excellence is Bullshit:
Rethinking Research Evaluation for a Networked World
@cameronneylon
http://orcid.org/0000-0002-0068-716X
“[The purpose of bullshit] is to
impress the listener and the reader
with words that communicate that
[…]something is being or has been
done, words that are neither true
nor false, and so obscure the facts of
the matter being discussed”
Harry Frankfurt
“[The purpose of bullshit] is to
impress the listener and the reader
with words that communicate that
[…]something is being or has been
done, words that are neither true
nor false, and so obscure the facts of
the matter being discussed”
Wikipedia
“[The purpose of bullshit] is to
impress the listener and the reader
with words that communicate that
[…]something is being or has been
done, words that are neither true
nor false, and so obscure the facts of
the matter being discussed”
Wikipedia
“[The purpose of bullshit] is to
impress the listener and the reader
with words that communicate that
[…]something is being or has been
done, words that are neither true
nor false, and so obscure the facts of
the matter being discussed”
Wikipedia
“[The purpose of bullshit] is to
impress the listener and the reader
with words that communicate that
[…]something is being or has been
done, words that are neither true
nor false, and so obscure the facts of
the matter being discussed”
Wikipedia
“[The purpose of bullshit] is to
impress the listener and the reader
with words that communicate that
[…]something is being or has been
done, words that are neither true
nor false, and so obscure the facts of
the matter that should be discussed”
My work is excellent…
This talk is excellent…
“[…a] commitment
to excellence and
advancement on merit”
“[…a] commitment
to excellence and
advancement on merit”
University College London
“[…a] commitment
to excellence and
advancement on merit”
University College London
What do we mean when we use the word…
“excellence”?
Pursuit of excellence:
We strive
for excellence, seeking
to apply the highest
standards to benefit…
University of Queensland
The university pursues
academic excellence
through the creation,
preservation…
University of San Diego
…to strive
for excellence and
distinction…
Curtin University
We prize excellence
Cape Peninsula
University of Technology
We demand excellence
University of Westminster
…with world-
class excellence
across all of its
departments
Princeton
As a world-leading centre of
academic excellence we aim…
University of Edinburgh
The university counts the diversity of
its community as […] integral to its
mission of excellence, and it is
committed to diversity and
inclusiveness in both educational…
University of Maryland
“[…a] commitment
to excellence and
advancement on merit…
Fairness and equality…
Diversity University College London
excellence in…?
excellence in professionally
relevant teaching
University of Westminster
excellence in research
and education
Indiana University
excellence in research,
education and knowledge
exchange
Strathclyde University
excellence in teaching,
research, and public
engagement
Cornell University
…a center of
excellence for cultural,
athletic and other events
University of Toledo
…internationally recognized
excellence in information
technology services and
infrastructure.
Indiana University
What do we mean when we use the word…
“excellence”?
How can we determine or measure…
“excellence”?
We prize
academic excellence at UC Davis.
More than 500 of our faculty have
earned prestigious [..] honors[..]
rank[ings]. UC Davis
Pursuing excellence means being
satisfied with no less than the
highest goals we can envision.
University of Missouri
Pursuing excellence involves being
informed by regional, national and
global standards, as well as our
personal expectations. University of Missouri
“excellence” is the holy
grail of academic life
Michèle Lamont
How Professors Think
excellence is produced and
defined in a multitude of sites
and by an array of actors
Michèle Lamont
How Professors Think
excellence is produced and
defined in a multitude of sites
and by an array of actors
Michèle Lamont
How Professors Think
excellence is produced and
defined in a multitude of sites
and by an array of actors
Michèle Lamont
How Professors Think
excellence is produced and
defined in a multitude of sites
and by an array of actors
Michèle Lamont
How Professors Think
“excellence” tells us nothing
about how important the science is
and everything about who decides.
Jack Stilgoe
Against Excellence
Using the word
excellence
is a way of avoiding
a difficult conversation
Using the word
excellence
is a way of saying
something is being or
has been done
Using the word
excellence
is a way of using words
that are neither true
nor false
Using the word
excellence
is a way of obscuring
the facts of the matter
that should be discussed
Using the word
excellence
is a way of
bullshitting ourselves
Using the word
excellence
is a way of avoiding
talking about values
Impact
Research
Economic
Cultural
Education
Health
Environment
Impact
Research
Economic
Cultural
Education
Health
Environment
excellence
Impact
Research
Economic
Cultural
Education
Health
Environment
Impact
Research
Economic
Cultural
Education
Health
Environment
impact
Impact
Research
Economic
Cultural
Education
Health
Environment
quality
Impact
Research
Economic
Cultural
Education
Health
Environment
innovation
Impact
Research
Economic
Cultural
Education
Health
Environment
Impact
Research
Economic
Cultural
Education
Health
Environment
Impact
Research
Economic
Cultural
Education
Health
Environment
Impact
Research
Economic
Cultural
Education
Health
Environment
Impact
evaluation
…what we may be doing […]
when we make [a] value
judgement of a […] work...
Barbara Herrnstein Smith
Contingencies of Value
…articulating an estimate of
how well that work will serve
implicitly defined functions…
Barbara Herrnstein Smith
Contingencies of Value
…for an
implicitly defined audience…
Barbara Herrnstein Smith
Contingencies of Value
…experiencing the work under
implicitly defined conditions…
Barbara Herrnstein Smith
Contingencies of Value
…the work
of evaluation is to make these
implicit factors explicit.
Impact
Research
Economic
Cultural
Education
Health
Environment
Impact
There is some good news…
http://www.flickr.com/photos/verzo/8020565592/ CC	
  BY
https://www.flickr.com/photos/see-­‐through-­‐the-­‐eye-­‐of-­‐g/5392290809	
  CC	
  BY
https://www.flickr.com/photos/jenny-­‐pics/3239638494	
  CC	
  BY
Citation
Bookmark
Citation
Bookmark
Citation
Social	
  media
conversation
Bookmark
Citation
Previous	
  
co-­‐authorship
Conference
co-­‐attendance
Social	
  media
conversation
Impact
There is some bad news…
Impact
“excellence” becomes a performance
Impact
…performance of
“excellence”
Impact
…in the place of
excellent performance
“[…a] commitment
to excellence and
advancement on merit…
Fairness and equality…
Diversity University College London
Impact
Change the narrative…
Impact
“soundness”
Impact
“practice”
“social practice”
Impact
Impact
Answers are easy…
Impact
…it’s the questions that are hard
Impact
How do we evaluate whether we are
“achieving maximum positive social,
environmental and economic
benefit”?
Impact
How do we evaluate whether we are
“[d]eveloping future generations of
leaders in scholarship, research, the
learned professions, the public sector,
business and innovation”?
Impact
How do we hold ourselves to values of
“fairness and equality, diversity,
collegiality and community-building,
inclusiveness, openness, ethically
acceptable standards of conduct…”
@cameronneylon
http://orcid.org/0000-0002-0068-716X
Slides: https://t.co/vNkQ9ZMhwm
Excellence is Bullshit

More Related Content

Similar to Excellence is Bullshit

Knowledge Sharing 2.0
Knowledge Sharing 2.0Knowledge Sharing 2.0
Knowledge Sharing 2.0
UNU-ViE
 
Plagarism + Turnitin Bus Induction Feb 2010
Plagarism + Turnitin   Bus Induction Feb 2010Plagarism + Turnitin   Bus Induction Feb 2010
Plagarism + Turnitin Bus Induction Feb 2010
esyin
 

Similar to Excellence is Bullshit (20)

Grant, Thoughts on the need for continuous learning and reskilling in librari...
Grant, Thoughts on the need for continuous learning and reskilling in librari...Grant, Thoughts on the need for continuous learning and reskilling in librari...
Grant, Thoughts on the need for continuous learning and reskilling in librari...
 
Knowledge Sharing 2.0
Knowledge Sharing 2.0Knowledge Sharing 2.0
Knowledge Sharing 2.0
 
Sentinel Event Case Study
Sentinel Event Case StudySentinel Event Case Study
Sentinel Event Case Study
 
A Story of Hype and Hope: Breaking Free of the Technology Bungy
A Story of Hype and Hope: Breaking Free of the Technology BungyA Story of Hype and Hope: Breaking Free of the Technology Bungy
A Story of Hype and Hope: Breaking Free of the Technology Bungy
 
Fit For 21st Century
Fit For 21st CenturyFit For 21st Century
Fit For 21st Century
 
Imagining a Smithsonian Commons - Gilbane 2008 slides
Imagining a Smithsonian Commons - Gilbane 2008 slidesImagining a Smithsonian Commons - Gilbane 2008 slides
Imagining a Smithsonian Commons - Gilbane 2008 slides
 
Changing Face of Higher Education: How Online, Blended and Open Learning is C...
Changing Face of Higher Education: How Online, Blended and Open Learning is C...Changing Face of Higher Education: How Online, Blended and Open Learning is C...
Changing Face of Higher Education: How Online, Blended and Open Learning is C...
 
The Quality Challenge: An Inconvenient Truth About e-Learning
The Quality Challenge: An Inconvenient Truth About e-LearningThe Quality Challenge: An Inconvenient Truth About e-Learning
The Quality Challenge: An Inconvenient Truth About e-Learning
 
Top 5 Universities In The World.pdf
Top 5 Universities In The World.pdfTop 5 Universities In The World.pdf
Top 5 Universities In The World.pdf
 
Professor Mark Brown "Flipping Quality Teaching"
Professor Mark Brown "Flipping Quality Teaching"Professor Mark Brown "Flipping Quality Teaching"
Professor Mark Brown "Flipping Quality Teaching"
 
Flipping Quality Teaching: Licking, Tasting and Sustaining Innovation
Flipping Quality Teaching: Licking, Tasting and Sustaining InnovationFlipping Quality Teaching: Licking, Tasting and Sustaining Innovation
Flipping Quality Teaching: Licking, Tasting and Sustaining Innovation
 
Venturefest 2016 Cyber Security Innovation
Venturefest 2016 Cyber Security InnovationVenturefest 2016 Cyber Security Innovation
Venturefest 2016 Cyber Security Innovation
 
Michael Edson @ Potomac Forum: Relevance is in the Eyes of the Beholder
Michael Edson @ Potomac Forum: Relevance is in the Eyes of the BeholderMichael Edson @ Potomac Forum: Relevance is in the Eyes of the Beholder
Michael Edson @ Potomac Forum: Relevance is in the Eyes of the Beholder
 
A BOLD New Future: The Changing Face of University Education
A BOLD New Future: The Changing Face of University EducationA BOLD New Future: The Changing Face of University Education
A BOLD New Future: The Changing Face of University Education
 
I Need An Example Of A Reflective Journal In Thi
I Need An Example Of A Reflective Journal In ThiI Need An Example Of A Reflective Journal In Thi
I Need An Example Of A Reflective Journal In Thi
 
VRA 2009
VRA 2009VRA 2009
VRA 2009
 
The 10 best institutions for higher education in australia 2018
The 10 best institutions for higher education in australia 2018The 10 best institutions for higher education in australia 2018
The 10 best institutions for higher education in australia 2018
 
Plagarism + Turnitin Bus Induction Feb 2010
Plagarism + Turnitin   Bus Induction Feb 2010Plagarism + Turnitin   Bus Induction Feb 2010
Plagarism + Turnitin Bus Induction Feb 2010
 
Internationalising the Curriculum: Teaching and Learning for the Digital World
Internationalising the Curriculum: Teaching and Learning for the Digital WorldInternationalising the Curriculum: Teaching and Learning for the Digital World
Internationalising the Curriculum: Teaching and Learning for the Digital World
 
1 final rawson_alt-post_msu
1 final rawson_alt-post_msu1 final rawson_alt-post_msu
1 final rawson_alt-post_msu
 

More from Cameron Neylon

Will we still know ourselves? Identity and Community in a Transforming Knowle...
Will we still know ourselves? Identity and Community in a Transforming Knowle...Will we still know ourselves? Identity and Community in a Transforming Knowle...
Will we still know ourselves? Identity and Community in a Transforming Knowle...
Cameron Neylon
 
Beyond Open: Culture and Scaling in the Making of Knowledge
Beyond Open: Culture and Scaling in the Making of KnowledgeBeyond Open: Culture and Scaling in the Making of Knowledge
Beyond Open: Culture and Scaling in the Making of Knowledge
Cameron Neylon
 
Openness in Scholarship: A return to core values?
Openness in Scholarship: A return to core values?Openness in Scholarship: A return to core values?
Openness in Scholarship: A return to core values?
Cameron Neylon
 
No stories without evidence, no evidence without stories
No stories without evidence, no evidence without storiesNo stories without evidence, no evidence without stories
No stories without evidence, no evidence without stories
Cameron Neylon
 

More from Cameron Neylon (20)

OA Advocacy Today
OA Advocacy TodayOA Advocacy Today
OA Advocacy Today
 
Open Knowledge Institutions: Is there a future for the university in a networ...
Open Knowledge Institutions: Is there a future for the university in a networ...Open Knowledge Institutions: Is there a future for the university in a networ...
Open Knowledge Institutions: Is there a future for the university in a networ...
 
Network Enabled Research: Connectivity, groups and growth in the production o...
Network Enabled Research: Connectivity, groups and growth in the production o...Network Enabled Research: Connectivity, groups and growth in the production o...
Network Enabled Research: Connectivity, groups and growth in the production o...
 
Open Science Needs Open Indicators
Open Science Needs Open IndicatorsOpen Science Needs Open Indicators
Open Science Needs Open Indicators
 
The Power of Infrastructures and the Infrastructures of Power
The Power of Infrastructures and the Infrastructures of PowerThe Power of Infrastructures and the Infrastructures of Power
The Power of Infrastructures and the Infrastructures of Power
 
Will we still know ourselves? Identity and Community in a Transforming Knowle...
Will we still know ourselves? Identity and Community in a Transforming Knowle...Will we still know ourselves? Identity and Community in a Transforming Knowle...
Will we still know ourselves? Identity and Community in a Transforming Knowle...
 
Beyond Open: Culture and Scaling in the Making of Knowledge
Beyond Open: Culture and Scaling in the Making of KnowledgeBeyond Open: Culture and Scaling in the Making of Knowledge
Beyond Open: Culture and Scaling in the Making of Knowledge
 
From Cycles to Networks
From Cycles to NetworksFrom Cycles to Networks
From Cycles to Networks
 
Where next for Open Scholarship?
Where next for Open Scholarship?Where next for Open Scholarship?
Where next for Open Scholarship?
 
Openness in Scholarship: A return to core values?
Openness in Scholarship: A return to core values?Openness in Scholarship: A return to core values?
Openness in Scholarship: A return to core values?
 
Interpreting Shadows on the Elephant in the Room
Interpreting Shadows on the Elephant in the RoomInterpreting Shadows on the Elephant in the Room
Interpreting Shadows on the Elephant in the Room
 
Sustaining Scholarly Infrastructures through Collective Action: The lessons t...
Sustaining Scholarly Infrastructures through Collective Action: The lessons t...Sustaining Scholarly Infrastructures through Collective Action: The lessons t...
Sustaining Scholarly Infrastructures through Collective Action: The lessons t...
 
Sustainable Futures for Research Communication
Sustainable Futures for Research CommunicationSustainable Futures for Research Communication
Sustainable Futures for Research Communication
 
Warning
WarningWarning
Warning
 
Investing in Scholarly Futures
Investing in Scholarly FuturesInvesting in Scholarly Futures
Investing in Scholarly Futures
 
No stories without evidence, no evidence without stories
No stories without evidence, no evidence without storiesNo stories without evidence, no evidence without stories
No stories without evidence, no evidence without stories
 
From research life cycle to networks: The role of the library
From research life cycle to networks: The role of the libraryFrom research life cycle to networks: The role of the library
From research life cycle to networks: The role of the library
 
CENDI - Impact
CENDI - ImpactCENDI - Impact
CENDI - Impact
 
Project Credit - Overview and Summary
Project Credit - Overview and SummaryProject Credit - Overview and Summary
Project Credit - Overview and Summary
 
Real Choices, False Colors
Real Choices, False ColorsReal Choices, False Colors
Real Choices, False Colors
 

Recently uploaded

DIFFERENCE IN BACK CROSS AND TEST CROSS
DIFFERENCE IN  BACK CROSS AND TEST CROSSDIFFERENCE IN  BACK CROSS AND TEST CROSS
DIFFERENCE IN BACK CROSS AND TEST CROSS
LeenakshiTyagi
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Sérgio Sacani
 
Formation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksFormation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disks
Sérgio Sacani
 
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Lokesh Kothari
 
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
PirithiRaju
 
Disentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTDisentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOST
Sérgio Sacani
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
gindu3009
 

Recently uploaded (20)

Botany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdfBotany 4th semester file By Sumit Kumar yadav.pdf
Botany 4th semester file By Sumit Kumar yadav.pdf
 
CELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdfCELL -Structural and Functional unit of life.pdf
CELL -Structural and Functional unit of life.pdf
 
DIFFERENCE IN BACK CROSS AND TEST CROSS
DIFFERENCE IN  BACK CROSS AND TEST CROSSDIFFERENCE IN  BACK CROSS AND TEST CROSS
DIFFERENCE IN BACK CROSS AND TEST CROSS
 
Chemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdfChemistry 4th semester series (krishna).pdf
Chemistry 4th semester series (krishna).pdf
 
Nanoparticles synthesis and characterization​ ​
Nanoparticles synthesis and characterization​  ​Nanoparticles synthesis and characterization​  ​
Nanoparticles synthesis and characterization​ ​
 
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 bAsymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
Asymmetry in the atmosphere of the ultra-hot Jupiter WASP-76 b
 
Raman spectroscopy.pptx M Pharm, M Sc, Advanced Spectral Analysis
Raman spectroscopy.pptx M Pharm, M Sc, Advanced Spectral AnalysisRaman spectroscopy.pptx M Pharm, M Sc, Advanced Spectral Analysis
Raman spectroscopy.pptx M Pharm, M Sc, Advanced Spectral Analysis
 
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceuticsPulmonary drug delivery system M.pharm -2nd sem P'ceutics
Pulmonary drug delivery system M.pharm -2nd sem P'ceutics
 
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCR
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCRStunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCR
Stunning ➥8448380779▻ Call Girls In Panchshil Enclave Delhi NCR
 
Formation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disksFormation of low mass protostars and their circumstellar disks
Formation of low mass protostars and their circumstellar disks
 
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
TEST BANK For Radiologic Science for Technologists, 12th Edition by Stewart C...
 
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
PossibleEoarcheanRecordsoftheGeomagneticFieldPreservedintheIsuaSupracrustalBe...
 
GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)GBSN - Microbiology (Unit 2)
GBSN - Microbiology (Unit 2)
 
VIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C PVIRUSES structure and classification ppt by Dr.Prince C P
VIRUSES structure and classification ppt by Dr.Prince C P
 
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
Labelling Requirements and Label Claims for Dietary Supplements and Recommend...
 
GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)GBSN - Microbiology (Unit 1)
GBSN - Microbiology (Unit 1)
 
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdfPests of cotton_Sucking_Pests_Dr.UPR.pdf
Pests of cotton_Sucking_Pests_Dr.UPR.pdf
 
Disentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOSTDisentangling the origin of chemical differences using GHOST
Disentangling the origin of chemical differences using GHOST
 
Animal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptxAnimal Communication- Auditory and Visual.pptx
Animal Communication- Auditory and Visual.pptx
 
Presentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptxPresentation Vikram Lander by Vedansh Gupta.pptx
Presentation Vikram Lander by Vedansh Gupta.pptx
 

Excellence is Bullshit