Mattingly "AI & Prompt Design: Large Language Models"
Value-added services for the Wageningen Institutional Repository (WaY)
1. Value-added services for the Wageningen
Institutional Repository (WaY)
Wouter Gerritsma, WageningenUR Library
2. Outline
Our systems, metis and Wageningen Yield
Value added services
● Bibliomtrics
● Tenure track
Why in the library
OA @ Wageningen UR
3. Metis, a current research information
system - CRIS
Data entry system for the repository
4. Metis, a current research information
system - CRIS
Data entry system for the repository
Data entry by office managers at science groups
5. Metis, a current research information
system - CRIS
Data entry system for the repository
Data entry by office managers at science groups
Validation of records by library staff
● Uploading of the full text to the e-depot
● Maintenance of journal lists (peer reviewed or not)
● Maintenance of book publishers list
6. Metis, a current research information
system - CRIS
Data entry system for the repository
Data entry by office managers at science groups
Validation of records by library staff
● Uploading of the full text to the e-depot
● Maintenance of journal lists (peer reviewed or not)
● Maintenance of book publishers list
Compulsory data entry
● Peer reviews, evaluations and bonuses on the basis
of information available in metis
7. Wageningen Yield
Comprehensive bibliography of all WageningenUR output
● Since 1976 for university
● Since 1996 for the research institutes
8. Wageningen Yield
Comprehensive bibliography of all WageningenUR output
● Since 1976 for university
● Since 1996 for the research institutes
Contains 190,000 metadata records
9. Wageningen Yield
Comprehensive bibliography of all WageningenUR output
● Since 1976 for university
● Since 1996 for the research institutes
Contains 190,000 metadata records
Includes 40,000 Open Access full text items
10. Wageningen Yield
Comprehensive bibliography of all WageningenUR output
● Since 1976 for university
● Since 1996 for the research institutes
Contains 190,000 metadata records
Includes 40,000 Open Access full text items
Since 2003 fed by metis, currently some 100,000 records
11. Wageningen Yield
Comprehensive bibliography of all WageningenUR output
● Since 1976 for university
● Since 1996 for the research institutes
Contains 190,000 metadata records
Includes 40,000 Open Access full text items
Since 2003 fed by metis, currently some 100,000 records
Overnight WaY is synchronised with updates from metis
12. Wageningen Yield
Comprehensive bibliography of all WageningenUR output
● Since 1976 for university
● Since 1996 for the research institutes
Contains 190,000 metadata records
Includes 40,000 Open Access full text items
Since 2003 fed by metis, currently some 100,000 records
Each night WaY is synchronised with updates from metis
By far the largest OA repository in the Netherlands
13.
14. Value added services
Bibliometric reports for any unit of Wageningen UR at
any moments available
Since 2010 used for tenure track reports with respect to
publication credits
15. Evaluation cycle at universities
Supervised by VSNU/QANU
● 6 year cycle for external peer reviews
● After 3 years midterm review
● Unit of analysis (in Wageningen): Graduate schools
Citation analyses are not stipulated in the current
Standard Evaluation Protocol. They have become
mandatory at Wageningen UR, also at the social sciences
department and the research institutes
17. Advanced bibliometric analyses
Citation data is downloaded from Web of Science
Comparisons of citations with baseline data from the
Essential Science Indicators are made
18. Advanced bibliometric analyses
Citation data is downloaded from Web of Science
Comparisons of citations with baseline data from the
Essential Science Indicators are made
Relative impact, percentage top10% most cited papers
(%T10%) and percentage top1% most cited papers
(%T1%) are calculated.
19. Coupling with WoS and ESI
WoS identifiers (UT) are obtained with an API
20. Coupling with WoS and ESI
WoS identifiers (UT) are obtained with an API
With the UT, citations per article can be retrieved from
WoS
21. Coupling with WoS and ESI
WoS identifiers (UT) are obtained with an API
With the UT, citations per article can be retrieved from
WoS
From the Essential Science Indicators (ESI)
● Average citation rates
● Percentiles (Top 10% en Top1%)
22. Why do we need baselines?
Scientist Z. Math has a publication from 2001 with 17 citations
Scientist M. Biology has a publication from 2007 with 32 citations
27. For a single publication
Zee, F.P.v.d., G. Lettinga & J.A. Field (2001) Azo dye
decolourisation by anaerobic granular sludge.
Chemosphere 44:1169-1176.
● Citations from Web of Science: 94
28. For a single publication
Zee, F.P.v.d., G. Lettinga & J.A. Field (2001) Azo dye
decolourisation by anaerobic granular sludge.
Chemosphere 44:1169-1176.
● Citations from Web of Science: 94
Journal: Chemosphere
29. For a single publication
Zee, F.P.v.d., G. Lettinga & J.A. Field (2001) Azo dye
decolourisation by anaerobic granular sludge.
Chemosphere 44:1169-1176.
● Citations from Web of Science: 94
Journal: Chemosphere
Categorised by ESI in Environment/Ecology
30. For a single publication
Zee, F.P.v.d., G. Lettinga & J.A. Field (2001) Azo dye
decolourisation by anaerobic granular sludge.
Chemosphere 44:1169-1176.
● Citations from Web of Science: 94
Journal: Chemosphere
Categorised by ESI in Environment/Ecology
Baseline data for Environment/Ecology.
● Article from 2001 in Environment/ecology:
● On average: 19.36 citations;
● Top 10%: 44 citations; Top1%: 141 citations
31. For a single publication
Zee, F.P.v.d., G. Lettinga & J.A. Field (2001) Azo dye
decolourisation by anaerobic granular sludge.
Chemosphere 44:1169-1176.
● Citations from Web of Science: 94
Journal: Chemosphere
Categorised by ESI in Environment/Ecology
Baseline data for Environment/Ecology.
● Article from 2001 in Environment/ecology:
● On average: 19.36 citations;
● Top 10%: 44 citations; Top1%: 141 citations
Relative Impact: 94 / 19.36 = 4.9
32. Advanced bibliometric indicators
Follow Moed (1995) as closely as possible; but.....
Moed, H.F., R.E. de Bruin & T.N. van leeuwen (1995). New bibliometric tools for the assessment of national research
performance: Database description, overview of indicators and first applications. Scientometrics, 33(3): 381-422.
http://dx.doi.org/10.1007/BF02017338
33. Advanced bibliometric indicators
Follow Moed (1995) as closely as possible; but.....
Web of Science is used for citation data
● We can’t make corrections for self citations
Moed, H.F., R.E. de Bruin & T.N. van leeuwen (1995). New bibliometric tools for the assessment of national research
performance: Database description, overview of indicators and first applications. Scientometrics, 33(3): 381-422.
http://dx.doi.org/10.1007/BF02017338
34. Advanced bibliometric indicators
Follow Moed (1995) as closely as possible; but.....
Web of Science is used for citation data
● We can’t make corrections for self citations
Essential Science Indicators for baseline data (World
average, Top 10% and Top 1%)
● Limited number of research fields (22)
Moed, H.F., R.E. de Bruin & T.N. van leeuwen (1995). New bibliometric tools for the assessment of national research
performance: Database description, overview of indicators and first applications. Scientometrics, 33(3): 381-422.
http://dx.doi.org/10.1007/BF02017338
35. Advanced bibliometric indicators
Follow Moed (1995) as closely as possible; but.....
Web of Science is used for citation data
● We can’t make corrections for self citations
Essential Science Indicators for baseline data (World
average, Top 10% and Top 1%)
● Limited number of research fields (22)
We can determine the representativeness of the citation
analysis!
Moed, H.F., R.E. de Bruin & T.N. van leeuwen (1995). New bibliometric tools for the assessment of national research
performance: Database description, overview of indicators and first applications. Scientometrics, 33(3): 381-422.
http://dx.doi.org/10.1007/BF02017338
36. Representativeness
SEP Table "Plant Production Systems" 2005-
2010
1. Academic publications a. Refereed articles 324
b. Non-refereed articles 7
c. Books 1
d.1. Refereed book chapters 36
d.2. Non-refereed book chapters 13
e. PhD Theses 45
f. Conference papers 137
Total publications 563
37. Representativeness
SEP Table "Plant Production Systems" 2005-
2010 WoS Repr
1. Academic publications a. Refereed articles 324 288 89%
b. Non-refereed articles 7
c. Books 1
d.1. Refereed book chapters 36
d.2. Non-refereed book chapters 13
e. PhD Theses 45
f. Conference papers 137
Total publications 563
43. Why in the library?
Library is the functional manager of Metis / WaY because
of wide experience with bibliographic metadata
44. Why in the library?
Library is the functional manager of Metis / WaY because
of wide experience with bibliographic metadata
Library manages contracts with publisher(s) of external
databases that are being used
45. Why in the library?
Library is the functional manager of Metis / WaY because
of wide experience with bibliographic metadata
Library manages contracts with publisher(s) of external
databases that are being used
Library has experience in developing and maintaining
large databases
46. Why in the library?
Library is the functional manager of Metis / WaY because
of wide experience with bibliographic metadata
Library manages contracts with publisher(s) of external
databases that are being used
Library has experience in developing and maintaining
large databases
Library has ample experience in searching complicated
databases such as Web of Science
47. Advantage of using Metis / WaY
Improvements in publication lists, etc. recorded
48. Advantage of using Metis / WaY
Improvements in publication lists, etc. recorded
Knowledge of, and experience with bibliometric analyses
is better institutionalized
49. Advantage of using Metis / WaY
Improvements in publication lists, etc. recorded
Knowledge of, and experience with bibliometric analyses
is better institutionalized
Clarity / transparency for researchers
50. Advantage of using Metis / WaY
Improvements in publication lists, etc. recorded
Knowledge of, and experience with bibliometric analyses
is better institutionalized
Clarity / transparency for researchers
Analysis of a single unit within the institute offers
advantages for the organization as a whole
51. Advantage of using Metis / WaY
Improvements in publication lists, etc. recorded
Knowledge of, and experience with bibliometric analyses
is better institutionalized
Clarity / transparency for researchers
Analysis of a single unit within the institute offers
advantages for the organization as a whole
More visibility through Open Access management
52. Advantage of using Metis / WaY
Improvements in publication lists, etc. recorded
Knowledge of, and experience with bibliometric analyses
is better institutionalized
Clarity / transparency for researchers
Analysis of a single unit within the institute offers
advantages for the organization as a whole
More visibility through Open Access management
Better understanding of our own researchers
● We know where they publish
● We know what they cite
● We know something about their impact
61. Lessons learned
Start small, gain experience
Show you can pull it off
Be transparent
How much is your university spending on bibliometrics?
62. Lessons learned
Start small, gain experience
Show you can pull it off
Be transparent
How much is your university spending on bibliometrics?
Invest those resources in your own systems