1. Research Metrics Nazi Torabi Research & Instructional Librarian Allyn & Betty Taylor Library April 27, 2011 http://www.slideshare.net/ntorabi/ 1
2. Objectives To provide an overview of various bibliometrics products Have a good understanding of limitation of each product How to calculate your own h-index 2
4. Why Research Metrics? Get published in a good journal Application for tenure, promotion, or grant funding Measure the impact of an individual’s research 4
13. Impact Factor Number of times articles published in 2008 and 2009 were cited by indexed journals during 2010 Total number of "citable items" published by that journal in 2008 and 2009 2010 Journal IF = i.e. An Impact Factor of 1.0 in 2010 means that, on average, the articles published in 2008 and 2009 have been cited one time. Self-citation is included. 7
14. Journal Immediacy Index Number of times articles published in 2010 were cited by indexed journals during 2010 Total number of "citable items" published by that journal in 2010 2010 Journal Immediacy = Index i.e. The journal Immediacy Index indicates how quickly articles in a journal are cited. JCR 8
15. For 2009, the journal CHEMBIOCHEM has an Impact Factor of 3.824. 9
16. Journal Ranking The Journal Ranking table shows the ranking of the current journal in its subject categories based on the journal IF. Data for Total Journals in Category and Quartile in Category are not available for JCR years before 2003. 10
17. IF & its shortcomings Citation pattern is discipline specific Time span Citation frequency differences in citation norms Sleeping beauties Self-Citation and other!!! Negative citations Title and journal format changes A questionable validity 11
18. Impact Factor Number of times articles published in 2008 and 2009 were cited by indexed journals during 2010 Total number of "citable items" published by that journal in 2008 and 2009 2010 Journal IF = i.e. An Impact Factor of 1.0 in 2010 means that, on average, the articles published in 2008 and 2009 have been cited one time. Self-citation is included. 12
19. Probability density function for journals in subject categories of ENERGY & FUELS – data from JCR -5 -4 -3 -2 -1 0 1 2 3 4 5 Normal distribution Pareto distribution 13
23. High School Dating Network Bearman, Peter S., James Moody, and Katherine Stovel. "Chains of Affection: The Structure of Adolescent Romantic and Sexual Networks." American Journal of Sociology 110, no. 1 (July 2004): 44-91. 17
24. Which network you would rather be part of? West, J (2010). The EigenfactorTM Metrics: a network approach to assessing scholarly journals. http://mediazone.brighttalk.com/comm/ReedElsevier/ad0fb0ef1d-21688-4348-23066 18 A B
29. Article Influence™ Score Journal’s Eigenfactor Score (5yrs) Number of articles in the journal Article Influence™ = Score http://www.eigenfactor.org/ 21
30. How can we better evaluate the scholarly literature ? How can we better navigate the scholarly literature? 22
35. Raw Impact per Paper (RIP) Number of times articles published in 2007, 2008 and 2009 were cited by indexed journals during 2010 Total number of "citable items" published by that journal in 2007, 2008 and 2009 2010 Journal RIP= 24
36. Source normalized impact per paper (SNIP) A journal’s Source Normalized Impact per Paper (SNIP) = Raw Impact per Paper published in the journal (RIP) ÷ Relative Database Citation Potential (RDCP) in the journal’s subfield i.e. It corrects for differences in the frequency of citation across research fields. http://www.journalindicators.com/Indicators.pdf 25 CWTS
39. Journal Ranking Summary Adapted and modified from: González-Pereir , B. et al. “The SJR indicator: A new indicator of journals' scientific prestige”. http://arxiv.org/ftp/arxiv/papers/0912/0912.4141.pdf 27
40. Exercise : Journal Ranking What is the Impact Factor Trend in the last 5 yearsfor the Am J Bioeth? Tip: you need to find the journal’s full title first. You are thinking of submitting a manuscript to the journal of MOLECULAR MEDICINE. How do you rank this journal in its appropriate subject category? Is it better to present this journal using IF or EigenFactor? Using Scopus, compare the journal of MOLECULAR MEDICINE with the journal of CURRENT MOLECULAR MEDICINE. Which journal might be a better candidate for your article? 28
41.
42. i.e. If a researcher has an h-index of 25 if 25 of their papers have been cited at least 25 times (See the graph in the handout).29
43. h-index shortcomings Early career researchers Sleeping beauties The balance between number of publications vs. number of citations each receives Databases are not error free Inconsistency between different metric tools (See the handout). 30 5 articles published – each cited 5 times – h-index = 5 2 articles published – each cited 20 times – h-index = 2
44. h-index Variants g-index: more weight is given to the highest cited papers The individual h-index: accounts for co-authorship in calculating impact by giving less weight to such papers The contemporary h-index: less weight to older cited papers The age-weighted citation rate: accounts for the age of papers Tarma Software Research (2010). Publish or Perish User’s Manual http://www.harzing.com/pophelp/metrics.htm#gindex 31
53. Citation overview from Scopus The Citation Overview Results page lists documents that cited the document you selected from the Citation Overview. You can include up to 5000 documents in a Citation Tracker. If you select more than 5000 documents only the first 5000 are included. 36
54. Exercise - Article analysis What is the most cited article written by Dr. Terry Delovitch? Tip: use both WOS and Scopus 37
76. F1000 factors The F1000 Article Factor (FFa) is calculated from the highest rating awarded by a Faculty Member (FM) plus an increment for each additional rating from other FMs. For example, a single article that has been evaluated by three Faculty Members, who rated it ‘Recommended’, ‘Must Read’ and ‘Must Read’, will have its FFa calculated thus: 8 (highest rating ‘Must Read’) + 2 (increment for ‘Must Read’) + 1 (increment for ‘Recommended’) = 11. 47
77. Which metric tool? Adapted form https://dspace.ndlr.ie/jspui/handle/10633/27390 48
78. Questions Need library related assistance?Please don’t hesitate to contact us: Nazi Torabi 519-661-2111 x88992 ntorabi@uwo.ca IM a librarian https://www.lib.uwo.ca/chat/ 49
Editor's Notes
A = the number of times articles published in 2008 and 2009 were cited by indexed journals during 2010B = the total number of "citable items" published by that journal in 2008 and 2009. 2010 impact factor = A/B("Citable items" are usually articles, reviews, proceedings, or notes; not editorials or Letters-to-the-Editor.)
the cited half-life: the median age of the articles that were cited in Journal Citation Reports each year. For example, if a journal's half-life in 2005 is 5, that means the citations from 2001-2005 are half of all the citations from that journal in 2005, and the other half of the citations precede 2001
A = the number of times articles published in 2008 and 2009 were cited by indexed journals during 2010B = the total number of "citable items" published by that journal in 2008 and 2009. 2010 impact factor = A/B("Citable items" are usually articles, reviews, proceedings, or notes; not editorials or Letters-to-the-Editor.)
The impact factor refers to the average number of citations per paper, but this is not a normal distribution. It is rather a Bradford distribution, as predicted by theory. Being an arithmetic mean, the impact factor therefore is not a valid representation of this distribution and unfit for citation evaluation.[7]
It was created by Physicist Mark Newman from data published in 2004 by Peter Bearman, James Moody, and Katherine Stovel. http://www.jstor.org/stable/pdfplus/10.1086/386272.pdf?acceptTC=truehttp://mediazone.brighttalk.com/comm/ReedElsevier/ad0fb0ef1d-21688-4348-23066
Head developer ofeigenfactor
SJR = SCImago Journal Rank reflects prestige of source: value of weighted citations per documentSNIP = Source normalized impact per paper: corrects for differences in the frequency of citation across research fields4 yrs of data is needed
Use pubmed journal database = AMERICAN JOURNAL OF BIOETHICS = 2.5- 3.4- 3.9-4.3-4.0IF mol med = 5.02 no ImmediacyIndexIF current mol med = 5.092
An index to quantify an individual's scientific research output
