“Citation impact”的意思、由来-开放百科全书

Citation impact quantifies the citation usage of scholarly works.^[1]^[2]^[3]^[4]^[5] It is a result of citation analysis or bibliometrics. Among the measures that have emerged from citation analysis are the citation counts for an individual article, an author, and an academic journal.

Article-level

One of the most basic citation metrics is how often an article was cited in other articles, books, or other sources (such as theses). Citation rates are heavily dependent on the discipline and the number of people working in that area. For instance, many more scientists work in neuroscience than in mathematics, and neuroscientists publish more papers than mathematicians, hence neuroscience papers are much more often cited than papers in mathematics.^[6]^[7] Similarly, review papers are more often cited than regular research papers because they summarize results from many papers. This may also be the reason why papers with shorter titles get more citations, given that they are usually covering a broader area.^[8]

Most-cited papers

The most-cited paper of all time is the paper by Oliver Lowry describing an assay to measure the concentration of proteins.^[9] By 2014 it had accumulated more than 305,000 citations. The 10 most cited papers all had more than 40,000 citations.^[10] To reach the top-100 papers required 12,119 citations by 2014.^[10] Of Thomson Reuter’s Web of Science database with more than 58 million items only 14,499 papers (~0.026%) had more than 1,000 citations in 2014.^[10]

Journal-level

Journal impact factors (JIFs) are a measure of the average number of citations that articles published by a journal in the previous two years have received in the current year. However, journals with very high impact factors are often based on a small number of very highly cited papers. For instance, most papers in Nature (impact factor 38.1, 2016) were "only" cited 10 or 20 times during the reference year (see figure). Journals with a "low" impact (e.g. PLOS One, impact factor 3.1) publish many papers that are cited 0 to 5 times but few highly cited articles.^[11]

JIFs are often mis-interpreted as a measure for journal quality or even article quality. The JIF is a journal-level metric, not an article-level metric, hence its use to determine the impact of a single article is statistically invalid. Citation distribution is skewed for journals because a very small number of articles is driving the vast majority of citations (see figure). Therefore, some journals have stopped publicizing their impact factor, e.g. the journals of the American Society for Microbiology.^[12]

Author-level

Total citations, or average citation count per article, can be reported for an individual author or researcher. Many other measures have been proposed, beyond simple citation counts, to better quantify an individual scholar's citation impact.^[13] The best-known measures include the h-index^[14] and the g-index.^[15] Each measure has advantages and disadvantages,^[16] spanning from bias to discipline-dependence and limitations of the citation data source.^[17] Counting the number of citations per paper is also employed to identify the authors of citation classics.^[18]

Alternatives

An alternative approach to measure a scholar's impact relies on usage data, such as number of downloads from publishers and analyzing citation performance, often at article level.^[19]^[20]^[21]^[22]

As early as 2004, the BMJ published the number of views for its articles, which was found to be somewhat correlated to citations.^[23] In 2008 the Journal of Medical Internet Research began publishing views and Tweets. These "tweetations" proved to be a good indicator of highly cited articles, leading the author to propose a "Twimpact factor", which is the number of Tweets it receives in the first seven days of publication, as well as a Twindex, which is the rank percentile of an article's Twimpact factor.^[24]

In response to growing concerns over the inappropriate use of journal impact factors in evaluating scientific outputs and scientists themselves, Université de Montréal, Imperial College London, PLOS, eLife, EMBO Journal, The Royal Society, Nature and Science proposed citation distributions metrics as alternative to impact factors.^[25]^[26]^[27]

Open Access publications

Open access publications are available without cost to readers, hence they should be cited more frequently.^[28]^[29]^[30]^[31]^[32]^[33]^[34]^[35] While this has been contradicted by some experimental and observational studies^[36]^[37] recent evidence suggests that OA journals were indeed found to have significantly more citations overall compared to non-OA journals (median 15.5 vs 12). Thus, it is better to publish in an OA journal for more citations.^[38]

Recent developments

An important recent development in research on citation impact is the discovery of universality, or citation impact patterns that hold across different disciplines in the sciences, social sciences, and humanities. For example, it has been shown that the number of citations received by a publication, once properly rescaled by its average across articles published in the same discipline and in the same year, follows a universal log-normal distribution that is the same in every discipline.^[39] This finding has suggested a universal citation impact measure that extends the h-index by properly rescaling citation counts and resorting publications, however the computation of such a universal measure requires the collection of extensive citation data and statistics for every discipline and year. Social crowdsourcing tools such as Scholarometer have been proposed to address this need.^[40]^[41] Kaur et al. proposed a statistical method to evaluate the universality of citation impact metrics, i.e., their capability to compare impact fairly across fields.^[42] Their analysis identifies universal impact metrics, such as the field-normalized h-index.

Research suggests the impact of an article can be, partly, explained by superficial factors and not only by the scientific merits of an article.^[43] Field-dependent factors are usually listed as an issue to be tackled not only when comparison across disciplines are made, but also when different fields of research of one discipline are being compared.^[44] For instance in Medicine among other factors the number of authors, the number of references, the article length, and the presence of a colon in the title influence the impact. Whilst in Sociology the number of references, the article length, and title length are among the factors.^[45] Also it is suggested scholars engage in ethical questionable behavior in order to inflate the number of citations articles receive.^[46]

Automated citation indexing^[47] has changed the nature of citation analysis research, allowing millions of citations to be analyzed for large scale patterns and knowledge discovery. The first example of automated citation indexing was CiteSeer, later to be followed by Google Scholar. More recently, advanced models for a dynamic analysis of citation aging have been proposed.^[48]^[49] The latter model is even used as a predictive tool for determining the citations that might be obtained at any time of the lifetime of a corpus of publications.

According to Mario Biagioli: "All metrics of scientific evaluation are bound to be abused. Goodhart's law [...] states that when a feature of the economy is picked as an indicator of the economy, then it inexorably ceases to function as that indicator because people start to game it."^[50]

See also

References

1. ^{{cite journal |last=Garfield |first=E. |year=1955 |url=http://www.garfield.library.upenn.edu/papers/science_v122v3159p108y1955.html |title=Citation Indexes for Science: A New Dimension in Documentation through Association of Ideas |journal=Science |volume=122 |issue=3159 |pages=108 |bibcode=1955Sci...122..108G |doi=10.1126/science.122.3159.108 |pmid=14385826}}
2. ^{{cite journal |last=Garfield |first=E. |year=1973 |url=http://www.garfield.library.upenn.edu/essays/V1p406y1962-73.pdf |title=Citation Frequency as a Measure of Research Activity and Performance |journal=Essays of an Information Scientist |volume=1 |pages=406–408}}
3. ^{{cite journal |last=Garfield |first=E. |year=1988 |url=http://www.garfield.library.upenn.edu/essays/v11p354y1988.pdf |title=Can Researchers Bank on Citation Analysis? |journal=Essays of an Information Scientist |volume=11 |pages=354}}
4. ^{{cite web |last=Garfield |first=E. |year=1998 |url=http://www.garfield.library.upenn.edu/papers/eval_of_science_CBE(Utah).html |title=The use of journal impact factors and citation analysis in the evaluation of science |work=41st Annual Meeting of the Council of Biology Editors}}
5. ^{{cite book |last1=Moed |first1=Henk F. |year=2005 |title=Citation Analysis in Research Evaluation |publisher=Springer |isbn=978-1-4020-3713-9}}
6. ^{{cite book |last=de Solla Price |first=D. J. |year=1963 |title=Little Science, Big Science |publisher=Columbia University Press}}
7. ^{{cite journal |last1=Larsen |first1=P. O. |last2=von Ins |first2=M. |year=2010 |title=The rate of growth in scientific publication and the decline in coverage provided by Science Citation Index |journal=Scientometrics |volume=84 |issue=3 |pages=575–603 |doi=10.1007/s11192-010-0202-z}}
8. ^{{cite journal |last1=Deng |first1=B. |title=Papers with shorter titles get more citations |url=http://www.nature.com/news/papers-with-shorter-titles-get-more-citations-1.18246 |journal=Nature News |date=26 August 2015 |doi=10.1038/nature.2015.18246}}
9. ^{{Cite journal |last=Lowry |first=O. H. |last2=Rosebrough |first2=N. J. |last3=Farr |first3=A. L. |last4=Randall |first4=R. J. |year=1951 |title=Protein measurement with the Folin phenol reagent |journal=The Journal of Biological Chemistry |volume=193 |issue=1 |pages=265–275 |pmid=14907713}}
10. ^¹²{{Cite journal |last=van Noorden |first=R. |last2=Maher |first2=B. |last3=Nuzzo |first3=R. |date=2014 |title=The top 100 papers |journal=Nature |volume=514 |issue=7524 |pages=550–553 |bibcode=2014Natur.514..550V |doi=10.1038/514550a |pmid=25355343}}
11. ^¹{{Cite journal |last=Callaway |first=E. |date=2016 |title=Beat it, impact factor! Publishing elite turns against controversial metric |url=http://www.nature.com/doifinder/10.1038/nature.2016.20224 |journal=Nature |volume=535 |issue=7611 |pages=210–211 |bibcode=2016Natur.535..210C |doi=10.1038/nature.2016.20224 |pmid=27411614}}
12. ^{{Cite journal |last=Casadevall |first=A. |last2=Bertuzzi |first2=S. |last3=Buchmeier |first3=M. J. |last4=Davis |first4=R. J. |last5=Drake |first5=H. |last6=Fang |first6=F. C. |last7=Gilbert |first7=J. |last8=Goldman |first8=B. M. |last9=Imperiale |first9=M. J. |date=2016 |title=ASM Journals Eliminate Impact Factor Information from Journal Websites |url=http://msphere.asm.org/content/1/4/e00184-16 |journal=mSphere |volume=1 |issue=4 |pages=e00184–16 |doi=10.1128/mSphere.00184-16 |pmc=4941020 |pmid=27408939}}
13. ^{{cite journal |last1=Belikov |first1=A. V. |last2=Belikov |first2=V. V. |year=2015 |title=A citation-based, author- and age-normalized, logarithmic index for evaluation of individual researchers independently of publication counts |journal=F1000Research |volume=4 |pages=884 |doi=10.12688/f1000research.7070.1}}
14. ^{{cite journal |last=Hirsch |first=J. E. |date=2005 |title=An index to quantify an individual's scientific research output |journal=PNAS |volume=102 |issue=46 |pages=16569–16572 |arxiv=physics/0508025 |bibcode=2005PNAS..10216569H |doi=10.1073/pnas.0507655102 |pmc=1283832 |pmid=16275915}}
15. ^{{cite journal |last=Egghe |first=L. |year=2006 |title=Theory and practise of the g-index |journal=Scientometrics |volume=69 |issue=1 |pages=131–152 |doi=10.1007/s11192-006-0144-7}}
16. ^{{cite journal |author=Gálvez RH |title=Assessing author self-citation as a mechanism of relevant knowledge diffusion |journal=Scientometrics |date=March 2017 |doi=10.1007/s11192-017-2330-1}}
17. ^{{Cite journal |last=Couto |first=F. M. |last2=Pesquita |first2=C. |last3=Grego |first3=T. |last4=Veríssimo |first4=P. |year=2009 |title=Handling self-citations using Google Scholar |url=http://www.cindoc.csic.es/cybermetrics/articles/v13i1p2.html |journal=Cybermetrics |volume=13 |issue=1 |page=2}}
18. ^{{cite journal|last1=Serenko |first1=A.|last2=Dumay |first2=J.|year=2015|url=http://www.aserenko.com/papers/Serenko_Dumay_CitationClassics1.pdf|title=Citation classics published in knowledge management journals. Part I: Articles and their characteristics. |journal=Journal of Knowledge Management|volume=19 |issue=2 |pages=401–431|doi=10.1108/JKM-06-2014-0220}}
19. ^{{cite journal |last=Bollen |first=J. |last2=Van de Sompel |first2=H. |last3=Smith |first3=J. |last4=Luce |first4=R. |year=2005 |title=Toward alternative metrics of journal impact: A comparison of download and citation data |journal=Information Processing and Management |volume=41 |issue=6 |pages=1419–1440 |arxiv=cs.DL/0503007 |doi=10.1016/j.ipm.2005.03.024}}
20. ^{{cite journal |last=Brody |first=T. |last2=Harnad |first2=S. |last3=Carr |first3=L. |year=2005 |title=Earlier Web Usage Statistics as Predictors of Later Citation Impact |journal=Journal of the Association for Information Science and Technology |volume= 57|issue= 8|pages=1060 |arxiv=cs/0503020 |bibcode=2005cs........3020B |doi=10.1002/asi.20373}}
21. ^{{cite journal |last1=Kurtz |first1=M. J. |last2=Eichhorn |first2=G. |last3=Accomazzi |first3=A. |last4=Grant |first4=C. |last5=Demleitner |first5=M. |last6=Murray |first6=S. S. |year=2004 |title=The Effect of Use and Access on Citations |journal=Information Processing and Management |volume=41 |issue=6 |pages=1395–1402 |arxiv=cs/0503029 |bibcode=2005IPM....41.1395K |doi=10.1016/j.ipm.2005.03.010}}
22. ^{{cite journal |last1=Moed |first1=H. F. |year=2005b |title=Statistical Relationships Between Downloads and Citations at the Level of Individual Documents Within a Single Journal |journal=Journal of the American Society for Information Science and Technology |volume=56 |issue=10 |pages=1088–1097 |doi=10.1002/asi.20200}}
23. ^{{cite journal |last1=Perneger |first1=T. V. |year=2004 |title=Relation between online "hit counts" and subsequent citations: Prospective study of research papers in the BMJ |journal=BMJ |volume=329 |issue=7465 |pages=546–7 |doi=10.1136/bmj.329.7465.546 |pmid=15345629 |pmc=516105}}
24. ^{{cite journal |last1=Eysenbach |first1=G. |year=2011 |title=Can Tweets Predict Citations? Metrics of Social Impact Based on Twitter and Correlation with Traditional Metrics of Scientific Impact |journal=Journal of Medical Internet Research |volume=13 |issue=4 |pages=e123 |doi=10.2196/jmir.2012 |pmid=22173204 |pmc=3278109}}
25. ^{{cite web |author=Veronique Kiermer |title=Measuring Up: Impact Factors Do Not Reflect Article Citation Rates |work=The Official PLOS Blog |year=2016 |url=http://blogs.plos.org/plos/2016/07/impact-factors-do-not-reflect-citation-rates/}}
26. ^{{cite web |url=http://www.the-scientist.com/?articles.view/articleNo/46495/title/Ditching-Impact-Factors-for-Deeper-Data/ |title=Ditching Impact Factors for Deeper Data |work=The Scientist|accessdate=2016-07-29}}
27. ^{{cite web |url=http://scitation.aip.org/content/aip/magazine/physicstoday/news/10.1063/PT.5.8183 |title=Scientific publishing observers and practitioners blast the JIF and call for improved metrics. |work=Physics Today |accessdate=2016-03-08}}
28. ^Bibliography of Findings on the Open Access Impact Advantage
29. ^{{cite journal |last1=Brody |first1=T. |last2=Harnad |first2=S. |year=2004 |title=Comparing the Impact of Open Access (OA) vs. Non-OA Articles in the Same Journals |url=http://eprints.ecs.soton.ac.uk/10207/ |journal=D-Lib Magazine |volume=10 |issue= |page=6}}
30. ^{{cite journal |last1=Eysenbach |first1=G. |last2=Tenopir |first2=C. |year=2006 |title=Citation Advantage of Open Access Articles |journal=PLoS Biology |volume=4 |issue=5 |pages=e157 |doi=10.1371/journal.pbio.0040157 |pmid=16683865 |pmc=1459247}}
31. ^{{cite journal |last1=Eysenbach |first1=G. |date=2006 |title=The Open Access Advantage |journal=Journal of Medical Internet Research |volume=8 |issue=2 |pages=e8 |doi=10.2196/jmir.8.2.e8}}
32. ^{{cite journal |last=Hajjem |first=C. |last2=Harnad |first2=S. |last3=Gingras |first3=Y. |year=2005 |title=Ten-Year Cross-Disciplinary Comparison of the Growth of Open Access and How It Increases Research Citation Impact |url=http://sites.computer.org/debull/A05dec/A05DEC-CD.pdf |journal=IEEE Data Engineering Bulletin |volume=28 |issue=4 |pages=39–47 |arxiv=cs/0606079 |bibcode=2006cs........6079H}}
33. ^{{cite journal |last1=Lawrence |first1=S. |year=2001 |title=Free online availability substantially increases a paper's impact |journal=Nature |volume=411 |issue=6837 |pages=521–521 |doi=10.1038/35079151 |pmid=11385534}}
34. ^{{cite journal |last1=MacCallum |first1=C. J. |last2=Parthasarathy |first2=H. |year=2006 |title=Open Access Increases Citation Rate |journal=PLoS Biology |volume=4 |issue=5 |pages=e176 |doi=10.1371/journal.pbio.0040176}}
35. ^{{cite journal |last1=Gargouri |first1=Y. |last2=Hajjem |first2=C. |last3=Lariviere |first3=V. |last4=Gingras |first4=Y. |last5=Brody |first5=T. |last6=Carr |first6=L. |last7=Harnad |first7=S. |year=2010 |title=Self-Selected or Mandated, Open Access Increases Citation Impact for Higher Quality Research |url=http://www.plosone.org/article/info%3Adoi%2F10.1371%2Fjournal.pone.0013636 |journal=PLOS One |volume=5 |issue=10 |page=e13636 |bibcode=2010PLoSO...513636G |doi=10.1371/journal.pone.0013636 |pmid=20976155 |pmc=2956678|arxiv=1001.0361}}
36. ^{{cite journal |last1=Davis |first1=P. M. |last2=Lewenstein |first2=B. V. |last3=Simon |first3=D. H. |last4=Booth |first4=J. G. |last5=Connolly |first5=M. J. L. |year=2008 |title=Open access publishing, article downloads, and citations: randomised controlled trial |journal=BMJ |volume=337 |issue= |pages=a568–a568 |doi=10.1136/bmj.a568 |pmid=18669565 |pmc=2492576}}
37. ^{{cite journal |last1=Davis |first1=P. M. |year=2011 |title=Open access, readership, citations: a randomized controlled trial of scientific journal publishing |journal=The FASEB Journal |volume=25 |issue=7 |pages=2129–2134 |doi=10.1096/fj.11-183988 |pmid=21450907}}
38. ^{{Cite journal|last=Chua|first=SK|last2=Qureshi|first2=Ahmad M|last3=Krishnan|first3=Vijay|last4=Pai|first4=Dinker R|last5=Kamal|first5=Laila B|last6=Gunasegaran|first6=Sharmilla|last7=Afzal|first7=MZ|last8=Ambawatta|first8=Lahiru|last9=Gan|first9=JY|date=2017-03-02|title=The impact factor of an open access journal does not contribute to an article’s citations|url=https://f1000research.com/articles/6-208/v1|journal=F1000Research|volume=6|doi=10.12688/f1000research.10892.1|page=208}}
39. ^{{cite journal |last=Radicchi |first=F. |last2=Fortunato |first2=S. |last3=Castellano |first3=C. |date=2008 |title=Universality of citation distributions: Toward an objective measure of scientific impact |journal=PNAS |volume=105 |issue=45 |pages=17268–17272 |arxiv=0806.0974 |bibcode=2008PNAS..10517268R |doi=10.1073/pnas.0806977105 |pmc=2582263 |pmid=18978030}}
40. ^{{cite conference |last=Hoang |first=D. |last2=Kaur |first2=J. |last3=Menczer |first3=F. |year=2010 |title=Crowdsourcing Scholarly Data |booktitle=Proceedings of the WebSci10: Extending the Frontiers of Society On-Line |url=http://journal.webscience.org/321/2/websci10_submission_107.pdf}}
41. ^{{cite journal |last=Kaur |first=J. |last2= Hoang |first2=D. |last3= Sun |first3=X. |last4= Possamai |first4=L. |last5= JafariAsbagh |first5=M. |last6= Patil |first6=S. |last7= Menczer |first7=F. |year=2012 |title= Scholarometer: A Social Framework for Analyzing Impact across Disciplines |journal=PLOS One |volume=7 |issue=9 |pages=e43235 |doi= 10.1371/journal.pone.0043235|bibcode=2012PLoSO...743235K }}
42. ^{{cite journal |last=Kaur |first=J. |last2=Radicchi |first2=F. |last3= Menczer |first3=F. |year=2013 |title= Universality of scholarly impact metrics |journal=Journal of Informetrics |volume=7 |issue=4 |pages= 924–932 |doi= 10.1016/j.joi.2013.09.002}}
43. ^{{cite journal |last1=Bornmann |first1=L. |last2=Daniel |first2=H. D. |year=2008 |title=What do citation counts measure? A review of studies on citing behavior |journal=Journal of Documentation |volume=64 |issue=1 |pages=45–80 |doi=10.1108/00220410810844150}}
44. ^{{cite journal |last=Anauati |first=M. V. |last2=Galiani |first2=S. |last3=Gálvez |first3=R. H. |year=2014 |title=Quantifying the Life Cycle of Scholarly Articles Across Fields of Economic Research |ssrn=2523078}}
45. ^{{cite journal |last=van Wesel |first=M. |last2=Wyatt |first2=S. |last3=ten Haaf |first3=J. |year=2014 |title=What a difference a colon makes: how superficial factors influence subsequent citation |journal=Scientometrics |volume=98 |issue=3 |pages=1601–1615 |doi=10.1007/s11192-013-1154-x}}
46. ^{{cite journal |last=van Wesel |first=M. |year=2016 |title=Evaluation by Citation: Trends in Publication Behavior, Evaluation Criteria, and the Strive for High Impact Publications |journal=Science and Engineering Ethics |volume=22 |issue=1 |pages=199–225 |doi=10.1007/s11948-015-9638-0|pmc=4750571}}
47. ^{{cite conference |last=Giles |first=C. L. |last2=Bollacker |first2=K. |last3=Lawrence |first3=S. |year=1998 |title=CiteSeer: An Automatic Citation Indexing System |booktitle=DL'98 Digital Libraries, 3rd ACM Conference on Digital Libraries |pages=89–98 |doi=10.1145/276675.276685}}
48. ^{{cite journal |last=Yu |first=G. |last2=Li |first2=Y.-J. |year=2010 |title=Identification of referencing and citation processes of scientific journals based on the citation distribution model |journal=Scientometrics |volume=82 |issue=2 |pages=249–261 |doi=10.1007/s11192-009-0085-z}}
49. ^{{cite journal |last=Bouabid |first=H. |year=2011 |title=Revisiting citation aging: A model for citation distribution and life-cycle prediction |journal=Scientometrics |volume=88 |issue=1 |pages=199–211 |doi=10.1007/s11192-011-0370-5}}
50. ^{{cite journal |last1=Biagioli |first1=M. |title=Watch out for cheats in citation game |journal=Nature |year=2016 |volume=535 |issue=7611 |pages=201–201 |bibcode=2016Natur.535..201B |doi=10.1038/535201a |pmid=27411599}}