|
|
|
| Alternative or Complementary Relationship between Usage Data and Citation Data |
| Xie Juan, Gong Kaile, Cheng Ying, Ke Qing |
| School of Information Management, Nanjing University, Nanjing 210023 |
|
|
|
|
Abstract The development of digital publishing has accelerated the process of scholarly communication and changed communication models. Originating from digital publishing, usage data bring new opportunities to Scientometrics. Research shows that usage data can be a prediction, an alternative, or a complement to citations. In order to detect the essence of usage data as well as their feasibility and applicability for scientific evaluation, this study takes Library and Information Science as an example and uses the usage count and citation data from the Web of Science. The correlation between usage and citation has been analyzed, together with the moderating effects of quality, document type, and subfield. The following two points are revealed: first, from the viewpoint of scholarly dissemination, usage data can be both an alternative and complementary to citation as components of the scientific communication system and because of their high correlation. Second, from the viewpoint of scientific evaluation, it is difficult to verify that usage data can be an alternative to citation as an indicator of quality.
|
|
Received: 14 November 2017
|
|
|
|
[1] Brown C.Communication in the sciences[J]. Annual Review of Information Science and Technology, 2010, 44(1): 285-316.
[2] Garfield E.Citation indexing - its theory and application in science, technology, and humanities[M]. New York: Wiley, 1979.
[3] Borgman C, Furner J.Scholarly communication and bibliometrics[J]. Annual Review of Information Science and Technology, 2002, 36(1): 2-72.
[4] Mcdonald J D.Understanding journal usage: A statistical analysis of citation and use[J]. Journal of the American Society for Information Science and Technology, 2007, 58(1): 39-50.
[5] Kurtz M J, Bollen J.Usage bibliometrics[J]. Annual Review of Information Science and Technology, 2010, 44(1): 1-64.
[6] Moed H F, Halevi G.Multidimensional assessment of scholarly research impact[J]. Journal of the Association for Information Science and Technology, 2015, 66(10): 1988-2002.
[7] Bollen J, Sompel H V.Usage impact factor: The effects of sample characteristics on usage-based impact metrics[J]. Journal of the American Society for Information Science and Technology, 2008, 59(1): 136-149.
[8] Wan J K, Hua P H, Rousseau R, et al.The journal download immediacy index (DII): experiences using a Chinese full-text database[J]. Scientometrics, 2010, 82(3): 555-566.
[9] Rowlands I, Nicholas D.The missing link: journal usage metrics[J]. Aslib Proceedings: New Information Perspectives, 2007, 59(3): 222-228.
[10] De Sordi J O, Conejero M A, Meireles M. Bibliometric indicators in the context of regional repositories: proposing the D-index[J]. Scientometrics, 2016, 107(1): 235-258.
[11] Bornmann L, Marx W.Standards for the application of bibliometrics in the evaluation of individual researchers working in the natural sciences[J]. Zeitschrift Fu?r Evaluation, 2013, 12(1): 103-127.
[12] Brody T, Harnad S, Carr L.Earlier web usage statistics as predictors of later citation impact[J]. Journal of the American Society for Information Science and Technology, 2006, 57(8): 1060-1072.
[13] Botting N, Dipper L, Hilari K.The effect of social media promotion on academic article uptake[J]. Journal of the Association for Information Science and Technology, 2017, 68(3): 795-800.
[14] Sharma H P.Download plus citation counts—A useful indicator to measure research impact[J]. Current Science, 2007, 92(7): 873.
[15] Schloegl C, Gorraiz J.Global usage versus global citation metrics: The case of pharmacology journals[J]. Journal of the American Society for Information Science and Technology, 2011, 62(1): 161-170.
[16] Scales P A.Citation analyses asindicators of the use of serials: a comparison of ranked title lists produced by citation counting and from use data[J]. Journal of Documentation, 1976, 32(1): 17-25.
[17] Tsay M Y.The relationship between journal use in a medical library and citation use[J]. Bulletin of the Medical Library Association, 1998, 86(1): 31-39.
[18] Schlögl C, Gorraiz J, Gumpenberger C, et al.Comparison of downloads, citations and readership data for two information systems journals[J]. Scientometrics, 2014, 101(2): 1113-1128.
[19] Moed H F.Statistical relationships between downloads and citations at the level of individual documents within a single journal[J]. Journal of the American Society for Information Science and Technology, 2005, 56(10): 1088-1097.
[20] Kurtz M J, Henneken E A.Measuring metrics—a 40-year longitudinal cross-validation of citations, downloads, and peer review in astrophysics[J]. Journal of the Association for Information Science and Technology, 2017, 68(3): 695-708.
[21] Boukacem-Zeghmouri C, Bador P, Lafouge T, et al.Relationships between consumption, publication and impact in French universities in a value perspective: a bibliometric analysis[J]. Scientometrics, 2016, 106(1): 263-280.
[22] Perneger T V.Relation between online “Hit Counts” and subsequent citations: Prospective study of research papers in the BM[J][J]. British Medical Journal, 2004, 329: 546.
[23] Darmoni S J, Roussel F, Benichou J, et al.Reading factor: a new bibliometric criterion for managing digital libraries[J]. Journal of the Medical Library Association, 2002, 90(3): 323-327.
[24] Kurtz M J, Eichhorn G, Accomazzi A, et al.The bibliometric properties of article readership information: Research articles[J]. Journal of the American Society for Information Science and Technology, 2005, 56(2): 111-128.
[25] Gorraiz J, Gumpenberger C, Schlögl C.Usage versus citation behaviours in four subject areas[J]. Scientometrics, 2014, 101(2): 1077-1095.
[26] Schloegl C, Gorraiz J.Comparison of citation and usage indicators: the case of oncology journals[J]. Scientometrics, 2010, 82(3): 567-580.
[27] 赵星. 学术文献用量级数据Usage的测度特性研究[J]. 中国图书馆学报, 2017, 43(3): 44-57.
[28] Kakushadze Z.An index for SSRN downloads[J]. Journal of Informetrics, 2016, 10(1): 9-28.
[29] Thelwall M, Kousha K.ResearchGate articles: Age, discipline, audience size, and impact[J]. Journal of the Association for Information Science and Technology, 2017, 68(2): 468-479.
[30] Macduff C.An evaluation of the process and initial impact of disseminating a nursing e-thesis[J]. Journal of Advanced Nursing, 2009, 65(5): 1010-1018.
[31] Shepherd P T.The feasibility of developing and implementing journal usage factors: a research project sponsored by UKSG[J]. Serials, 2007, 20(2): 117-123.
[32] Baker G, Read E J.Vendor-supplied usage data for electronic resources: a survey of academic libraries[J]. Learned Publishing, 2008, 21: 48-57.
[33] Bollen J, De Sompel H V. An architecture for the aggregation and analysis of scholarly usage data[C]// Proceedings of the 6th ACM/IEEE-CS Joint Conference on Digital Libraries, 2006: 298-307.
[34] Wang X W, Fang Z C, Sun X L.Usage patterns of scholarly articles on Web of Science: a study on Web of Science usage count[J]. Scientometrics, 2016, 109(2): 917-926.
[35] Chi P S, Glänzel W.An empirical investigation of the associations among usage, scientific collaboration and citation impact[J]. Scientometrics, 2017, 112(1): 403-412.
[36] 谢娟, 龚凯乐, 成颖, 等. 论文下载量与被引量相关关系的元分析[J]. 情报学报, 2017, 36(12): 1255-1269.
[37] Jung Y, Kim J, Kim H.STM e-journal use analysis by utilizing KESLI usage statistics consolidation platform[J]. Collnet Journal of Scientometrics and Information Management, 2013, 7(2): 205-215.
[38] Duy J, Vaughan L.Can electronic journal usage data replace citation data as a measure of journal use? An empirical examination[J]. The Journal of Academic Librarianship, 2006, 32(5): 512-517.
[39] Buckarma E H, Thiels C A, Gas B L, et al.Influence of social media on the dissemination of a traditional surgical research article[J]. Journal of Surgical Education, 2017, 74(1): 79-83.
[40] 米哈依洛夫А.И. 科学交流与情报学[M]. 徐新民, 译. 北京: 科学技术文献出版社, 1980.
[41] 曹艺, 王曰芬, 丁洁. 面向学术影响力评价的科技文献引用与下载的相关性研究[J]. 图书情报工作, 2012, 56(8): 56-64.
[42] Bollen J, De Sompel H V, Smith J A, et al. Toward alternative metrics of journal impact: A comparison of download and citation data[J]. Information Processing & Management, 2005, 41(6): 1419-1440.
[43] 倪延年. 知识传播学[M]. 南京: 南京师范大学出版社, 1999.
[44] Nicholas D, Huntington P, Dobrowolski T, et al.Revisiting ‘obsolescence’ and journal article ‘decay’ through usage data: an analysis of digital journal use by year of publication[J]. Information Processing & Management, 2005, 41(6): 1441-1461.
[45] Cohen J.Statistical power analysis for the behavioral sciences[M]. Hillsdale: L. Erlbaum Associates, 1988.
[46] Ketcham C M.The proper use of citation data in journal management[J]. Archivum Immunologiae et Therapiae Experimentalis, 2008, 56(6): 357-362.
[47] Subotic S, Mukherjee B.Short and amusing: The relationship between title characteristics, downloads, and citations in psychology articles[J]. Journal of Information Science, 2014, 40(1): 115-124.
[48] Nieder C, Dalhaug A, Aandahl G.Correlation between article download and citation figures for highly accessed articles from five open access oncology journals[J]. SpringerPlus, 2013, 2(1): 261.
[49] Bornmann L.Scientific Peer Review[J]. Annual Review of Information Science and Technology, 2011, 45(1): 197-245.
[50] Wallmark J T, Sedig K G. Quality of research measured by citation method and by peer review—A comparison[J]. IEEE Transactions on Engineering Management, 1986, EM-33(4): 218-222.
[51] Derrick G E, Haynes A, Chapman S, et al.The association between Four Citation Metrics and Peer Rankings of Research Influence of Australian Researchers in six fields of public health[J]. PLoS ONE, 2011, 6(4): e18521.
[52] Anderson R C, Narin F, Mcallister P.Publication ratings versus peer ratings of universities[J]. Journal of the American Society for Information Science and Technology, 1978, 29(2): 91-103.
[53] Mryglod O, Kenna R, Holovatch Y, et al.Absolute and specific measures of research group excellence[J]. Scientometrics, 2013, 95(1): 115-127.
[54] Vaughan L, Tang J, Yang R B.Investigating disciplinary differences in the relationships between citations and downloads[J]. Scientometrics, 2017, 111(3): 1533-1545.
[55] Tahamtan I, Afshar A S, Ahamdzadeh K.Factors affecting number of citations: a comprehensive review of the literature[J]. Scientometrics, 2016, 107(3): 1195-1225. |
|
|
|
