|
|
|
| A Comparative Study of the Academic and Social Impact of Papers from the Diffusion Perspective: Taking Biomedicine as an Example |
| Zhang Jingwen, Min Chao |
| School of Information Management, Nanjing University, Nanjing 210023 |
|
|
|
|
Abstract The dynamic process of citation diffusion demonstrates more comprehensively the quality and influence of scientific papers. From the perspective of citation diffusion, we introduce Altmetrics and the traditional citation indicators and attempt to comprehensively explore the impact of research under different citation diffusion patterns and the correlation between the indicators of academic and social impact. This study suggests that the Altmetrics score in regular and continuous citation diffusion patterns is positively correlated with citations, and these patterns have both high academic and social impact. In an irregular citation diffusion pattern, citations are not related to social media, indicating that high social impact does not always represent high academic impact. In the initial period of publication, the Altmetrics score can promote the citation. In this study, we analyze the research impact of different citation diffusion patterns with Altmetrics and citations from the perspective of diffusion, thereby providing a reference for evaluating the impact of scientific research using multi-dimensional indicators, as well as for improving academic impact.
|
|
Received: 03 December 2021
|
|
|
|
1 Line M B, Sandison A. “Obsolescence” and changes in the use of literature with time[J]. Journal of Documentation, 1974, 30(3): 283-350.
2 Bornmann L. Measuring the societal impact of research[J]. EMBO Reports, 2012, 13(8): 673-676.
3 REF 2014: panel criteria and working methods[EB/OL]. (2012-01-01) [2021-06-01]. https://www.ref.ac.uk/2014/media/ref/content/pub/panelcriteriaandworkingmethods/01_12_1.pdf.
4 Bornmann L. What is societal impact of research and how can it be assessed? A literature survey[J]. Journal of the American Society for Information Science and Technology, 2013, 64(2): 217-233.
5 Chretien K C, Azar J, Kind T. Physicians on Twitter[J]. JAMA, 2011, 305(6): 566-568.
6 Priem J, Taraborelli D, Groth P, et al. Altmetrics: a manifesto[EB/OL]. (2010-10-26) [2021-06-01]. http://altmetrics.org/manifesto.
7 Sugimoto C R, Work S, Larivière V, et al. Scholarly use of social media and altmetrics: a review of the literature[J]. Journal of the Association for Information Science and Technology, 2017, 68(9): 2037-2062.
8 Cronin B, Sugimoto C R. Beyond bibliometrics: harnessing multidimensional indicators of scholarly impact[M]. Cambridge: The MIT Press, 2014.
9 邱均平, 余厚强. 论推动替代计量学发展的若干基本问题[J]. 中国图书馆学报, 2015, 41(1): 4-15.
10 Wei M K, Noroozi Chakoli A. Evaluating the relationship between the academic and social impact of open access books based on citation behaviors and social media attention[J]. Scientometrics, 2020, 125(3): 2401-2420.
11 de Winter J C F. The relationship between tweets, citations, and article views for PLOS ONE articles[J]. Scientometrics, 2015, 102(2): 1773-1779.
12 Gl?nzel W, Chi P S. The big challenge of Scientometrics 2.0: exploring the broader impact of scientific research in public health[J]. Scientometrics, 2020, 125(2): 1011-1031.
13 Ebrahimy S, Mehrad J, Setareh F, et al. Path analysis of the relationship between visibility and citation: the mediating roles of save, discussion, and recommendation metrics[J]. Scientometrics, 2016, 109(3): 1497-1510.
14 闵超, YingDing, 李江, 等. 单篇论著的引文扩散[J]. 情报学报, 2018, 37(4): 341-350.
15 Cano V, Lind N C. Citation life cycles of ten citation classics[J]. Scientometrics, 1991, 22(2): 297-312.
16 Avramescu A. Actuality and obsolescence of scientific literature[J]. Journal of the American Society for Information Science, 1979, 30(5): 296-303.
17 van Raan A F J. Sleeping beauties in science[J]. Scientometrics, 2004, 59: 467-472.
18 李江, 姜明利, 李玥婷. 引文曲线的分析框架研究——以诺贝尔奖得主的引文曲线为例[J]. 中国图书馆学报, 2014, 40(2): 41-49.
19 王海燕, 马峥, 潘云涛, 等. 高被引论文与“睡美人”论文引用曲线及影响因素研究[J]. 图书情报工作, 2015, 59(16): 83-89.
20 Aversa E S. Citation patterns of highly cited papers and their relationship to literature aging: a study of the working literature[J]. Scientometrics, 1985, 7: 383-389.
21 熊泽泉, 段宇锋. 中文学术期刊论文的引文模式研究——以2006—2008年图书情报领域期刊论文为例[J]. 图书情报工作, 2019, 63(8): 107-115.
22 Baumgartner S E, Leydesdorff L. Group-based trajectory modeling (GBTM) of citations in scholarly literature: dynamic qualities of “transient” and “sticky knowledge claims”[J]. Journal of the Association for Information Science and Technology, 2014, 65(4): 797-811.
23 石燕青, 赵一方. 科学文献被引轨迹的跨学科特征影响研究[J]. 图书情报工作, 2020, 64(14): 74-84.
24 杜建, 武夷山. 睡美人与王子文献的识别方法研究[J]. 图书情报工作, 2015, 59(19): 84-92.
25 张靖雯, 孙建军, 闵超. 引文起飞的定义与量化方法研究[J]. 情报学报, 2019, 38(8): 786-797.
26 Wang J. Citation time window choice for research impact evaluation[J]. Scientometrics, 2013, 94(3): 851-872.
27 Costas R, van Leeuwen T N, van Raan A F J. Is scientific literature subject to a ‘Sell-By-Date’? A general methodology to analyze the ‘durability’ of scientific documents[J]. Journal of the American Society for Information Science and Technology, 2010, 61(2): 329-339.
28 李凌英, 闵超, 孙建军. 引文波峰的量化与分布探究[J]. 情报学报, 2019, 38(7): 697-708.
29 Amin M, Mabe M A. Impact factors: use and abuse[J]. Medicina, 2003, 63(4): 347-354.
30 张琳, 孙蓓蓓, 王贤文, 等. 交叉科学成果影响力研究: 使用数据与引用数据视角[J]. 情报学报, 2020, 39(5): 469-477.
31 Hou J, Li H, Zhang Y. Identifying the princes base on Altmetrics: an awakening mechanism of sleeping beauties from the perspective of social media[J]. PLoS One, 2020, 15(11): e0241772.
32 Garfield E. The history and meaning of the journal impact factor[J]. JAMA, 2006, 295(1): 90-93.
33 Cronin B, Meho L. Using the h-index to rank influential information scientistss[J]. Journal of the American Society for Information Science and Technology, 2006, 57(9): 1275-1278.
34 Erdt M, Nagarajan A, Sin S C J, et al. Altmetrics: an analysis of the state-of-the-art in measuring research impact on social media[J]. Scientometrics, 2016, 109(2): 1117-1166.
35 Bornmann L, Haunschild R, Adams J. Do altmetrics assess societal impact in a comparable way to case studies? An empirical test of the convergent validity of altmetrics based on data from the UK research excellence framework (REF)[J]. Journal of Informetrics, 2019, 13(1): 325-340.
36 Costas R, Zahedi Z, Wouters P. Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective[J]. Journal of the Association for Information Science and Technology, 2015, 66(10): 2003-2019.
37 Haustein S, Peters I, Sugimoto C R, et al. Tweeting biomedicine: an analysis of tweets and citations in the biomedical literature[J]. Journal of the Association for Information Science and Technology, 2014, 65(4): 656-669.
38 Thelwall M, Haustein S, Larivière V, et al. Do altmetrics work? Twitter and ten other social web services[J]. PLoS One, 2013, 8(5): e64841.
39 Bornmann L. Alternative metrics in scientometrics: a meta-analysis of research into three altmetrics[J]. Scientometrics, 2015, 103(3): 1123-1144.
40 Mohammadi E, Thelwall M, Haustein S, et al. Who reads research articles? An altmetrics analysis of Mendeley user categories[J]. Journal of the Association for Information Science and Technology, 2015, 66(9): 1832-1846.
41 Hou J H, Ma D. How the high-impact papers formed? A study using data from social media and citation[J]. Scientometrics, 2020, 125: 2597-2615.
42 王磊. 基于Altmetrics的国内期刊影响力评价研究[J]. 大学图书馆学报, 2019, 37(3): 74-83.
43 杜建, 武夷山. 文献引文轨迹: 分类及测度[J]. 情报理论与实践, 2015, 38(7): 52-58.
44 Xia F, Su X Y, Wang W, et al. Bibliographic analysis of nature based on twitter and facebook altmetrics data[J]. PLoS One, 2016, 11(12): e0165997.
45 王凯利, 黄晓, 吴江. 融合Altmetrics和引文分析的期刊影响力综合评价研究[J]. 情报科学, 2021, 39(2): 169-177.
46 余厚强, 邱均平. 替代计量指标分层与聚合的理论研究[J]. 图书馆杂志, 2014, 33(10): 13-19.
47 Altmetric. Twitter[EB/OL]. (2020-09-17) [2021-06-01]. https://help.altmetric.com/support/solutions/articles/6000235926-twitter.
48 Haustein S, Peters I, Sugimoto C R, et al. Tweeting biomedicine: an analysis of tweets and citations in the biomedical literature[J]. Journal of the Association for Information Science and Technology, 2014, 65(4): 656-669.
49 Wang X W, Fang Z C, Guo X H. Tracking the digital footprints to scholarly articles from social media[J]. Scientometrics, 2016, 109(2): 1365-1376.
50 Allen H G, Stanton T R, Di Pietro F, et al. Social media release increases dissemination of original articles in the clinical pain sciences[J]. PLoS One, 2013, 8(7): e68914.
51 Eysenbach G. Can tweets predict citations? Metrics of social impact based on Twitter and correlation with traditional metrics of scientific impact[J]. Journal of Medical Internet Research, 2011, 13(4): e123.
52 Hassan S U, Iqbal S, Aljohani N R, et al. Introducing the ‘alt-index’ for measuring the social visibility of scientific research[J]. Scientometrics, 2020, 123: 1407-1419. |
|
|
|
