|
|
|
| Representative Paper Selection Based on Citation Comment Weighing |
| Ma Ruimin1,2, Liu Zhifang1, Lyu Yuhan1, Feng Yumei1 |
1.School of Economics and Management, Shanxi University, Taiyuan 030006
2.Research Center for Science Evaluation, Shanxi University, Taiyuan 030006 |
|
|
|
|
Abstract The scientific selection of representative paper is the basic work that ensures the implementation of the representative work evaluation system. It is theoretically and methodologically crucial to establish a novel alternative under the current background of “breaking the five-only.” This study first probes into the connotation of representative paper and the selection perspectives. Then it elaborates on the idea sources of selection models from theoretical and empirical perspectives. Furthermore, the selection model combing authority citer and citation comment classification is developed. Subsequently, the empirical research based on candidate projects of the National Natural Science Award in the field of physics is conducted. The obtained results demonstrate that the proposed selection model is a typical model of “selecting the best from best,” which can accurately select representative papers from several papers of applicants. Meanwhile, compared with non-self-citation count and impact factor, it further proves that the mode is superior — more discriminative and more stable.
|
|
Received: 11 May 2022
|
|
|
|
1 叶继元. “SCI至上”的要害、根源与破解之道[J]. 情报学报, 2020, 39(8): 787-795.
2 邱均平, 张裕晨, 周子番. 新时代我国科研评价体系重构中必须处理好八大关系[J]. 中国图书馆学报, 2021, 47(1): 47-60.
3 曾建勋. 重视学术代表作的识别与遴选[J]. 数字图书馆论坛, 2021(9): 1.
4 马瑞敏. 建立科学的论文代表作评价制度[N]. 中国社会科学报, 2021-02-23(1).
5 Moed H F, Halevi G. Multidimensional assessment of scholarly research impact[J]. Journal of the Association for Information Science and Technology, 2015, 66(10): 1988-2002.
6 Schubert A. Using the h-index for assessing single publications[J]. Scientometrics, 2009, 78(3): 559-565.
7 Kosmulski M. Successful papers: a new idea in evaluation of scientific output[J]. Journal of Informetrics, 2011, 5(3): 481-485.
8 Ye F Y, Leydesdorff L. The “academic trace” of the performance matrix: a mathematical synthesis of the h-index and the integrated impact indicator (I3)[J]. Journal of the Association for Information Science and Technology, 2014, 65(4): 742-750.
9 Nykl M, Je?ek K, Fiala D, et al. PageRank variants in the evaluation of citation networks[J]. Journal of Informetrics, 2014, 8(3): 683-692.
10 Yan E J, Ding Y, Sugimoto C R. P-Rank: an indicator measuring prestige in heterogeneous scholarly networks[J]. Journal of the American Society for Information Science and Technology, 2011, 62(3): 467-477.
11 Wang J, Veugelers R, Stephan P. Bias against novelty in science: a cautionary tale for users of bibliometric indicators[J]. Research Policy, 2017, 46(8): 1416-1436.
12 Wu L F, Wang D S, Evans J A. Large teams develop and small teams disrupt science and technology[J]. Nature, 2019, 566(7744): 378-382.
13 Zhang G, Ding Y, Milojevi? S. Citation content analysis (CCA): a framework for syntactic and semantic analysis of citation content[J]. Journal of the American Society for Information Science and Technology, 2013, 64(7): 1490-1503.
14 卢超, 章成志, 王玉琢, 等. 语义特征分析的深化——学术文献的全文计量分析研究综述[J]. 中国图书馆学报, 2021, 47(2): 110-131.
15 Iqbal S, Hassan S U, Aljohani N R, et al. A decade of in-text citation analysis based on natural language processing and machine learning techniques: an overview of empirical studies[J]. Scientometrics, 2021, 126(8): 6551-6599.
16 Tahamtan I, Bornmann L. What do citation counts measure? An updated review of studies on citations in scientific documents published between 2006 and 2018[J].Scientometrics, 2019, 121(3): 1635-1684.
17 Hu Z G, Chen C M, Liu Z Y. Where are citations located in the body of scientific articles? A study of the distributions of citation locations[J]. Journal of Informetrics, 2013, 7(4): 887-896.
18 冯长根. 一种自然而然的科技成果评价方法值得国家推广[J]. 中国人大, 2017(7): 33-35.
19 尚海茹, 冯长根, 孙良. 用学术影响力评价学术论文——兼论关于学术传承效应和长期引用的两个新指标[J]. 科学通报, 2016, 61(26): 2853-2860.
20 Le X Q, Chu J D, Deng S Y, et al. CiteOpinion: evidence-based evaluation tool for academic contributions of research papers based on citing sentences[J]. Journal of Data and Information Science, 2019, 4(4): 26-41.
21 章成志, 李铮. 基于学术论文全文的创新研究评价句抽取研究[J]. 数据分析与知识发现, 2019, 3(10): 12-19.
22 Costas R, Zahedi Z, Wouters P. Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective[J]. Journal of the Association for Information Science and Technology, 2015, 66(10): 2003-2019.
23 Bornmann L, Haunschild R. Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data[J]. PLoS One, 2018, 13(5): e0197133.
24 Thelwall M. Measuring societal impacts of research with altmetrics? Common problems and mistakes[J]. Journal of Economic Surveys, 2021, 35(5): 1302-1314.
25 郭凤娇, 赵蓉英, 孙劭敏. 基于科学交流过程的学术论文影响力评价研究——以中国社会科学国际学术论文为例[J]. 情报学报, 2020, 39(4): 357-366.
26 姜磊. 单篇学术论文的评价指标体系研究[D]. 大连: 大连理工大学, 2014.
27 Bornmann L, Mutz R. Further steps towards an ideal method of measuring citation performance: the avoidance of citation (ratio) averages in field-normalization[J]. Journal of Informetrics, 2011, 5(1): 228-230.
28 刘雪立, 申蓝, 郭佳, 等. 利用论文被引频次基准线遴选学者代表作的方法——以河南省学者论文为例[J]. 中国科技期刊研究, 2020, 31(8): 941-947.
29 姜春林, 赵宇航. 代表作评价: 探索之路与完善之策[J]. 甘肃社会科学, 2016(3): 143-148.
30 Zhou J L, Zeng A, Fan Y, et al. The representative works of scientists[J]. Scientometrics, 2018, 117(3): 1721-1732.
31 孙劲楠, 丁佐奇. 基于Z指数的大学教师代表作评价研究[J]. 药学教育, 2021, 37(1): 1-6.
32 任全娥. 代表性学术成果评价的图书情报学认知与阐释[J]. 扬州大学学报(人文社会科学版), 2021(4): 119-128.
33 俞立平, 张矿伟, 蒋长兵. 推进代表作评价存在的问题与对策研究[J]. 情报学报, 2021, 40(4): 345-353.
34 谢珍, 马建霞, 胡文静. 学术代表作评价: 方法述评与研究展望[J]. 情报理论与实践, 2021, 44(12): 190-196.
35 R.K.默顿. 科学社会学: 理论与经验研究[M]. 鲁旭东, 林聚任, 译. 北京: 商务印书馆, 2009.
36 乔纳森?科尔, 斯蒂芬?科尔. 科学界的社会分层[M]. 赵佳苓, 译. 北京: 华夏出版社, 1989.
37 刘珺珺. 科学社会学[M]. 上海: 上海科技教育出版社, 2009.
38 White H D. Authors as citers over time[J]. Journal of the American Society for Information Science and Technology, 2001, 52(2): 87-108.
39 皮埃尔?布尔迪厄. 科学的社会用途——写给科学场的临床社会学[M]. 刘成富, 张艳, 译. 南京: 南京大学出版社, 2005.
40 Ding Y, Cronin B. Popular and/or prestigious? Measures of scholarly esteem[J]. Information Processing & Management, 2011, 47(1): 80-96.
41 马瑞敏, 张慧, 杨雨华. 加权引用视角下的作者学术影响力评价研究[J]. 情报学报, 2017, 36(8): 790-797.
42 Clauset A, Shalizi C R, Newman M E J. Power-law distributions in empirical data[J]. SIAM Review, 2009, 51(4): 661-703.
43 万柏坤, 薛召军, 李佳, 等. 应用ROC曲线优选模式分类算法[J]. 自然科学进展, 2006, 16(11): 1511-1516. |
|
|
|
