|
|
|
| Opinions on New Science and Technology Evaluation Methods |
| Chen Yunwei1,2, Zhang Zhiqiang1,2 |
1.Scientometrics & Evaluation Research Center (SERC), Chengdu Library and Information Center of Chinese Academy of Sciences, Chengdu 610041
2.School of Economics and Management, University of Chinese Academy of Sciences, Beijing 100190 |
|
|
|
|
Abstract This paper analyzes the original intent and mission of research evaluation, international practices, the complexity of evaluation subjects, and the difficulty of eradicating and replacing evaluation systems to discuss three key issues in the practice of research evaluation: reasonable understanding of various evaluation indicators, rational use of paper indicators, and comprehensive application of other indicators. Three suggestions to improve research evaluation practices include understanding the basic principles of research evaluation, reforming the evaluation policy system, and applying indicators in a rational and limited way.
|
|
Received: 04 May 2020
|
|
|
|
1 侯剑华, 李旭彦. 让科技评价回归科学[N]. 中国科学报, 2020-03-31(7).
2 张志强, 田倩飞, 陈云伟. 科技强国主要科技指标体系比较研究[J]. 中国科学院院刊, 2018, 33(10): 1052-1063.
3 European Commission. New: European Innovation Scoreboard 2019[EB/OL]. [2020-04-22]. http://www.iprhelpdesk.eu/news/new-european-innovation-scoreboard-2019.
4 European Commission. The 2019 EU Industrial R&D Investment Scoreboard[EB/OL]. [2020-04-22]. https://iri.jrc.ec.europa.eu/sites/default/files/2020-01/SB2019_Final_online.pdf.
5 Clarivate. Derwent Top 100 Global Innovators 2020[EB/OL]. [2020-04-22]. https://clarivate.com/derwent/top100innovators/.
6 陈宁. 美国的科技评价与科研事后评价概况[J]. 全球科技经济瞭望, 2007, 22(12): 25-31.
7 REF. Research Excellence Framework[EB/OL]. [2020-04-23]. https://www.ref.ac.uk/.
8 郑久良, 叶晓文, 范琼, 等. 德国马普学会的科技创新机制研究[J]. 世界科技研究与发展, 2018, 40(6): 627-633.
9 章熙春, 柳一超. 德国科技创新能力评价的做法与借鉴[J]. 科技管理研究, 2017, 37(2): 77-83.
10 方晓东, 董瑜, 金瑛, 等. 法国科技评价发展及其对中国的启 示——基于CoNRS和HCéRES评价指标的案例研究[J]. 世界科技研究与发展, 2019, 41(3): 294-306.
11 刘强, 陈云伟, 张志强. 用于科技评价的挪威模型方法与应用综述[J]. 数据分析与知识发现, 2019, 3(5): 41-50.
12 北京智源人工智能研究院. 如何破除“唯论文”? 详解伯克利“科研重工业模式”的成功经验[EB/OL]. [2020-04-24]. https://mp.weixin.qq.com/s/NI_ReqRxQDccHs0ZqqVpxg.
13 林豆豆, 田大山. MPG科研管理模式对创新我国基础研究机构的启示[J]. 自然辩证法通讯, 2006, 28(4): 53-60, 111.
14 仲志磊, 程正喜, 孙强, 等. 日本理化所人才政策对中科院工程类研究所人事制度改革的启示[J]. 才智, 2017(6): 230-231, 233.
15 Zuckerman H, Merton R K. Patterns of evaluation in science: Institutionalization, structure and functions of the referee system[J]. Minerva, 1971, 9(1): 66-100.
16 刘强, 陈云伟. 科学家评价方法述评[J]. 情报杂志, 2019, 38(3): 80-86, 60.
17 Wainer J, Vieira P. Correlations between bibliometrics and peer evaluation for all disciplines: The evaluation of Brazilian scientists[J]. Scientometrics, 2013, 96(2): 395-410.
18 Lin L L, Xu Z M, Ding Y, et al. Finding topic-level experts in scholarly networks[J]. Scientometrics, 2013, 97(3): 797-819.
19 Whitfield J. Collaboration: Group theory[J]. Nature, 2008, 455(7214): 720-723.
20 Abbasi A, Altmann J, Hossain L. Identifying the effects of co-authorship networks on the performance of scholars: A correlation and regression analysis of performance measures and social network analysis measures[J]. Journal of Informetrics, 2011, 5(4): 594-607.
21 McCarty C, Jawitz J W, Hopkins A, et al. Predicting author h-index using characteristics of the co-author network[J]. Scientometrics, 2013, 96(2): 467-483.
22 Priem J, Taraborelli D, Groth P, et al. Altmetrics: A manifesto[EB/OL]. [2020-04-24]. http://altmetrics.org/manifesto/.
23 王志刚. 要写有价值高水平论文 不唯论文并非不要论文[EB/OL]. [2020-03-17]. https://www.chinanews.com/gn/2020/03-17/9128444.shtml.
24 Hirsch J E. An index to quantify an individual??s scientific research output[J]. Proceedings of the National Academy of Sciences of the United States of America, 2005, 102(46): 16569-16572.
25 Otte E, Rousseau R. Social network analysis: A powerful strategy, also for the information sciences[J]. Journal of Information Science, 2002, 28(6): 441-453.
26 Yan E J, Ding Y. Discovering author impact: A PageRank perspective[J]. Information Processing and Management, 2011, 47(1): 125-134.
27 中国科协. 2016-2017中国科协学科发展研究系列报告[EB/OL]. [2020-02-14]. http://www.xinhuanet.com/2018-04/10/c_137100739.htm.
28 田倩飞, 张志强, 任晓亚, 等. 科技强国基础研究投入-产出-政策分析及其启示[J].中国科学院院刊, 2019, 34(12): 1406-1420.
29 任晓亚, 张志强. 主要科技领域国际权威奖项规律及其驱动因素分析[J]. 情报学报, 2019, 38(9): 881-893.
30 DORA. San Francisco Declaration on Research Assessment[EB/OL]. [2020-02-24]. https://sfdora.org/read/.
31 Hicks D, Wouters P, Waltman L, et al. Bibliometrics: The Leiden Manifesto for research metrics[J]. Nature, 2015, 520(7548): 429-431.
32 Moed H F. Appropriate use of metrics in research assessment of autonomous academic institutions[J]. Scholarly Assessment Reports, 2020, 2(1): 1.
33 王璐, 王小栋. 英国第三方教育评估的发展与规范: 基于英国独立学校督导团的研究[J]. 外国教育研究, 2018, 45(2): 16-28.
34 de Rijcke S, Wouters P F, Rushforth A D, et al. Evaluation practices and effects of indicator use—A literature review[J]. Research Evaluation, 2016, 25(2): 161-169.
35 AdamsJ, McVeighM, PendleburyD, et al. 全面画像 而非简单指标[J]. 科学观察, 2019, 14(4): 58-65. |
|
|
|
