|
|
|
| A New Method for Journal Evaluation—Analysis Based on the Authors’ Bios in Journal Articles |
| Song Xiaochen1, Li Menghao2, Zhou Liang3 |
1. School of Business, Renmin University of China, Beijing 100872;
2. School of Business, Renmin University of China, Beijing 100872;
3. School of Public Administration, Sichuan University, Chengdu 610065 |
|
|
|
|
Abstract Researchers categorize the various methods of assessing journal quality into two approaches—bibliometric methods and expert assessment—each having its own advantages. This paper proposes a new method to measure the academic influence of journals. The method takes the authors of authoritative journal articles as the starting point and collects the personal profiles/biographies written in these articles that disclose the main journals in which such authors used to publish. We organize and process the ranking of journals’ importance in a certain field and calculate the authors’ Vote Score (V-score) on every journal. On the basis of this V-score, we can assess the impact of a journal in such a field. In addition, the efficacy of the method is tested with examples based on leading journals in the field of Information Systems. This method combines the advantages of the two traditional methods, and compensates for their deficiencies to a certain extent, which has certain practical significance.
|
|
Received: 08 April 2018
|
|
|
|
[1] Straub D, Anderson C. Journal quality and citations: Common metrics and considerations about their use[J]. MIS Quarterly, 2010, 34(1): iii-xii.
[2] Harvey C, Morris H, Kelly A.Academic journal quality guide: Journals classified by field and rank[M]. United Kingdom: The Association of Business Schools, 2007: 1-2.
[3] Allen L, Jones C, Dolby K, et al.Looking for landmarks: The role of expert review and bibliometric analysis in evaluating scientific publication outputs[J]. PLoS ONE, 2009, 4(6): e5910.
[4] 钱艳俊, 林军. 基于IF和AIS的期刊质量评价——以管理科学领域为例[J]. 情报学报, 2015, 34(2): 176-181.
[5] Garfield E.The history and meaning of the journal impact factor[J]. JAMA, 2006, 295(1): 90-93.
[6] 金碧辉, 汪寿阳, 任胜利, 等. 论期刊影响因子与论文学术质量的关系[J]. 中国科技期刊研究, 2000, 11(4): 202-205.
[7] 李建辉, 王志魁, 徐宏, 等. 自引对科技期刊影响因子作用的量化研究[J]. 编辑学报, 2007, 19(2): 154-157.
[8] Bergstrom C.Measuring the value and prestige of scholarly journals[J]. College & Research Libraries News, 2007, 68(5): 314-316.
[9] Franceschet M.The difference between popularity and prestige in the sciences and in the social sciences: A bibliometric analysis[J]. Journal of Informetrics, 2010, 4(1): 55-63.
[10] Franceschet M.A cluster analysis of scholar and journal bibliometric indicators[J]. Journal of the American Society for Information Science & Technology, 2009, 60(10): 1950-1964.
[11] 任胜利. 特征因子(Eigenfactor): 基于引证网络分析期刊和论文的重要性[J]. 中国科技期刊研究, 2009, 20(3): 415-418.
[12] 俞立平, 王作功. 时间视角下h指数创新: h1_n指数与hn指数[J]. 情报学报, 2017, 36(4): 346-351.
[13] Braun T, Nzel W, Schubert S.A Hirsch-type index for journal[J]. Scientometrics, 2006, 6(91): 169-173.
[14] Finch A.Can we do better than existing author citation metrics?[J]. Bioessays, 2010, 32(9): 744-747.
[15] 王智博, 盛小平. 中心性指标在开放存取期刊评价中的适用性研究[J]. 图书馆, 2014(4): 37-40.
[16] Butler D.Free journal ranking tool enters citation market[J]. Nature, 2008, 451(7174): 6.
[17] 顾欢. “标准特征因子”、“标准论文影响分值”与SNIP在跨学科评价中的相关性分析[J]. 情报杂志, 2017, 36(8): 120-123.
[18] 王一华. 基于IF(JCR)、IF(Scopus)、h指数、SJR值、SNIP值的期刊评价研究[J]. 图书情报工作, 2011, 55(16): 144-148.
[19] Aleskerov F T, Pislyakov V.A subochev ranking journals in economics, management and political science by social choice theory methods[J]. SSRN Electronic Journal, 2014.
[20] Straub D, Anderson C. Journal quality and citations: Common metrics and considerations about their use[J]. MIS Quarterly, 2010, 34(1): iii-xii.
[21] Lewis B R, Templeton G F, Luo X.A scientometric investigation into the validity of is journal quality measures[J]. Journal of the Association for Information Systems, 2007, 8(12): 619-633.
[22] 周春雷. 期刊评价中新型专家评审指标探讨[J]. 图书情报工作, 2012, 56(16): 71-74.
[23] Lowry P B, Moody G D, Gaskin J, et al.Evaluating journal quality and the Association for Information Systems (AIS) Senior Scholars’ journal basket via bibliometric measures: Do expert journal assessments add value?[J]. MIS Quarterly, 2013, 37(4): 993-1012.
[24] Polites G L, Watson R T.Using social network analysis to analyze relationships among IS journals[J]. Journal of the Association for Information Systems, 2009, 10(8): 595-636. |
|
|
|
