|
|
|
| Research on Influence Evaluation of Humanities and Social Sciences Academic Monographs from the Perspective of Altmetrics: Comparative Analysis Based on BkCI, Amazon, and Goodreads |
| Li Jiangbo1, Zhang Liang1, Jiang Chunlin2 |
1.Department of Management Science and Engineering, School of Business, Qingdao University, Qingdao 266100
2.WISE Lab, Institute of Science of Science and S&T Management, Dalian University of Technology, Dalian 116024 |
|
|
|
|
Abstract Altmetrics has developed rapidly since it was introduced, significantly broadening the research scope of bibliometrics evaluation. Currently, the vast majority of altmetrics research focuses on evaluating the academic achievements of papers, and it seems that not enough attention is paid to the evaluation of academic monographs or other types of academic achievements. However, the monograph is an important form of academic achievement in Social Sciences and Humanities. This study focuses on the evaluation of academic achievements of the monograph. By standardizing the publishing time, we calculate the daily average citation of monographs in the database. This study also uses a recurrent neural network method to classify the online reviews of monographs. It uses an emotion dictionary to analyze the review text with fine-grained emotion and gets the sentiment analysis indicator. The results show that some academic books are cited less in the BkCI database, but their daily average citation is higher because these academic monographs are published later, and there is not enough time to accumulate citations. This shows that the low citation of monographs does not mean that their academic influence should be low. It is problematic to evaluate academic monographs’ influence only by using the citation in the citation index database. Another result shows little correlation between Altmetrics indicators and citation indicators, especially between average sentiment score indicator and citation indicator. Low correlation means that the Altmetric indicators from online reviews do not have the feasibility to evaluate academic influence of academic monographs, so they can only be used to evaluate the social influence of academic monographs.
|
|
Received: 21 February 2020
|
|
|
|
1 Priem J, Taraborellid D, Groth P. et al. Altmetrics: A manifesto[EB/OL]. (2010-10-26) [2016-11-30]. http://altmetrics.org/mani festo.
2 邱均平, 张心源, 董克. Altmetrics指标在机构知识库中的应用研究[J]. 图书情报工作, 2015, 59(2): 100-105.
3 McFedries P. Measuring the impact of altmetrics [technically speaking][J]. IEEE Spectrum, 2012, 49(8): 28.
4 Galligan F, Dyas-Correia S. Altmetrics: Rethinking the way we measure[J]. Serials Review, 2013, 39(1): 56-61.
5 Costas R, Zahedi Z, Wouters P. Do “altmetrics” correlate with citations? Extensive comparison of altmetric indicators with citations from a multidisciplinary perspective[J]. Journal of the Association for Information Science and Technology, 2015, 66(10): 2003-2019.
6 Gl?nzel W, Schoepflin U. A bibliometric study of reference literature in the sciences and social sciences[J]. Information Processing & Management, 1999, 35(1): 31-44.
7 Huang M H, Chang Y W. Characteristics of research output in social sciences and humanities: From a research evaluation perspective[J]. Journal of the American Society for Information Science and Technology, 2008, 59(11): 1819-1828.
8 Nederhof A J. Bibliometric monitoring of research performance in the social sciences and the humanities: A review[J]. Scientometrics, 2006, 66(1): 81-100.
9 姜春林. 国外人文社会科学学术图书评价研究进展[J]. 西南民族大学学报(人文社科版), 2019, 40(2): 228-235.
10 Zuccala A A, Verleysen F T, Cornacchia R, et al. Altmetrics for the humanities: Comparing Goodreads reader ratings with citations to history books[J]. Aslib Journal of Information Management, 2015, 67(3): 320-336.
11 Kousha K, Thelwall M. Can Amazon.com reviews help to assess the wider impacts of books?[J]. Journal of the Association for Information Science and Technology, 2016, 67(3): 566-581.
12 何峻, 蔡蓉华. 中文图书评价体系研究[J]. 大学图书馆学报, 2016, 34(3): 51-58, 15.
13 李明, 陈铭. 学术图书Altmetrics评价指标分层框架探析[J]. 现代情报, 2018, 38(5): 106-109.
14 姜春林, 魏庆肖. 融合补充计量指标的人文社科专著影响力评价指标体系研究[J]. 情报杂志, 2018, 37(12): 65-71, 77.
15 李明, 陈铭. 中文学术图书Altmetrics评价优势、体系及难点分析[J]. 西南民族大学学报(人文社会科学版), 2019, 40(2): 236-240.
16 李明, 李江, 陈铭, 等. 中文学术图书引文量与Altmetrics指标探索性分析及其启示[J]. 情报学报, 2019, 38(6): 557-567.
17 章成志, 童甜甜, 周清清. 整合不同评论平台的图书综合影响力评价研究[J]. 情报学报, 2018, 37(9): 861-873.
18 Xiang Z, Du Q Z, Ma Y F, et al. A comparative analysis of major online review platforms: Implications for social media analytics in hospitality and tourism[J]. Tourism Management, 2017, 58: 51-65.
19 He R N, McAuley J. Ups and downs: Modeling the visual evolution of fashion trends with one-class collaborative filtering[C]// Proceedings of the 25th International Conference on World Wide Web. New York: ACM Press, 2016: 507-517.
20 McAuley J, Targett C, Shi Q F, et al. Image-based recommendations on styles and substitutes[C]// Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval. New York: ACM Press, 2015: 43-52.
21 Wan M T, McAuley J. Item recommendation on monotonic behavior chains[C]// Proceedings of the 12th ACM Conference on Recommender Systems. New York: ACM Press, 2018: 86-94.
22 Wan M T, Misra R, Nakashole N, et al. Fine-grained spoiler detection from large-scale review corpora[C]// Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Stroudsburg: Association for Computational Linguistics, 2019: 2605-2610.
23 Abadi M, Barham P, Chen J M, et al. TensorFlow: A system for large-scale machine learning[C]// Proceedings of the 12th USENIX Conference on Operating Systems Design and Implementation. Berkeley: USENIX Association, 2016: 265-283.
24 Hochreiter S, Schmidhuber J. Long short-term memory[J]. Neural Computation, 1997, 9(8): 1735-1780.
25 周清清, 章成志. 在线用户评论细粒度属性抽取[J]. 情报学报, 2017, 36(5): 484-493.
26 Zhou Q Q, Zhang C Z, Zhao S X, et al. Measuring book impact based on the multi-granularity online review mining[J]. Scientometrics, 2016, 107(3): 1435-1455.
27 Salton G, McGill M J. Introduction to modern information retrieval[M]. New York: McDraw-Hill, 1983: 30-42.
28 Smilkov D, Thorat N, Nicholson C, et al. Embedding Projector: Interactive visualization and interpretation of embeddings[OL]. https://arxiv.org/pdf/1611.05469.pdf.
29 Hu M Q, Liu B. Mining and summarizing customer reviews[C]//Proceedings of the Tenth ACM SIGKDD International Conference on Knowledge Discovery and Data Mining. New Yok: ACM Press, 2004: 168-177.
30 Bornmann L, Haunschild R. Normalization of zero-inflated data: An empirical analysis of a new indicator family and its use with altmetrics data[J]. Journal of Informetrics, 2018, 12(3): 998-1011. |
|
|
|
