Academic writing in the age of AI: Comparing the reliability of ChatGPT and Bard with Scopus and Web of Science

Authors : Swati Garg, Asad Ahmad, Dag Øivind Madsen

ChatGPT and Bard (now known as Gemini) are becoming indispensable resources for researchers, academicians and diverse stakeholders within the academic landscape. At the same time, traditional digital tools such as scholarly databases continue to be widely used. Web of Science and Scopus are the most extensive academic databases and are generally regarded as consistently reliable scholarly research resources. With the increasing acceptance of artificial intelligence (AI) in academic writing, this study focuses on understanding the reliability of the new AI models compared to Scopus and Web of Science.

The study includes a bibliometric analysis of green, sustainable and ecological buying behaviour, covering the period from 1 January 2011 to 21 May 2023. These results are used to compare the results from the AI and the traditional scholarly databases on several parameters. Overall, the findings suggest that AI models like ChatGPT and Bard are not yet reliable for academic writing tasks. It appears to be too early to depend on AI for such tasks.

URL : Academic writing in the age of AI: Comparing the reliability of ChatGPT and Bard with Scopus and Web of Science

DOI : https://doi.org/10.1016/j.jik.2024.100563

Field-specific gold open access dynamics in the Chinese mainland: Overviews, disparities, and strategic insights

Authors : Xinyi ChenZhiqiang Liu

Gold Open Access (OA) journals are crucial for scholarly communication, highlighting the need for a thorough evaluation of their academic influence on different research fields. This study leverages the InCites platform to examine article-level characteristics relating to 22 Essential Science Indicators (ESI) research fields, with a focus on the dynamics of gold OA articles, including gold OA uptake in the Chinese mainland and gold OA adoption in the domestic English-language academic journal publishing of the Chinese mainland.

The findings reveal that disparities in gold OA adoption across 22 ESI fields are more pronounced in the Chinese mainland compared with the world scenario. In the Chinese mainland, there is a significant polarization in gold OA publishing volumes across different ESI fields, particularly in Chemistry, Clinical Medicine, and Engineering.

This study builds on the understanding of OA citation advantage (OACA) by incorporating gold OA publishing volume into a two-dimensional framework, resulting in the development of a “distance” metric. It further categorizes gold OA citation effects into four quadrants: positive citation effects (quadrants A and B) and negative citation effects (quadrants C and D), based on category normalized citation impact (CNCI) and journal normalized citation impact (JNCI) indicators from the InCites database.

The findings underscore the importance of developing tailored strategies to address field-specific challenges and promote gold OA dynamics in the Chinese mainland; while prioritizing high-quality gold OA journals is essential for fostering gold OA development in the rest of the world.

URL : Field-specific gold open access dynamics in the Chinese mainland: Overviews, disparities, and strategic insights

DOI : https://doi.org/10.1002/leap.1630

“Giving them the best information I could with whatever I had at hand”. Physicians’ online health communication practices in a post-normal science context

Authors :

This study describes US-based physicians’ online public communication practices, particularly on the social media platform Twitter/X, during the COVID-19 pandemic. We draw on 28 semi-structured interviews to examine how they responded to the unique COVID-19 context with respect to each of the four features of post-normal science (PNS): facts uncertain, values in dispute, stakes high, and decisions urgent.

Our analysis reveals that the pandemic shifted what, why, and how physicians used the platform, and with whom they aimed to communicate. We discuss the implications of these changes in their online communication habits, discourses, and representations around social media as a reaction to the context of PNS brought about by the pandemic.

URL : “Giving them the best information I could with whatever I had at hand”. Physicians’ online health communication practices in a post-normal science context

DOI : https://doi.org/10.22323/2.23060204

Publishing Instincts: An Exploration-Exploitation Framework for Studying Academic Publishing Behavior and “Home Venues”

Authors : Teddy Lazebnik, Shir Aviv-Reuven, Ariel Rosenfeld

Scholarly communication is vital to scientific advancement, enabling the exchange of ideas and knowledge. When selecting publication venues, scholars consider various factors, such as journal relevance, reputation, outreach, and editorial standards and practices. However, some of these factors are inconspicuous or inconsistent across venues and individual publications.

This study proposes that scholars’ decision-making process can be conceptualized and explored through the biologically inspired exploration-exploitation (EE) framework, which posits that scholars balance between familiar and under-explored publication venues. Building on the EE framework, we introduce a grounded definition for “Home Venues” (HVs) – an informal concept used to describe the set of venues where a scholar consistently publishes – and investigate their emergence and key characteristics.

Our analysis reveals that the publication patterns of roughly three-quarters of computer science scholars align with the expectations of the EE framework. For these scholars, HVs typically emerge and stabilize after approximately 15-20 publications. Additionally, scholars with higher h-indexes or a greater number of publications, tend to have higher-ranking journals as their HVs.

URL : https://arxiv.org/abs/2409.12158

Status of peer review guidelines in international surgical journals: A cross-sectional survey

Authors : Min DongWenjing WangXuemei LiuFang LeiYunmei Luo

Aim

To gain insight into the current status of peer review guidelines in international surgical journals and to offer guidance for the development of peer review guidelines for surgical journals.

Methods

We selected the top 100 journals in the category of ‘Surgery’ according to the Journal Citation Report 2021. We conducted a search of the websites of these journals, and Web of Science, PubMed, other databases, in order to gather the peer review guidelines published by these top 100 journals up until June 30, 2022. Additionally, we analysed the contents of these peer review guidelines.

Results

Only 52% (52/100) of journals provided guidelines for reviewers. Sixteen peer review guidelines which were published by these 52 surgical journals were included in this study. The contents of these peer review guidelines were classified into 33 items. The most common item was research methodology, which was mentioned by 13 journals (25%, 13/52). Other important items include statistical methodology, mentioned by 11 journals (21.2%), the rationality of figures, tables, and data, mentioned by 11 journals (21.2%), innovation of research, mentioned by nine journals (17.3%), and language expression, readability of papers, ethical review, references, and so forth, mentioned by eight journals (15.4%).

Two journals described items for quality assessment of peer review. Forty-three journals offered a checklist to guide reviewers on how to write a review report. Some surgical journals developed peer review guidelines for reviewers with different academic levels, such as professional reviewers and patient/public reviewers. Additionally, some surgical journals provided specific items for different types of papers, such as original articles, reviews, surgical videos, surgical database research, surgery-related outcome measurements, and case reports in their peer review guidelines.

Conclusions

Key contents of peer review guidelines for the reviewers of surgical journals not only include items relating to reviewing research methodology, statistical methods, figures, tables and data, research innovation, ethical review, but also cover items concerning reviewing surgical videos, surgical database research, surgery-related outcome measurements, instructions on how to write a review report, and guidelines on how to assess quality of peer review.

URL : Status of peer review guidelines in international surgical journals: A cross-sectional survey

DOI : https://doi.org/10.1002/leap.1624

Is open access disrupting the journal business? A perspective from comparing full adopters, partial adopters, and non-adopters

Author : Xijie Zhang

Two decades after the inception of open access publishing (OA), its impact has remained a focal point in academic discourse. This study adopted a disruptive innovation framework to examine OA’s influence on the traditional subscription market. It assesses the market power of gold journals (OA full adopters) in comparison with hybrid journals and closed-access journals (partial adopters and non-adopters). Additionally, it contrasts the market power between hybrid journals (partial adopters) and closed-access journals (non-adopters).

Using the Lerner index to measure market power through price elasticity of demand, this study employs difference tests and multiple regressions. These findings indicate that OA full adopters disrupt the market power of non-adopting incumbents. However, by integrating the OA option into their business models, partial adopters can effectively mitigate this disruption and expand their influence from the traditional subscription market to the emerging OA paradigm.

URL : Is open access disrupting the journal business? A perspective from comparing full adopters, partial adopters, and non-adopters

DOI : https://doi.org/10.1016/j.joi.2024.101574

“Academic Publishing is a Business Interest”: Reconciling Faculty Serials Needs and Economic Realities at a Carnegie R2 University

Authors : Rachel E. Scott, Anne Shelley, Chad E. Buckley, Cassie Thayer-Styes, Julie A. Murphy

Introduction

This article explores faculty conceptions of academic publishers, their willingness to circumvent paywalls and share content, and their understanding of who holds the responsibility to pay for this body of scholarly work to which they all contribute.

Methods

The authors conducted semi-structured interviews with 25 faculty at their Carnegie R2 university to explore scholars’ perspectives with respect to the costs of serials and the responsibilities of the University and library in support of scholarly publishing.

Results

Participants reported a broad spectrum of perspectives with respect to circumventing publisher paywalls and offered nuanced practices for interacting with paywalled content. They explained which library services work well and offered suggestions on how best to support faculty needs for serial literature. Although most participants agree that the University has the responsibility of making academic literature available to the community, they differ in their conceptions of academic publishers as good-faith partners in the knowledge enterprise.

Discussion

The results suggest a great deal of ambiguity and diversity of beliefs among faculty: some would support boycotting all commercial publishers; some understand academic publishers to be integral to the dissemination of their work, not to mention tenure and promotion processes; and many acknowledge a variety of tensions in what feels to them an exploitative and fraught relationship.

These findings have implications for library services in acquisitions, collection management, scholarly communication, discovery, and access.

Conclusion

The data provide insight into the nuanced perceptions that faculty members at a Carnegie R2 hold concerning the costs of scholarly publishing and the role of academic publishers within scholarly communication.

URL : “Academic Publishing is a Business Interest”: Reconciling Faculty Serials Needs and Economic Realities at a Carnegie R2 University

DOI : https://doi.org/10.31274/jlsc.16232