Enhancing peer review efficiency: A mixed-methods analysis of artificial intelligence-assisted reviewer selection across academic disciplines

Author : Shai Farber

This mixed-methods study evaluates the efficacy of artificial intelligence (AI)-assisted reviewer selection in academic publishing across diverse disciplines. Twenty journal editors assessed AI-generated reviewer recommendations for a manuscript. The AI system achieved a 42% overlap with editors’ selections and demonstrated a significant improvement in time efficiency, reducing selection time by 73%.

Editors found that 37% of AI-suggested reviewers who were not part of their initial selection were indeed suitable. The system’s performance varied across disciplines, with higher accuracy in STEM fields (Cohen’s d = 0.68). Qualitative feedback revealed an appreciation for the AI’s ability to identify lesser-known experts but concerns about its grasp of interdisciplinary work. Ethical considerations, including potential algorithmic bias and privacy issues, were highlighted.

The study concludes that while AI shows promise in enhancing reviewer selection efficiency and broadening the reviewer pool, it requires human oversight to address limitations in understanding nuanced disciplinary contexts. Future research should focus on larger-scale longitudinal studies and developing ethical frameworks for AI integration in peer-review processes.

URL : Enhancing peer review efficiency: A mixed-methods analysis of artificial intelligence-assisted reviewer selection across academic disciplines

DOI : https://doi.org/10.1002/leap.1638

Publish or perish? Innovative models for scholarly publishing in Zimbabwe

Authors : Nomsa Chirisa, Mpho Ngoepe

Innovative publishing models have emerged to meet the demands of the ‘publish or perish’ philosophy prevalent in academic and scholarly circles. Publishing models serve as the operational blueprint underpinning the value and supply chains of products in the publishing industry, aligning operational plans, design strategies, and production methodologies with the overarching goal of scholarly publishing. The duty of scholarly publishers to advance knowledge and disseminate it widely necessitates their role in supporting researchers to meet the expectations of the ‘publish or perish’ culture.

This philosophy becomes even more critical in the endangered landscape of scholarly publishing in Africa, where scholarly publishing is evidently perishing, as researchers in the region face additional challenges in accessing reputable publishing outlets for their work. Zimbabwe has a low research publishing output, and although it ranks second in southern Africa, it lags behind South Africa by an astounding 65%. This intensifies the pressure to publish to maintain visibility and credibility within the global academic community.

This paper thus examines the publishing models implemented in the publishing of scholarly works by scholarly publishers in Zimbabwe. Qualitative data were collected through the Delphi Technique design, with publishing experts over three rounds of interviews, and triangulated with data from document analysis.

The key findings indicate open access, self-publishing, and collaborative publishing as effective market models for university presses. However, Zimbabwean universities are still lagging behind, as few have established university presses.

URL : Publish or perish? Innovative models for scholarly publishing in Zimbabwe

DOI : https://doi.org/10.1177/02666669241289916

The Costs of Open Access Publication: A Case Study at Catalan Universities

Authors : Ángel Borrego, Lluís Anglada

This article explores the financial dynamics of open access (OA) publication in Catalan universities by combining four data sources: publication data coupled with article processing charge (APC) estimates; information on journal subscriptions, transformative agreements and APC payments made by universities; acknowledgements of APC funding sources in OA scholarly outputs; and a survey of authors.

The findings reveal a consistent increase in OA publication across Catalan universities, with 60% of the articles indexed in the Web of Science being published in either gold or hybrid OA in 2022. In parallel, investment in the research publishing system shows an upward trend. Resources allocated to journal subscription licenses have been redirected towards transformative agreements, leading to a rise in hybrid OA publications. Additional budget allocations have been made to accommodate APCs for gold OA journals.

Authors employ varied funding sources for gold and hybrid OA, with university funding programmes and research grants commonly facilitating gold OA, while transformative agreements often support hybrid OA. Authors associated with Catalan universities frequently benefit from funding schemes and transformative agreements that are accessible to their coauthors.

However, survey responses underscore the multifaceted nature of researchers’ financial support, including personal assets and waivers. Authors express frustration with the evolving OA landscape, particularly concerning the exorbitant publication fees.

Nevertheless, the allure of high-impact journals and expedited peer review processes continues to incentivize authors towards gold OA. Researchers voice concerns regarding the lack of equitable funding programmes and potential conflicts of interest within gold OA models, which signals the risk of compromising peer review integrity to prioritize profits.

This study underscores the need for further research to deepen our understanding of scholarly publishing expenditure and inform strategies for fostering a sustainable, equitable OA ecosystem.

URL : The Costs of Open Access Publication: A Case Study at Catalan Universities

DOI : https://doi.org/10.53377/lq.19069

When researchers pay to publish: Results from a survey on APCs in four countries

Authors : Osvaldo Gallardo, Matías Milia, André Luiz Appel, Grip-APC Team, François van Schalkwyk

This paper provides an empirical overview of the impact and practices of paying Article Processing Charges (APCs) by four nationally categorized groups of researchers in Argentina, Brazil, Mexico, and South Africa.

The data was collected from 13,577 researchers through an online questionnaire. The analysis compares the practice of publishing in journals that charge APCs across different dimensions, including country, discipline, gender, and age of the researchers.

The paper also focuses on the maximum amount APC paid and the methods and strategies researchers use to cover APC payments, such as waivers, research project funds, payment by coauthors, and the option to publish in closed access, where possible. Different tendencies were identified among the different disciplines and the national systems examined.

Findings show that Argentine researchers apply for waivers most frequently and often use personal funds or international coauthors for APCs, with younger researchers less involved in APC payments. In contrast, Brazil, South Africa, and Mexico have more older researchers, yet younger researchers still publish more in APC journals. South African researchers lead in APC publications, likely due to better funding access and read and publish agreements.

This study lays the groundwork for further analysis of gender asymmetries, funding access, and views on the commercial Open Access model of scientific dissemination.

Arxiv : https://arxiv.org/abs/2410.12144

Altmetric.com or PlumX: Does it matter?

Authors : Behrooz Rasuli, Majid Nabavi

Facing the coronavirus disease 2019 (COVID-19) pandemic, medical publishers rose to the occasion, moving to make their full portfolio of COVID-19–related research available to read for free and expediting peer review and production processes. With such a rapid transition from paper submission to publication, however, concerns also arose regarding whether the quality of the research publication process was being affected. This article seeks to document the transformation of medical publishers’ practices in response to the COVID-19 pandemic and briefly discuss where they may go from here. For this goal, a literature search was performed in PubMed at several points to identify papers that reported early trends in how medical publishers handled COVID-19 research.

URL : Altmetric.com or PlumX: Does it matter?

DOI : https://doi.org/10.1002/leap.1625

Status of peer review guidelines in international surgical journals: A cross-sectional survey

Authors : Min DongWenjing WangXuemei LiuFang LeiYunmei Luo

Aim

To gain insight into the current status of peer review guidelines in international surgical journals and to offer guidance for the development of peer review guidelines for surgical journals.

Methods

We selected the top 100 journals in the category of ‘Surgery’ according to the Journal Citation Report 2021. We conducted a search of the websites of these journals, and Web of Science, PubMed, other databases, in order to gather the peer review guidelines published by these top 100 journals up until June 30, 2022. Additionally, we analysed the contents of these peer review guidelines.

Results

Only 52% (52/100) of journals provided guidelines for reviewers. Sixteen peer review guidelines which were published by these 52 surgical journals were included in this study. The contents of these peer review guidelines were classified into 33 items. The most common item was research methodology, which was mentioned by 13 journals (25%, 13/52). Other important items include statistical methodology, mentioned by 11 journals (21.2%), the rationality of figures, tables, and data, mentioned by 11 journals (21.2%), innovation of research, mentioned by nine journals (17.3%), and language expression, readability of papers, ethical review, references, and so forth, mentioned by eight journals (15.4%).

Two journals described items for quality assessment of peer review. Forty-three journals offered a checklist to guide reviewers on how to write a review report. Some surgical journals developed peer review guidelines for reviewers with different academic levels, such as professional reviewers and patient/public reviewers. Additionally, some surgical journals provided specific items for different types of papers, such as original articles, reviews, surgical videos, surgical database research, surgery-related outcome measurements, and case reports in their peer review guidelines.

Conclusions

Key contents of peer review guidelines for the reviewers of surgical journals not only include items relating to reviewing research methodology, statistical methods, figures, tables and data, research innovation, ethical review, but also cover items concerning reviewing surgical videos, surgical database research, surgery-related outcome measurements, instructions on how to write a review report, and guidelines on how to assess quality of peer review.

URL : Status of peer review guidelines in international surgical journals: A cross-sectional survey

DOI : https://doi.org/10.1002/leap.1624

“Academic Publishing is a Business Interest”: Reconciling Faculty Serials Needs and Economic Realities at a Carnegie R2 University

Authors : Rachel E. Scott, Anne Shelley, Chad E. Buckley, Cassie Thayer-Styes, Julie A. Murphy

Introduction

This article explores faculty conceptions of academic publishers, their willingness to circumvent paywalls and share content, and their understanding of who holds the responsibility to pay for this body of scholarly work to which they all contribute.

Methods

The authors conducted semi-structured interviews with 25 faculty at their Carnegie R2 university to explore scholars’ perspectives with respect to the costs of serials and the responsibilities of the University and library in support of scholarly publishing.

Results

Participants reported a broad spectrum of perspectives with respect to circumventing publisher paywalls and offered nuanced practices for interacting with paywalled content. They explained which library services work well and offered suggestions on how best to support faculty needs for serial literature. Although most participants agree that the University has the responsibility of making academic literature available to the community, they differ in their conceptions of academic publishers as good-faith partners in the knowledge enterprise.

Discussion

The results suggest a great deal of ambiguity and diversity of beliefs among faculty: some would support boycotting all commercial publishers; some understand academic publishers to be integral to the dissemination of their work, not to mention tenure and promotion processes; and many acknowledge a variety of tensions in what feels to them an exploitative and fraught relationship.

These findings have implications for library services in acquisitions, collection management, scholarly communication, discovery, and access.

Conclusion

The data provide insight into the nuanced perceptions that faculty members at a Carnegie R2 hold concerning the costs of scholarly publishing and the role of academic publishers within scholarly communication.

URL : “Academic Publishing is a Business Interest”: Reconciling Faculty Serials Needs and Economic Realities at a Carnegie R2 University

DOI : https://doi.org/10.31274/jlsc.16232