On The Peer Review Reports: Does Size Matter?

Authors : Abdelghani Maddi, Luis Miotti

Amidst the ever-expanding realm of scientific production and the proliferation of predatory journals, the focus on peer review remains paramount for scientometricians and sociologists of science. Despite this attention, there is a notable scarcity of empirical investigations into the tangible impact of peer review on publication quality.

This study aims to address this gap by conducting a comprehensive analysis of how peer review contributes to the quality of scholarly publications, as measured by the citations they receive. Utilizing an adjusted dataset comprising 57,482 publications from Publons to Web of Science and employing the Raking Ratio method, our study reveals intriguing insights. Specifically, our findings shed light on a nuanced relationship between the length of reviewer reports and the subsequent citations received by publications.

Through a robust regression analysis, we establish that, beginning from 947 words, the length of reviewer reports is significantly associated with an increase in citations. These results not only confirm the initial hypothesis that longer reports indicate requested improvements, thereby enhancing the quality and visibility of articles, but also underscore the importance of timely and comprehensive reviewer reports.

Furthermore, insights from Publons’ data suggest that open access to reports can influence reviewer behavior, encouraging more detailed reports. Beyond the scholarly landscape, our findings prompt a reevaluation of the role of reviewers, emphasizing the need to recognize and value this resource-intensive yet underappreciated activity in institutional evaluations.

Additionally, the study sounds a cautionary note regarding the challenges faced by peer review in the context of an increasing volume of submissions, potentially compromising the vigilance of peers in swiftly assessing numerous articles.

HAL : https://cnrs.hal.science/hal-04492274

The ‘Must Stock’ Challenge in Academic Publishing: Pricing Implications of Transformative Agreements

Author : W. Benedikt Schmal

The high relevance of top-notch academic journals turns them into ‘must stock’ products that assign its often commercial owners with extraordinary market power. Intended to tackle this, university consortia around the globe negotiate so-called ‘transformative agreements’ with many publishing houses. It shall pave the way towards standard open-access publishing.

While several contract designs exist, the ‘publish-and-read’ (PAR) scheme is the one that comes closest to the ideal of an entirely open access environment: Publishers are paid a fixed case-by-case rate for each publication, which includes a fee for their extensive libraries. In turn, all subscription payments are waived.

I theoretically derive that this contract design benefits the included publishers regardless of whether the number of publications in these publishers’ journals grows or declines. Consequently, widespread PAR contracts are likely to raise entry barriers for new (open-access) competitors even further. Intending to lower costs for the universities, their libraries, and, ultimately, the taxpayers, this PAR fee contract design of transformative agreements might cause the opposite.

URL : The ‘Must Stock’ Challenge in Academic Publishing: Pricing Implications of Transformative Agreements

Arxiv : https://arxiv.org/abs/2403.03597

Mega-authorship implications: How many scientists can fit into one cell?

Author : Daniel S. Dotson

The past 20 years has seen a significant increase in articles with 500 or more authors. This increase has presented problems in terms of determining true authorship versus other types of contribution, issues with database metadata and data output, and publication length. Using items with 500+ authors deemed as mega-author titles, a total of 5,533 mega-author items were identified using InCites. Metadata about the items was then gathered from Web of Science and Scopus.

Close examination of these items found that the vast majority of these covered physics topics, with medicine a far distant second place and only minor representation from other science fields. This mega-authorship saw significant events that appear to correspond to similar events in the Large Hadron Collider’s timeline, indicating that the projects for the collider are driving this heavy output. Some solutions are offered for the problems resulting from this phenomenon, partially driven by recommendations from the International Committee of Medical Journal Editors.

URL : Mega-authorship implications: How many scientists can fit into one cell?

DOI : https://doi.org/10.1080/08989621.2024.2318790

Choice of Open Access in Elsevier Hybrid Journals

Author : Sumiko Asai

Open access articles in hybrid journals have recently increased despite high article processing charges. This study investigated the impacts of grants and transformative agreements on authors’ choice of open and non-open access articles by comparing two article types. The samples were hybrid journals launched independently by Elsevier.

The results revealed that the authors who received more grants in countries with transformative agreements were more likely to choose open access articles. By contrast, authors in developing countries were likely to publish non-open access articles.

These findings imply that authors’ choices depend on the funding systems and open access policies in individual countries. Consequently, open access may become a barrier to the dissemination of work for researchers who have financial difficulty choosing open access, although it enables everyone to access articles free of charge.

URL : Choice of Open Access in Elsevier Hybrid Journals

DOI : https://doi.org/10.1007/s12109-024-09978-0

Does it pay to pay? A comparison of the benefits of open-access publishing across various sub-fields in biology

Authors : Amanda D. Clark, Tanner C. Myers, Todd D. Steury, Ali Krzton et al.

Authors are often faced with the decision of whether to maximize traditional impact metrics or minimize costs when choosing where to publish the results of their research. Many subscription-based journals now offer the option of paying an article processing charge (APC) to make their work open.

Though such “hybrid” journals make research more accessible to readers, their APCs often come with high price tags and can exclude authors who lack the capacity to pay to make their research accessible.

Here, we tested if paying to publish open access in a subscription-based journal benefited authors by conferring more citations relative to closed access articles. We identified 146,415 articles published in 152 hybrid journals in the field of biology from 2013–2018 to compare the number of citations between various types of open access and closed access articles.

In a simple generalized linear model analysis of our full dataset, we found that publishing open access in hybrid journals that offer the option confers an average citation advantage to authors of 17.8 citations compared to closed access articles in similar journals.

After taking into account the number of authors, Journal Citation Reports 2020 Quartile, year of publication, and Web of Science category, we still found that open access generated significantly more citations than closed access (p < 0.0001).

However, results were complex, with exact differences in citation rates among access types impacted by these other variables. This citation advantage based on access type was even similar when comparing open and closed access articles published in the same issue of a journal (p < 0.0001).

However, by examining articles where the authors paid an article processing charge, we found that cost itself was not predictive of citation rates (p = 0.14). Based on our findings of access type and other model parameters, we suggest that, in the case of the 152 journals we analyzed, paying for open access does confer a citation advantage.

For authors with limited budgets, we recommend pursuing open access alternatives that do not require paying a fee as they still yielded more citations than closed access. For authors who are considering where to submit their next article, we offer additional suggestions on how to balance exposure via citations with publishing costs.

URL : Does it pay to pay? A comparison of the benefits of open-access publishing across various sub-fields in biology

DOI : https://doi.org/10.7717/peerj.16824

How transformative are transformative agreements? Evidence from Germany across disciplines

Author : W. Benedikt Schmal

Research institutions across the globe attempt to change the academic publishing system as digitization opens up new opportunities, and subscriptions to the large journal bundles of the leading publishers put library budgets under pressure. One approach is the negotiation of so-called transformative agreements.

I study the ‘DEAL’ contracts between nearly all German research institutions and Springer Nature and Wiley. I investigate 6.1 million publications in 5,862 journals covering eight fields in the years 2016–2022 and apply a causal difference-in-differences design to identify whether the likelihood of a paper appearing in an eligible journal increases. The effect strongly depends on the discipline.

While material science, chemistry, and economics s tend to hift towards these journals, all other disciplines in my sample do not react. Suggestive evidence hints at the market position of the encompassed publishers before the ‘DEAL’ was established: Springer Nature and Wiley appear to benefit more from the contracts in disciplines in which they possessed a higher market share ex ante.

The transformative vigor of these agreements in terms of publication behavior seems to be limited. It and highlights that the developments in this intertwined market require further examination.

URL : How transformative are transformative agreements? Evidence from Germany across disciplines

DOI : https://doi.org/10.1007/s11192-024-04955-y

Beyond journals and peer review: towards a more flexible ecosystem for scholarly communication

Author : Michael Wood

This article challenges the assumption that journals and peer review are essential for developing,evaluating and disseminating scientific and other academic knowledge. It suggests a more flexible ecosystem, and examines some of the possibilities this might facilitate. The market for academic outputs should be opened up by encouraging the separation of the dissemination service from the evaluation service.

Publishing research in subject-specific journals encourages compartmentalising research into rigid categories. The dissemination of knowledge would be better served by an open access, web-based repository system encompassing all disciplines. There would then be a role for organisations to assess the items in this repository to help users find relevant, high-quality work.

There could be a variety of such organisations which could enable reviews from peers to be supplemented with evaluation by non-peers from a variety of different perspectives: user reviews, statistical reviews, reviews from the perspective of different disciplines, and so on. This should reduce the inevitably conservative influence of relying on two or three peers, and make the evaluation system more critical, multi-dimensional and responsive to the requirements of different audience groups, changing circumstances, and new ideas.

Non-peer review might make it easier to challenge dominant paradigms, and expanding the potential audience beyond a narrow group of peers might encourage the criterion of simplicity to be taken more seriously – which is essential if human knowledge is to continue to progress.

Arxiv : https://arxiv.org/abs/1311.4566