Comparison of effect estimates between preprints and peer-reviewed journal articles of COVID-19 trials

Authors : Mauricia Davidson, Theodoros Evrenoglou, Carolina Graña, Anna Chaimani, Isabelle Boutron

Background

Preprints are increasingly used to disseminate research results, providing multiple sources of information for the same study. We assessed the consistency in effect estimates between preprint and subsequent journal article of COVID-19 randomized controlled trials.

Methods

The study utilized data from the COVID-NMA living systematic review of pharmacological treatments for COVID-19 (covid-nma.com) up to July 20, 2022. We identified randomized controlled trials (RCTs) evaluating pharmacological treatments vs. standard of care/placebo for patients with COVID-19 that were originally posted as preprints and subsequently published as journal articles.

Trials that did not report the same analysis in both documents were excluded. Data were extracted independently by pairs of researchers with consensus to resolve disagreements. Effect estimates extracted from the first preprint were compared to effect estimates from the journal article.

Results

The search identified 135 RCTs originally posted as a preprint and subsequently published as a journal article. We excluded 26 RCTs that did not meet the eligibility criteria, of which 13 RCTs reported an interim analysis in the preprint and a final analysis in the journal article. Overall, 109 preprint–article RCTs were included in the analysis.

The median (interquartile range) delay between preprint and journal article was 121 (73–187) days, the median sample size was 150 (71–464) participants, 76% of RCTs had been prospectively registered, 60% received industry or mixed funding, 72% were multicentric trials. The overall risk of bias was rated as ‘some concern’ for 80% of RCTs.

We found that 81 preprint–article pairs of RCTs were consistent for all outcomes reported. There were nine RCTs with at least one outcome with a discrepancy in the number of participants with outcome events or the number of participants analyzed, which yielded a minor change in the estimate of the effect. Furthermore, six RCTs had at least one outcome missing in the journal article and 14 RCTs had at least one outcome added in the journal article compared to the preprint. There was a change in the direction of effect in one RCT. No changes in statistical significance or conclusions were found.

Conclusions

Effect estimates were generally consistent between COVID-19 preprints and subsequent journal articles. The main results and interpretation did not change in any trial. Nevertheless, some outcomes were added and deleted in some journal articles.

URL : Comparison of effect estimates between preprints and peer-reviewed journal articles of COVID-19 trials

DOI : https://doi.org/10.1186/s12874-023-02136-8

Determinants of manuscript submissions to fully open access journals: elasticity to article processing charges

Author : Sumiko Asai

Article processing charges that authors and research institutions pay to make articles open access are increasing. If manuscript submission is price elastic, then rising charges will cause a significant reduction in submissions, leading to decreased revenues under constant acceptance rates.

Therefore, the elasticity of manuscript submission to article processing charge is one of the determinants of publishers’ charges. However, several studies that investigated the determinants of article processing charges did not consider this elasticity.

This study investigated the determinants of submissions, including the elasticity to article processing charge, by formulating the number of manuscript submissions to fully open access journals published by Hindawi and Elsevier in 2022. Moreover, this study formulated manuscript submissions using both list prices and charges paid to Elsevier that OpenAPC collected to compare the results.

The estimation results reveal that the two publishers increase their revenues by raising the article processing charges due to the inelasticity. Moreover, these conclusions do not depend on the data set used, although the number of observations sourced from OpenAPC is small.

URL : Determinants of manuscript submissions to fully open access journals: elasticity to article processing charges

DOI : https://doi.org/10.1007/s11192-024-04934-3

New academic journals: an international overview of indexing and access models

Authors : Rosangela Rodrigues, Cristóbal Urbano, Patrícia Neubert, José Miguel Rodríguez-Gairín, Marta Somoza-Fernández

Introduction

An international analysis of academic journals newly created in the period from 2011 to 2020 according to type of publisher, place of publication, their relationship with open access, and their indexing in databases.

Studies of the issues of concentration of journal publisher ownership, uses of metrics, and access to titles reveal a changing landscape that is nevertheless still dominated by large commercial oligopolies. One notable trend is the creation of new titles in various configurations.

Method

To assess the global scenario, we analyse titles created from 2011 to 2020, focusing on indexing and access models. The methodology is multidimensional, predominantly bibliometric and quantitative. The data were collected from Crossref and other databases and processed with the resources of the Information Matrix for the Analysis of Journals.

Results

The findings confirm the expansion of the periodical publishing market, of which the academic journal market represents a small fraction (7.29%). Of thdatabases may be considered academic based on indexing in some database, most are open access, indicated by their presence in the Directory of Open Access Journals (55.21%).

The analysis of publisher type confirmed the predominance of commercial publishers (44.57%), followed by universities (30.08%). The largest proportion of the titles are in the health field, compatible with the existing distribution of fields, followed by journals in the multidisciplinary and education fields.

Conclusion

In the expansion of the publishing market, academic journals represent a small fraction of the total. The main sources of new titles in open access with no processing charges for authors are universities in countries that are not home to large commercial publishers (Indonesia, Brazil, and Spain), all with government subsidies.

URL : New academic journals: an international overview of indexing and access models

Original URL : https://informationr.net/infres/article/view/466

DOI : https://doi.org/10.47989/ir284466

Going Open Access: The Attitudes and Actions of Scientific Journal Editors in China

Authors : Wenqi Fu, Jie Xu, Qing Fang, Jingjia Ding, Hanqing Ma

This study aims to investigate the attitudes and actions of scientific journal editors in China towards open access. Semi-structured interviews were conducted with 17 Chinese editors from various scientific journals during September and October of 2022.

The results indicate that the editors generally possess knowledge of open access and have implemented an appropriate open access model for their respective journals. However, the Chinese-language journal editors expressed a lack of motivation to adopt open access, unless there is a reform in the mechanism of academic publishing or a policy is imposed.

On the other hand, the English-language journal editors acknowledged that they have no other choice but to adopt open access. This study helps us learn about Chinese editors’ understanding and attitudes towards open access, the current status of open access in China’s scientific journals, and the mechanisms of academic publishing in China.

URL : Going Open Access: The Attitudes and Actions of Scientific Journal Editors in China

DOI : https://doi.org/10.3390/publications12010001

Applying Librarian- Created Evaluation Tools to Determine Quality and Credibility of Open Access Library Science Journals

Authors : Maggie Albro, Jessica L. Serrao, Christopher D. Vidas, Jenessa M. McElfresh, K. Megan Sheffield, Megan Palmer

This article explores the application of journal quality and credibility evaluation tools to library science publications. The researchers investigate quality and credibility attributes of forty-eight peer-reviewed library science journals with open access components using two evaluative tools developed and published by librarians.

The results identify common positive and negative attributes of library science journals, compare the results of the two evaluation tools, and discuss their ease of use and limitations. Overall, the results show that while library science journals do not fall prey to the same concerning characteristics that librarians use to caution other researchers, there are several areas in which publishers can improve the quality and credibility of their journals.

URL : https://preprint.press.jhu.edu/portal/sites/default/files/06_24.1albro.pdf

Gender differences in submission behavior exacerbate publication disparities in elite journals

Authors : Isabel Basson, Chaoqun Ni, Giovanna Badia, Nathalie Tufenkji, Cassidy R. Sugimoto, Vincent Larivière

Women are particularly underrepresented in journals of the highest scientific impact, with substantial consequences for their careers. While a large body of research has focused on the outcome and the process of peer review, fewer articles have explicitly focused on gendered submission behavior and the explanations for these differences.

In our study of nearly five thousand active authors, we find that women are less likely to report having submitted papers and, when they have, to submit fewer manuscripts, on average, than men. Women were more likely to indicate that they did not submit their papers (in general and their subsequently most cited papers) to Science, Nature, or PNAS because they were advised not to.

In the aggregate, no statistically significant difference was observed between men and women in how they rated the quality of their work. Nevertheless, regardless of discipline, women were more likely than men to indicate that their “work was not ground-breaking or sufficiently novel” as a rationale for not submitting to one of the listed prestigious journals. Men were more likely than women to indicate that the “work would fit better in a more specialized journal.”

We discuss the implications of these findings and interventions that can serve to mitigate the disparities caused by gendered differences in submission behavior.

DOI : https://doi.org/10.1101/2023.08.21.554192

Open access movement in the scholarly world: Pathways for libraries in developing countries

Authors : Arslan Sheikh, Joanna Richardson

Open access is a scholarly publishing model that has emerged as an alternative to traditional subscription-based journal publishing. This study explores the adoption of the open access movement worldwide and the role that libraries can play in addressing those factors which are slowing its progress within developing countries.

The study has drawn upon both qualitative data from a focused literature review and quantitative data from major open access platforms. The results indicate that while the open access movement is steadily gaining acceptance worldwide, the progress in developing countries within geographical areas such as Africa, Asia and Oceania is quite a bit slower.

Two significant factors are the cost of publishing fees and the lack of institutional open access mandates and policies to encourage uptake. The study provides suggested strategies for academic libraries to help overcome current challenges.

DOI : https://doi.org/10.1177/01655515231202758