Impact of the COVID-19 pandemic on publication dynamics and non-COVID-19 research production

Authors : Marc Raynaud, Valentin Goutaudier, Kevin Louis, Solaf Al‑Awadhi, Quentin Dubourg, Agathe Truchot, Romain Brousse, Nouredine Saleh, Alessia Giarraputo, Charlotte Debiais, Zeynep Demir, Anaïs Certain, Francine Tacafred, Esteban Cortes‑Garcia, Safia Yanes, Jessy Dagobert, Sofia Naser, Blaise Robin, Élodie Bailly, Xavier Jouven, Peter P. Reese, Alexandre Loupy

Background

The COVID-19 pandemic has severely affected health systems and medical research worldwide but its impact on the global publication dynamics and non-COVID-19 research has not been measured.

We hypothesized that the COVID-19 pandemic may have impacted the scientific production of non-COVID-19 research.

Methods

We conducted a comprehensive meta-research on studies (original articles, research letters and case reports) published between 01/01/2019 and 01/01/2021 in 10 high-impact medical and infectious disease journals (New England Journal of Medicine, Lancet, Journal of the American Medical Association, Nature Medicine, British Medical Journal, Annals of Internal Medicine, Lancet Global Health, Lancet Public Health, Lancet Infectious Disease and Clinical Infectious Disease).

For each publication, we recorded publication date, publication type, number of authors, whether the publication was related to COVID-19, whether the publication was based on a case series, and the number of patients included in the study if the publication was based on a case report or a case series.

We estimated the publication dynamics with a locally estimated scatterplot smoothing method. A Natural Language Processing algorithm was designed to calculate the number of authors for each publication.

We simulated the number of non-COVID-19 studies that could have been published during the pandemic by extrapolating the publication dynamics of 2019 to 2020, and comparing the expected number to the observed number of studies.

Results

Among the 22,525 studies assessed, 6319 met the inclusion criteria, of which 1022 (16.2%) were related to COVID-19 research. A dramatic increase in the number of publications in general journals was observed from February to April 2020 from a weekly median number of publications of 4.0 (IQR: 2.8–5.5) to 19.5 (IQR: 15.8–24.8) (p < 0.001), followed afterwards by a pattern of stability with a weekly median number of publications of 10.0 (IQR: 6.0–14.0) until December 2020 (p = 0.045 in comparison with April).

Two prototypical editorial strategies were found: 1) journals that maintained the volume of non-COVID-19 publications while integrating COVID-19 research and thus increased their overall scientific production, and 2) journals that decreased the volume of non-COVID-19 publications while integrating COVID-19 publications.

We estimated using simulation models that the COVID pandemic was associated with a 18% decrease in the production of non-COVID-19 research. We also found a significant change of the publication type in COVID-19 research as compared with non-COVID-19 research illustrated by a decrease in the number of original articles, (47.9% in COVID-19 publications vs 71.3% in non-COVID-19 publications, p < 0.001).

Last, COVID-19 publications showed a higher number of authors, especially for case reports with a median of 9.0 authors (IQR: 6.0–13.0) in COVID-19 publications, compared to a median of 4.0 authors (IQR: 3.0–6.0) in non-COVID-19 publications (p < 0.001).

Conclusion

In this meta-research gathering publications from high-impact medical journals, we have shown that the dramatic rise in COVID-19 publications was accompanied by a substantial decrease of non-COVID-19 research.

URL : Impact of the COVID-19 pandemic on publication dynamics and non-COVID-19 research production

DOI : https://doi.org/10.1186/s12874-021-01404-9

How far does an emphasis on stakeholder engagement and co-production in research present a threat to academic identity and autonomy? A prospective study across five European countries

Authors : Annette Boaz, Robert Borst, Maarten Kok, Alison O’Shea

There is a growing recognition that needs more to be done to ensure that research contributes to better health services and patient outcomes. Stakeholder engagement in research, including co-production, has been identified as a promising mechanism for improving the value, relevance and utilization of research.

This article presents findings from a prospective study which explored the impact of stakeholder engagement in a 3-year European tobacco control research project. That research project aimed to engage stakeholders in the development, testing and dissemination of a return-on-investment tool across five EU countries (the Netherlands, Spain, Hungary, Germany and the UK).

The prospective study comprised interviews, observations and document review. The analysis focused on the extent to which the project team recognized, conceptualized and operationalized stakeholder engagement over the course of the research project. Stakeholder engagement in the European research project was conceptualized as a key feature of pre-designated spaces within their work programme.

Over the course of the project, however, the tool development work and stakeholder engagement activities decoupled. While the modelling and tool development became more secluded, stakeholder engagement activities subtly transformed from co-production, to consultation, to something more recognizable as research participation.

The contribution of this article is not to argue against the potential contribution of stakeholder engagement and co-production, but to show how even well-planned engagement activities can be diverted within the existing research funding and research production systems where non-research stakeholders remain at the margins and can even be seen as a threat to academic identify and autonomy.

URL : How far does an emphasis on stakeholder engagement and co-production in research present a threat to academic identity and autonomy? A prospective study across five European countries

DOI : https://doi.org/10.1093/reseval/rvab013

Investigating the process of ethical approval in citizen science research: the case of Public Health

Authors : Antonella Ficorilli, Giovanni Maccani, Mara Balestrini, Annibale Biggeri, Bruna De Marchi, Frederique E. M. Froeling, Florence Gignac, Regina Grazuleviciene, Gerard Hoek, Tjaša Kanduč, David Kocman, Valeria Righi, Xavier Basagana

Undertaking citizen science research in Public Health involving human subjects poses significant challenges concerning the traditional process of ethical approval.

It requires an extension of the ethics of protection of research subjects in order to include the empowerment of citizens as citizen scientists.

This paper investigates these challenges and illustrates the ethical framework and the strategies developed within the CitieS-Health project. It also proposes first recommendations generated from the experiences of five citizen science pilot studies in environmental epidemiology within this project.

URL : Investigating the process of ethical approval in citizen science research: the case of Public Health

DOI : https://doi.org/10.22323/2.20060204

Representation of Women Among Editors in Chief of Leading Medical Journals

Authors : Ana-Catarina Pinho-Gomes, Amy Vassallo, Kelly Thompson, Kate Womersley, Robyn Norton, Mark Woodward

Importance

Women remain underrepresented among editors of scientific journals, particularly in senior positions. However, to what extent this applies to medical journals of different specialties remains unclear.

Objective

To investigate the gender distribution of the editors in chief at leading medical journals.

Design, Setting, and Participants

Cross-sectional study of the editors in chief at the top 10 international medical journals of 41 categories related to the medical specialties of the Clarivate Analytics Web of Science Journal Citation Reports in 2019.

Main Outcomes and Measures

Proportion of women as editors in chief.

Results

This study found that, overall, women represented 21% (94 of 44) of the editors in chief, with wide variation across medical specialties from 0% to 82%. There were 5 categories for which none of the editors in chief were women (dentistry, oral surgery and medicine; allergy; psychiatry; anesthesiology; and ophthalmology) and only 3 categories for which women outnumbered men as editors in chief (primary health care, microbiology, and genetics and heredity).

In 27 of the 41 categories, women represented less than a third of the editors in chief (eg, 1 of 10 for critical care medicine, 2 of 10 for gastroenterology and hepatology, and 3 of 10 for endocrinology and metabolism).

Conclusions and Relevance

This study found that women are underrepresented among editors in chief of leading medical journals. For the benefit of medical research, a joint effort from editorial boards, publishers, authors, and academic institutions is required to address this gender gap.

URL : Representation of Women Among Editors in Chief of Leading Medical Journals

DOI :10.1001/jamanetworkopen.2021.23026

Association between the Rankings of Top Bioinformatics and Medical Informatics Journals and the Scholarly Reputations of Chief Editors

Author : Salim Sazzed

The scientometric indices, such as the journal Impact Factor (IF) or SCImago Journal Rank (SJR), often play a determining role while choosing a journal for possible publication. The Editor-in-Chief (EiC), also known as a lead editor or chief editor, usually decides the outcomes (e.g., accept, reject) of the submitted manuscripts taking the reviewer’s feedback into account.

This study investigates the associations between the EiC’s scholarly reputation (i.e., citation-level metrics) and the rankings of top Bioinformatics and Computational Biology (BCB) and Medical Informatics (MI) journals. I consider three scholarly indices (i.e., citation, h-index, and i-10 index) of the EiC and four scientometric indices (i.e., h5-index, h5-median, impact factor, and SJR) of various journals.

To study the correlation between scientometric indices of the EiC and journal, I apply Spearman (ρ) and Kendall (τ) correlation coefficients. Moreover, I employ machine learning (ML) models for the journal’s SJR and IF predictions leveraging the EiC’s scholarly reputation indices.

The analysis reveals no correlation between the EiC’s scholarly achievement and the journal’s quantitative metrics. ML models yield high prediction errors for SJR and IF estimations, which suggests that the EiC’s scholarly indices are not good representations of the journal rankings.

URL : Association between the Rankings of Top Bioinformatics and Medical Informatics Journals and the Scholarly Reputations of Chief Editors

DOI : https://doi.org/10.3390/publications9030042

Covid-19 et Science ouverte, premiers reculs

Auteur/Author : Ghislaine Chartron

Cet article propose un premier bilan de la science ouverte liée à la pandémie Covid-19. Typologie des ressources mises à disposition en fonction des publics cibles, analyse de certains problèmes de qualité de l’information et des données, enjeux de la science des données et de la gouvernance des données, énoncé de certaines limites de la science ouverte dans le contexte Covid-19, évolution de la communication scientifique en virologie.

URL : https://hal.archives-ouvertes.fr/hal-03347094

Do authors of research funded by the Canadian Institutes of Health Research comply with its open access mandate?: A meta-epidemiologic study

Authors : Michael A. Scaffidi, Karam Elsolh, Juana Li, Yash Verma, Rishi Bansal, Nikko Gimpaya, Vincent Larivière, Rishad Khan, Samir C. Grover

Background

Since 2008, the Canadian Institutes of Health Research (CIHR) has mandated that studies it funds either in whole or in part are required to publish their results as open access (OA) within 12 months of publication using either online repositories and/or OA journals.

Yet, there is evidence that authors are poorly compliant with this mandate. Specifically, there has been an apparent decrease in OA publication after 2015, which coincides with a change in the OA policy during the same year.

One particular policy change that may have contributed to this decline was lifting the requirement that authors deposit their article in an OA repository immediately upon publication.

We investigated the proportion of OA compliance of CIHR-funded studies in the period before and after the policy change of 2015 with manual confirmation of both CIHR funding and OA status.

Methods and findings

We identified CIHR-funded studies published between the years 2014 to 2017 using a comprehensive search in the Web of Science (WoS). We took a stratified random sample from all four years (i.e. 2014 to 2017), with 250 studies from each year.

Two authors independently reviewed the final full-text publications retrieved from the journal web page to determine to confirm CIHR funding, as indicated in the acknowledgements or elsewhere in the paper.

For each study, we also collected bibliometric data that included citation count and Altmetric attention score Statistical analyses were conducted using two-tailed Fisher’s exact test with relative risk (RR). Among the 851 receiving CIHR funding published from 2014 to 2017, the percentage of CIHR-funded studies published as OA significantly decreased from 79.6% in 2014 to 70.3% in 2017 (RR = 0.88, 95% CI: 0.79–0.99, P = 0.028).

When considering all four years, there was no significant difference in the percentage of CIHR-funded studies published as OA in both 2014 and 2015 compared to both 2016 and 2017 (RR = 0.97, 95% CI: 0.90–1.05, P = 0.493). Additionally, OA publications had significantly higher citation count (both in year of publication and in total) and higher attention scores (P<0.05).

Conclusions

Overall, we found that there was a significant decrease in the proportion of CIHR funded studies published as OA from 2014 compared to 2017, though this difference did not persist when comparing both 2014–2015 to 2016–2017.

The primary limitation was the reliance of self-reported data from authors on CIHR funding status. We posit that this decrease may be attributable to CIHR’s OA policy change in 2015.

Further exploration is warranted to both validate these studies using a larger dataset and, if valid, investigate the effects of potential interventions to improve the OA compliance, such as use of a CIHR publication database, and reinstatement of a policy for authors to immediately submit their findings to OA repositories upon publication.

URL : Do authors of research funded by the Canadian Institutes of Health Research comply with its open access mandate?: A meta-epidemiologic study

DOI : https://doi.org/10.1371/journal.pone.0256577