Preprints in motion: tracking changes between posting and journal publication

Authors : Jessica K Polka, Gautam Dey, Máté Pálfy, Federico Nanni, Liam Brierley, Nicholas Fraser, Jonathon Alexis Coates

Amidst the COVID-19 pandemic, preprints in the biomedical sciences are being posted and accessed at unprecedented rates, drawing widespread attention from the general public, press and policymakers for the first time.

This phenomenon has sharpened longstanding questions about the reliability of information shared prior to journal peer review. Does the information shared in preprints typically withstand the scrutiny of peer review, or are conclusions likely to change in the version of record?

We assessed preprints that had been posted and subsequently published in a journal between 1st January and 30th April 2020, representing the initial phase of the pandemic response. We utilised a combination of automatic and manual annotations to quantify how an article changed between the preprinted and published version.

We found that the total number of figure panels and tables changed little between preprint and published articles. Moreover, the conclusions of 6% of non-COVID-19-related and 15% of COVID-19-related abstracts undergo a discrete change by the time of publication, but the majority of these changes do not reverse the main message of the paper.

DOI : https://doi.org/10.1101/2021.02.20.432090

Methodological quality of COVID-19 clinical research

Authors : Richard G. Jung, Pietro Di Santo, Cole Clifford, Graeme Prosperi-Porta, Stephanie Skanes, Annie Hung, Simon Parlow, Sarah Visintini, F. Daniel Ramirez, Trevor Simard & Benjamin Hibbert

The COVID-19 pandemic began in early 2020 with major health consequences. While a need to disseminate information to the medical community and general public was paramount, concerns have been raised regarding the scientific rigor in published reports.

We performed a systematic review to evaluate the methodological quality of currently available COVID-19 studies compared to historical controls. A total of 9895 titles and abstracts were screened and 686 COVID-19 articles were included in the final analysis.

Comparative analysis of COVID-19 to historical articles reveals a shorter time to acceptance (13.0[IQR, 5.0–25.0] days vs. 110.0[IQR, 71.0–156.0] days in COVID-19 and control articles, respectively; p < 0.0001).

Furthermore, methodological quality scores are lower in COVID-19 articles across all study designs. COVID-19 clinical studies have a shorter time to publication and have lower methodological quality scores than control studies in the same journal. These studies should be revisited with the emergence of stronger evidence.

URL : Methodological quality of COVID-19 clinical research

DOI : https://doi.org/10.1038/s41467-021-21220-5

COVID‐19 and the generation of novel scientific knowledge: Evidence‐based decisions and data sharing

Authors : Lucie Perillat, Brian S. Baigrie

Rationale, aims and objectives

The COVID‐19 pandemic has impacted every facet of society, including medical research. This paper is the second part of a series of articles that explore the intricate relationship between the different challenges that have hindered biomedical research and the generation of novel scientific knowledge during the COVID‐19 pandemic.

In the first part of this series, we demonstrated that, in the context of COVID‐19, the scientific community has been faced with numerous challenges with respect to (1) finding and prioritizing relevant research questions and (2) choosing study designs that are appropriate for a time of emergency.

Methods

During the early stages of the pandemic, research conducted on hydroxychloroquine (HCQ) sparked several heated debates with respect to the scientific methods used and the quality of knowledge generated.

Research on HCQ is used as a case study in both papers. The authors explored biomedical databases, peer‐reviewed journals, pre‐print servers and media articles to identify relevant literature on HCQ and COVID‐19, and examined philosophical perspectives on medical research in the context of this pandemic and previous global health challenges.

Results

This second paper demonstrates that a lack of research prioritization and methodological rigour resulted in the generation of fleeting and inconsistent evidence that complicated the development of public health guidelines.

The reporting of scientific findings to the scientific community and general public highlighted the difficulty of finding a balance between accuracy and speed.

Conclusions

The COVID‐19 pandemic presented challenges in terms of (3) evaluating evidence for the purpose of making evidence‐based decisions and (4) sharing scientific findings with the rest of the scientific community.

This second paper demonstrates that the four challenges outlined in the first and second papers have often compounded each other and have contributed to slowing down the creation of novel scientific knowledge during the COVID‐19 pandemic.

DOI : https://doi.org/10.1111/jep.13548

The Pandemic as a Portal: Reimagining Psychological Science as Truly Open and Inclusive

Authors : Alison Ledgerwood, Sa-kiera Hudson, Neil Lewis, Keith Maddox, Cynthia Pickett, Jessica Remedios, Sapna Cheryan, Amanda Diekman, Jin Goh, Stephanie Goodwin, Yuko Munakata, Danielle Navarro, Ivuoma Onyeador, Sanjay Srivastava, Clara Wilkins

Psychological science is at an inflection point: The COVID-19 pandemic has already begun to exacerbate inequalities that stem from our historically closed and exclusive culture. Meanwhile, reform efforts to change the future of our science are too narrow in focus to fully succeed.

In this paper, we call on psychological scientists—focusing specifically on those who use quantitative methods in the United States as one context in which such a conversation can begin—to reimagine our discipline as fundamentally open and inclusive.

First, we discuss who our discipline was designed to serve and how this history produced the inequitable reward and support systems we see today.

Second, we highlight how current institutional responses to address worsening inequalities are inadequate, as well as how our disciplinary perspective may both help and hinder our ability to craft effective solutions.

Third, we take a hard look in the mirror at the disconnect between what we ostensibly value as a field and what we actually practice. Fourth and finally, we lead readers through a roadmap for reimagining psychological science in whatever roles and spaces they occupy, from an informal discussion group in a department to a formal strategic planning retreat at a scientific society.

DOI : https://doi.org/10.31234/osf.io/gdzue

YouTube as a source of information on chloroquine and hydroxychloroquine during the COVID-19 pandemic

Authors : Thales Brandi Ramos, Luciana Castilho Bokehi, Raphael Castilho Bokehi, Taynah da Silava Pinheiro, Erika Barreto de Oliveira, Renan da SilvaGianoti Torres, Jose Raphael Bokehi, Sabrina Calil-Elias, Selma Rodrigues de Castilho

This research aimed to analyze the quality of the information conveyed through YouTube videos in Portuguese on the use of two medicines suggested for the treatment of COVID-19: chloroquine and hydroxychloroquine.

The ‘Brief DISCERN’ questionnaire was applied to assess the quality of the video content as well as baseline characteristics, such as length, views, likes and dislikes, in a total of 90 videos with almost 4,5 million views.

Traditional media accounted for 58,89% of videos. Misleading information was present in most of the videos (63,5%). Despite the ease of access, the videos showed problems in the quality of information.

URL : YouTube as a source of information on chloroquine and hydroxychloroquine during the COVID-19 pandemic

DOI : https://doi.org/10.22323/2.19070206

Social Media and Trust in Scientific Expertise: Debating the Covid-19 Pandemic in The Netherlands

Authors : José van Dijck, Donya Alinead

This article examines the role of social media dynamics in the public exchange of information between scientists (experts), government (policy-makers), mass media (journalists), and citizens (nonexperts) during the first 4 months after the Covid-19 outbreak in the Netherlands.

Over the past decade, the institutional model of science communication, based on linear vectors of information flows between institutions, has gradually converted into a networked model where social media propel information flows circulating between all actors involved.

The question driving our research is, “How are social media deployed to both undermine and enhance public trust in scientific expertise during a health crisis?” Analyzing the public debate during the period of the corona outbreak in the Netherlands, we investigate two stages: the emergency response phase and the “smart exit strategy” phase, discussing how scientific experts, policy-makers, journalists, and citizens appropriate social media logic to steer information and to control the debate.

We conclude by outlining the potential risks and benefits of adopting social media dynamics in institutional contexts of science communication.

URL : Social Media and Trust in Scientific Expertise: Debating the Covid-19 Pandemic in The Netherlands

DOI : https://doi.org/10.1177/2056305120981057

Scholarly publishing and journal targeting in the time of the Coronavirus Disease 2019 (COVID-19) pandemic: a cross-sectional survey of rheumatologists and other specialists

Authors : Latika Gupta, Armen Yuri Gasparyan, Olena Zimba, Durga Prasanna Misra

The evolving research landscape in the time of the Coronavirus disease 2019 (COVID-19) pandemic calls for greater understanding of the perceptions of scholars regarding the current state and future of publishing.

An anonymised and validated e-survey featuring 30 questions was circulated among rheumatologists and other specialists over social media to understand preferences while choosing target journals, publishing standards, commercial editing services, preprint archiving, social media and alternative publication activities.

Of 108 respondents, a significant proportion were clinicians (68%), researchers (60%) and educators (47%), with median 23 publications and 15 peer-review accomplishments. The respondents were mainly rheumatologists from India, Ukraine and Turkey.

While choosing target journals, relevance to their field (69%), PubMed Central archiving (61%) and free publishing (59%) were the major factors. Thirty-nine surveyees (36%) claimed that they often targeted local journals for publishing their research. However, only 18 (17%) perceived their local society journals as trustworthy.

Occasional publication in the so-called predatory journals (5, 5%) was reported and obtaining support from commercial editing agencies to improve English and data presentation was not uncommon (23, 21%).

The opinion on preprint archiving was disputed; only one-third believed preprints were useful. High-quality peer review (56%), full and immediate open access (46%) and post-publication social media promotion (32%) were identified as key anticipated features of scholarly publishing in the foreseeable future.

These perceptions of surveyed scholars call for greater access to free publishing, attention to proper usage of English and editing skills, and a larger role for engagement over social media.

URL : Scholarly publishing and journal targeting in the time of the Coronavirus Disease 2019 (COVID-19) pandemic: a cross-sectional survey of rheumatologists and other specialists

DOI : https://doi.org/10.1007/s00296-020-04718-x