Archives des mots-clés : biomedical research

Preprints in times of COVID19: the time is ripe for agreeing on terminology and good practices

Posté le par

Authors : Raffaella Ravinetto, Céline Caillet, Muhammad H. Zaman, Jerome Amir Singh, Philippe J. Guerin, Aasim Ahmad, Carlos E. Durán, Amar Jesani, Ana Palmero, Laura Merson, Peter W. Horby, E. Bottieau, Tammy Hoffmann, Paul N. Newton

Over recent years, the research community has been increasingly using preprint servers to share manuscripts that are not yet peer-reviewed. Even if it enables quick dissemination of research findings, this practice raises several challenges in publication ethics and integrity.

In particular, preprints have become an important source of information for stakeholders interested in COVID19 research developments, including traditional media, social media, and policy makers.

Despite caveats about their nature, many users can still confuse pre-prints with peer-reviewed manuscripts. If unconfirmed but already widely shared first-draft results later prove wrong or misinterpreted, it can be very difficult to “unlearn” what we thought was true. Complexity further increases if unconfirmed findings have been used to inform guidelines.

To help achieve a balance between early access to research findings and its negative consequences, we formulated five recommendations: (a) consensus should be sought on a term clearer than ‘pre-print’, such as ‘Unrefereed manuscript’, “Manuscript awaiting peer review” or ‘’Non-reviewed manuscript”; (b) Caveats about unrefereed manuscripts should be prominent on their first page, and each page should include a red watermark stating ‘Caution—Not Peer Reviewed’; (c) pre-print authors should certify that their manuscript will be submitted to a peer-review journal, and should regularly update the manuscript status; (d) high level consultations should be convened, to formulate clear principles and policies for the publication and dissemination of non-peer reviewed research results; (e) in the longer term, an international initiative to certify servers that comply with good practices could be envisaged.

URL : Preprints in times of COVID19: the time is ripe for agreeing on terminology and good practices

DOI : https://doi.org/10.1186/s12910-021-00667-7

Publication patterns’ changes due to the COVID-19 pandemic: a longitudinal and short-term scientometric analysis

Posté le par

Authors : Shir Aviv-Reuven, Ariel Rosenfeld

In recent months the COVID-19 (also known as SARS-CoV-2 and Coronavirus) pandemic has spread throughout the world. In parallel, extensive scholarly research regarding various aspects of the pandemic has been published. In this work, we analyse the changes in biomedical publishing patterns due to the pandemic.

We study the changes in the volume of publications in both peer reviewed journals and preprint servers, average time to acceptance of papers submitted to biomedical journals, international (co-)authorship of these papers (expressed by diversity and volume), and the possible association between journal metrics and said changes.

We study these possible changes using two approaches: a short-term analysis through which changes during the first six months of the outbreak are examined for both COVID-19 related papers and non-COVID-19 related papers; and a longitudinal approach through which changes are examined in comparison to the previous four years.

Our results show that the pandemic has so far had a tremendous effect on all examined accounts of scholarly publications: A sharp increase in publication volume has been witnessed and it can be almost entirely attributed to the pandemic; a significantly faster mean time to acceptance for COVID-19 papers is apparent, and it has (partially) come at the expense of non-COVID-19 papers; and a significant reduction in international collaboration for COVID-19 papers has also been identified.

As the pandemic continues to spread, these changes may cause a slow down in research in non-COVID-19 biomedical fields and bring about a lower rate of international collaboration.

DOI : https://doi.org/10.1007/s11192-021-04059-x

The Use of Twitter by Medical Journals: Systematic Review of the Literature

Posté le par

Authors : Natalie Erskine, Sharief Hendricks

Background

Medical journals use Twitter to engage and disseminate their research articles and implement a range of strategies to maximize reach and impact.

Objective

This study aims to systematically review the literature to synthesize and describe the different Twitter strategies used by medical journals and their effectiveness on journal impact and readership metrics.

Methods

A systematic search of the literature before February 2020 in four electronic databases (PubMed, Web of Science, Scopus, and ScienceDirect) was conducted. Articles were reviewed using the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines.

Results

The search identified 44 original research studies that evaluated Twitter strategies implemented by medical journals and analyzed the relationship between Twitter metrics and alternative and citation-based metrics. The key findings suggest that promoting publications on Twitter improves citation-based and alternative metrics for academic medical journals.

Moreover, implementing different Twitter strategies maximizes the amount of attention that publications and journals receive. The four key Twitter strategies implemented by many medical journals are tweeting the title and link of the article, infographics, podcasts, and hosting monthly internet-based journal clubs. Each strategy was successful in promoting the publications. However, different metrics were used to measure success.

Conclusions

Four key Twitter strategies are implemented by medical journals: tweeting the title and link of the article, infographics, podcasts, and hosting monthly internet-based journal clubs. In this review, each strategy was successful in promoting publications but used different metrics to measure success.

Thus, it is difficult to conclude which strategy is most effective. In addition, the four strategies have different costs and effects on dissemination and readership. We recommend that journals and researchers incorporate a combination of Twitter strategies to maximize research impact and capture audiences with a variety of learning methods.

URL : The Use of Twitter by Medical Journals: Systematic Review of the Literature

DOI : https://doi.org/10.2196/26378

Reproducibility of COVID-19 pre-prints

Posté le par

Authors : Annie Collins, Rohan Alexander

To examine the reproducibility of COVID-19 research, we create a dataset of pre-prints posted to arXiv, bioRxiv, medRxiv, and SocArXiv between 28 January 2020 and 30 June 2021 that are related to COVID-19.

We extract the text from these pre-prints and parse them looking for keyword markers signalling the availability of the data and code underpinning the pre-print. For the pre-prints that are in our sample, we are unable to find markers of either open data or open code for 75 per cent of those on arXiv, 67 per cent of those on bioRxiv, 79 per cent of those on medRxiv, and 85 per cent of those on SocArXiv.

We conclude that there may be value in having authors categorize the degree of openness of their pre-print as part of the pre-print submissions process, and more broadly, there is a need to better integrate open science training into a wide range of fields.

URL : https://arxiv.org/abs/2107.10724

Grand challenges and emergent modes of convergence science

Posté le par

Authors : Alexander M. Petersen, Mohammed E. Ahmed, Ioannis Pavlidis

To address complex problems, scholars are increasingly faced with challenges of integrating diverse domains. We analyzed the evolution of this convergence paradigm in the ecosystem of brain science, a research frontier that provides a contemporary testbed for evaluating two modes of cross-domain integration: (a) cross-disciplinary collaboration among experts from academic departments associated with disparate disciplines; and (b) cross-topic knowledge recombination across distinct subject areas.

We show that research involving both modes features a 16% citation premium relative to a mono-domain baseline. We further show that the cross-disciplinary mode is essential for integrating across large epistemic distances.

Yet we find research utilizing cross-topic exploration alone—a convergence shortcut—to be growing in prevalence at roughly 3% per year, significantly outpacing the more essential cross-disciplinary convergence mode.

By measuring shifts in the prevalence and impact of different convergence modes in the 5-year intervals up to and after 2013, we find that shortcut patterns may relate to competitive pressures associated with Human Brain funding initiatives launched that year.

Without policy adjustments, flagship funding programs may unintentionally incentivize suboptimal integration patterns, thereby undercutting convergence science’s potential in tackling grand challenges.

URL : Grand challenges and emergent modes of convergence science

DOI : https://doi.org/10.1057/s41599-021-00869-9

Day-to-day discovery of preprint–publication links

Posté le par

Authors : Guillaume Cabanac, Theodora Oikonomidi, Isabelle Boutron

Preprints promote the open and fast communication of non-peer reviewed work. Once a preprint is published in a peer-reviewed venue, the preprint server updates its web page: a prominent hyperlink leading to the newly published work is added.

Linking preprints to publications is of utmost importance as it provides readers with the latest version of a now certified work. Yet leading preprint servers fail to identify all existing preprint–publication links.

This limitation calls for a more thorough approach to this critical information retrieval task: overlooking published evidence translates into partial and even inaccurate systematic reviews on health-related issues, for instance.

We designed an algorithm leveraging the Crossref public and free source of bibliographic metadata to comb the literature for preprint–publication links. We tested it on a reference preprint set identified and curated for a living systematic review on interventions for preventing and treating COVID-19 performed by international collaboration: the COVID-NMA initiative (covid-nma.com).

The reference set comprised 343 preprints, 121 of which appeared as a publication in a peer-reviewed journal. While the preprint servers identified 39.7% of the preprint–publication links, our linker identified 90.9% of the expected links with no clues taken from the preprint servers.

The accuracy of the proposed linker is 91.5% on this reference set, with 90.9% sensitivity and 91.9% specificity. This is a 16.26% increase in accuracy compared to that of preprint servers. We release this software as supplementary material to foster its integration into preprint servers’ workflows and enhance a daily preprint–publication chase that is useful to all readers, including systematic reviewers.

This preprint–publication linker currently provides day-to-day updates to the biomedical experts of the COVID-NMA initiative.

URL : Day-to-day discovery of preprint–publication links

DOI : https://doi.org/10.1007/s11192-021-03900-7

Publication by association: how the COVID-19 pandemic has shown relationships between authors and editorial board members in the field of infectious diseases

Posté le par

Authors : Clara Locher, David Moher, Ioana Alina Cristea, Florian Naudet

During the COVID-19 pandemic, the rush to scientific and political judgements on the merits of hydroxychloroquine was fuelled by dubious papers which may have been published because the authors were not independent from the practices of the journals in which they appeared.

This example leads us to consider a new type of illegitimate publishing entity, ‘self-promotion journals’ which could be deployed to serve the instrumentalisation of productivity-based metrics, with a ripple effect on decisions about promotion, tenure and grant funding, but also on the quality of manuscripts that are disseminated to the medical community and form the foundation of evidence-based medicine.

DOI : http://dx.doi.org/10.1136/bmjebm-2021-111670