Publication by association: the Covid-19 pandemic reveals relationships between authors and editors

Authors : Clara Locher, David Moher, Ioana Cristea, Florian Naudet

During the COVID-19 pandemic, the rush to scientific and political judgments on the merits of hydroxychloroquine was fuelled by dubious papers which may have been published because the authors were not independent from the practices of the journals in which they appeared.

This example leads us to consider a new type of illegitimate publishing entity, “self-promotion journals” which could be deployed to serve the instrumentalisation of productivity-based metrics, with a ripple effect on decisions about promotion, tenure, and grant funding.

URL : Publication by association: the Covid-19 pandemic reveals relationships between authors and editors

DOI : https://doi.org/10.31222/osf.io/64u3s

Quantifying professionalism in peer review

Authors : Travis G. Gerwing, Alyssa M. Allen Gerwing, Stephanie Avery-Gomm, Chi-Yeung Choi, Jeff C. Clements, Joshua A. Rash

Background

The process of peer-review in academia has attracted criticism surrounding issues of bias, fairness, and professionalism; however, frequency of occurrence of such comments is unknown.

Methods

We evaluated 1491 sets of reviewer comments from the fields of “Ecology and Evolution” and “Behavioural Medicine,” of which 920 were retrieved from the online review repository Publons and 571 were obtained from six early career investigators.

Comment sets were coded for the occurrence of “unprofessional comments” and “incomplete, inaccurate or unsubstantiated critiques” using an a-prior rubric based on our published research. Results are presented as absolute numbers and percentages.

Results

Overall, 12% (179) of comment sets included at least one unprofessional comment towards the author or their work, and 41% (611) contained incomplete, inaccurate of unsubstantiated critiques (IIUC).

Conclusions

The large number of unprofessional comments, and IIUCs observed could heighten psychological distress among investigators, particularly those at an early stage in their career. We suggest that development and adherence to a universally agreed upon reviewer code of conduct is necessary to improve the quality and professional experience of peer review.

URL : Quantifying professionalism in peer review

DOI : https://doi.org/10.1186/s41073-020-00096-x

Researcher’s Perceptions on Publishing “Negative” Results and Open Access

Authors : Lucía Echevarría, Alberto Malerba, Virginia Arechavala-Gomeza

Scientific advance is based on reproducibility, corroboration, and availability of research results. However, large numbers of experimental results that contradict previous work do not get published and many research results are not freely available as they are hidden behind paywalls.

As part of COST Action “DARTER”, a network of researchers in the field of RNA therapeutics, we have performed a small survey among our members and their colleagues to assess their opinion on the subject of publishing contradictory or ambiguous results and their attitude to open access (OA) publishing.

Our survey indicates that, although researchers highly value publication of “negative” results, they often do not publish their own, citing lack of time and the perception that those results may not be as highly cited. OA, on the other hand, seems to be widely accepted, but in many cases not actively sought by researchers due to higher costs associated with it.

URL : Researcher’s Perceptions on Publishing “Negative” Results and Open Access

DOI : https://doi.org/10.1089/nat.2020.0865

International authorship and collaboration across bioRxiv preprints

Authors : Richard J Abdill, Elizabeth M Adamowicz, Ran Blekhman

Preprints are becoming well established in the life sciences, but relatively little is known about the demographics of the researchers who post preprints and those who do not, or about the collaborations between preprint authors.

Here, based on an analysis of 67,885 preprints posted on bioRxiv, we find that some countries, notably the United States and the United Kingdom, are overrepresented on bioRxiv relative to their overall scientific output, while other countries (including China, Russia, and Turkey) show lower levels of bioRxiv adoption.

We also describe a set of ‘contributor countries’ (including Uganda, Croatia and Thailand): researchers from these countries appear almost exclusively as non-senior authors on international collaborations.

Lastly, we find multiple journals that publish a disproportionate number of preprints from some countries, a dynamic that almost always benefits manuscripts from the US.

URL :  International authorship and collaboration across bioRxiv preprints

DOI : https://doi.org/10.7554/eLife.58496

Evaluation of untrustworthy journals: Transition from formal criteria to a complex view

Authors : Jiří Kratochvíl, Lukáš Plch, Martin Sebera, Eva Koriťáková

Not all the journals included in credible indexes meet the ethical rules of COPE, DOAJ, OASPA and WAMEand equally there may be trustworthy journals excluded from these indexes which means they cannot be used as definitive whitelists for trustworthy journals.

Equally the many methods suggested to determine trustworthiness are not reliable due to including questionable criteria. The question arises whether valid criteria for identifying an untrustworthy journal can be determined and whether other assessment procedures are necessary.

Since 2017, the Masaryk University Campus Library has been developing a suitable evaluation method for journals. A list of 19 criteria based on those originally suggested by Beall, COPE, DOAJ, OASPA and WAME were reduced to 10 objectively verifiable criteria following two workshops with librarians.

An evaluation of 259 biomedical journals using both the list of 19 and then 10 criteria revealed that 74 journals may have been incorrectly assessed as untrustworthy using the longer list.

The most common reason for failure to comply was in the provision of sufficient editorial information and declaration of article processing charges. However our investigation revealed that no criteria can reliably identify predatory journals.

Therefore, a complex evaluation is needed combining objectively verifiable criteria with analysis of a journal’s content and knowledge of the journal’s background.

URL : https://is.muni.cz/publication/1669782/en/Kratochvil-Plch-Sebera-Koritakova/Evaluation-of-untrustworthy-journals-Transition-from-formal-criteria-to-a-complex-view

Responsible, practical genomic data sharing that accelerates research

Authors : James Brian Byrd, Anna C. Greene, Deepashree Venkatesh Prasad, Xiaoqian Jiang, Casey S. Greene

Data sharing anchors reproducible science, but expectations and best practices are often nebulous. Communities of funders, researchers and publishers continue to grapple with what should be required or encouraged.

To illuminate the rationales for sharing data, the technical challenges and the social and cultural challenges, we consider the stakeholders in the scientific enterprise. In biomedical research, participants are key among those stakeholders.

Ethical sharing requires considering both the value of research efforts and the privacy costs for participants. We discuss current best practices for various types of genomic data, as well as opportunities to promote ethical data sharing that accelerates science by aligning incentives.

URL : Responsible, practical genomic data sharing that accelerates research

DOI : https://doi.org/10.1038/s41576-020-0257-5

Transparency and open science principles in reporting guidelines in sleep research and chronobiology journals

Authors : Manuel Spitschan, Marlene H. Schmidt, Christine Blume

Background

“Open science” is an umbrella term describing various aspects of transparent and open science practices. The adoption of practices at different levels of the scientific process (e.g., individual researchers, laboratories, institutions) has been rapidly changing the scientific research landscape in the past years, but their uptake differs from discipline to discipline.

Here, we asked to what extent journals in the field of sleep research and chronobiology encourage or even require following transparent and open science principles in their author guidelines.

Methods

We scored the author guidelines of a comprehensive set of 28 sleep and chronobiology journals, including the major outlets in the field, using the standardised Transparency and Openness (TOP) Factor.

This instrument rates the extent to which journals encourage or require following various aspects of open science, including data citation, data transparency, analysis code transparency, materials transparency, design and analysis guidelines, study pre-registration, analysis plan pre-registration, replication, registered reports, and the use of open science badges.

Results

Across the 28 journals, we find low values on the TOP Factor (median [25th, 75th percentile] 2.5 [1, 3], min. 0, max. 9, out of a total possible score of 28) in sleep research and chronobiology journals.

Conclusions

Our findings suggest an opportunity for sleep research and chronobiology journals to further support the recent developments in transparent and open science by implementing transparency and openness principles in their guidelines and making adherence to them mandatory.

URL : Transparency and open science principles in reporting guidelines in sleep research and chronobiology journals

DOI : https://doi.org/10.12688/wellcomeopenres.16111.1