Quantifying professionalism in peer review

Authors : Travis G. Gerwing, Alyssa M. Allen Gerwing, Stephanie Avery-Gomm, Chi-Yeung Choi, Jeff C. Clements, Joshua A. Rash

Background

The process of peer-review in academia has attracted criticism surrounding issues of bias, fairness, and professionalism; however, frequency of occurrence of such comments is unknown.

Methods

We evaluated 1491 sets of reviewer comments from the fields of “Ecology and Evolution” and “Behavioural Medicine,” of which 920 were retrieved from the online review repository Publons and 571 were obtained from six early career investigators.

Comment sets were coded for the occurrence of “unprofessional comments” and “incomplete, inaccurate or unsubstantiated critiques” using an a-prior rubric based on our published research. Results are presented as absolute numbers and percentages.

Results

Overall, 12% (179) of comment sets included at least one unprofessional comment towards the author or their work, and 41% (611) contained incomplete, inaccurate of unsubstantiated critiques (IIUC).

Conclusions

The large number of unprofessional comments, and IIUCs observed could heighten psychological distress among investigators, particularly those at an early stage in their career. We suggest that development and adherence to a universally agreed upon reviewer code of conduct is necessary to improve the quality and professional experience of peer review.

URL : Quantifying professionalism in peer review

DOI : https://doi.org/10.1186/s41073-020-00096-x

Humanités numériques et archives : la longue émergence d’un nouveau paradigme

Auteur/Author : Frédéric Giuliano

Cet article vise à démystifier le domaine de recherche que sont les humanités numériques en révélant sa contribution et l’immense potentiel de ses approches pour la pratique archivistique et bibliothéconomique.

L’auteur y présente une réflexion sur les apports conceptuels et technologiques des humanités numériques tout en soulignant les défis que doivent relever les professionnels de l’information associés à ces projets, mais aussi les nouveaux rôles que ces derniers sont appelés à y jouer.

DOI : https://doi.org/10.7202/1063788ar

 

Individuation through infrastructure: Get Full Text Research, data extraction and the academic publishing oligopoly

Author : Samuel Moore

This article explores the recent turn within academic publishing towards ‘seamless access’, an approach to content provision that ensures users do not have to continually authenticate in order to access journal content.

Through a critical exploration of Get Full Text Research, a service developed collaboratively by five of the world’s largest academic publishers to provide such seamless access to academic research, the article shows how publishers are seeking to control the ways in which readers access publications in order to trace, control and ultimately monetise user interactions on their platforms.

Theorised as a process of individuation through infrastructure, the article reveals how publishers are attempting an ontological shift to position the individual, quantifiable researcher, rather than the published content, at the centre of the scholarly communication universe.

The implications of the shift towards individuation are revealed as part of a broader trend in scholarly communication infrastructure towards data extraction, mirroring a trend within digital capitalism more generally.

URL : Individuation through infrastructure: Get Full Text Research, data extraction and the academic publishing oligopoly

DOI : http://dx.doi.org/10.17613/3pez-w041

Researcher’s Perceptions on Publishing “Negative” Results and Open Access

Authors : Lucía Echevarría, Alberto Malerba, Virginia Arechavala-Gomeza

Scientific advance is based on reproducibility, corroboration, and availability of research results. However, large numbers of experimental results that contradict previous work do not get published and many research results are not freely available as they are hidden behind paywalls.

As part of COST Action “DARTER”, a network of researchers in the field of RNA therapeutics, we have performed a small survey among our members and their colleagues to assess their opinion on the subject of publishing contradictory or ambiguous results and their attitude to open access (OA) publishing.

Our survey indicates that, although researchers highly value publication of “negative” results, they often do not publish their own, citing lack of time and the perception that those results may not be as highly cited. OA, on the other hand, seems to be widely accepted, but in many cases not actively sought by researchers due to higher costs associated with it.

URL : Researcher’s Perceptions on Publishing “Negative” Results and Open Access

DOI : https://doi.org/10.1089/nat.2020.0865

International authorship and collaboration across bioRxiv preprints

Authors : Richard J Abdill, Elizabeth M Adamowicz, Ran Blekhman

Preprints are becoming well established in the life sciences, but relatively little is known about the demographics of the researchers who post preprints and those who do not, or about the collaborations between preprint authors.

Here, based on an analysis of 67,885 preprints posted on bioRxiv, we find that some countries, notably the United States and the United Kingdom, are overrepresented on bioRxiv relative to their overall scientific output, while other countries (including China, Russia, and Turkey) show lower levels of bioRxiv adoption.

We also describe a set of ‘contributor countries’ (including Uganda, Croatia and Thailand): researchers from these countries appear almost exclusively as non-senior authors on international collaborations.

Lastly, we find multiple journals that publish a disproportionate number of preprints from some countries, a dynamic that almost always benefits manuscripts from the US.

URL :  International authorship and collaboration across bioRxiv preprints

DOI : https://doi.org/10.7554/eLife.58496

Our Study is Published, But the Journey is Not Finished!

Authors : Olivier Pourret, Katsuhiko Suzuki, Yoshio Takahashi

Each June, we receive e-mails from publishers welcoming the evolution of their journals’ journal impact factor (JIF). The JIF is a controversial metric (Callaway 2016), and it is worth asking, “What’s behind it?”

In this age of “publish or perish” (Harzing 2007), we take much time and effort to write our papers and get them published. But how much time and effort do we put into finding readers or ensuring that we are reaching the right audience? Are metrics, such as the JIF, good guides for how well we are doing at reaching our target audience?

DOI : https://doi.org/10.2138/gselements.16.4.229

Curated Archiving of Research Software Artifacts: Lessons Learned from the French Open Archive (HAL)

Authors : Roberto di Cosmo, Morane Gruenpeter, Bruno Marmol, Alain Monteil, Laurent Romary, Jozefina Sadowsa

Software has become an indissociable support of technical and scientific knowledge. The preservation of this universal body of knowledge is as essential as preserving research articles and data sets.

In the quest to make scientific results reproducible, and pass knowledge to future generations, we must preserve these three main pillars: research articles that describe the results, the data sets used or produced, and the software that embodies the logic of the data transformation.

The collaboration between Software Heritage (SWH), the Center for Direct Scientific Communication (CCSD) and the scientific and technical information services (IES) of The French Institute for Research in Computer Science and Automation (Inria) has resulted in a specified moderation and curation workflow for research software artifacts deposited in the HAL the French global open access repository.

The curation workflow was developed to help digital librarians and archivists handle this new and peculiar artifact – software source code. While implementing the workflow, a set of guidelines has emerged from the challenges and the solutions put in place to help all actors involved in the process.

URL : Curated Archiving of Research Software Artifacts: Lessons Learned from the French Open Archive (HAL)

DOI : https://doi.org/10.2218/ijdc.v15i1.698