Purposes of peer review: A qualitative study of stakeholder expectations and perceptions

Authors : Anna Severin, Joanna Chataway

Stakeholders might have diverging or conflicting expectations about the functions that peer review should fulfil. We aimed to explore how stakeholder groups perceive peer review and what they expect from it. We conducted qualitative focus group workshops with early‐, mid‐, and senior career scholars, editors, and publishers.

We recruited participants following a purposive maximum variation sampling approach. To identify purposes of peer review, we conducted a thematic analysis. Stakeholders expected peer review (1) to assess the contributions of a manuscript, (2) to conduct quality control, (3) to improve manuscripts, (4) to assess the suitability of manuscripts for a journal, (5) to provide a decision‐making tool for editors, (6) to provide feedback by peers, (7) to curate a community, and (8) to provide a seal of accreditation for published articles.

Stakeholders with different roles and tasks in the peer review process differed in the value they attached to the functions of peer review. Early‐ and mid‐career researchers valued social and feedback functions of peer review, while senior career researchers and editors expected it to instead perform a technical assessment of manuscripts and serve as a decision‐making tool.

Publishers expected peer review to assess the suitability of manuscripts for their journals and to provide a seal of accreditation. This revealed a potential tension between functions of peer review. Stakeholder expectations are shaped by how stakeholders perceive their own roles both in relation to the peer review process and within their scientific community.

URL : Purposes of peer review: A qualitative study of stakeholder expectations and perceptions

DOI : https://doi.org/10.1002/leap.1336

Branding Scholarly Journals: Transmuting Symbolic Capital into Economic Capital

Auteurs/Authors : Mahdi Khelfaoui, Yves Gingras

In this paper, we analyze a relatively recent commercial strategy devised by large academic publishers, consisting in the branding of their most prestigious scientific journals. Using Pierre Bourdieu’s model of capital conversion, we show how publishers transfer the symbolic capital of an already prestigious journal to derivative journals that capture part of the prestige of the original brand and transform it into new economic capital.

As shown by their high impact factors, these new journals, bearing the mark of the original journal in their titles, are rapidly adopted by researchers. Through manuscript transfer mechanisms, publishers also use part of the papers rejected by their flagship and highly selective jour-nals to recycle and monetize them inlower impactor open access derivativejournals of their lists.

URL : https://cirst2.openum.ca/files/sites/179/2020/08/Note_2020-03-branding.pdf

‘I Updated the ‘: The Evolution of References in the English Wikipedia and the Implications for Altmetrics

Authors : Olga Zagovora, Roberto Ulloa, Katrin Weller, Fabian Flöck

With this work, we present a publicly available dataset of the history of all the references (more than 55 million) ever used in the English Wikipedia until June 2019. We have applied a new method for identifying and monitoring references in Wikipedia, so that for each reference we can provide data about associated actions: creation, modifications, deletions, and reinsertions.

The high accuracy of this method and the resulting dataset was confirmed via a comprehensive crowdworker labelling campaign. We use the dataset to study the temporal evolution of Wikipedia references as well as users’ editing behaviour.

We find evidence of a mostly productive and continuous effort to improve the quality of references: (1) there is a persistent increase of reference and document identifiers (DOI, PubMedID, PMC, ISBN, ISSN, ArXiv ID), and (2) most of the reference curation work is done by registered humans (not bots or anonymous editors).

We conclude that the evolution of Wikipedia references, including the dynamics of the community processes that tend to them should be leveraged in the design of relevance indexes for altmetrics, and our dataset can be pivotal for such effort.

URL : https://arxiv.org/abs/2010.03083

Evaluating the impact of open access policies on research institutions

Authors : Chun-kai (karl) Huang, Cameron Neylon, Richard Hosking, Lucy Montgomery, Katie S Wilson, Alkim Ozaygen, Chloe Brookes-Kenworthy

The proportion of research outputs published in open access journals or made available on other freely-accessible platforms has increased over the past two decades, driven largely by funder mandates, institutional policies, grass-roots advocacy, and changing attitudes in the research community.

However, the relative effectiveness of these different interventions has remained largely unexplored. Here we present a robust, transparent and updateable method for analysing how these interventions affect the open access performance of individual institutes.

We studied 1,207 institutions from across the world, and found that, in 2017, the top-performing universities published around 80–90% of their research open access.

The analysis also showed that publisher-mediated (gold) open access was popular in Latin American and African universities, whereas the growth of open access in Europe and North America has mostly been driven by repositories.

URL : Evaluating the impact of open access policies on research institutions

DOI : https://doi.org/10.7554/eLife.57067

Global electronic thesis and dissertation repositories – collection diversity and management issues

Authors: Fayaz Ahmad Loan, Ufaira Yaseen Shah

This article discovers the collection diversity of electronic thesis and dissertation (ETD) repositories based on key parameters such as regional distribution, subject classification, language diversity, etc. and identifies the critical management issues of the ETD repositories related to collection management, software management, content management and metadata policies.

The ETD repositories were identified in the Directory of Open Access Repositories (OpenDOAR). The required data were manually collected from the OpenDOAR and websites of repositories to achieve the prescribed objectives of the study. The data were later tabulated, analysed and interpreted using simple arithmetic techniques.

The study was limited to the ETD repositories available in the OpenDOAR, and findings cannot be generalized across repositories and directories. It provides insights about ETD repositories worldwide, highlights their critical management issues and suggests mechanisms for their sustainable growth and development.

This article is purely based on research and its findings are valid for scholars, faculty members, institutions – as well as administrators and managers of the ETD repositories.

URL : Global electronic thesis and dissertation repositories – collection diversity and management issues

DOI : http://doi.org/10.1629/uksg.524

Data journals: incentivizing data access and documentation within the scholarly communication system

Authors : William H. Walters

Data journals provide strong incentives for data creators to verify, document and disseminate their data. They also bring data access and documentation into the mainstream of scholarly communication, rewarding data creators through existing mechanisms of peer-reviewed publication and citation tracking.

These same advantages are not generally associated with data repositories, or with conventional journals’ data-sharing mandates. This article describes the unique advantages of data journals. It also examines the data journal landscape, presenting the characteristics of 13 data journals in the fields of biology, environmental science, chemistry, medicine and health sciences.

These journals vary considerably in size, scope, publisher characteristics, length of data reports, data hosting policies, time from submission to first decision, article processing charges, bibliographic index coverage and citation impact. They are similar, however, in their peer review criteria, their open access license terms and the characteristics of their editorial boards.

URL : Data journals: incentivizing data access and documentation within the scholarly communication system

DOI : http://doi.org/10.1629/uksg.510

How often do leading biomedical journals use statistical experts to evaluate statistical methods? The results of a survey

Authors : Tom E. Hardwicke, Steven N. Goodman

Scientific claims in biomedical research are typically derived from statistical analyses. However, misuse or misunderstanding of statistical procedures and results permeate the biomedical literature, affecting the validity of those claims.

One approach journals have taken to address this issue is to enlist expert statistical reviewers. How many journals do this, how statistical review is incorporated, and how its value is perceived by editors is of interest.

Here we report an expanded version of a survey conducted more than 20 years ago by Goodman and colleagues (1998) with the intention of characterizing contemporary statistical review policies at leading biomedical journals.

We received eligible responses from 107 of 364 (28%) journals surveyed, across 57 fields, mostly from editors in chief. 34% (36/107) rarely or never use specialized statistical review, 34% (36/107) used it for 10–50% of their articles and 23% used it for all articles.

These numbers have changed little since 1998 in spite of dramatically increased concern about research validity. The vast majority of editors regarded statistical review as having substantial incremental value beyond regular peer review and expressed comparatively little concern about the potential increase in reviewing time, cost, and difficulty identifying suitable statistical reviewers. Improved statistical education of researchers and different ways of employing statistical expertise are needed. Several proposals are discussed.

URL : How often do leading biomedical journals use statistical experts to evaluate statistical methods? The results of a survey

DOI : https://doi.org/10.1371/journal.pone.0239598