Preprints and Scholarly Communication: An Exploratory Qualitative Study of Adoption, Practices, Drivers and Barriers

Authors : Andrea Chiarelli, Rob Johnson, Stephen Pinfield, Emma Richens

Background

Since 2013, there has been a dramatic increase in the number of preprint servers. Little is known about the position of researchers, funders, research performing organisations and other stakeholders with respect to this fast-paced landscape.

In this article, we explore the perceived benefits and challenges of preprint posting, alongside issues including infrastructure and financial sustainability. We also discuss the definition of a ‘preprint’ in different communities, and the impact this has on uptake.

Methods

This study is based on 38 semi-structured interviews of key stakeholders, based on a purposive heterogeneous sampling approach and undertaken between October 2018 and January 2019.

Interviewees were primarily drawn from biology, chemistry and psychology, where use of preprints is growing. Interviews were recorded, transcribed and subjected to thematic analysis to identify trends. Interview questions were designed based on Innovation Diffusion Theory, which was also used to interpret our results.

Results

Participants were conscious of the rising prominence of preprints and cited early and fast dissemination as their most appealing feature. Preprints were also considered to enable broader access to scientific literature and increased opportunities for informal commenting.

The main concerns related to the lack of quality assurance and the ‘Ingelfinger rule’. We identified trust as an essential factor in preprint posting, and highlight the enabling role of Twitter in showcasing preprints.

Conclusions

The preprints landscape is evolving fast, and disciplinary communities are at different stages in the innovation diffusion process. The landscape is characterised by experimentation, which leads to the conclusion that a one-size-fits-all approach to preprints is not feasible.

Cooperation and active engagement between the stakeholders involved will play an important role going forward. We share questions for the further development of the preprints landscape, with the most important being whether preprint posting will develop as a publisher- or researcher-centric practice.

URL : Preprints and Scholarly Communication: An Exploratory Qualitative Study of Adoption, Practices, Drivers and Barriers

DOI : https://doi.org/10.12688/f1000research.19619.2

Motivations, understandings, and experiences of open‐access mega‐journal authors: Results of a large‐scale survey

Authors : Simon Wakeling, Claire Creaser, Stephen Pinfield, Jenny Fry, Valérie Spezi, Peter Willett, Monica Paramita

Open‐access mega‐journals (OAMJs) are characterized by their large scale, wide scope, open‐access (OA) business model, and “soundness‐only” peer review. The last of these controversially discounts the novelty, significance, and relevance of submitted articles and assesses only their “soundness.”

This article reports the results of an international survey of authors (n = 11,883), comparing the responses of OAMJ authors with those of other OA and subscription journals, and drawing comparisons between different OAMJs. Strikingly, OAMJ authors showed a low understanding of soundness‐only peer review: two‐thirds believed OAMJs took into account novelty, significance, and relevance, although there were marked geographical variations.

Author satisfaction with OAMJs, however, was high, with more than 80% of OAMJ authors saying they would publish again in the same journal, although there were variations by title, and levels were slightly lower than subscription journals (over 90%).

Their reasons for choosing to publish in OAMJs included a wide variety of factors, not significantly different from reasons given by authors of other journals, with the most important including the quality of the journal and quality of peer review.

About half of OAMJ articles had been submitted elsewhere before submission to the OAMJ with some evidence of a “cascade” of articles between journals from the same publisher.

URL : Motivations, understandings, and experiences of open‐access mega‐journal authors: Results of a large‐scale survey

DOI : https://doi.org/10.1002/asi.24154

“No comment”?: A study of commenting on PLOS articles

Authors : Simon Wakeling, Peter Willett, Claire Creaser, Jenny Fry, Stephen Pinfield, Valerie Spezi, Marc Bonne, Christina Founti, Itzelle Medina Perea

Article commenting functionality allows users to add publically visible comments to an article on a publisher’s website. As well as facilitating forms of post-publication peer review, for publishers of open-access mega-journals (large, broad scope, OA journals that seek to publish all technically or scientifically sound research) comments are also thought to serve as a means for the community to discuss and communicate the significance and novelty of the research, factors which are not assessed during peer review.

In this paper we present the results of an analysis of commenting on articles published by the Public Library of Science (PLOS), publisher of the first and best-known mega-journal PLOS ONE, between 2003 and 2016.

We find that while overall commenting rates are low, and have declined since 2010, there is substantial variation across different PLOS titles. Using a typology of comments developed for this research we also find that only around half of comments engage in an academic discussion of the article, and that these discussions are most likely to focus on the paper’s technical soundness.

Our results suggest that publishers have yet to encourage significant numbers of readers to leave comments, with implications for the effectiveness of commenting as a means of collecting and communicating community perceptions of an article’s importance.

DOI : https://doi.org/10.1177%2F0165551518819965

The UK Scholarly Communication Licence: Attempting to Cut through the Gordian Knot of the Complexities of Funder Mandates, Publisher Embargoes and Researcher Caution in Achieving Open Access

Authors : Julie Baldwin, Stephen Pinfield

Whilst take-up of open access (OA) in the UK is growing rapidly due partly to a number of funder mandates, managing the complexities of balancing compliance with these mandates against restrictive publisher policies and ingrained academic priorities, has resulted in UK higher education institutions (HEIs) often struggling with confused researchers, complex workflows, and rising costs.

In order to try to address this situation, the UK Scholarly Communication Licence (UK-SCL) was formulated to bypass the root causes of many of these challenges by implementing a licensing mechanism for multiple-mandate compliance in one single policy.

This is the first empirical study to focus on the genesis of the UK-SCL and how its implementation has been conceived thus far. A qualitative research method was used, taking the form of 14 semi-structured interviews with key stakeholders from the initiative across the UK.

The results indicate that those working within UK HEIs are concerned with the complexity of the current OA policy landscape and are frustrated with the inertia within the current system, which has resulted in higher costs, further publisher restrictions, and has not addressed the underlying tensions in academic culture.

The UK-SCL is seen by its initiators as a way to achieve further transition towards OA and take back some element of control of the content produced at their institutions.

The study concludes by modelling the ways in which the UK-SCL is intended to impact relationships between key stakeholders, and discussing possible implementation futures.

URL : The UK Scholarly Communication Licence: Attempting to Cut through the Gordian Knot of the Complexities of Funder Mandates, Publisher Embargoes and Researcher Caution in Achieving Open Access

Alternative location : http://www.mdpi.com/2304-6775/6/3/31

“Let the community decide”? The vision and reality of soundness-only peer review in open-access mega-journals

Authors : Valerie Spezi, Simon Wakeling, Stephen Pinfield, Jenny Fry, Claire Creaser, Peter Willett

Purpose

The purpose of this paper is to better understand the theory and practice of peer review in open-access mega-journals (OAMJs). OAMJs typically operate a “soundness-only” review policy aiming to evaluate only the rigour of an article, not the novelty or significance of the research or its relevance to a particular community, with these elements being left for “the community to decide” post-publication.

Design/methodology/approach

The paper reports the results of interviews with 31 senior publishers and editors representing 16 different organisations, including 10 that publish an OAMJ. Thematic analysis was carried out on the data and an analytical model developed to explicate their significance.

Findings

Findings suggest that in reality criteria beyond technical or scientific soundness can and do influence editorial decisions. Deviations from the original OAMJ model are both publisher supported (in the form of requirements for an article to be “worthy” of publication) and practice driven (in the form of some reviewers and editors applying traditional peer review criteria to OAMJ submissions). Also publishers believe post-publication evaluation of novelty, significance and relevance remains problematic.

Originality/value

The study is based on unprecedented access to senior publishers and editors, allowing insight into their strategic and operational priorities.

The paper is the first to report in-depth qualitative data relating specifically to soundness-only peer review for OAMJs, shedding new light on the OAMJ phenomenon and helping inform discussion on its future role in scholarly communication. The paper proposes a new model for understanding the OAMJ approach to quality assurance, and how it is different from traditional peer review.

URL : “Let the community decide”? The vision and reality of soundness-only peer review in open-access mega-journals

DOI : https://doi.org/10.1108/JD-06-2017-0092

Open access megajournals: The publisher perspective (Part 2: Operational realities)

Authors : Simon Wakeling ,Valérie Spezi, Jenny Fry, Claire Creaser, Stephen Pinfield, Peter Willett

This paper is the second of two Learned Publishing articles in which we report the results of a series of interviews, with senior publishers and editors exploring open access megajournals (OAMJs).

Megajournals (of which PLoS One is the best known example) represent a relatively new approach to scholarly communication and can be characterized as large, broad-scope, open access journals, which take an innovative approach to peer review, basing acceptance decisions solely on the technical or scientific soundness of the article. B

ased on interviews with 31 publishers and editors, this paper reports the perceived cultural, operational, and technical challenges associated with launching, growing, and maintaining a megajournal.

We find that overcoming these challenges while delivering the societal benefits associated with OAMJs is seen to require significant investment in people and systems, as well as an ongoing commitment to the model.

URL : Open access megajournals: The publisher perspective (Part 2: Operational realities)

Alternative location : http://onlinelibrary.wiley.com/doi/10.1002/leap.1118/full

 

Open access megajournals: The publisher perspective (Part 1: Motivations)

Authors : Simon Wakeling ,Valérie Spezi , Jenny Fry, Claire Creaser, Stephen Pinfield, Peter Willett

This paper is the first of two Learned Publishing articles in which we report the results of a series of interviews with senior publishers and editors exploring open access megajournals (OAMJs).

Megajournals (of which PLoS One is the best known example) represent a relatively new approach to scholarly communication and can be characterized as large, broad-scope, open access journals that take an innovative approach to peer review, basing acceptance decisions solely on the technical or scientific soundness of the article.

This model is often said to support the broader goals of the open science movement. Based on in-depth interviews with 31 publishers and editors representing 16 different organizations (10 of which publish a megajournal), this paper reports how the term ‘megajournal’ is understood and publishers’ rationale and motivations for launching (or not launching) an OAMJ.

We find that while there is general agreement on the common characteristics of megajournals, there is not yet a consensus on their relative importance. We also find seven motivating factors that were said to drive the launch of an OAMJ and link each of these factors to potential societal and business benefits.

These results suggest that the often polarized debate surrounding OAMJs is a consequence of the extent to which observers perceive publishers to be motivated by these societal or business benefits.

URL : Open access megajournals: The publisher perspective (Part 1: Motivations)

Alternative location : http://onlinelibrary.wiley.com/doi/10.1002/leap.1117/full