Publishers’ Responsibilities in Promoting Data Quality and Reproducibility

Author : Iain Hrynaszkiewicz

Scholarly publishers can help to increase data quality and reproducible research by promoting transparency and openness.

Increasing transparency can be achieved by publishers in six key areas: (1) understanding researchers’ problems and motivations, by conducting and responding to the findings of surveys; (2) raising awareness of issues and encouraging behavioural and cultural change, by introducing consistent journal policies on sharing research data, code and materials; (3) improving the quality and objectivity of the peer-review process by implementing reporting guidelines and checklists and using technology to identify misconduct; (4) improving scholarly communication infrastructure with journals that publish all scientifically sound research, promoting study registration, partnering with data repositories and providing services that improve data sharing and data curation; (5) increasing incentives for practising open research with data journals and software journals and implementing data citation and badges for transparency; and (6) making research communication more open and accessible, with open-access publishing options, permitting text and data mining and sharing publisher data and metadata and through industry and community collaboration.

This chapter describes practical approaches being taken by publishers, in these six areas, their progress and effectiveness and the implications for researchers publishing their work.

URL : Publishers’ Responsibilities in Promoting Data Quality and Reproducibility

Alternative location : https://link.springer.com/chapter/10.1007%2F164_2019_290

The fundamental problem blocking open access and how to overcome it: the BitViews project

Authors : Camillo Lamanna, Manfredi La Manna

In our view the fundamental obstacle to open access (OA) is the lack of any incentive-based mechanism that unbundles authors’ accepted manuscripts (AMs) from articles (VoRs).

The former can be seen as the public good that ought to be openly accessible, whereas the latter is owned by publishers and rightly paywall-restricted. We propose one such mechanism to overcome this obstacle: BitViews.

BitViews is a blockchain-based application that aims to revolutionize the OA publishing ecosystem. Currently, the main academic currency of value is the citation. There have been attempts in the past to create a second currency whose measure is the online usage of research materials (e.g. PIRUS).

However, these have failed due to two problems. Firstly, it has been impossible to find a single agency willing to co-ordinate and fund the validation and collation of global online usage data. Secondly, online usage metrics have lacked transparency in how they filter non-human online activity.

BitViews is a novel solution which uses blockchain technology to bypass both problems: online AMS usage will be recorded on a public, distributed ledger, obviating the need for a central responsible agency, and the rules governing activity-filtering will be part of the open-source BitViews blockchain application, creating complete transparency.

Once online AMS usage has measurable value, researchers will be incentivized to promote and disseminate AMs. This will fundamentally re-orient the academic publishing ecosystem.

A key feature of BitViews is that its success (or failure) is wholly and exclusively in the hands of the worldwide community of university and research libraries, as we suggest that it ought to be financed by conditional crowdfunding, whereby the actual financial commitment of each contributing library depends on the total amount raised.

If the financing target is not reached, then all contributions are returned in full and if the target is over-fulfilled, then the surplus is returned pro rata.

URL : The fundamental problem blocking open access and how to overcome it: the BitViews project

DOI : http://doi.org/10.1629/uksg.488

 

Mapping the Publishing Challenges for an Open Access University Press

Authors : Megan Taylor

Managing a New University Press (NUP) is often a one-person operation and, with limits on time and resources, efficiency and effectiveness are key to having a successful production process and providing a high level of author, editor and reader services.

This article looks at the challenges faced by open access (OA) university presses throughout the publishing journey and considers ways in which these challenges can be addressed. In particular, the article focuses on six key stages throughout the lifecycle of an open access publication: commissioning; review; production; discoverability; marketing; analytics.

Approached from the point of view of the University of Huddersfield Press, this article also draws on discussions and experiences of other NUPs from community-led forums and events.

By highlighting the issues faced, and the potential solutions to them, this research recognises the need for a tailored and formalised production workflow within NUPs and also provides guidance how to begin implementing possible solutions.

URL : Mapping the Publishing Challenges for an Open Access University Press

DOI : https://doi.org/10.3390/publications7040063

Defining predatory journals and responding to the threat they pose: a modified Delphi consensus process

Authors : Samantha Cukier, Manoj M. Lalu, Gregory L. Bryson, Kelly D. Cobey, Agnes Grudniewicz, David Moher

Background

Posing as legitimate open access outlets, predatory journals and publishers threaten the integrity of academic publishing by not following publication best practices. Currently, there is no agreed upon definition of predatory journals, making it difficult for funders and academic institutions to generate practical guidance or policy to ensure their members do not publish in these channels.

Methods

We conducted a modified three-round Delphi survey of an international group of academics, funders, policy makers, journal editors, publishers and others, to generate a consensus definition of predatory journals and suggested ways the research community should respond to the problem.

Results

A total of 45 participants completed the survey on predatory journals and publishers. We reached consensus on 18 items out of a total of 33, to be included in a consensus definition of predatory journals and publishers.

We came to consensus on educational outreach and policy initiatives on which to focus, including the development of a single checklist to detect predatory journals and publishers, and public funding to support research in this general area.

We identified technological solutions to address the problem: a ‘one-stop-shop’ website to consolidate information on the topic and a ‘predatory journal research observatory’ to identify ongoing research and analysis about predatory journals/publishers.

Conclusions

In bringing together an international group of diverse stakeholders, we were able to use a modified Delphi process to inform the development of a definition of predatory journals and publishers.

This definition will help institutions, funders and other stakeholders generate practical guidance on avoiding predatory journals and publishers.

URL : Defining predatory journals and responding to the threat they pose: a modified Delphi consensus process

DOI : https://doi.org/10.1101/19010850

Does the use of open, non-anonymous peer review in scholarly publishing introduce bias? Evidence from the F1000 post-publication open peer review publishing model

Authors : Mike Thelwall, Verena Weigert, Liz Allen, Zena Nyakoojo, Eleanor-Rose Papas

This study examines whether there is any evidence of bias in two areas of common critique of open, non-anonymous peer review – and used in the post-publication, peer review system operated by the open-access scholarly publishing platform F1000Research.

First, is there evidence of bias where a reviewer based in a specific country assesses the work of an author also based in the same country? Second, are reviewers influenced by being able to see the comments and know the origins of previous reviewer?

Scrutinising the open peer review comments published on F1000Research, we assess the extent of two frequently cited potential influences on reviewers that may be the result of the transparency offered by a fully attributable, open peer review publishing model: the national affiliations of authors and reviewers, and the ability of reviewers to view previously-published reviewer reports before submitting their own.

The effects of these potential influences were investigated for all first versions of articles published by 8 July 2019 to F1000Research. In 16 out of the 20 countries with the most articles, there was a tendency for reviewers based in the same country to give a more positive review.

The difference was statistically significant in one. Only 3 countries had the reverse tendency. Second, there is no evidence of a conformity bias. When reviewers mentioned a previous review in their peer review report, they were not more likely to give the same overall judgement.

Although reviewers who had longer to potentially read a previously published reviewer reports were slightly less likely to agree with previous reviewer judgements, this could be due to these articles being difficult to judge rather than deliberate non-conformity.

URL : https://arxiv.org/abs/1911.03379

Scientific sinkhole: The pernicious price of formatting

Authors : Allana G. LeBlanc, Joel D. Barnes, Travis J. Saunders, Mark S. Tremblay, Jean-Philippe Chaput

Objective

To conduct a time-cost analysis of formatting in scientific publishing.

Design

International, cross-sectional study (one-time survey).

Setting

Internet-based self-report survey, live between September 2018 and January 2019.

Participants

Anyone working in research, science, or academia and who submitted at least one peer-reviewed manuscript for consideration for publication in 2017. Completed surveys were available for 372 participants from 41 countries (60% of respondents were from Canada).

Main outcome measure

Time (hours) and cost (wage per hour x time) associated with formatting a research paper for publication in a peer-reviewed academic journal.

Results

The median annual income category was US$61,000–80,999, and the median number of publications formatted per year was four. Manuscripts required a median of two attempts before they were accepted for publication.

The median formatting time was 14 hours per manuscript, or 52 hours per person, per year. This resulted in a median calculated cost of US$477 per manuscript or US$1,908 per person, per year.

Conclusions

To our knowledge, this is the first study to analyze the cost of manuscript formatting in scientific publishing. Our results suggest that scientific formatting represents a loss of 52 hours, costing the equivalent of US$1,908 per researcher per year.

These results identify the hidden and pernicious price associated with scientific publishing and provide evidence to advocate for the elimination of strict formatting guidelines, at least prior to acceptance.

URL : Scientific sinkhole: The pernicious price of formatting

DOI : https://doi.org/10.1371/journal.pone.0223116

Worldwide inequality in access to full textscientific articles: the example ofophthalmology

Authors : Christophe Boudry, Patricio Alvarez-Muñoz, Ricardo Arencibia-Jorge, Didier Ayena, Niels J. Brouwer, Zia Chaudhuri, Brenda Chawner, Emilienne Epee, Khalil Erraïs, Akbar Fotouhi, Almutez M. Gharaibeh, Dina H. Hassanein, Martina C. Herwig-Carl, Katherine Howard, Dieudonne Kaimbo Wa Kaimbo, Patricia-Ann Laughrea, Fernando A. Lopez, Juan D. Machin-Mastromatteo, Fernando K. Malerbi, Papa Amadou Ndiaye, Nina A. Noor, Josmel Pacheco-Mendoza, Vasilios P. Papastefanou, Mufarriq Shah, Carol L. Shields, Ya Xing Wang, Vasily Yartsev, Frederic Mouriaux

Background

The problem of access to medical information, particularly in low-income countries, has been under discussion for many years. Although a number of developments have occurred in the last decade (e.g., the open access (OA) movement and the website Sci-Hub), everyone agrees that these difficulties still persist very widely, mainly due to the fact that paywalls still limit access to approximately 75% of scholarly documents.

In this study, we compare the accessibility of recent full text articles in the field of ophthalmology in 27 established institutions located worldwide.

Methods

A total of 200 references from articles were retrieved using the PubMed database. Each article was individually checked for OA. Full texts of non-OA (i.e., “paywalled articles”) were examined to determine whether they were available using institutional and Hinari access in each institution studied, using “alternative ways” (i.e., PubMed Central, ResearchGate, Google Scholar, and Online Reprint Request), and using the website Sci-Hub.

Results

The number of full texts of “paywalled articles” available using institutional and Hinari access showed strong heterogeneity, scattered between 0% full texts to 94.8% (mean = 46.8%; SD = 31.5; median = 51.3%).

We found that complementary use of “alternative ways” and Sci-Hub leads to 95.5% of full text “paywalled articles,” and also divides by 14 the average extra costs needed to obtain all full texts on publishers’ websites using pay-per-view.

Conclusions

The scant number of available full text “paywalled articles” in most institutions studied encourages researchers in the field of ophthalmology to use Sci-Hub to search for scientific information.

The scientific community and decision-makers must unite and strengthen their efforts to find solutions to improve access to scientific literature worldwide and avoid an implosion of the scientific publishing model.

This study is not an endorsement for using Sci-Hub. The authors, their institutions, and publishers accept no responsibility on behalf of readers.

URL : Worldwide inequality in access to full textscientific articles: the example ofophthalmology

DOI : https://doi.org/10.7717/peerj.7850