Does Peer Review Identify the Best Papers? A Simulation Study of Editors, Reviewers, and the Scientific Publication Process

Author : Justin Esarey

How does the structure of the peer review process, which can vary among journals, influence the quality of papers published in a journal? This article studies multiple systems of peer review using computational simulation. I find that, under any of the systems I study, a majority of accepted papers are evaluated by an average reader as not meeting the standards of the journal.

Moreover, all systems allow random chance to play a strong role in the acceptance decision. Heterogeneous reviewer and reader standards for scientific quality drive both results. A peer review system with an active editor—that is, one who uses desk rejection before review and does not rely strictly on reviewer votes to make decisions—can mitigate some of these effects.

DOI : https://doi.org/10.1017/S1049096517001081

Make researchers revisit past publications to improve reproducibility

Authors : Clare Fiala, Eleftherios P. Diamandis

Scientific irreproducibility is a major issue that has recently increased attention from publishers, authors, funders and other players in the scientific arena. Published literature suggests that 50-80% of all science performed is irreproducible. While various solutions to this problem have been proposed, none of them are quick and/or cheap.

Here, we propose one way of reducing scientific irreproducibility by asking authors to revisit their previous publications and provide a commentary after five years. We believe that this measure will alert authors not to over sell their results and will help with better planning and execution of their experiments.

We invite scientific journals to adapt this proposal immediately as a prerequisite for publishing.

URL : Make researchers revisit past publications to improve reproducibility

DOI : http://dx.doi.org/10.12688/f1000research.12715.1

 

Altmetrics and Archives

Author : Elizabeth Joan Kelly

Altmetrics are an alternative to traditional measurement of the impact of published resources. While altmetrics are primarily used by researchers and institutions to measure the impact of scholarly publications online, they can also be used by archives to measure the impact of their diverse online holdings, including digitized and born-digital collections, digital exhibits, repository websites, and online finding aids.

Furthermore, altmetrics may fill a need for user engagement assessments for cultural heritage organizations. This article introduces the concept of altmetrics for archives and discusses barriers to adoption, best practices for collection, and potential further areas of study.

URL : http://elischolar.library.yale.edu/jcas/vol4/iss1/1/

Unlocking the digital potential of scholarly monographs in 21st century research

Authors : Margo Bargheer, Zeki Mustafa Dogan, Wolfram Horstmann, Mike Mertens, Andrea Rapp

In the light of new digital production and dissemination practices, the scholarly publishing system has seen significant and also disruptive changes, especially in STM (science, technology and medicine) and with regard to the predominant format “journal article”.

The digital transformation also holds true for those disciplines that continue to rely on the scholarly monograph as a publication format and means for reputation building, namely the Humanities and the Social Sciences with a qualitative approach (HSS).

In our paper we analyse the reasons why the monograph has not yet reached its full potential in the digital paradigm, especially in the uptake of Open Access and innovative publishing options.

We highlight some of the principal underlying factors for this, and suggest how especially practices, now more widespread in HSS but arising from the Digital Humanities, could play a role in moving forward the rich digitality of the scholarly monograph.

URL  : Unlocking the digital potential of scholarly monographs in 21st century research

DOI : http://doi.org/10.18352/lq.10174

 

What Does the Future Hold for Scientific Journals? Visual Abstracts and Other Tools for Communicating Research

Authors : Vahagn C. Nikolian, Andrew M. Ibrahim

Journals fill several important roles within academic medicine, including building knowledge, validating quality of methods, and communicating research. This section provides an overview of these roles and highlights innovative approaches journals have taken to enhance dissemination of research.

As journals move away from print formats and embrace web-based content, design-centered thinking will allow for engagement of a larger audience. Examples of recent efforts in this realm are provided, as well as simplified strategies for developing visual abstracts to improve dissemination via social media.

Finally, we hone in on principles of learning and education which have driven these advances in multimedia-based communication in scientific research.

URL : https://www.thieme-connect.de/products/ejournals/abstract/10.1055/s-0037-1604253

From paper-based towards post-digital scholarly publishing: an analysis of an ideological dilemma and its consequences

Authors : Jarmo Saarti, Kimmo Tuominen

Introduction

Even though the current publishing model is based on digital dissemination, it still utilizes some of the basic principles of printed culture. Recently a policy emphasis towards open access has been set for publicly funded research.

This paper reports on a study of the practices, business models and values linked with scholarly publishing.

Method

Conceptual analysis was conducted, drawing on literature on scholarly publishing policies, practices, values and economies, with an emphasis on the structures and conflicts between license-based and open publishing models.

Results

Scholarly interests of sharing collide with commercial interests of generating profits. In the digital era, the scientific community might have a third economically viable alternative. This third way is based on what the authors call post-digital scholarly publishing.

Conclusion

Science should aim at as complete openness as possible. Scholarly activities advance best when the whole scientific community has access to both publications and research data.

What seems to stand in the way of scientific sharing is the global publishing industry in its present form. In the future, post-digital scholarly publishing might provide a means for finding an economically viable way between sharing economy and commercial interests.

URL : http://www.informationr.net/ir/22-3/paper769.html