Étiquette : Peer Review

Catégories
EN

Reviewing the review process: Investigation of researchers’ opinions on different methods of peer review

Author : Carolin Anna Rebernig

Peer review is considered the gold standard of scientific publishing. Trust in the traditional system of editor – blind-reviewer – author is still high, but it’s authority is in decline and alternative methods are on the rise.

The current study investigates opinions of alternative peer review methods, the arguments for and against, and the reasons why academics are searching for new approaches. The opinions were analysed by applying qualitative content analysis to online discussions.

The findings were interpreted using two different sociological theories: the Mertonian sociology of science and social constructivism.

The results of the study show that the most discussed method was also the most traditional one: closed pre-publication peer review comprised of single blind, double-blind and open peer review (non blinded).

Discussions of open peer review (both open publishing of reports and open discussions) were also common. All other alternative methods were discussed much less. But the discussions were lively and each method was discussed in both positive and negative terms.

The reasons for preferring certain methods were also manifold, but dominant topics were bias and fairness, quality issues (regarding reviews and publications), issues concerning human resources and communication and exchange among people.

The results of this study demonstrate that while ethical norms seems to be a scientific ideal, human nature makes it impossible to accomplish this goal.

URN : http://urn.kb.se/resolve?urn=urn%3Anbn%3Ase%3Ahb%3Adiva-14607

Catégories
EN

Scholarship as an Open Conversation: Utilizing Open Peer Review in Information Literacy Instruction

Author : Emily Ford

This article explores the ACRL Framework for Information Literacy’s frame, Scholarship as a Conversation. This frame asserts that information literate students have the disposition, skills, and knowledge to recognize and participate in disciplinary scholarly conversations.

By investigating the peer-review process as part of scholarly conversations, this article provides a brief literature review on peer review in information literacy instruction, and argues that by using open peer review (OPR) models for teaching, library workers can allow students to gain a deeper understanding of scholarly conversations.

OPR affords students the ability to begin dismantling the systemic oppression that blinded peer review and the traditional scholarly publishing system reinforce. Finally, the article offers an example classroom activity using OPR to help students enter scholarly conversations, and recognize power and oppression in scholarly publishing.

URL : http://www.inthelibrarywiththeleadpipe.org/2018/open-conversation/

Catégories
EN

Case for the double-blind peer review

Author : Lucie Tvrznikova

Peer review is a process designed to produce a fair assessment of research quality prior to publication of scholarly work in a journal. Demographics, nepotism, and seniority have been all shown to affect reviewer behavior suggesting the most common, single-blind review method (or the less common open review method) might be biased.

A survey of current research suggests that double-blind review offers a solution to many biases stemming from author’s gender, seniority, or location without imposing any major downsides.

URL : https://arxiv.org/abs/1807.01408

Catégories
EN

Ten considerations for open peer review

Authors : Birgit Schmidt, Tony Ross-Hellauer, Xenia van Edig, Elizabeth C Moylan

Open peer review (OPR), as with other elements of open science and open research, is on the rise. It aims to bring greater transparency and participation to formal and informal peer review processes.

But what is meant by `open peer review’, and what advantages and disadvantages does it have over standard forms of review? How do authors or reviewers approach OPR? And what pitfalls and opportunities should you look out for?

Here, we propose ten considerations for OPR, drawing on discussions with authors, reviewers, editors, publishers and librarians, and provide a pragmatic, hands-on introduction to these issues.

We cover basic principles and summarise best practices, indicating how to use OPR to achieve best value and mutual benefits for all stakeholders and the wider research community.

URL : Ten considerations for open peer review

DOI : http://dx.doi.org/10.12688/f1000research.15334.1

Catégories
EN

The State of The Art in Peer Review

Author : John Tennant

Scholarly communication is in a perpetual state of disruption. Within this, peer review of research articles remains an essential part of the formal publication process, distinguishing it from virtually all other modes of communication.

In the last several years, there has been an explosive wave of innovation in peer review research, platforms, discussions, tools, and services. This is largely coupled with the ongoing and parallel evolution of scholarly communication as it adapts to rapidly changing environments, within what is widely considered as the ‘open research’ or ‘open science’ movement.

Here, we summarise the current ebb and flow around changes to peer review and consider its role in a modern digital research and communications infrastructure and discuss why uptake of new models of peer review appears to have been so low compared to what is often viewed as the ‘traditional’ method of peer review.

Finally, we offer some insight into the potential futures of scholarly peer review and consider what impacts this might have on the broader scholarly research ecosystem.

DOI : https://dx.doi.org/10.17605/OSF.IO/C29TM

Catégories
EN

Analysis of Peer Review Effectiveness for Academic Journals Based on Distributed Parallel System

Authors : Zong-Yuan Tan, Ning Cai, Jian Zhou

A simulation model based on parallel systems is established, aiming to explore the relation between the number of submissions and the overall quality of academic journals within a similar discipline under peer review.

The model can effectively simulate the submission, review and acceptance behaviors of academic journals, in a distributed manner. According to the simulation experiments, it could possibly happen that the overall standard of academic journals may deteriorate due to excessive submissions.

URL : https://arxiv.org/abs/1806.00287

Catégories
EN

A Case Study for a New Peer-Review Journal on Race and Ethnicity in American Higher Education

Author : Cristobal Salinas Jr.

In this exploratory case study, the interests, attitudes, and opinions of participants of the National Conference on Race and Ethnicity (NCORE) in American Higher Education are presented.

This case study sought to understand how college and university administrators and faculty perceived the need to create a peer-reviewed journal that aimed to support and create opportunities to publish research, policy, practices, and procedures within the context of race and ethnicity in American higher education.

The findings of this study reflect that the vast majority of those surveyed (n = 605) and interviewed (n = 5) support, and are interested in, having a peer-reviewed journal that focuses on race and ethnicity in American higher education.

URL : A Case Study for a New Peer-Review Journal on Race and Ethnicity in American Higher Education

DOI : https://doi.org/10.3390/publications6020026