This article argues that the pedagogical and scholarly benefits of open peer review far outweigh those of traditional double-blind peer review, but require a shift in our perspective of the function and value of peer review – from a gate-keeping process, toward a supportive, constructive process of collaboration between peers and mentors.
Étiquette : Peer Review
Purpose
The purpose of this paper is twofold, first, to discuss the current and future issues around post-publication open peer review. Second, to highlight some of the main protagonists and platforms that encourages open peer review, pre-and post-publication.
Design/methodology/approach
The first part of the paper aims to discuss the facilitators and barriers that will enable and prevent academics engaging with the new and established platforms of scholarly communication and review. These issues are covered with the intention of proposing further dialogue within the academic community that ultimately address researchers’ concerns, whilst continuing to nurture a progressive approach to scholarly communication and review. The paper will continue to look at the prominent open post-publication platforms and tools and discuss whether in the future it will become a standard model.
Findings
The paper identifies several problems, not exclusive to open peer review that could inhibit academics from being open with their reviews and comments of other’s research. Whilst identifies opportunities to be had by embracing a new era of academic openness.
Practical implications
The paper summarises key platforms and arguments for open peer review and will be of interest to researchers in different disciplines as well as the wider academic community wanting to know more about scholarly communications and measurement.
Originality/value
This paper looks at many of the new platforms that have been previously ignored and discusses issues relating to open peer review that have only been touched on in brief by other published research.
Purpose
The purpose of this paper is to understand individual academics’ perception, attitudes and participation in Open Access Publishing and open scholarship and revisit some principles and designs of openness in academic publishing from the perspective of creative end-users, which helps to increase the sustainability and efficiency of open models.
Design/methodology/approach
This paper draws on a case study of China and empirical data collected through semi-structured interviews with a wide range of academics and stakeholders.
Findings
A separation between the communication and certification functions of publishing is identified: open initiatives are valued for efficient and interactive communication while traditional publishing still dominates the legitimacy of research publications, which leads to the quandary of individual academics operating within the transitional landscape of scholarly communication.
Practical implications
Practical recommendations for sustainable and efficient openness are derived from discussions on the difficulties associated open/social certification and the shifting maxims that govern academics from “publish or perish” to “be visible or vanish”.
Originality/value
“Openness” is defined in broad sense integrating Open Access and open scholarship to comprehensively reflect individual academics’ views in the transitional landscape of academic publishing. The research findings suggest that new open approaches are needed to address the evolving tension and conflicts between communication and certification.
Purpose
The purpose of this paper is to explore the difference between Open Access and accessibility, to argue that accessibility is the most crucial feature, and to suggest some ways in which Open Access militates against accessibility.
Design/methodology/approach
Analysis of best practice by journals and monograph publishers is used to highlight the degree to which accessibility is enhanced by input from readers and editors. The expense of this, both real and hidden, is shown to be compatible only with difficulty with publishing methods where keeping costs low is essential, and Open Access alternatives that make available manuscripts “as submitted” are shown to make available less accessible scholarship.
Findings
Scholarship is markedly improved by referees and editors; the emphasis needs to be put on making available the most accessible scholarship, not on making more scholarship available.
Practical implications
Journals and publishers should concentrate on, and research councils and similar bodies insist upon, ensuring high quality critical review and editing, not cost-free access.
Originality/value
The debate on Open Access has put its emphasis in the wrong place. Rather than easier access to more scholarship, increased resource devoted to pre-publication review, revision and editing is the most important development to ensure the greatest advances in research and scholarship.
Objectives
To assess whether reports from reviewers recommended by authors show a bias in quality and recommendation for editorial decision, compared with reviewers suggested by other parties, and whether reviewer reports for journals operating on open or single-blind peer review models differ with regard to report quality and reviewer recommendations.
Design
Retrospective analysis of the quality of reviewer reports using an established Review Quality Instrument, and analysis of reviewer recommendations and author satisfaction surveys.
Setting
BioMed Central biology and medical journals. BMC Infectious Diseases and BMC Microbiology are similar in size, rejection rates, impact factors and editorial processes, but the former uses open peer review while the latter uses single-blind peer review. The Journal of Inflammation has operated under both peer review models.
Sample
Two hundred reviewer reports submitted to BMC Infectious Diseases, 200 reviewer reports submitted to BMC Microbiology and 400 reviewer reports submitted to the Journal of Inflammation.
Results
For each journal, author-suggested reviewers provided reports of comparable quality to non-author-suggested reviewers, but were significantly more likely to recommend acceptance, irrespective of the peer review model (p<0.0001 for BMC Infectious Diseases, BMC Microbiology and the Journal of Inflammation). For BMC Infectious Diseases, the overall quality of reviewer reports measured by the Review Quality Instrument was 5% higher than for BMC Microbiology (p=0.042). For the Journal of Inflammation, the quality of reports was the same irrespective of the peer review model used.
Conclusions
Reviewers suggested by authors provide reports of comparable quality to non-author-suggested reviewers, but are significantly more likely to recommend acceptance. Open peer review reports for BMC Infectious Diseases were of higher quality than single-blind reports for BMC Microbiology. There was no difference in quality of peer review in the Journal of Inflammation under open peer review compared with single blind.
DOI : 10.1136/bmjopen-2015-008707
We examine selected aspects of peer review and suggest possible improvements. To this end, we analyse a dataset containing information about 300 papers submitted to the Biochemistry and Biotechnology section of the Journal of the Serbian Chemical Society. After separating the peer review process into stages that each review has to go through, we use a weighted directed graph to describe it in a probabilistic manner and test the impact of some modifications of the editorial policy on the efficiency of the whole process.
Motivation
Reproducing the results from a scientific paper can be challenging due to the absence of data and the computational tools required for their analysis. In addition, details relating to the procedures used to obtain the published results can be difficult to discern due to the use of natural language when reporting how experiments have been performed.
The Investigation/Study/Assay (ISA), Nanopublications (NP), and Research Objects (RO) models are conceptual data modelling frameworks that can structure such information from scientific papers. Computational workflow platforms can also be used to reproduce analyses of data in a principled manner. We assessed the extent by which ISA, NP, and RO models, together with the Galaxy workflow system, can capture the experimental processes and reproduce the findings of a previously published paper reporting on the development of SOAPdenovo2, a de novo genome assembler.
Results
Executable workflows were developed using Galaxy, which reproduced results that were consistent with the published findings. A structured representation of the information in the SOAPdenovo2 paper was produced by combining the use of ISA, NP, and RO models. By structuring the information in the published paper using these data and scientific workflow modelling frameworks, it was possible to explicitly declare elements of experimental design, variables, and findings.
The models served as guides in the curation of scientific information and this led to the identification of inconsistencies in the original published paper, thereby allowing its authors to publish corrections in the form of an errata. »
DOI : 10.1371/journal.pone.0127612