Archives des catégories : EN

Improving the peer-review process and editorial quality: key errors escaping the review and editorial process in top scientific journals

Posté le par

We apply a novel mistake index to assess trends in the proportion of corrections published between 1993 and 2014 in Nature, Science and PNAS. The index revealed a progressive increase in the proportion of corrections published in these three high-quality journals.

The index appears to be independent of the journal impact factor or the number of items published, as suggested by a comparative analyses among 16 top scientific journals of different impact factors and disciplines. A more detailed analysis suggests that the trend in the time-to-correction increased significantly over time and also differed among journals (Nature 233 days; Science 136 days; PNAS 232 days).

A detailed review of 1,428 errors showed that 60% of corrections were related to figures, authors, references or results. According to the three categories established, 34.7% of the corrections were considered mild, 47.7% moderate and 17.6% severe, also differing among journals. Errors occurring during the printing process were responsible for 5% of corrections in Nature, 3% in Science and 18% in PNAS.

The measurement of the temporal trends in the quality of scientific manuscripts can assist editors and reviewers in identifying the most common mistakes, increasing the rigor of peer-review and improving the quality of published scientific manuscripts.

URL : Improving the peer-review process and editorial quality: key errors escaping the review and editorial process in top scientific journals

DOI : https://doi.org/10.7717/peerj.1670

Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals

Posté le par

Background

Recent controversies highlighting substandard peer review in Open Access (OA) and traditional (subscription) journals have increased the need for authors, funders, publishers, and institutions to assure quality of peer-review in academic journals. I propose that transparency of the peer-review process may be seen as an indicator of the quality of peer-review, and develop and validate a tool enabling different stakeholders to assess transparency of the peer-review process.

Methods and Findings

Based on editorial guidelines and best practices, I developed a 14-item tool to rate transparency of the peer-review process on the basis of journals’ websites. In Study 1, a random sample of 231 authors of papers in 92 subscription journals in different fields rated transparency of the journals that published their work. Authors’ ratings of the transparency were positively associated with quality of the peer-review process but unrelated to journal’s impact factors.

In Study 2, 20 experts on OA publishing assessed the transparency of established (non-OA) journals, OA journals categorized as being published by potential predatory publishers, and journals from the Directory of Open Access Journals (DOAJ). Results show high reliability across items (α = .91) and sufficient reliability across raters. Ratings differentiated the three types of journals well.

In Study 3, academic librarians rated a random sample of 140 DOAJ journals and another 54 journals that had received a hoax paper written by Bohannon to test peer-review quality. Journals with higher transparency ratings were less likely to accept the flawed paper and showed higher impact as measured by the h5 index from Google Scholar.

Conclusions

The tool to assess transparency of the peer-review process at academic journals shows promising reliability and validity. The transparency of the peer-review process can be seen as an indicator of peer-review quality allowing the tool to be used to predict academic quality in new journals.

URL : Peer Review Quality and Transparency of the Peer-Review Process in Open Access and Subscription Journals

DOI: 10.1371/journal.pone.0147913

Evaluating an Open Access Publishing Fund at a Comprehensive University

Posté le par

Introduction

As the open access movement has fostered a shift from subscriber-funded journals to author-pays models, scholars seek funding for the dissemination of their research. In response to this need, some libraries have established open access funds at their institutions. This paper presents an evaluation of an open access fund at a comprehensive university.

Description of program/service

Wanting to learn how faculty have benefitted from an open access publishing fund, Grand Valley State University Libraries surveyed recipients of the fund. The survey asked authors why they chose an open access publishing option and whether the fund influenced this decision. Authors were also asked whether they perceived that selecting an open access option broadened exposure to their work and about their likelihood of choosing open access in the future.

Next steps

This article shares the results of this small survey and explores next steps in promoting and evaluating the fund and opportunities for focusing educational efforts across campus.

URL : Evaluating an Open Access Publishing Fund at a Comprehensive University

DOI : http://doi.org/10.7710/2162-3309.1204

Open access in the world and Latin America: A review since the Budapest Open Access Initiative

Posté le par

In 2012, the Open Access Movement to scientific information celebrated ten years of existence. The period, which represents the first stage of consolidation of the movement, has been analyzed to allow the planning of new phases. With the purpose of providing tools and contributing to these discussions, the article addresses the historical aspects of the international and regional constitution of Open Access Movement.

The approach was developed from a descriptive temporal narrative of the main events and initiatives identified in the scientific literature on the subject. The elements discussed in the present study work were organized under two parameters. The first refers to a temporal perspective, defined from the publication of Budapest Open Access Initiative. The second is related to brief discussion of the participation of Latin America.

As result, we present a timeline of open access in the world and in Latin America, showing the main aspects covered in the study. The goal of the study is achieved by the proposed systematization as we analyze the open access initiatives in Latin America and establish how they influenced and were influenced by other regions of the world.

URL : Open access in the world and Latin America: A review since the Budapest Open Access Initiative

Alternative location : http://ref.scielo.org/9nh4p4

Principles of the Self Journal of Science: bringing ethics and freedom to scientific publishing

Posté le par

I present the core principles of the “Self-Journal of Science” (SJS), an open repository as well as a new paradigm of scientific publication. Rooted in Science ethics, a full and consistent solution is proposed to address the many flaws in current systems. SJS implements an optimal peer review, which itself becomes a measurable process, and builds an objective and unfalsifiable evaluation system.

In addition, it can operate at very low costs. One of the essential features of SJS is to allow every scientist to play his full role as a member of the scientific community and to be credited for all contributions – whether as author, referee, or editor. The output is the responsibility of each scientist, and no subgroup can dictate scientific policy to all.

By fully opening up the process of publication, peer pressure becomes the force that drives output towards the highest quality in a virtuous self-regulating circle. SJS also provides a self-organizing and scalable solution to handle an ever-increasing number of articles.

URL : Principles of the Self Journal of Science: bringing ethics and freedom to scientific publishing

Alternative location : http://www.sjscience.org/article?id=46

The Peer Reviewers’ Openness Initiative: incentivizing open research practices through peer review

Posté le par

Openness is one of the central values of science. Open scientific practices such as sharing data, materials and analysis scripts alongside published articles have many benefits, including easier replication and extension studies, increased availability of data for theory-building and meta-analysis, and increased possibility of review and collaboration even after a paper has been published. Although modern information technology makes sharing easier than ever before, uptake of open practices had been slow. We suggest this might be in part due to a social dilemma arising from misaligned incentives and propose a specific, concrete mechanism—reviewers withholding comprehensive review—to achieve the goal of creating the expectation of open practices as a matter of scientific principle.

URL : The Peer Reviewers’ Openness Initiative: incentivizing open research practices through peer review

DOI: 10.1098/rsos.150547

Viscous open data: The roles of intermediaries in an open data ecosystem

Posté le par

Open data has the potential to improve the governance of universities as public institutions. In addition, open data is likely to increase the quality, efficacy and efficiency of the research and analysis of higher education systems by providing a shared empirical base for critical interrogation and reinterpretation.

Drawing on research conducted by the Emerging Impacts of Open Data in Developing Countries project, and using an ecosystems approach, this research paper considers the supply, demand and use of open data as well as the roles of intermediaries in the governance of South African public higher education.

It shows that government’s higher education database is a closed and isolated data source in the data ecosystem; and that the open data that is made available by government is inaccessible and rarely used. In contrast, government data made available by data intermediaries in the ecosystem are being used by key stakeholders.

Intermediaries are found to play several important roles in the ecosystem: (i) they increase the accessibility and utility of data; (ii) they may assume the role of a ‘keystone species’ in a data ecosystem; and (iii) they have the potential to democratise the impacts and use of open data.

The article concludes that despite poor data provision by government, the public university governance open data ecosystem has evolved because intermediaries in the ecosystem have reduced the viscosity of government data. Further increasing the fluidity of government open data will improve access and ensure the sustainability of open data supply in the ecosystem.

URL : http://hdl.handle.net/11427/14654