Archives des catégories : EN

Quality of reports of investigations of research integrity by academic institutions

Posté le par

Authors : Andrew Grey, Mark Bolland, Greg Gamble, Alison Avenell

Background

Academic institutions play important roles in protecting and preserving research integrity. Concerns have been expressed about the objectivity, adequacy and transparency of institutional investigations of potentially compromised research integrity.

We assessed the reports provided to us of investigations by three academic institutions of a large body of overlapping research with potentially compromised integrity.

Methods

In 2017, we raised concerns with four academic institutions about the integrity of > 200 publications co-authored by an overlapping set of researchers. Each institution initiated an investigation.

By November 2018, three had reported to us the results of their investigations, but only one report was publicly available. Two investigators independently assessed each available report using a published 26-item checklist designed to determine the quality and adequacy of institutional investigations of research integrity. Each assessor recorded additional comments ad hoc.

Results

Concerns raised with the institutions were overlapping, wide-ranging and included those which were both general and publication-specific. The number of potentially affected publications at individual institutions ranged from 34 to 200.

The duration of investigation by the three institutions which provided reports was 8–17 months. These investigations covered 14%, 15% and 77%, respectively, of potentially affected publications.

Between-assessor agreement using the quality checklist was 0.68, 0.72 and 0.65 for each report. Only 4/78 individual checklist items were addressed adequately: a further 14 could not be assessed.

Each report was graded inadequate overall. Reports failed to address publication-specific concerns and focussed more strongly on determining research misconduct than evaluating the integrity of publications.

Conclusions

Our analyses identify important deficiencies in the quality and reporting of institutional investigation of concerns about the integrity of a large body of research reported by an overlapping set of researchers.

They reinforce disquiet about the ability of institutions to rigorously and objectively oversee integrity of research conducted by their own employees.

URL : Quality of reports of investigations of research integrity by academic institutions

DOI : https://doi.org/10.1186/s41073-019-0062-x

Peer Review Bias: A Critical Review

Posté le par

Authors : Samir Haffar, Fateh Bazerbachi, M. Hassan Murad

Various types of bias and confounding have been described in the biomedical literature that can affect a study before, during, or after the intervention has been delivered.

The peer review process can also introduce bias. A compelling ethical and moral rationale necessitates improving the peer review process. A double-blind peer review system is supported on equipoise and fair-play principles.

Triple- and quadruple-blind systems have also been described but are not commonly used. The open peer review system introduces “Skin in the Game” heuristic principles for both authors and reviewers and has a small favorable effect on the quality of published reports.

In this exposition, we present, on the basis of a comprehensive literature search of PubMed from its inception until October 20, 2017, various possible mechanisms by which the peer review process can distort research results, and we discuss the evidence supporting different strategies that may mitigate this bias.

It is time to improve the quality, transparency, and accountability of the peer review system.

DOI : https://doi.org/10.1016/j.mayocp.2018.09.004

Is open access affordable? Why current models do not work and why we need internet‐era transformation of scholarly communications

Posté le par

Author : Toby Green

Progress to open access (OA) has stalled, with perhaps 20% of new papers ‘born‐free’, and half of all versions of record pay‐walled; why? In this paper, I review the last 12 months: librarians showing muscle in negotiations, publishers’ Read and Publish deals, and funders determined to force change with initiatives like Plan S. I conclude that these efforts will not work.

For example, flipping to supply‐side business models, such as article processing charges, simply flips the pay‐wall to a ‘play‐wall’ to the disadvantage of authors without financial support.

I argue that the focus on OA makes us miss the bigger problem: today’s scholarly communications is unaffordable with today’s budgets. OA is not the problem, the publishing process is the problem.

To solve it, I propose using the principles of digital transformation to reinvent publishing as a two‐step process where articles are published first as preprints, and then, journal editors invite authors to submit only papers that ‘succeed’ to peer review.

This would reduce costs significantly, opening a sustainable pathway for scholarly publishing and OA. The catalyst for this change is for the reputation economy to accept preprints as it does articles in minor journals today.

DOI : https://doi.org/10.1002/leap.1219

Open Access Escape Room: the key to OA engagement?

Posté le par

Author: Katrine Sundsbø

Open access (OA) has had, and will continue to have, a significant effect on the scholarly publishing landscape in academia, yet many academic staff publish OA in order to comply with policies, rather than engaging with the value of open scholarship and in debates that ultimately affect them.

Training sessions and workshops are often arranged to increase knowledge and awareness in the academic community, but engagement is often low. On the other hand, some academic staff, who already do engage, will happily attend sessions and workshops to increase their knowledge even further.

The struggle to increase OA engagement overall could be due to the training not being appealing enough, and academics not being aware of benefits until after they have attended workshops.

At the University of Essex, we took a bold, brave and curious approach to increasing engagement during Open Access Week 2018, and created an OA-themed escape room.

This resulted in great engagement from students, academic staff and professional services staff, some of whom reported that they never knew how relevant OA was for them. The Open Access Escape Room was a success, and provided a positive environment for conversations around OA.

URL : Open Access Escape Room: the key to OA engagement?

DOI : http://doi.org/10.1629/uksg.459

When a Repository Is Not Enough: Redesigning a Digital Ecosystem to Serve Scholarly Communication

Posté le par

Authors : Robin R. Sewell, Sarah Potvin, Pauline Melgoza, James Silas Creel, Jeremy T. Huff, Gregory T. Bailey, John Bondurant, Sean Buckner, Anton R. duPlessis, Lisa Furubotten, Julie A. Mosbo Ballestro, Ian W. Muise, Brian J. Wright

INTRODUCTION

Our library’s digital asset management system (DAMS) was no longer meeting digital asset management requirements or expanding scholarly communication needs.

We formed a multiunit task force (TF) to (1) survey and identify existing and emerging institutional needs; (2) research available DAMS (open source and proprietary) and assess their potential fit; and (3) deploy software locally for in-depth testing and evaluation.

DESCRIPTION OF PROGRAM

We winnowed a field of 25 potential DAMS down to 5 for deployment and evaluation. The process included selection and identification of test collections and the creation of a multipart task based rubric based on library and campus needs assessments.

Time constraints and DAMS deployment limitations prompted a move toward a new evaluation iteration: a shorter criteria-based rubric.

LESSONS LEARNED

We discovered that no single DAMS was “just right,” nor was any single DAMS a static product. Changing and expanding scholarly communication and digital needs could only be met by the more flexible approach offered by a multicomponent digital asset management ecosystem (DAME), described in this study.

We encountered obstacles related to testing complex, rapidly evolving software available in a range of configurations and flavors (including tiers of vendor-hosted functionality) and time and capacity constraints curtailed in-depth testing.

While we anticipate long-term benefits from “going further together” by including university-wide representation in the task force, there were trade-offs in distributing responsibilities and diffusing priorities.

NEXT STEPS

Shifts in scholarly communication at multiple levels—institutional, regional, consortial, national, and international—have already necessitated continual review and adjustment of our digital systems.

URL : When a Repository Is Not Enough: Redesigning a Digital Ecosystem to Serve Scholarly Communication

DOI : https://doi.org/10.7710/2162-3309.2225

Networking Social Scholarship…Again

Posté le par

Author : Shawn Martin

This paper proposes to answer several questions that arise from the actions of American scientists between 1840 and 1890. How did the broader organization of science in the late nineteenth century create a system of professional disciplines?

Why did the American Association for the Advancement of Science (AAAS) form, and why did specialized societies like the American Chemical Society (ACS) later found an organization separate from the AAAS?

Why did these professional societies create journals, and how did these journals help to communicate science? This paper combines both quantitative textual analysis and qualitative historical and sociological methods within the context of nineteenth-century American science.

It is hoped that by broadening the methods used, and by better understanding the early deliberations of scientists before there was a formal scholarly communication system, it may be possible to contextualize current debates about the need for changes in the scholarly communication system.

URL : Networking Social Scholarship…Again

DOI : http://doi.org/10.5334/kula.47

Towards Open Annotation: Examples and Experiments

Posté le par

Authors : Lindsey Seatter

This article interrogates how digital text annotation tools and projects facilitate online engagement and virtual communities of practice. With the rise of the Web 2.0 movement and the proliferation of digital resources, annotation has evolved from an isolated practice to a collaborative one.

This article unpacks the impact of this shift by providing an in-depth discussion of five web-based tools and two social reading projects.

This article examines issues of design, usability, and applicability to pedagogical intervention as well as underscores how productive group dynamics can be fostered through digital, social annotation.

URL : Towards Open Annotation: Examples and Experiments

DOI : http://doi.org/10.5334/kula.49