Catégories
EN

Rethinking success, integrity, and culture in research (part 2) — a multi-actor qualitative study on problems of science

Authors : Noémie Aubert Bonn, Wim Pinxten

Background

Research misconduct and questionable research practices have been the subject of increasing attention in the past few years. But despite the rich body of research available, few empirical works also include the perspectives of non-researcher stakeholders.

Methods

We conducted semi-structured interviews and focus groups with policy makers, funders, institution leaders, editors or publishers, research integrity office members, research integrity community members, laboratory technicians, researchers, research students, and former-researchers who changed career to inquire on the topics of success, integrity, and responsibilities in science.

We used the Flemish biomedical landscape as a baseline to be able to grasp the views of interacting and complementary actors in a system setting.

Results

Given the breadth of our results, we divided our findings in a two-paper series with the current paper focusing on the problems that affect the integrity and research culture. We first found that different actors have different perspectives on the problems that affect the integrity and culture of research.

Problems were either linked to personalities and attitudes, or to the climates in which researchers operate. Elements that were described as essential for success (in the associate paper) were often thought to accentuate the problems of research climates by disrupting research culture and research integrity.

Even though all participants agreed that current research climates need to be addressed, participants generally did not feel responsible nor capable of initiating change. Instead, respondents revealed a circle of blame and mistrust between actor groups.

Conclusions

Our findings resonate with recent debates, and extrapolate a few action points which might help advance the discussion.

First, the research integrity debate must revisit and tackle the way in which researchers are assessed.

Second, approaches to promote better science need to address the impact that research climates have on research integrity and research culture rather than to capitalize on individual researchers’ compliance.

Finally, inter-actor dialogues and shared decision making must be given priority to ensure that the perspectives of the full research system are captured. Understanding the relations and interdependency between these perspectives is key to be able to address the problems of science.

URL : Rethinking success, integrity, and culture in research (part 2) — a multi-actor qualitative study on problems of science

DOI : https://doi.org/10.1186/s41073-020-00105-z

Catégories
EN

Rethinking success, integrity, and culture in research (part 1) — a multi-actor qualitative study on success in science

Authors : Noémie Aubert Bonn, Wim Pinxten

Background

Success shapes the lives and careers of scientists. But success in science is difficult to define, let alone to translate in indicators that can be used for assessment. In the past few years, several groups expressed their dissatisfaction with the indicators currently used for assessing researchers.

But given the lack of agreement on what should constitute success in science, most propositions remain unanswered. This paper aims to complement our understanding of success in science and to document areas of tension and conflict in research assessments.

Methods

We conducted semi-structured interviews and focus groups with policy makers, funders, institution leaders, editors or publishers, research integrity office members, research integrity community members, laboratory technicians, researchers, research students, and former-researchers who changed career to inquire on the topics of success, integrity, and responsibilities in science.

We used the Flemish biomedical landscape as a baseline to be able to grasp the views of interacting and complementary actors in a system setting.

Results

Given the breadth of our results, we divided our findings in a two-paper series, with the current paper focusing on what defines and determines success in science. Respondents depicted success as a multi-factorial, context-dependent, and mutable construct.

Success appeared to be an interaction between characteristics from the researcher (Who), research outputs (What), processes (How), and luck. Interviewees noted that current research assessments overvalued outputs but largely ignored the processes deemed essential for research quality and integrity.

Interviewees suggested that science needs a diversity of indicators that are transparent, robust, and valid, and that also allow a balanced and diverse view of success; that assessment of scientists should not blindly depend on metrics but also value human input; and that quality should be valued over quantity.

Conclusions

The objective of research assessments may be to encourage good researchers, to benefit society, or simply to advance science. Yet we show that current assessments fall short on each of these objectives. Open and transparent inter-actor dialogue is needed to understand what research assessments aim for and how they can best achieve their objective.

URL : Rethinking success, integrity, and culture in research (part 1) — a multi-actor qualitative study on success in science

DOI : https://doi.org/10.1186/s41073-020-00104-0

Catégories
EN

Survey study of research integrity officers’ perceptions of research practices associated with instances of research misconduct

Author : Michael Kalichman

Background

Research on research integrity has tended to focus on frequency of research misconduct and factors that might induce someone to commit research misconduct.

A definitive answer to the first question has been elusive, but it remains clear that any research misconduct is too much. Answers to the second question are so diverse, it might be productive to ask a different question: What about how research is done allows research misconduct to occur?

Methods

With that question in mind, research integrity officers (RIOs) of the 62 members of the American Association of Universities were invited to complete a brief survey about their most recent instance of a finding of research misconduct.

Respondents were asked whether one or more good practices of research (e.g., openness and transparency, keeping good research records) were present in their case of research misconduct.

Results

Twenty-four (24) of the respondents (39% response rate) indicated they had dealt with at least one finding of research misconduct and answered the survey questions. Over half of these RIOs reported that their case of research misconduct had occurred in an environment in which at least nine of the ten listed good practices of research were deficient.

Conclusions

These results are not evidence for a causal effect of poor practices, but it is arguable that committing research misconduct would be more difficult if not impossible in research environments adhering to good practices of research.

URL : Survey study of research integrity officers’ perceptions of research practices associated with instances of research misconduct

DOI : https://doi.org/10.1186/s41073-020-00103-1

Catégories
EN

Metascience as a scientific social movement

Authors : David Peterson, Aaron Panofsky

Emerging out of the “reproducibility crisis” in science, metascientists have become central players in debates about research integrity, scholarly communication, and science policy. The goal of this article is to introduce metascience to STS scholars, detail the scientific ideology that is apparent in its articles, strategy statements, and research projects, and discuss its institutional and intellectual future.

Put simply, metascience is a scientific social movement that seeks to use the tools of science- especially, quantification and experimentation- to diagnose problems in research practice and improve efficiency.

It draws together data scientists, experimental and statistical methodologists, and open science activists into a project with both intellectual and policy dimensions. Metascientists have been remarkably successful at winning grants, motivating news coverage, and changing policies at science agencies, journals, and universities.

Moreover, metascience represents the apotheosis of several trends in research practice, scientific communication, and science governance including increased attention to methodological and statistical criticism of scientific practice, the promotion of “open science” by science funders and journals, the growing importance of both preprint and data repositories for scientific communication, and the new prominence of data scientists as research makes a turn toward Big Science.

URL : Metascience as a scientific social movement

DOI : https://doi.org/10.31235/osf.io/4dsqa

Catégories
EN

Research Integrity Among PhD Students at the Faculty of Medicine: A Comparison of Three Scandinavian Universities

Authors : Bjørn Hofmann, Lone Bredahl Jensen, Mette Brandt Eriksen, Gert Helgesson, Niklas Juth, Søren Holm

This study investigates research integrity among PhD students in health sciences at three universities in Scandinavia (Stockholm, Oslo, Odense). A questionnaire with questions on knowledge, attitudes, experiences, and behavior was distributed to PhD students and obtained a response rate of 77.7%.

About 10% of the respondents agreed that research misconduct strictly defined (such as fabrication, falsification, and plagiarism, FFP) is common in their area of research, while slightly more agreed that other forms of misconduct is common.

A nonnegligible segment of the respondents was willing to fabricate, falsify, or omit contradicting data if they believe that they are right in their overall conclusions. Up to one third reported to have added one or more authors unmerited.

Results showed a negative correlation between “good attitudes” and self-reported misconduct and a positive correlation between how frequent respondents thought that misconduct occurs and whether they reported misconduct themselves.

This reveals that existing educational and research systems partly fail to foster research integrity.

URL : Research Integrity Among PhD Students at the Faculty of Medicine: A Comparison of Three Scandinavian Universities

DOI : https://doi.org/10.1177/1556264620929230

Catégories
EN

Unconsented acknowledgments as a form of authorship abuse: What can be done about it?

Author : Mladen Koljatic

Unwelcome or unconsented acknowledgments is an unethical practice seldom addressed. It constitutes a form of authorship abuse perpetrated in the acknowledgments section of published research, where the victim is credited as having made a contribution to the paper, without having given their consent, and often without having seen a draft of the paper.

The acknowledgment may be written in such a way as to imply endorsement of the study’s data and conclusions. Through a real-life case, this paper explores the issue of unconsented acknowledgments and makes recommendations to prevent its occurrence, thereby promoting research integrity.

URL : Unconsented acknowledgments as a form of authorship abuse: What can be done about it?

DOI : https://doi.org/10.1177/1747016120952516

Catégories
Non classé

On the Willingness to Report and the Consequences of Reporting Research Misconduct: The Role of Power Relations

Authors : Serge P. J. M. Horbach, Eric Breit, Willem Halffman, Svenn-Erik Mamelund

While attention to research integrity has been growing over the past decades, the processes of signalling and denouncing cases of research misconduct remain largely unstudied.

In this article, we develop a theoretically and empirically informed understanding of the causes and consequences of reporting research misconduct in terms of power relations.

We study the reporting process based on a multinational survey at eight European universities (N = 1126). Using qualitative data that witnesses of research misconduct or of questionable research practices provided, we aim to examine actors’ rationales for reporting and not reporting misconduct, how they report it and the perceived consequences of reporting.

In particular we study how research seniority, the temporality of work appointments, and gender could impact the likelihood of cases being reported and of reporting leading to constructive organisational changes.

Our findings suggest that these aspects of power relations play a role in the reporting of research misconduct. Our analysis contributes to a better understanding of research misconduct in an academic context.

Specifically, we elucidate the processes that affect researchers’ ability and willingness to report research misconduct, and the likelihood of universities taking action.

Based on our findings, we outline specific propositions that future research can test as well as provide recommendations for policy improvement.

URL : On the Willingness to Report and the Consequences of Reporting Research Misconduct: The Role of Power Relations

DOI : https://doi.org/10.1007/s11948-020-00202-8