Modes d’évaluation ouverte par les pairs : de la revue à la plateforme

Auteurs/Authors : Evelyne Broudoux, Madjid Ihadjadene

Cet article a pour but de proposer un état de l’art des différentes formes de l’évaluation d’articles ou de communications par les pairs. De l’évaluation « aveugle» à l’évaluation « ouverte », de multiples possibilités existent et sont expérimentées.

C’est dans le champ des sciences que l’on trouve le plus d’innovations sociotechniques s’appuyant sur des plateformes de publication modélisant des workflows éditoriaux originaux.

L’ouverture de l’évaluation peut se produire entre pairs, en rendant publiques les identités et/ou les rapports des évaluateurs, à différents stades de l’article scientifique : préprint, en cours de rédaction, ou encore après publication.

Cet état de l’art est basé sur un ensemble de publications essentiellement produites par les acteurs de l’évaluation ouverte, issus principalement des disciplines STM.

URL : Modes d’évaluation ouverte par les pairs : de la revue à la plateforme

URL : https://revue-cossi.numerev.com/articles/revue-9/2496-modes-d-evaluation-ouverte-par-les-pairs-de-la-revue-a-la-plateforme

Exploring factors that influence the practice of Open Science by early career health researchers: a mixed methods study

Authors : Ksenija Zečević, Catherine Houghton, Chris Noone, Hopin Lee, Karen Matvienko-Sikar, Elaine Toomey

Background

There is a growing global movement towards open science and ensuring that health research is more transparent. It is vital that the researchers are adequately prepared for this research environment from early in their careers.

However, limited research has been conducted on the barriers and enablers to practicing open science for early career researchers. This study aimed to explore the views, experiences and factors influencing open science practices amongst ECRs working in health research.

Methods

Semi-structured individual interviews were conducted with a convenience sample of ECRs working in health research. Participants also completed surveys regarding the factors influencing open science practices. Thematic analysis was used to analyse the qualitative data and descriptive statistical analyses were used to analyse survey data.

Results

14 ECRs participated. Two main themes were identified from interview data; Valuing Open Science and Creating a Culture for Open Science. Within ‘Valuing Open Science’, participants spoke about the conceptualisation of open science to be open across the entire research cycle, and important for producing better and more impactful research for patients and the public.

Within ‘Creating a Culture of Open Science’ participants spoke about a number of factors influencing their practice of open science. These included cultural and academic pressures, the positives and negatives of increased accountability and transparency, and the need for more training and supporting resources to facilitate open science practices.

Conclusion

ECRs see the importance of open science for beneficially impacting patient and public health but many feel that they are not fully supported to practice open science.

Resources and supports including education and training are needed, as are better incentives for open science activities. Crucially, tangible engagement from institutions, funders and researchers is needed to facilitate the development of an open science culture.

URL : Exploring factors that influence the practice of Open Science by early career health researchers: a mixed methods study

Open Research Data and Open Peer Review: Perceptions of a Medical and Health Sciences Community in Greece

Authors : Eirini Delikoura, Dimitrios Kouis

Recently significant initiatives have been launched for the dissemination of Open Access as part of the Open Science movement. Nevertheless, two other major pillars of Open Science such as Open Research Data (ORD) and Open Peer Review (OPR) are still in an early stage of development among the communities of researchers and stakeholders.

The present study sought to unveil the perceptions of a medical and health sciences community about these issues. Through the investigation of researchers‘ attitudes, valuable conclusions can be drawn, especially in the field of medicine and health sciences, where an explosive growth of scientific publishing exists.

A quantitative survey was conducted based on a structured questionnaire, with 179 valid responses. The participants in the survey agreed with the Open Peer Review principles. However, they ignored basic terms like FAIR (Findable, Accessible, Interoperable, and Reusable) and appeared incentivized to permit the exploitation of their data.

Regarding Open Peer Review (OPR), participants expressed their agreement, implying their support for a trustworthy evaluation system.

Conclusively, researchers need to receive proper training for both Open Research Data principles and Open Peer Review processes which combined with a reformed evaluation system will enable them to take full advantage of the opportunities that arise from the new scholarly publishing and communication landscape.

URL : Open Research Data and Open Peer Review: Perceptions of a Medical and Health Sciences Community in Greece

DOI : https://doi.org/10.3390/publications9020014

Le libre accès au service de la communication sur le changement climatique en Afrique

Auteur/Author : Marième Pollèle Ndiaye

Cette contribution est issue d’un projet de recherche consacré aux défis de la science ouverte pour stimuler la communication sur le changement climatique en Afrique. Nous tentons de comprendre d’abord, ce qui explique l’invisibilité des recherches dans ce domaine avant de questionner ce qui définit le décloisonnement scientifique.

En nous servant des sciences de l’information et de la communication (SIC) comme guide, deux hypothèses serviront de fils conducteurs à la réflexion. La première consistera à envisager les temporalités organisationnelles comme facteurs pouvant influencer l’engagement des chercheurs en faveur d’une science ouverte.

Dans le même ordre d’idée, la seconde hypothèse considérera l’aspect rhizomique (au sens de Gilles Deuleuze et Felix Guattari, 1976) des SIC tel un écueil pour identifier les recherches africaines autour de la communication sur le changement climatique.

DOI : https://doi.org/10.4000/ctd.4008

Open science reforms: Strengths, challenges, and future directions

Author : Kathryn R. Wentzel

In this article, I comment on the potential benefits and limitations of open science reforms for improving the transparency and accountability of research, and enhancing the credibility of research findings within communities of policy and practice.

Specifically, I discuss the role of replication and reproducibility of research in promoting better quality studies, the identification of generalizable principles, and relevance for practitioners and policymakers.

Second, I suggest that greater attention to theory might contribute to the impact of open science practices, and discuss ways in which theory has implications for sampling, measurement and research design.

Ambiguities concerning the aims of preregistration and registered reports also are highlighted. In conclusion, I discuss structural roadblocks to open science reform and reflect on the relevance of these reforms for educational psychology.

URL : https://edarxiv.org/sgfy8/

Notebook articles: towards a transformative publishing experience in nonlinear science

Authors : Cristel Chandre, Jonathan Dubois

Open Science, Reproducible Research, Findable, Accessible, Interoperable and Reusable (FAIR) data principles are long term goals for scientific dissemination. However, the implementation of these principles calls for a reinspection of our means of dissemination. In our viewpoint, we discuss and advocate, in the context of nonlinear science, how a notebook article represents an essential step toward this objective by fully embracing cloud computing solutions.

Notebook articles as scholar articles offer an alternative, efficient and more ethical way to disseminate research through their versatile environment. This format invites the readers to delve deeper into the reported research. Through the interactivity of the notebook articles, research results such as for instance equations and figures are reproducible even for non-expert readers.

The codes and methods are available, in a transparent manner, to interested readers. The methods can be reused and adapted to answer additional questions in related topics. The codes run on cloud computing services, which provide easy access, even to low-income countries and research groups.

The versatility of this environment provides the stakeholders – from the researchers to the publishers – with opportunities to disseminate the research results in innovative ways.

URL : https://arxiv.org/abs/2103.05770

From Old School to Open Science: The Implications of New Research Norms for Educational Psychology and Beyond

Authors : Hunter Gehlbach, Carly Robinson

Recently, scholars have noted how several “old school” practices—a host of well-regarded, long-standing scientific norms—in combination, sometimes compromise the credibility of research.

In response, other scholarly fields have developed several “open science” norms and practices to address these credibility issues. Against this backdrop, this special issue explores the extent to which and how these norms should be adopted and adapted for educational psychology and education more broadly.

Our introductory article contextualizes the special issue’s goals by: overviewing the historical context that led to open science norms (particularly in medicine and psychology); providing a conceptual map to illustrate the interrelationships between various old school as well as open science practices; and then describing educational psychologists’ opportunity to benefit from and contribute to the translation of these norms to novel research contexts.

We conclude by previewing the articles in the special issue.

DOI : https://doi.org/10.35542/osf.io/za7p5