Catégories
EN

The impact of open and reproducible scholarship on students’ scientific literacy, engagement, and attitudes towards science: A review and synthesis of the evidence

Authors : Madeleine Pownall, Flávio Azevedo, Laura M. König, et al. 

In recent years, the scientific community has called for improvements in the credibility, robustness, and reproducibility of research, characterized by higher standards of scientific evidence, increased interest in open practices, and promotion of transparency. While progress has been positive, there is a lack of consideration about how this approach can be embedded into undergraduate and postgraduate research training.

Currently, the impact of integrating an open and reproducible approach into the curriculum on student outcomes is not well articulated in the literature.

Therefore, in this paper, we provide the first comprehensive review of how integrating open and reproducible scholarship into teaching and learning may impact students, using a large-scale, collaborative, team-science approach. Our review highlighted how embedding open and reproducible scholarship may impact: (1) students’ scientific literacies (i.e., students’ understanding of open research, consumption of science, and the development of transferable skills); (2) student engagement (i.e., motivation and engagement with learning, collaboration, and engagement in open research), and (3) students’ attitudes towards science (i.e., trust in science and confidence in research findings).

Our review also identified a need for more robust and rigorous methods within evaluations of teaching practice. We discuss implications for teaching and learning scholarship in this area.

URL : The impact of open and reproducible scholarship on students’ scientific literacy, engagement, and attitudes towards science: A review and synthesis of the evidence

DOI : https://doi.org/10.31222/osf.io/9e526

Catégories
EN

Adoption of Transparency and Openness Promotion (TOP) Guidelines across Journals

Authors : Inga Patarčić, Jadranka Stojanovski

Journal policies continuously evolve to enable knowledge sharing and support reproducible science. However, that change happens within a certain framework. Eight modular standards with three levels of increasing stringency make Transparency and Openness Promotion (TOP) guidelines which can be used to evaluate to what extent and with which stringency journals promote open science.

Guidelines define standards for data citation, transparency of data, material, code and design and analysis, replication, plan and study pre-registration, and two effective interventions: “Registered reports” and “Open science badges”, and levels of adoption summed up across standards define journal’s TOP Factor. In this paper, we analysed the status of adoption of TOP guidelines across two thousand journals reported in the TOP Factor metrics.

We show that the majority of the journals’ policies align with at least one of the TOP’s standards, most likely “Data citation” (70%) followed by “Data transparency” (19%). Two-thirds of adoptions of TOP standard are of the stringency Level 1 (less stringent), whereas only 9% is of the stringency Level 3.

Adoption of TOP standards differs across science disciplines and multidisciplinary journals (N = 1505) and journals from social sciences (N = 1077) show the greatest number of adoptions. Improvement of the measures that journals take to implement open science practices could be done: (1) discipline-specific, (2) journals that have not yet adopted TOP guidelines could do so, (3) the stringency of adoptions could be increased.

URL : Adoption of Transparency and Openness Promotion (TOP) Guidelines across Journals

DOI : https://doi.org/10.3390/publications10040046

Catégories
EN

Open science and conflict of interest policies of medical and health sciences journals before and during the COVID-19 pandemic: A repeat cross-sectional study

Authors : Antoni D. Gardener, Ellen J. Hick, Chloe Jacklin, Gifford Tan, Aidan G. Cashin, Hopin Lee, David Nunan, Elaine C. Toomey, Georgia C. Richards

Objectives

To audit the transparent and open science standards of health and medical sciences journal policies and explore the impact of the COVID-19 pandemic.

Design

Repeat cross-sectional study.

Setting

19 journals listed in Google Scholar’s Top Publications for health and medical sciences.

Participants

Blood, Cell, Circulation, European Heart Journal, Gastroenterology, Journal of Clinical Oncology, Journal of the American College of Cardiology, Nature Genetics, Nature Medicine, Nature Neuroscience, Neuron, PLoS ONE, Proceedings of the National Academy of Sciences, Science Translational Medicine, The British Medical Journal, The Journal of the American Medical Association, The Lancet, The Lancet Oncology, and The New England Journal of Medicine.

Main outcome measures

We used the Transparency and Openness Promotion (TOP) guideline and the International Committee of Medical Journal Editors (ICMJE) requirements for disclosing conflicts
of interest (COIs) to evaluate journals standards.

Results

TOP scores slightly improved during the COVID-19 pandemic, from a median of 5 (IQR: 2–12.5) out of a possible 24 points in February 2020 to 7 (IQR: 4–12) in May 2021, but overall, scores were very low at both time points. Journal policies scored highest for their adherence to data transparency and scored lowest for preregistration of study protocols and analysis plans and the submission of replication studies. Most journals fulfilled all ICMJE provisions for reporting COIs before (84%; n = 16) and during (95%; n = 18) the COVID-19 pandemic.

Conclusions

The COVID-19 pandemic has highlighted the importance of practising open science. However, requirements for open science practices in audited policies were overall low, which may impede progress in health and medical research. As key stakeholders in disseminating research, journals should promote a research culture of greater transparency and more robust open science practices.

URL : Open science and conflict of interest policies of medical and health sciences journals before and during the COVID-19 pandemic: A repeat cross-sectional study

DOI : https://doi.org/10.1177/20542704221132139

Catégories
EN

Open Science in Africa: What policymakers should consider

Authors : Elisha R. T. Chiware, Lara Skelly

As Open Science (OS) is being promoted as the best avenue to share and drive scientific discoveries at much lower costs and in transparent and credible ways, it is imperative that African governments and institutions take advantage of the momentum and build research infrastructures that are responsive to this movement.

This paper aims to provide useful insight into the importance and implementation of OS policy frameworks. The paper uses a systematic review approach to review existing literature and analyse global OS policy development documents. The approach includes a review of existing OS policy frameworks that can guide similar work by African governments and institutions.

This critical review also makes recommendations on key issues that Africa should consider in the process of OS policy development. These approaches can be widely used as further foundations for future developments in OS practices on the continent.

URL : Open Science in Africa: What policymakers should consider

DOI : https://doi.org/10.3389/frma.2022.950139

Catégories
EN

FAIREST: A Framework for Assessing Research Repositories

Authors : Mathieu d’Aquin, Fabian Kirstein, Daniela Oliveira, Sonja Schimmler, Sebastian Urbanek

The open science movement has gained significant momentum within the last few years. This comes along with the need to store and share research artefacts, such as publications and research data. For this purpose, research repositories need to be established.

A variety of solutions exist for implementing such repositories, covering diverse features, ranging from custom depositing workflows to social media-like functions.

In this article, we introduce the FAIREST principles, a framework inspired by the well- known FAIR principles, but designed to provide a set of metrics for assessing and selecting solutions for creating digital repositories for research artefacts. The goal is to support decision makers in choosing such a solution when planning for a repository, especially at an institutional level.

The metrics included are therefore based on two pillars: (1) an analysis of established features and functionalities, drawn from existing dedicated, general purpose and commonly used solutions, and (2) a literature review on general requirements for digital repositories for research artefacts and related systems.

We further describe an assessment of 11 widespread solutions, with the goal to provide an overview of the current landscape of research data repository solutions, identifying gaps and research challenges to be addressed.

DOI : https://doi.org/10.1162/dint_a_00159

Catégories
EN

Promoting Open Science through bibliometrics : a practical guide to build an open access monitor

Author : Laetitia Bracco

In order to assess the progress of Open Science in France, the French Ministry of Higher Education, Research and Innovation published the French Open Science Monitor in 2019. Even if this tool has a bias, for only the publications with a DOI can be considered, thus promoting article-dominant research communities, its indicators are trustworthy and reliable.

The University of Lorraine was the very first institution to reuse the National Monitor in order to create a new version at the scale of one university in 2020. Since its release, the Lorraine Open Science Monitor has been reused by many other institutions.

In 2022, the French Open Science Monitor further evolved, enabling new insights on open science. The Lorraine Open Science Monitor has also evolved since it began. This paper details how the initial code for the Lorraine Open Science Monitor was developed and disseminated. It then outlines plans for development in the next few years.

URL : Promoting Open Science through bibliometrics : a practical guide to build an open access monitor

DOI : https://doi.org/10.53377/lq.11545

Catégories
EN

Preprints as a driver of open science: Opportunities for Southeast Asia

Authors : Dasapta Erwin Irawan, Hilyatuz Zahroh, Iratxe Puebla

Southeast Asia is an emerging force of open access scholarly output. For example, Indonesia is in a tight competition with United Kingdom as the largest publisher of open access journals and the second largest producer of open access articles in the world (according to DOAJ and the COKI OA Dashboard, respectively).

However, this support for open practices is not yet reflected in institutional research policies in Southeast Asian countries, which still rely on criteria influenced by world university rankings that focus on publication outputs and do not incorporate elements related to research culture, integrity, or open science.

Preprints have gained increasing attention across disciplines in the last few years, but they are still not included in institutional policies in SouthEast Asia. This paper discusses the potential for preprints to be a driving force for open science and for quality and integrity in scholarly outputs from Southeast Asia.

There is a fledgling preprinting culture in the region, catalyzed by the RINarxiv preprint server in Indonesia and the Malaysia Open Science Platform. We argue that preprints have many advantages: opportunities for open access and for researchers to maintain copyright to their work, wide dissemination, encouraging feedback and critical thinking, and community governance.

With these advantages, preprints can become a fast and open communication hub between researchers and all stakeholders in the research process. We recommend regulatory and practical steps to incorporate preprints into science policy and researchers’ practices as an effort to promote research integrity, open data and reproducibility.

URL : Preprints as a driver of open science: Opportunities for Southeast Asia

DOI : https://doi.org/10.3389/frma.2022.992942