Adoption of Transparency and Openness Promotion (TOP) Guidelines across Journals

Authors : Inga Patarčić, Jadranka Stojanovski

Journal policies continuously evolve to enable knowledge sharing and support reproducible science. However, that change happens within a certain framework. Eight modular standards with three levels of increasing stringency make Transparency and Openness Promotion (TOP) guidelines which can be used to evaluate to what extent and with which stringency journals promote open science.

Guidelines define standards for data citation, transparency of data, material, code and design and analysis, replication, plan and study pre-registration, and two effective interventions: “Registered reports” and “Open science badges”, and levels of adoption summed up across standards define journal’s TOP Factor. In this paper, we analysed the status of adoption of TOP guidelines across two thousand journals reported in the TOP Factor metrics.

We show that the majority of the journals’ policies align with at least one of the TOP’s standards, most likely “Data citation” (70%) followed by “Data transparency” (19%). Two-thirds of adoptions of TOP standard are of the stringency Level 1 (less stringent), whereas only 9% is of the stringency Level 3.

Adoption of TOP standards differs across science disciplines and multidisciplinary journals (N = 1505) and journals from social sciences (N = 1077) show the greatest number of adoptions. Improvement of the measures that journals take to implement open science practices could be done: (1) discipline-specific, (2) journals that have not yet adopted TOP guidelines could do so, (3) the stringency of adoptions could be increased.

URL : Adoption of Transparency and Openness Promotion (TOP) Guidelines across Journals

DOI : https://doi.org/10.3390/publications10040046

Open science and conflict of interest policies of medical and health sciences journals before and during the COVID-19 pandemic: A repeat cross-sectional study

Authors : Antoni D. Gardener, Ellen J. Hick, Chloe Jacklin, Gifford Tan, Aidan G. Cashin, Hopin Lee, David Nunan, Elaine C. Toomey, Georgia C. Richards

Objectives

To audit the transparent and open science standards of health and medical sciences journal policies and explore the impact of the COVID-19 pandemic.

Design

Repeat cross-sectional study.

Setting

19 journals listed in Google Scholar’s Top Publications for health and medical sciences.

Participants

Blood, Cell, Circulation, European Heart Journal, Gastroenterology, Journal of Clinical Oncology, Journal of the American College of Cardiology, Nature Genetics, Nature Medicine, Nature Neuroscience, Neuron, PLoS ONE, Proceedings of the National Academy of Sciences, Science Translational Medicine, The British Medical Journal, The Journal of the American Medical Association, The Lancet, The Lancet Oncology, and The New England Journal of Medicine.

Main outcome measures

We used the Transparency and Openness Promotion (TOP) guideline and the International Committee of Medical Journal Editors (ICMJE) requirements for disclosing conflicts
of interest (COIs) to evaluate journals standards.

Results

TOP scores slightly improved during the COVID-19 pandemic, from a median of 5 (IQR: 212.5) out of a possible 24 points in February 2020 to 7 (IQR: 4–12) in May 2021, but overall, scores were very low at both time points. Journal policies scored highest for their adherence to data transparency and scored lowest for preregistration of study protocols and analysis plans and the submission of replication studies. Most journals fulfilled all ICMJE provisions for reporting COIs before (84%; n = 16) and during (95%; n = 18) the COVID-19 pandemic.

Conclusions

The COVID-19 pandemic has highlighted the importance of practising open science. However, requirements for open science practices in audited policies were overall low, which may impede progress in health and medical research. As key stakeholders in disseminating research, journals should promote a research culture of greater transparency and more robust open science practices.

URL : Open science and conflict of interest policies of medical and health sciences journals before and during the COVID-19 pandemic: A repeat cross-sectional study

DOI : https://doi.org/10.1177/20542704221132139

Open Science in Africa: What policymakers should consider

Authors : Elisha R. T. Chiware, Lara Skelly

As Open Science (OS) is being promoted as the best avenue to share and drive scientific discoveries at much lower costs and in transparent and credible ways, it is imperative that African governments and institutions take advantage of the momentum and build research infrastructures that are responsive to this movement.

This paper aims to provide useful insight into the importance and implementation of OS policy frameworks. The paper uses a systematic review approach to review existing literature and analyse global OS policy development documents. The approach includes a review of existing OS policy frameworks that can guide similar work by African governments and institutions.

This critical review also makes recommendations on key issues that Africa should consider in the process of OS policy development. These approaches can be widely used as further foundations for future developments in OS practices on the continent.

URL : Open Science in Africa: What policymakers should consider

DOI : https://doi.org/10.3389/frma.2022.950139

FAIREST: A Framework for Assessing Research Repositories

Authors : Mathieu d’Aquin, Fabian Kirstein, Daniela Oliveira, Sonja Schimmler, Sebastian Urbanek

The open science movement has gained significant momentum within the last few years. This comes along with the need to store and share research artefacts, such as publications and research data. For this purpose, research repositories need to be established.

A variety of solutions exist for implementing such repositories, covering diverse features, ranging from custom depositing workflows to social media-like functions.

In this article, we introduce the FAIREST principles, a framework inspired by the well- known FAIR principles, but designed to provide a set of metrics for assessing and selecting solutions for creating digital repositories for research artefacts. The goal is to support decision makers in choosing such a solution when planning for a repository, especially at an institutional level.

The metrics included are therefore based on two pillars: (1) an analysis of established features and functionalities, drawn from existing dedicated, general purpose and commonly used solutions, and (2) a literature review on general requirements for digital repositories for research artefacts and related systems.

We further describe an assessment of 11 widespread solutions, with the goal to provide an overview of the current landscape of research data repository solutions, identifying gaps and research challenges to be addressed.

DOI : https://doi.org/10.1162/dint_a_00159

Promoting Open Science through bibliometrics : a practical guide to build an open access monitor

Author : Laetitia Bracco

In order to assess the progress of Open Science in France, the French Ministry of Higher Education, Research and Innovation published the French Open Science Monitor in 2019. Even if this tool has a bias, for only the publications with a DOI can be considered, thus promoting article-dominant research communities, its indicators are trustworthy and reliable.

The University of Lorraine was the very first institution to reuse the National Monitor in order to create a new version at the scale of one university in 2020. Since its release, the Lorraine Open Science Monitor has been reused by many other institutions.

In 2022, the French Open Science Monitor further evolved, enabling new insights on open science. The Lorraine Open Science Monitor has also evolved since it began. This paper details how the initial code for the Lorraine Open Science Monitor was developed and disseminated. It then outlines plans for development in the next few years.

URL : Promoting Open Science through bibliometrics : a practical guide to build an open access monitor

DOI : https://doi.org/10.53377/lq.11545

Preprints as a driver of open science: Opportunities for Southeast Asia

Authors : Dasapta Erwin Irawan, Hilyatuz Zahroh, Iratxe Puebla

Southeast Asia is an emerging force of open access scholarly output. For example, Indonesia is in a tight competition with United Kingdom as the largest publisher of open access journals and the second largest producer of open access articles in the world (according to DOAJ and the COKI OA Dashboard, respectively).

However, this support for open practices is not yet reflected in institutional research policies in Southeast Asian countries, which still rely on criteria influenced by world university rankings that focus on publication outputs and do not incorporate elements related to research culture, integrity, or open science.

Preprints have gained increasing attention across disciplines in the last few years, but they are still not included in institutional policies in SouthEast Asia. This paper discusses the potential for preprints to be a driving force for open science and for quality and integrity in scholarly outputs from Southeast Asia.

There is a fledgling preprinting culture in the region, catalyzed by the RINarxiv preprint server in Indonesia and the Malaysia Open Science Platform. We argue that preprints have many advantages: opportunities for open access and for researchers to maintain copyright to their work, wide dissemination, encouraging feedback and critical thinking, and community governance.

With these advantages, preprints can become a fast and open communication hub between researchers and all stakeholders in the research process. We recommend regulatory and practical steps to incorporate preprints into science policy and researchers’ practices as an effort to promote research integrity, open data and reproducibility.

URL : Preprints as a driver of open science: Opportunities for Southeast Asia

DOI : https://doi.org/10.3389/frma.2022.992942

Open Science Knowledge Production: Addressing Epistemological Challenges and Ethical Implications

Author : Bjørn Hofmann

Open Science (OS) is envisioned to have a wide range of benefits including being more transparent, shared, accessible, and collaboratively developed than traditional science. Despite great enthusiasm, there are also several challenges with OS.

In order to ensure that OS obtains its benefits, these challenges need to be addressed. Accordingly, the objective of this study is to provide an overview of one type of challenge, i.e., epistemological challenges with OS knowledge production, and their ethical implications.

Based on a literature review, it (a) reveals factors undermining the envisioned benefits of OS, (b) identifies negative effects on knowledge production, and (c) exposes epistemological challenges with the various phases of the OS process.

The main epistemic challenges are related to governance, framing, looping effects, proper data procurement, validation, replication, bias, and polarization. The ethical implications are injustice, reduced benefit (efficiency), increased harm (as a consequence of poor-quality science), deception and manipulation (reduced autonomy), and lack of trustworthiness.

Accordingly, to obtain the envisioned benefits of OS, we need to address these epistemological challenges and their ethical implications.

URL : Open Science Knowledge Production: Addressing Epistemological Challenges and Ethical Implications

DOI : https://doi.org/10.3390/publications10030024