Open science, the replication crisis, and environmental public health

Posté le par

Author : Daniel J. Hicks

Concerns about a crisis of mass irreplicability across scientific fields (“the replication crisis”) have stimulated a movement for open science, encouraging or even requiring researchers to publish their raw data and analysis code.

Recently, a rule at the US Environmental Protection Agency (US EPA) would have imposed a strong open data requirement. The rule prompted significant public discussion about whether open science practices are appropriate for fields of environmental public health.

The aims of this paper are to assess (1) whether the replication crisis extends to fields of environmental public health; and (2) in general whether open science requirements can address the replication crisis.

There is little empirical evidence for or against mass irreplicability in environmental public health specifically. Without such evidence, strong claims about whether the replication crisis extends to environmental public health – or not – seem premature.

By distinguishing three concepts – reproducibility, replicability, and robustness – it is clear that open data initiatives can promote reproducibility and robustness but do little to promote replicability.

I conclude by reviewing some of the other benefits of open science, and offer some suggestions for funding streams to mitigate the costs of adoption of open science practices in environmental public health.

URL : Open science, the replication crisis, and environmental public health

DOI : https://doi.org/10.1080/08989621.2021.1962713

Citizen-driven participatory research conducted through knowledge intermediary units. A thematic synthesis of the literature on “Science Shops

Posté le par

Authors : Anne-Sophie Gresle, Eduardo Urias, Rosario Scandurra, Bálint Balázs, Irene Jimeno, Leonardo de la Torre Ávila, Maria Jesus Pinazo

A Science Shop acts as a mission-oriented intermediary unit between the scientific sphere and civil society organizations. It seeks to facilitate citizen-driven open science projects that respond to the needs of civil society organizations and which, typically, include students in the work process.

We performed a thematic analysis of a systematically selected literature on Science Shops to understand how the scientific literature reflects the historical evolution of Science Shops in different settings and what factors the literature associates with the rise and fall of the Science Shop.

We used the PRISMA methodology to search for scientific papers in indexed journals in eight databases published in English, French and Spanish, and employed the thematic theory approach to extract and systematize our results. Twenty-six scientific articles met the inclusion criteria.

We identified three meta-categories and ten sub-topics which can serve as key pointers to guide the set-up and future work of Science Shops. Our results identify a major paradox: Science Shops incorporate public values in their scientific agendas but have difficulties sustaining themselves institutionally as they do not fit the current dominant research paradigm. Science shops represent a persuasive complementary approach to the way science is defined, executed and produced today.

URL : Citizen-driven participatory research conducted through knowledge intermediary units. A thematic synthesis of the literature on “Science Shops

DOI : https://doi.org/10.22323/2.20050202

How Long Can We Build It? Ensuring Usability of a Scientific Code Base

Posté le par

Authors : Klaus Rechert, Jurek Oberhauser, Rafael Gieschke

Software and in particular source code became an important component of scientific publications and henceforth is now subject of research data management. Maintaining source code such that it remains a usable and a valuable scientific contribution is and remains a huge task.

Not all code contributions can be actively maintained forever. Eventually, there will be a significant backlog of legacy source-code. In this article we analyse the requirements for applying the concept of long-term reusability to source code.

We use simple case study to identify gaps and provide a technical infrastructure based on emulator to support automated builds of historic software in form of source code.

URL : How Long Can We Build It? Ensuring Usability of a Scientific Code Base

DOI : https://doi.org/10.2218/ijdc.v16i1.770

Clinical trial transparency and data sharing among biopharmaceutical companies and the role of company size, location and product type: a cross-sectional descriptive analysis

Posté le par

Authors : Sydney A Axson, Michelle M Mello, Deborah Lincow, Catherine Yang, Cary P Gross, Joseph S Ross, Jennifer Miller

Objectives

To examine company characteristics associated with better transparency and to apply a tool used to measure and improve clinical trial transparency among large companies and drugs, to smaller companies and biologics.

Design

Cross-sectional descriptive analysis.

Setting and participants

Novel drugs and biologics Food and Drug Administration (FDA) approved in 2016 and 2017 and their company sponsors.

Main outcome measures

Using established Good Pharma Scorecard (GPS) measures, companies and products were evaluated on their clinical trial registration, results dissemination and FDA Amendments Act (FDAAA) implementation; companies were ranked using these measures and a multicomponent data sharing measure.

Associations between company transparency scores with company size (large vs non-large), location (US vs non-US) and sponsored product type (drug vs biologic) were also examined.

Results

26% of products (16/62) had publicly available results for all clinical trials supporting their FDA approval and 67% (39/58) had public results for trials in patients by 6 months after their FDA approval; 58% (32/55) were FDAAA compliant.

Large companies were significantly more transparent than non-large companies (overall median transparency score of 95% (IQR 91–100) vs 59% (IQR 41–70), p<0.001), attributable to higher FDAAA compliance (median of 100% (IQR 88–100) vs 57% (0–100), p=0.01) and better data sharing (median of 100% (IQR 80–100) vs 20% (IQR 20–40), p<0.01). No significant differences were observed by company location or product type.

Conclusions

It was feasible to apply the GPS transparency measures and ranking tool to non-large companies and biologics. Large companies are significantly more transparent than non-large companies, driven by better data sharing procedures and implementation of FDAAA trial reporting requirements.

Greater research transparency is needed, particularly among non-large companies, to maximise the benefits of research for patient care and scientific innovation.

URL : Clinical trial transparency and data sharing among biopharmaceutical companies and the role of company size, location and product type: a cross-sectional descriptive analysis

DOI : http://dx.doi.org/10.1136/bmjopen-2021-053248

Why Open Access: Economics and Business Researchers’ Perspectives

Posté le par

Authors : Carmen López-Vergara, Pilar Flores Asenjo, Alfonso Rosa-García

Public research policies have been promoting open-access publication in recent years as an adequate model for the dissemination of scientific knowledge. However, depending on the disciplines, its use is very diverse.

This study explores the determinants of open-access publication among academic researchers of economics and business, as well as their assessment of different economic measures focused on publication stimulus.

To do so, a survey of Spanish business and economics researchers was conducted. They reported an average of 19% of their publications in open-access journals, hybrids or fully Gold Route open access. Almost 80% of the researchers foresee a future increase in the volume of open-access publications.

When determining where to publish their research results, the main criterion for the selection of a scientific journal is the impact factor. Regarding open access, the most valued aspect is the visibility and dissemination it provides.

Although the cost of publication is not the most relevant criterion in the choice of a journal, three out of four researchers consider that a reduction in fees and an increase in funding are measures that would boost the open-access model.

URL : Why Open Access: Economics and Business Researchers’ Perspectives

DOI : https://doi.org/10.3390/publications9030037

Revisiting the digital humanities through the lens of Indigenous studies—or how to question the cultural blindness of our technologies and practices

Posté le par

Author : Coppélie Cocq

This article examines the benefits of putting Indigenous perspectives and the digital humanities (DH) in conversation with each other in order to elaborate a DH approach that is suitable for Indigenous research and to suggest critical perspectives for a more sustainable DH.

For this purpose, the article examines practices of data harvesting, categorizing, and sharing from the perspectives of groups in the margin, more specifically in relation to Sámi research. Previous research has emphasized the role of cultural and social contexts in the design, use, and adaptation of technologies in general, and digital technologies in particular (Douglas, 1987. Inventing American broadcasting; Nissenbaum, 2001. Computer, 34, 118–120; Powell & Aitken, 2011.

The American literature scholar in the digital age) and several scholars have argued for how the application of critical studies make a fruitful contribution to the DH (Liu, 2012. Debates in the digital humanities; McPherson, 2012. Debates in the digital humanities).

This article suggests an approach that addresses a need to acknowledge the diversity of technoscientific traditions. The perspectives of Indigenous groups bring this matter to a head. In order to make the DH more sustainable and inclusive, the development of the DH should be driven by cultural studies to a greater extent than it has been so far.

A sustainable DH also means a better rendering of the plurality of the cultural values, perspectives, and ethics that characterize our fieldwork and research subjects.

URL : Revisiting the digital humanities through the lens of Indigenous studies—or how to question the cultural blindness of our technologies and practices

DOI : https://doi.org/10.1002/asi.24564

Doctoral Students’ Educational Needs in Research Data Management: Perceived Importance and Current Competencies

Posté le par

Author : Jukka Rantasaari

Sound research data management (RDM) competencies are elementary tools used by researchers to ensure integrated, reliable, and re-usable data, and to produce high quality research results.

In this study, 35 doctoral students and faculty members were asked to self-rate or rate doctoral students’ current RDM competencies and rate the importance of these competencies.

Structured interviews were conducted, using close-ended and open-ended questions, covering research data lifecycle phases such as collection, storing, organization, documentation, processing, analysis, preservation, and data sharing.

The quantitative analysis of the respondents’ answers indicated a wide gap between doctoral students’ rated/self-rated current competencies and the rated importance of these competencies.

In conclusion, two major educational needs were identified in the qualitative analysis of the interviews: to improve and standardize data management planning, including awareness of the intellectual property and agreements issues affecting data processing and sharing; and to improve and standardize data documenting and describing, not only for the researcher themself but especially for data preservation, sharing, and re-using. Hence the study informs the development of RDM education for doctoral students.

URL : Doctoral Students’ Educational Needs in Research Data Management: Perceived Importance and Current Competencies

DOI : https://doi.org/10.2218/ijdc.v16i1.684