Risk Assessment for Scientific Data

Posté le par

Authors : Matthew S. Mayernik, Kelsey Breseman, Robert R. Downs, Ruth Duerr, Alexis Garretson, Chung-Yi (Sophie) Hou

Ongoing stewardship is required to keep data collections and archives in existence. Scientific data collections may face a range of risk factors that could hinder, constrain, or limit current or future data use.

Identifying such risk factors to data use is a key step in preventing or minimizing data loss. This paper presents an analysis of data risk factors that scientific data collections may face, and a data risk assessment matrix to support data risk assessments to help ameliorate those risks.

The goals of this work are to inform and enable effective data risk assessment by: a) individuals and organizations who manage data collections, and b) individuals and organizations who want to help to reduce the risks associated with data preservation and stewardship.

The data risk assessment framework presented in this paper provides a platform from which risk assessments can begin, and a reference point for discussions of data stewardship resource allocations and priorities.

URL : Risk Assessment for Scientific Data

DOI : http://doi.org/10.5334/dsj-2020-010

Publications numériques scientifiques universitaires internationales : Disruption, quels acteurs,quels projets ?

Posté le par

Auteur/Author : Appoline Romanens

Les enseignants-chercheurs d’aujourd’hui se heurtent à des APC, ont besoin de logiciels de PAO, avec un DMP pour apparaître dans la base de données du DOAJ, ou espérer rentrer dans celle duWoS.

Tous ces termes nous semblent éloignés du jargon du Journal des Sçavans, première manifestation de la compilation des pensées de la recherche scientifique.

Pourtant ils sont le signe d’une évolution du médium qui porte l’article académique scientifique aujourd’hui, le web de données, dans lequel toute publication scientifique se doit d’être réticulée pour survivre au publish or perish.

Afin de comprendre ce nouveau jargon de la recherche scientifique, qui témoigne de profonds changements dans le rapport qu’entretient l’enseignant-chercheur, l’éditeur puis le lecteur par rapport au texte, ce mémoire explore la notion de disruption dans le processus de création, relecture et édition puis publication et diffusion d’un article.

Outre un développement basé sur les théories de l’économie du document et de l’article scientifique, ce mémoire apporte deux études de cas qui rendent compte du phénomène de disruption dans les publications scientifiques, et propose à partir de ce corpus une ouverture sur ses enjeux actuels et futurs.

URL : Publications numériques scientifiques universitaires internationales : Disruption, quels acteurs,quels projets ?

Original location : https://www.enssib.fr/bibliotheque-numerique/notices/69398-publications-numeriques-scientifiques-universitaires-internationales-disruption-quels-acteurs-quels-projets

Why we publish where we do: Faculty publishing values and their relationship to review, promotion and tenure expectations

Posté le par

Authors : Meredith T. Niles, Lesley A. Schimanski, Erin C. McKiernan, Juan Pablo Alperin

Using an online survey of academics at 55 randomly selected institutions across the US and Canada, we explore priorities for publishing decisions and their perceived importance within review, promotion, and tenure (RPT).

We find that respondents most value journal readership, while they believe their peers most value prestige and related metrics such as impact factor when submitting their work for publication.

Respondents indicated that total number of publications, number of publications per year, and journal name recognition were the most valued factors in RPT.

Older and tenured respondents (most likely to serve on RPT committees) were less likely to value journal prestige and metrics for publishing, while untenured respondents were more likely to value these factors.

These results suggest disconnects between what academics value versus what they think their peers value, and between the importance of journal prestige and metrics for tenured versus untenured faculty in publishing and RPT perceptions.

URL : Why we publish where we do: Faculty publishing values and their relationship to review, promotion and tenure expectations

DOI : https://doi.org/10.1371/journal.pone.0228914

No raw data, no science: another possible source of the reproducibility crisis

Posté le par

Author : Tsuyoshi Miyakawa

A reproducibility crisis is a situation where many scientific studies cannot be reproduced. Inappropriate practices of science, such as HARKing, p-hacking, and selective reporting of positive results, have been suggested as causes of irreproducibility. In this editorial, I propose that a lack of raw data or data fabrication is another possible cause of irreproducibility.

As an Editor-in-Chief of Molecular Brain, I have handled 180 manuscripts since early 2017 and have made 41 editorial decisions categorized as “Revise before review,” requesting that the authors provide raw data.

Surprisingly, among those 41 manuscripts, 21 were withdrawn without providing raw data, indicating that requiring raw data drove away more than half of the manuscripts. I rejected 19 out of the remaining 20 manuscripts because of insufficient raw data.

Thus, more than 97% of the 41 manuscripts did not present the raw data supporting their results when requested by an editor, suggesting a possibility that the raw data did not exist from the beginning, at least in some portions of these cases.

Considering that any scientific study should be based on raw data, and that data storage space should no longer be a challenge, journals, in principle, should try to have their authors publicize raw data in a public database or journal site upon the publication of the paper to increase reproducibility of the published results and to increase public trust in science.

URL : No raw data, no science: another possible source of the reproducibility crisis

DOI : https://doi.org/10.1186/s13041-020-0552-2

Reproducible and transparent research practices in published neurology research

Posté le par

Authors : Trevor Torgerson, Austin L. Johnson, Jonathan Pollard, Daniel Tritz, Matt Vassar

Background

The objective of this study was to evaluate the nature and extent of reproducible and transparent research practices in neurology publications.

Methods

The NLM catalog was used to identify MEDLINE-indexed neurology journals. A PubMed search of these journals was conducted to retrieve publications over a 5-year period from 2014 to 2018.

A random sample of publications was extracted. Two authors conducted data extraction in a blinded, duplicate fashion using a pilot-tested Google form. This form prompted data extractors to determine whether publications provided access to items such as study materials, raw data, analysis scripts, and protocols.

In addition, we determined if the publication was included in a replication study or systematic review, was preregistered, had a conflict of interest declaration, specified funding sources, and was open access.

Results

Our search identified 223,932 publications meeting the inclusion criteria, from which 400 were randomly sampled. Only 389 articles were accessible, yielding 271 publications with empirical data for analysis.

Our results indicate that 9.4% provided access to materials, 9.2% provided access to raw data, 0.7% provided access to the analysis scripts, 0.7% linked the protocol, and 3.7% were preregistered.

A third of sampled publications lacked funding or conflict of interest statements. No publications from our sample were included in replication studies, but a fifth were cited in a systematic review or meta-analysis.

Conclusions

Currently, published neurology research does not consistently provide information needed for reproducibility. The implications of poor research reporting can both affect patient care and increase research waste. Collaborative intervention by authors, peer reviewers, journals, and funding sources is needed to mitigate this problem.

URL : Reproducible and transparent research practices in published neurology research

DOI : https://doi.org/10.1186/s41073-020-0091-5

 

The Heritage Data Reuse Charter: from principles to research workflows

Posté le par

Authors : Erzsébet Tóth-Czifra, Laurent Romary

There is a growing need to establish domain-or discipline-specific approaches to research data sharing workflows. A defining feature of data and data workflows in the arts and humanities domain is their dependence on cultural heritage sources hosted and curated in museums, libraries, galleries and archives.

A major difficulty when scholars interact with heritage data is that the nature of the cooperation between researchers and Cultural Heritage Institutions (henceforth CHIs) is often constrained by structural and legal challenges but even more by uncertainties as to the expectations of both parties.

The Heritage Data Reuse Charter aims to address these by designing a common environment that will enable all the relevant actors to work together to connect and improve access to heritage data and make transactions related to the scholarly use of cultural heritage data more visible and transparent.

As a first step, a wide range of stakeholders on the Cultural Heritage and research sector agreed upon a set of generic principles, summarized in the Mission Statement of the Charter, that can serve as a baseline governing the interactions between CHIs, researchers and data centres.

This was followed by a long and thorough validation process related to these principles through surveys 1 and workshops 2. As a second step, we now put forward a questionnaire template tool that helps researchers and CHIs to translate the 6 core principles into specific research project settings.

It contains questions about access to data, provenance information, preferred citation standards, hosting responsibilities etc. on the basis of which the parties can arrive at mutual reuse agreements that could serve as a starting point for a FAIR-by-construction data management, right from the project planning/application phase.

The questionnaire template and the resulting mutual agreements can be flexibly applied to projects of different scale and in platform-independent ways. Institutions can embed them into their own exchange protocols while researchers can add them to their Data Management Plans.

As such, they can show evidence for responsible and fair conduct of cultural heritage data, and fair (but also FAIR) research data management practices that are based on partnership with the holding institution.

URL : https://halshs.archives-ouvertes.fr/halshs-02475692

Open Access eXchange (OAeX): an economic model and platform for fundraising open scholarship services

Posté le par

Authors : Jack Hyland, Alexander Kouker, Dmitri Zaitsev

This article describes the Open Access eXchange (OAeX) project, a pragmatic and comprehensive economic model and fundraising platform for open scholarship initiatives.

OAeX connects bidders with funders at scale and right across the open scholarship spectrum through crowdfunding: financial expenditure is regulated by a market of freely competing providers and financial transactions and transparency are assured by a clearing-house entity.

Specifically, OAeX seeks to facilitate open access publishing without the barrier of article processing charges (APCs), as well as contribute to solving challenges of transparency and economic sustainability in open scholarship projects in the broader sense.

URL : Open Access eXchange (OAeX): an economic model and platform for fundraising open scholarship services

DOI : http://doi.org/10.1629/uksg.500