Archives des mots-clés : open science

Open science and modified funding lotteries can impede the natural selection of bad science

Posté le par

Authors : Paul E. Smaldino, Matthew A. Turner, Pablo A. Contreras Kallens

Assessing scientists using exploitable metrics can lead to the degradation of research methods even without any strategic behaviour on the part of individuals, via ‘the natural selection of bad science.’

Institutional incentives to maximize metrics like publication quantity and impact drive this dynamic. Removing these incentives is necessary, but institutional change is slow.

However, recent developments suggest possible solutions with more rapid onsets. These include what we call open science improvements, which can reduce publication bias and improve the efficacy of peer review. In addition, there have been increasing calls for funders to move away from prestige- or innovation-based approaches in favour of lotteries.

We investigated whether such changes are likely to improve the reproducibility of science even in the presence of persistent incentives for publication quantity through computational modelling.

We found that modified lotteries, which allocate funding randomly among proposals that pass a threshold for methodological rigour, effectively reduce the rate of false discoveries, particularly when paired with open science improvements that increase the publication of negative results and improve the quality of peer review.

In the absence of funding that targets rigour, open science improvements can still reduce false discoveries in the published literature but are less likely to improve the overall culture of research practices that underlie those publications.

URL : Open science and modified funding lotteries can impede the natural selection of bad science

DOI : https://doi.org/10.1098/rsos.190194

Open Social Scholarship Annotated Bibliography

Posté le par

Authors: Randa El Khatib, Lindsey Seatter, Tracey El Hajj, Conrad Leibel, Alyssa Arbuckle, Ray Siemens, Caroline Winter, the ETCL and INKE Research Groups

This annotated bibliography responds to and contextualizes the growing “Open” movements and recent institutional reorientation towards social, public-facing scholarship.

The aim of this document is to present a working definition of open social scholarship through the aggregation and summation of critical resources in the field. Our work surveys foundational publications, innovative research projects, and global organizations that enact the theories and practices of open social scholarship.

The bibliography builds on the knowledge creation principles outlined in previous research by broadening the focus beyond traditional academic spaces and reinvigorating central, defining themes with recently published research.

URL : Open Social Scholarship Annotated Bibliography

DOI : http://doi.org/10.5334/kula.58

The Economic Impacts of Open Science: A Rapid Evidence Assessment

Posté le par

Author : Michael J. Fell

A common motivation for increasing open access to research findings and data is the potential to create economic benefits—but evidence is patchy and diverse. This study systematically reviewed the evidence on what kinds of economic impacts (positive and negative) open science can have, how these comes about, and how benefits could be maximized.

Use of open science outputs often leaves no obvious trace, so most evidence of impacts is based on interviews, surveys, inference based on existing costs, and modelling approaches.

There is indicative evidence that open access to findings/data can lead to savings in access costs, labour costs and transaction costs. There are examples of open science enabling new products, services, companies, research and collaborations. Modelling studies suggest higher returns to R&D if open access permits greater accessibility and efficiency of use of findings. Barriers include lack of skills capacity in search, interpretation and text mining, and lack of clarity around where benefits accrue.

There are also contextual considerations around who benefits most from open science (e.g., sectors, small vs. larger companies, types of dataset). Recommendations captured in the review include more research, monitoring and evaluation (including developing metrics), promoting benefits, capacity building and making outputs more audience-friendly.

URL : The Economic Impacts of Open Science: A Rapid Evidence Assessment

DOI : https://doi.org/10.3390/publications7030046

The Definition of Reuse

Posté le par

Authors : Stephanie van de Sandt, Sünje Dallmeier-Tiessen, Artemis Lavasa, Vivien Petras

The ability to reuse research data is now considered a key benefit for the wider research community. Researchers of all disciplines are confronted with the pressure to share their research data so that it can be reused.

The demand for data use and reuse has implications on how we document, publish and share research in the first place, and, perhaps most importantly, it affects how we measure the impact of research, which is commonly a measurement of its use and reuse.

It is surprising that research communities, policy makers, etc. have not clearly defined what use and reuse is yet.

We postulate that a clear definition of use and reuse is needed to establish better metrics for a comprehensive scholarly record of individuals, institutions, organizations, etc.

Hence, this article presents a first definition of reuse of research data. Characteristics of reuse are identified by examining the etymology of the term and the analysis of the current discourse, leading to a range of reuse scenarios that show the complexity of today’s research landscape, which has been moving towards a data-driven approach.

The analysis underlines that there is no reason to distinguish use and reuse. We discuss what that means for possible new metrics that attempt to cover Open Science practices more comprehensively.

We hope that the resulting definition will enable a better and more refined strategy for Open Science.

URL : The Definition of Reuse

DOI : http://doi.org/10.5334/dsj-2019-022

Strengthening bibliodiversity: The current situation in France at national and institutional levels

Posté le par

Authors : Jean-François Lutz, Jacques Lafait

Almost one year after the announcement of the French National Plan for Open Science, the intervention aims at presenting a progress report on achievements in strengthening bibliodiversity and setting up a National Open Science Fund, two of the objectives of the Plan.

At the national level, the work was carried out within a working group the Open Science Committee.

Four complementary aspects were taken into account:

  • the establishment of exemplary criteria to assess infrastructures and platforms in terms of governance, ethics, openness and sustainability. These 40 criteria are to be used in the evaluation of the initiatives that will apply to the National Open Science Fund.
  • support for the strategic orientation of the National Open Science Fund.
  • the drafting of recommendations for the implementation of Plan S by the Agence Nationale de la Recherche (ANR), which is member of cOAlition S.
  • information exchange and coordination with other initiatives such as OA2020 and SCOSS.

URL : https://elpub.episciences.org/5529

Science should be open, right?: A survey conducted by the Research Centre of the Slovenian Academy of Sciences and Arts (ZRC SAZU) on the use of academic literature and open science

Posté le par

Author : Aleš Pogačnik

What does “open science” mean to researchers? A survey of researchers at the Research Centre of the Slovenian Academy of Sciences and Arts (ZRC SAZU) suggests some interesting conclusions, particularly as far as the humanities are concerned. According to the responses, most of these researchers are in favour of open science as a matter of personal conviction.

However, when it comes to publishing their own work, hardly any would consent to being published under some basic conditions of open science (adaptation, commercial use). Furthermore, they do appreciate subscription-based e-libraries, although they admit to using other methods, e.g. “resourcefulness”, to gain access to research papers.

They would rather not pay to be published or to acquire an e-article of a fellow researcher. They read predominantly in English, with the second language of their research literature being Slovenian (before any other language). Even the most productive age group (40–50 years of age) write more articles than they perform peer-reviewing.

They do not support open reviews, yet they consider peer-reviews to be very important; in their opinion peer-reviewing should be included in their evaluation. The survey and its results are just a minor example from a European country, but they have a very clear and universal message: open science is something yet to be defined.

URL : https://hal.archives-ouvertes.fr/hal-02141850

AccessLab: Workshops to broaden access to scientific research

Posté le par

Authors : Amber G. F. Griffiths, Ivvet Modinou, Clio Heslop, Charlotte Brand, Aidan Weatherill, Kate Baker, Anna E. Hughes, Jen Lewis, Lee de Mora, Sara Mynott, Katherine E. Roberts, David J. Griffiths, Iain Hrynaszkiewicz​, Natasha Simons​, Azhar Hussain​,​ Simon Goudie

AccessLabs are workshops with two simultaneous motivations, achieved through direct citizen-scientist pairings: (1) to decentralise research skills so that a broader range of people are able to access/use scientific research, and (2) to expose science researchers to the difficulties of using their research as an outsider, creating new open access advocates.

Five trial AccessLabs have taken place for policy makers, media/journalists, marine sector participants, community groups, and artists. The act of pairing science academics with local community members helps build understanding and trust between groups at a time when this relationship appears to be under increasing threat from different political and economic currents in society.

Here, we outline the workshop motivations, format, and evaluation, with the aim that others can build on the methods developed.

URL : AccessLab: Workshops to broaden access to scientific research

DOI : https://doi.org/10.1371/journal.pbio.3000258