fiddle: a tool to combat publication bias by getting research out of the file drawer and into the scientific community

Authors : René Bernard, Tracey L. Weissgerber, Evgeny Bobrov, Stacey J. Winham, Ulrich Dirnag, Nico Riedel

Statistically significant findings are more likely to be published than non-significant or null findings, leaving scientists and healthcare personnel to make decisions based on distorted scientific evidence.

Continuously expanding ´file drawers’ of unpublished data from well-designed experiments waste resources creates problems for researchers, the scientific community and the public. There is limited awareness of the negative impact that publication bias and selective reporting have on the scientific literature.

Alternative publication formats have recently been introduced that make it easier to publish research that is difficult to publish in traditional peer reviewed journals. These include micropublications, data repositories, data journals, preprints, publishing platforms, and journals focusing on null or neutral results. While these alternative formats have the potential to reduce publication bias, many scientists are unaware that these formats exist and don’t know how to use them.

Our open source file drawer data liberation effort (fiddle) tool (RRID:SCR_017327 available at: http://s-quest.bihealth.org/fiddle/) is a match-making Shiny app designed to help biomedical researchers to identify the most appropriate publication format for their data. Users can search for a publication format that meets their needs, compare and contrast different publication formats, and find links to publishing platforms.

This tool will assist scientists in getting otherwise inaccessible, hidden data out of the file drawer into the scientific community and literature. We briefly highlight essential details that should be included to ensure reporting quality, which will allow others to use and benefit from research published in these new formats.

URL : fiddle: a tool to combat publication bias by getting research out of the file drawer and into the scientific community

DOI : https://doi.org/10.1042/CS20201125

Social Media and Trust in Scientific Expertise: Debating the Covid-19 Pandemic in The Netherlands

Authors : José van Dijck, Donya Alinead

This article examines the role of social media dynamics in the public exchange of information between scientists (experts), government (policy-makers), mass media (journalists), and citizens (nonexperts) during the first 4 months after the Covid-19 outbreak in the Netherlands.

Over the past decade, the institutional model of science communication, based on linear vectors of information flows between institutions, has gradually converted into a networked model where social media propel information flows circulating between all actors involved.

The question driving our research is, “How are social media deployed to both undermine and enhance public trust in scientific expertise during a health crisis?” Analyzing the public debate during the period of the corona outbreak in the Netherlands, we investigate two stages: the emergency response phase and the “smart exit strategy” phase, discussing how scientific experts, policy-makers, journalists, and citizens appropriate social media logic to steer information and to control the debate.

We conclude by outlining the potential risks and benefits of adopting social media dynamics in institutional contexts of science communication.

URL : Social Media and Trust in Scientific Expertise: Debating the Covid-19 Pandemic in The Netherlands

DOI : https://doi.org/10.1177/2056305120981057

Enforcing public data archiving policies in academic publishing: A study of ecology journals

Authors : Dan Sholler, Karthik Ram, Carl Boettiger, Daniel S Katz

To improve the quality and efficiency of research, groups within the scientific community seek to exploit the value of data sharing. Funders, institutions, and specialist organizations are developing and implementing strategies to encourage or mandate data sharing within and across disciplines, with varying degrees of success.

Academic journals in ecology and evolution have adopted several types of public data archiving policies requiring authors to make data underlying scholarly manuscripts freely available. The effort to increase data sharing in the sciences is one part of a broader “data revolution” that has prompted discussion about a paradigm shift in scientific research.

Yet anecdotes from the community and studies evaluating data availability suggest that these policies have not obtained the desired effects, both in terms of quantity and quality of available datasets.

We conducted a qualitative, interview-based study with journal editorial staff and other stakeholders in the academic publishing process to examine how journals enforce data archiving policies.

We specifically sought to establish who editors and other stakeholders perceive as responsible for ensuring data completeness and quality in the peer review process. Our analysis revealed little consensus with regard to how data archiving policies should be enforced and who should hold authors accountable for dataset submissions.

Themes in interviewee responses included hopefulness that reviewers would take the initiative to review datasets and trust in authors to ensure the completeness and quality of their datasets.

We highlight problematic aspects of these thematic responses and offer potential starting points for improvement of the public data archiving process.

URL : Enforcing public data archiving policies in academic publishing: A study of ecology journals

DOI : https://doi.org/10.1177/2053951719836258

“Participant” Perceptions of Twitter Research Ethics

Authors : Casey Fiesler, Nicholas Proferes

Social computing systems such as Twitter present new research sites that have provided billions of data points to researchers. However, the availability of public social media data has also presented ethical challenges.

As the research community works to create ethical norms, we should be considering users’ concerns as well. With this in mind, we report on an exploratory survey of Twitter users’ perceptions of the use of tweets in research.

Within our survey sample, few users were previously aware that their public tweets could be used by researchers, and the majority felt that researchers should not be able to use tweets without consent.

However, we find that these attitudes are highly contextual, depending on factors such as how the research is conducted or disseminated, who is conducting it, and what the study is about. The findings of this study point to potential best practices for researchers conducting observation and analysis of public data.

URL : “Participant” Perceptions of Twitter Research Ethics

DOI : https://doi.org/10.1177/2056305118763366

Exploratory analysis of indicators for open knowledge institutions: a case study of Australian universities

Authors : Richard Hosking, Chun-Kai Huang, Lucy Montgomery, Cameron Neylon, Alkim Ozaygen, Katie Wilson

While the movement for open access (OA) has gained momentum in recent years, there remain concerns about the broader commitment to openness in knowledge production and dissemination. Increasingly, universities are under pressure to transform themselves to engage with the wider community and to be more inclusive.

Open knowledge institutions (OKIs) provide a framework that encourages universities to act with the principles of openness at their centre; not only should universities embrace digital OA, but also lead actions in cultivating diversity, equity, transparency and positive changes in society.

Accordingly, this leads onto questions of whether we can evaluate the progress of OKIs and what are potential indicators for OKIs. As an exploratory study, this article reports on the collection and analysis of a list of potential indicators for OKIs.

Data for these indicators are gathered for 43 Australian universities. The results show evidence of large disparities in characteristics such as Indigenous employment and gender equity, and a preference for repository-mediated OA across the Australian universities.

These OKI indicators provide high-dimensional and complex signals that can be widely categorised into three groups of diversity, communication and coordination.

URL : Exploratory analysis of indicators for open knowledge institutions: a case study of Australian universities

DOI : http://dx.doi.org/10.17613/r2sx-xg40

Copyright and protection of scientific results: the experience of Russia, the United States and the countries of the Near East

Authors : D V Ponomareva, P B Maggs, AG Barabashev

In this article, the authors analyze the legal regulation of the copyright protection of the results of scientific activity in Russia, the United States and the countries of the Near East.

Considerable attention is paid to the review of key regulatory acts of the states operating in the designated area, as well as international treaties affecting aspects of the copyright protection of intellectual rights in the field of science.

The authors consider the main ways of protecting the scientific results by means of copyright. Special attention is paid to the analysis of the judicial practice of the states, which plays a vital role in defining approaches to the legal regulation of the scientific results.

The authors emphasized the similarity and difference between the systems of copyright protection of the results of scientific activity, the role of the judiciary in the functioning of such systems.

In the end the conclusion is made about the prospects for harmonization of the approaches to the legal regulation of the results of scientific activity by means of copyright.

The article will be relevant to practicing lawyers, researchers, students and everyone who is interested in IP law.

URL : Copyright and protection of scientific results: the experience of Russia, the United States and the countries of the Near East

DOI : https://doi.org/10.1088/1742-6596/1685/1/012018

How to achieve short-term green open access and long-term radical reform of scholarly communication. The BitViews Project as a test case

Author : Manfredi La Manna

The Open Access movement has reached adulthood, but not maturity: fewer than one-third of newly-published peer-reviewed articles are available open access (OA) and progress widening OA has stalled.

Scores of uncoordinated initiatives try to achieve universal OA, but academic journal publishing is still dominated by a handful of powerful commercial publishers. Individual authors show little interest in OA and indeed have to be mandated (see the UK REF or Plan S) to release their research on OA.

The BitViews Project is a low-cost, no-risk, high-return initiative to turn all academic journals «green» through a combination of blockchain technology, provision of appropriate incentives to authors, and a new crowdfunding mechanism.

The project is predicated on the active participation of individual libraries taking direct action. The paper will provide an interim report on the progress of the project and an account of how libraries and their various associations (both in the global South and in the global North) have reacted to the project.

The concluding section of the paper sketches a possible direction for academic journal publishing in the near future. Huge savings and increased efficiency can flow to the academy from finally dissolving its current one-sided contract with publishers and from reclaiming control of the peer-review process.

Practical and incentive-based suggestions are proposed for the transition from publisher-owned to academy-owned peer review.

URL : https://hal.archives-ouvertes.fr/hal-02544856