Archives des mots-clés : scientific communication

Improving evidence-based practice through preregistration of applied research: Barriers and recommendations

Posté le par

Authors : Thomas Rhys Evans, Peter Branney, Andrew Clements, Ella Hatton

Preregistration is the practice of publicly publishing plans on central components of the research process before access to, or collection, of data. Within the context of the replication crisis, open science practices like preregistration have been pivotal in facilitating greater transparency in research.

However, such practices have been applied nearly exclusively to basic academic research, with rare consideration of the relevance to applied and consultancy-based research. This is particularly problematic as such research is typically reported with very low levels of transparency and accountability despite being disseminated as influential gray literature to inform practice.

Evidence-based practice is best served by an appreciation of multiple sources of quality evidence, thus the current review considers the potential of preregistration to improve both the accessibility and credibility of applied research toward more rigorous evidence-based practice.

The current three-part review outlines, first, the opportunities of preregistration for applied research, and second, three barriers – practical challenges, stakeholder roles, and the suitability of preregistration.

Last, this review makes four recommendations to overcome these barriers and maximize the opportunities of preregistration for academics, industry, and the structures they are held within – changes to preregistration templates, new types of templates, education and training, and recognition and structural changes.

URL : Improving evidence-based practice through preregistration of applied research: Barriers and recommendations

DOI : https://doi.org/10.1080/08989621.2021.1969233

Who are the users of national open access journals? The case of the Finnish Journal.fi platform

Posté le par

Authors : Janne Pölönen, Sami Syrjämäki, Antti-Jussi Nygård, Björn Hammarfelt

In this paper we study the diversity of users of open access articles on the Finnish Journal.fi platform. This platform hosts around hundred open access journals from Finland publishing in different fields and mainly Finnish and English languages.

The study is based on an online survey, conducted on 48 journals during Spring 2020, in which visitors were asked to indicate their background and allow their location and download behaviour be tracked. Among 668 survey participants, the two largest groups were students (40%) and researchers (36%), followed by private citizens (8%), other experts (7%) and teachers (5%).

Other identified user categories include journalists, civil servants, entrepreneurs and politicians. While new publications attract a considerable share of the views, there is still a relatively large interest, especially among students, in older materials.

Our findings indicate that Finnish language publications are particularly important for reaching students, citizens, experts and politicians. Thus, open access to publications in national languages is vital for the local relevance and outreach of research.

URL : Who are the users of national open access journals? The case of the Finnish Journal.fi platform

DOI : https://doi.org/10.1002/leap.1405

Introducing a data availability policy for journals at IOP Publishing: Measuring the impact on authors and editorial teams

Posté le par

Authors : Jade Holt, Andrew Walker, Phill Jones

As the open research movement continues to gather pace, a number of publishers, funders, and institutions are mandating the sharing of underlying research data. At the same time, concerns about introducing extra quality control steps around data availability statements (DAS) are driving a discussion about the best way to make data more open without slowing down publication.

This article describes a pilot project to introduce a new Open Data policy to three IOP Publishing (IOPP) journals as part of IOPP’s commitment to increasing transparency and support for open science.

An investigation was undertaken using an automated workflow monitoring tool to understand the impact of this change on authors and the editorial staff. Changes in revised submission processing times and how often manuscripts were returned to the author were measured.

An overall increase in the time editorial staff spent processing manuscripts was found as well as an increase in the number of times manuscripts were returned to authors. Detailed analysis shows that manuscripts in which authors claim in the DAS to have included data within the manuscript were the most strongly affected. Steps to mitigate the effects through improved author communication were found to be effective.

URL : Introducing a data availability policy for journals at IOP Publishing: Measuring the impact on authors and editorial teams

DOI : https://doi.org/10.1002/leap.1386

Classification and analysis of PubPeer comments: How a web journal club is used

Posté le par

Author : José Luis Ortega

This study explores the use of PubPeer by the scholarly community, to understand the issues discussed in an online journal club, the disciplines most commented on, and the characteristics of the most prolific users.

A sample of 39,985 posts about 24,779 publications were extracted from PubPeer in 2019 and 2020. These comments were divided into seven categories according to their degree of seriousness (Positive review, Critical review, Lack of information, Honest errors, Methodological flaws, Publishing fraud, and Manipulation).

The results show that more than two-thirds of comments are posted to report some type of misconduct, mainly about image manipulation. These comments generate most discussion and take longer to be posted. By discipline, Health Sciences and Life Sciences are the most discussed research areas.

The results also reveal “super commenters,” users who access the platform to systematically review publications. The study ends by discussing how various disciplines use the site for different purposes.

URL : Classification and analysis of PubPeer comments: How a web journal club is used

DOI : https://doi.org/10.1002/asi.24568

Structure of Research Article Abstracts in Political Science: A Genre-Based Study

Posté le par

Author : Hesham Suleiman Alyousef

The research article (RA) abstract is the first section researchers read to determine its relevance to their interests. Researchers need to possess an implicit knowledge of the rhetorical move structure and organization of this section. Unlike most scientific disciplines, political science RA abstracts are unstructured, that is, with no headings (or moves), which makes it more challenging.

To the best of our knowledge, the rhetorical move structure in high readership political science RA abstracts has not been researched. This study investigated (a) the rhetorical move structure in 120 political science RA abstracts from six high-impact journals, (b) the most common move patterns, and (c) the move(s) occupying most textual space. The findings indicated the lack of obligatory moves. A move structure model for writing a political science RA abstract is proposed, comprising four conventional moves (Introduction [I]–Purpose [P]–Methods [M]–Results [R]) and two optional step/move, namely, Research Gap step and Discussion [D] move. The results also showed that the first most frequent move pattern is I-P-M-R-D, followed by I-P-M-R and the I-P-R-D.

The fact that an RA abstract summarizes the whole RA results in move embedding, particularly in the four moves, I-P-M-R. The findings revealed the importance of the Results move as it occupied nearly one third of text space. The results may contribute to the fields of discourse and genre studies.

They may provide invaluable insights for novice political science researchers attempting to publish their work in high-ranking journals. The proposed move structure model can act as a guide for English for Academic Purposes (EAP)/English for Specific Purposes (ESP) tutors and political science authors.

URL : Structure of Research Article Abstracts in Political Science: A Genre-Based Study

DOI : https://doi.org/10.1177%2F21582440211040797

Visual Summary Identification From Scientific Publications via Self-Supervised Learning

Posté le par

Authors : Shintaro Yamamoto, Anne Lauscher, Simone Paolo Ponzetto, Goran Glavaš, Shigeo Morishima

The exponential growth of scientific literature yields the need to support users to both effectively and efficiently analyze and understand the some body of research work. This exploratory process can be facilitated by providing graphical abstracts–a visual summary of a scientific publication.

Accordingly, previous work recently presented an initial study on automatic identification of a central figure in a scientific publication, to be used as the publication’s visual summary.

This study, however, have been limited only to a single (biomedical) domain. This is primarily because the current state-of-the-art relies on supervised machine learning, typically relying on the existence of large amounts of labeled data: the only existing annotated data set until now covered only the biomedical publications.

In this work, we build a novel benchmark data set for visual summary identification from scientific publications, which consists of papers presented at conferences from several areas of computer science. We couple this contribution with a new self-supervised learning approach to learn a heuristic matching of in-text references to figures with figure captions.

Our self-supervised pre-training, executed on a large unlabeled collection of publications, attenuates the need for large annotated data sets for visual summary identification and facilitates domain transfer for this task. We evaluate our self-supervised pretraining for visual summary identification on both the existing biomedical and our newly presented computer science data set.

The experimental results suggest that the proposed method is able to outperform the previous state-of-the-art without any task-specific annotations.

URL : Visual Summary Identification From Scientific Publications via Self-Supervised Learning

DOI : https://doi.org/10.3389/frma.2021.719004

How Long Can We Build It? Ensuring Usability of a Scientific Code Base

Posté le par

Authors : Klaus Rechert, Jurek Oberhauser, Rafael Gieschke

Software and in particular source code became an important component of scientific publications and henceforth is now subject of research data management. Maintaining source code such that it remains a usable and a valuable scientific contribution is and remains a huge task.

Not all code contributions can be actively maintained forever. Eventually, there will be a significant backlog of legacy source-code. In this article we analyse the requirements for applying the concept of long-term reusability to source code.

We use simple case study to identify gaps and provide a technical infrastructure based on emulator to support automated builds of historic software in form of source code.

URL : How Long Can We Build It? Ensuring Usability of a Scientific Code Base

DOI : https://doi.org/10.2218/ijdc.v16i1.770