Catégorie : EN

Publié le

Open science reforms: Strengths, challenges, and future directions

Author : Kathryn R. Wentzel

In this article, I comment on the potential benefits and limitations of open science reforms for improving the transparency and accountability of research, and enhancing the credibility of research findings within communities of policy and practice.

Specifically, I discuss the role of replication and reproducibility of research in promoting better quality studies, the identification of generalizable principles, and relevance for practitioners and policymakers.

Second, I suggest that greater attention to theory might contribute to the impact of open science practices, and discuss ways in which theory has implications for sampling, measurement and research design.

Ambiguities concerning the aims of preregistration and registered reports also are highlighted. In conclusion, I discuss structural roadblocks to open science reform and reflect on the relevance of these reforms for educational psychology.

URL : https://edarxiv.org/sgfy8/

Publié le

Fear of the academic fake? Journal editorials and the amplification of the ‘predatory publishing’ discourse

Authors : Kelsey Inouye, David Mills

This analysis of 229 editorials and opinion pieces published in science and medical journals explores the affective discourses used to characterise so‐called predatory publishing. Most (84%, n = 193) deploy one or more of three related categories of metaphorical and figurative language (fear, fakery and exploitation) to strengthen their rhetorical case.

This paper examines the deployment, co‐occurrence and amplification of this language across the science publishing system, focusing particularly on the role of major science journals in adopting and normalising this emotive discourse.

The analysis shows how few editorials offer alternative perspectives on these developments (n = 9), and their relative invisibility in scholarly debates.

URL : Fear of the academic fake? Journal editorials and the amplification of the ‘predatory publishing’ discourse

DOI : https://doi.org/10.1002/leap.1377

Publié le

The Pioneering Role of Sci in Post Publication Public Peer Review (P4R)

Authors : Ahmad Yaman Abdin, Muhammad Jawad Nasim, Yannick Ney, Claus Jacob

Scientists observe, discover, justify and eventually share their findings with the scientific community. Dissemination is an integral aspect of scientific discovery, since discoveries which go unnoticed have no or little impact on science.

Today, peer review is part of this process of scientific dissemination as it contributes proactively to the quality of a scientific article. As the numbers of scientific journals and scientific articles published therein are increasing steadily, processes such as the single-blind or double-blind peer review are facing a near collapse situation.

In fact, these traditional forms of reviewing have reached their limits and, because of this, are also increasingly considered as unfair, sloppy, superficial and even biased. In this manuscript, we propose forms of post-publication public peer review (P4R) as valuable alternatives to the traditional blind peer review system.

We describe how the journal Sci has explored such an approach and provide first empirical evidence of the benefits and also challenges, such a P4R approach faces.

URL : The Pioneering Role of Sci in Post Publication Public Peer Review (P4R)

DOI : https://doi.org/10.3390/publications9010013

Publié le

Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World

Author : Raminta Pranckutė

Nowadays, the importance of bibliographic databases (DBs) has increased enormously, as they are the main providers of publication metadata and bibliometric indicators universally used both for research assessment practices and for performing daily tasks. Because the reliability of these tasks firstly depends on the data source, all users of the DBs should be able to choose the most suitable one.

Web of Science (WoS) and Scopus are the two main bibliographic DBs. The comprehensive evaluation of the DBs’ coverage is practically impossible without extensive bibliometric analyses or literature reviews, but most DBs users do not have bibliometric competence and/or are not willing to invest additional time for such evaluations.

Apart from that, the convenience of the DB’s interface, performance, provided impact indicators and additional tools may also influence the users’ choice. The main goal of this work is to provide all of the potential users with an all-inclusive description of the two main bibliographic DBs by gathering the findings that are presented in the most recent literature and information provided by the owners of the DBs at one place.

This overview should aid all stakeholders employing publication and citation data in selecting the most suitable DB.

URL : Web of Science (WoS) and Scopus: The Titans of Bibliographic Information in Today’s Academic World

DOI : https://doi.org/10.3390/publications9010012

Publié le

Research impact evaluation and academic discourse

Author : Marta Natalia Wróblewska

The introduction of ‘impact’ as an element of assessment constitutes a major change in the construction of research evaluation systems. While various protocols of impact evaluation exist, the most articulated one was implemented as part of the British Research Excellence Framework (REF).

This paper investigates the nature and consequences of the rise of ‘research impact’ as an element of academic evaluation from the perspective of discourse. Drawing from linguistic pragmatics and Foucauldian discourse analysis, the study discusses shifts related to the so-called Impact Agenda on four stages, in chronological order: (1) the ‘problematization’ of the notion of ‘impact’, (2) the establishment of an ‘impact infrastructure’, (3) the consolidation of a new genre of writing–impact case study, and (4) academics’ positioning practices towards the notion of ‘impact’, theorized here as the triggering of new practices of ‘subjectivation’ of the academic self.

The description of the basic functioning of the ‘discourse of impact’ is based on the analysis of two corpora: case studies submitted by a selected group of academics (linguists) to REF2014 (no = 78) and interviews (n = 25) with their authors.

Linguistic pragmatics is particularly useful in analyzing linguistic aspects of the data, while Foucault’s theory helps draw together findings from two datasets in a broader analysis based on a governmentality framework. This approach allows for more general conclusions on the practices of governing (academic) subjects within evaluation contexts.

URL : Research impact evaluation and academic discourse

DOI : https://doi.org/10.1057/s41599-021-00727-8

Publié le

Assessment of gender divide in scientific communities

Authors : Antonio De Nicola, Gregorio D’Agostino

Increasing evidence of women’s under-representation in some scientific disciplines is prompting researchers to expand our understanding of this social phenomenon. Moreover, any countermeasures proposed to eliminate this under-representation should be tailored to the actual reasons for this different participation.

Here, we take a multi-dimensional approach to assessing gender differences in science by representing scientific communities as social networks, and using data analytics, complexity science methods, and semantic methods to measure gender differences in the context, the attitude and the success of scientists.

We apply this approach to four scientific communities in the two fields of computer science and information systems using the network of authors at four different conferences. For each discipline, one conference is based in Italy and attracts mostly Italians, while one conference is international in both location and participants.

The present paper provides evidence against common narratives that women’s under-representation is due to women’s limited skills and/or less social centrality.

URL : Assessment of gender divide in scientific communities

DOI : https://doi.org/10.1007/s11192-021-03885-3

Publié le

Accuracy of PubMed-based author lists of publications and use of author identifiers to address author name ambiguity: a cross-sectional study

Authors : Paul Sebo, Sylvain de Lucia, Nathalie Vernaz

Objective

To assess the accuracy of PubMed-based author lists of publications and use of author identifiers to address author name ambiguity.

Methods

In this Swiss study conducted in 2019, 300 hospital-based senior physicians were asked to generate a list of their publications in PubMed and complete a questionnaire (type of query used, number of errors in their list of publications, knowledge and use of ORCID and ResearcherID).

Results

156 physicians (52%) agreed to participate, 145 of whom published at least one article (mean number of publications: 60 (SD 73)). Only 17% used the advanced search option. On average, there were 5 articles in the lists that were not co-authored by participants (advanced search: 1.0 (SD 2.6) vs. 5.9 (SD 13.9), p value 0.02) and 3 articles co-authored by participants that did not appear in the lists (advanced search: 1.5 (SD 2.0) vs. 3.6 (SD 8.4), p-value 0.05). Although 82% were aware of ORCID, only 16% added all their articles (39% and 6% respectively for ResearcherID).

Conclusions

When used by senior physicians, the advanced search in PubMed is accurate for retrieving authors’ publications. Author identifiers are only used by a minority of physicians and are therefore not recommended in this context, as they would lead to inaccurate results.

URL : Accuracy of PubMed-based author lists of publications and use of author identifiers to address author name ambiguity: a cross-sectional study

DOI : https://doi.org/10.1007/s11192-020-03845-3