Evaluative altmetrics: is there evidence for its application to research evaluation?

Posté le par

Authors : Wenceslao Arroyo-Machado, Daniel Torres-Salinas

Introduction

Altmetrics have been demonstrated as a promising tool for analyzing scientific communication on social media. Nevertheless, its application for research evaluation remains underdeveloped, despite the advancement of research in the study of diverse scientific interactions.

Methods

This paper develops a method for applying altmetrics in the evaluation of researchers, focusing on a case study of the Environment/Ecology ESI field publications by researchers at the University of Granada. We considered Twitter as a mirror of social attention, news outlets as media, and Wikipedia as educational, exploring mentions from these three sources and the associated actors in their respective media, contextualizing them using various metrics.

Results

Our analysis evaluated different dimensions such as the type of audience, local attention, engagement generated around the mention, and the profile of the actor. Our methodology effectively provided dashboards that gave a comprehensive view of the different instances of social attention at the author level.

Discussion

The use of altmetrics for research evaluation presents significant potential, as shown by our case study. While this is a novel method, our results suggest that altmetrics could provide valuable insights into the social attention that researchers garner. This can be an important tool for research evaluation, expanding our understanding beyond traditional metrics.

URL : Evaluative altmetrics: is there evidence for its application to research evaluation?

DOI : https://doi.org/10.3389/frma.2023.1188131

Données ouvertes liées et recherche historique : un changement de paradigme

Posté le par

Auteur/Author : Francesco Beretta

Dans le contexte de la transition numérique, le Web sémantique et les données ouvertes liées (linked open data [LOD], en anglais) jouent un rôle de plus en plus central, car ils permettent de construire des « graphes d’information » (knowledge graphs, en anglais) reliant l’ensemble des ressources du Web.

Ce phénomène interroge les sciences historiques et soulève la question d’un changement de paradigme. Après avoir précisé ce qu’il faut entendre par « données », l’article analyse la place qu’elles occupent dans le processus de production du savoir.

Il présente les principales composantes du changement de paradigme, en particulier le potentiel des LOD et d’une sémantique robuste en tant que véhicules d’une information factuelle de qualité, intelligible et réutilisable. S’ensuit une présentation des projets d’infrastructure réalisés au sein du Laboratoire de recherche historique Rhône-Alpes (Larhra) : symogih.org, ontome.net, geovistory.org.

Leur but est de faciliter la transition numérique grâce à un outillage construit en cohérence avec l’épistémologie des sciences historiques et de contribuer à la réalisation d’un « graphe d’information » disciplinaire.

URL : Données ouvertes liées et recherche historique : un changement de paradigme

DOI : https://doi.org/10.4000/revuehn.3349

(Semi)automated disambiguation of scholarly repositories

Posté le par

Authors  : Miriam Baglioni, Andrea Mannocci, Gina Pavone, Michele De Bonis, Paolo Manghi

The full exploitation of scholarly repositories is pivotal in modern Open Science, and scholarly repository registries are kingpins in enabling researchers and research infrastructures to list and search for suitable repositories. However, since multiple registries exist, repository managers are keen on registering multiple times the repositories they manage to maximise their traction and visibility across different research communities, disciplines, and applications.

These multiple registrations ultimately lead to information fragmentation and redundancy on the one hand and, on the other, force registries’ users to juggle multiple registries, profiles and identifiers describing the same repository. Such problems are known to registries, which claim equivalence between repository profiles whenever possible by cross-referencing their identifiers across different registries.

However, as we will see, this “claim set” is far from complete and, therefore, many replicas slip under the radar, possibly creating problems downstream.

In this work, we combine such claims to create duplicate sets and extend them with the results of an automated clustering algorithm run over repository metadata descriptions. Then we manually validate our results to produce an “as accurate as possible” de-duplicated dataset of scholarly repositories.

URL : https://arxiv.org/abs/2307.02647

Gender-Related Differences in the Citation Impact of Scientific Publications and Improving the Authors’ Productivity

Posté le par

Authors : Oleksandr Kuchanskyi, Yurii Andrashko, Andrii Biloshchytskyi, Serik Omirbayev, Aidos Mukhatayev, Svitlana Biloshchytska, Adil Faizullin

The article’s purpose is an analysis of the citation impact of scientific publications by authors of different gender compositions. The page method was chosen to calculate the citation impact of scientific publications, and the obtained results allowed to estimate the impact of the scientific publications based on the number of citations.

The normalized citation impact is calculated according to nine subsets of scientific publications that correspond to patterns of different gender compositions of authors. Also, these estimates were calculated for each country with which the authors of the publications are affiliated.

The Citation database, Network Dataset (Ver. 13), was chosen for the scientometric analysis. The dataset includes more than 5 million scientific publications and 48 million citations. Most of the publications in the dataset are from the STEM field. The results indicate that articles with a predominantly male composition are cited more than articles with a mixed or female composition of authors in this direction.

Analysis of advantages in dynamics indicates that in the last decade, in developed countries, there has been a decrease in the connection between the citation impact of scientific publications and the gender composition of their authors.

However, the obtained results still confirm the presence of gender inequality in science, which may be related to socioeconomic and cultural characteristics, natural homophily, and other factors that contribute to the appearance of gender gaps.

An essential consequence of overcoming these gaps, including in science, is ensuring the rights of people in all their diversity.

URL : Gender-Related Differences in the Citation Impact of Scientific Publications and Improving the Authors’ Productivity

DOI : https://doi.org/10.3390/publications11030037

Research Outputs as Testimony & the APC as Testimonial Injustice in the Global South

Posté le par

Author : Emily Cox

Research outputs are a form of testimony with researchers serving as expert testifiers. Research outputs align with philosophical understandings of testimony, as research represents an everyday, informal communicative act. If research outputs are a form of testimony, they are open to ethical and epistemic critique.

The open access (OA) article processing charge (APC) in the Global South serves as an apt topic for this critique. The APC is a financial barrier to publication for Southern researchers, and thus raises problems around epistemic and testimonial injustice.

The second half of this paper examines a variety of equity issues in prestige scholarly publishing and OA APCs, which are then more fully illustrated by the development of a hypothetical testimonial injustice case study focused on a researcher working in Latin America.

Ultimately, I propose the following argument: If people use journal rankings as a guide to which testimony they should take seriously and the OA APC publishing model systematically excludes researchers from the Global South on non-meritocratic grounds, then the OA APC publishing model contributes to testimonial injustice.

This paper is a philosophical, theory-based discussion that contributes to research about equitable systems of scholarship.

URL : Research Outputs as Testimony & the APC as Testimonial Injustice in the Global South

DOI : https://doi.org/10.5860/crl.84.4.513

Open Access Author Contracts and Alignment with the Open Ethos: A Global Study

Posté le par

Authors : Melissa H. Cantrell, Sarah Wipperman

Author contracts in scholarly publishing serve to outline the rights and permissions for each party in the use and redistribution of a work throughout the life of its copyright term. Although rights and licensing expectations for open access publishing—the “open access ethos”—have been detailed in the Budapest Declaration, Plan S Principles, and other documentation, studies that explore the implementation of these ideals in contracts between authors and publishers have been limited in focus and scope.

This study seeks to initiate a holistic approach toward evaluating open access journal agreements that is not limited by region or discipline, with the aim of discerning best practices as well as delineating common points of deviation. The authors distributed a survey to contacts from journals in the Directory of Open Access Journals (DOAJ), including both journals with and without a DOAJ Seal.

The results suggest that DOAJ Seal status is central to alignment with the open access ethos and that there is more misunderstanding about the importance of copyright and licensing terms than shown in previous research. This research contributes to discussions pursuing a future of open access publishing that supports authors’ rights as a central tenet.

URL : Open Access Author Contracts and Alignment with the Open Ethos: A Global Study

DOI : https://doi.org/10.5860/crl.84.4.605

Monitoring Organisational Article Processing Charges (APCs) using Bibliographic Information Sources: Turku University Library Case

Posté le par

Authors : Anna-Kaarina Linna, Irene Ylönen, Anna Salmi

As open access publishing has become more widespread and required by research funders and the research community, the management and monitoring of article processing charges (APCs) have emerged as an important task in research organisations around the world. Within this tendency, a question of the comprehensiveness of organisational APC monitoring has become relevant.

This case study demonstrates how the comprehensiveness of in-house APC monitoring can be evaluated using international bibliographic information sources like Web of Science and Scopus, where it is possible to identify the corresponding author, as well as Unpaywall and DOAJ, which contain information about the open access statuses and APCs of articles.

Based on study results, it can be assumed that the organisation’s in-house bookkeeping has succeeded in registering 52 percent of APC invoices while 48 percent have not been identified.

The results show that the number of unreported publications that have been openly published and whose corresponding author is affiliated with the university is almost equal to those registered in the university’s institutional APC report.

The study describes the stages of data collection and processing in order of implementation, which allows a similar review to be feasible in another organisation.

At the end of the article, development proposals are presented for both the organisations’ in-house data collection and the content of publishers’ invoices.

URL : Monitoring Organisational Article Processing Charges (APCs) using Bibliographic Information Sources: Turku University Library Case

DOI : https://doi.org/10.53377/lq.13361