Catégories
EN

Generative AI and the future of scientometrics: current topics and future questions

Authors : Benedetto Lepori, Jens Peter Andersen, Karsten Donnay

The aim of this paper is to review the use of GenAI in scientometrics, and to begin a debate on the broader implications for the field. First, we provide an introduction on GenAI’s generative and probabilistic nature as rooted in distributional linguistics.

And we relate this to the debate on the extent to which GenAI might be able to mimic human ‘reasoning’. Second, we leverage this distinction for a critical engagement with recent experiments using GenAI in scientometrics, including topic labelling, the analysis of citation contexts, predictive applications, scholars’ profiling, and research assessment.

GenAI shows promise in tasks where language generation dominates, such as labelling, but faces limitations in tasks that require stable semantics, pragmatic reasoning, or structured domain knowledge. However, these results might become quickly outdated. Our recommendation is, therefore, to always strive to systematically compare the performance of different GenAI models for specific tasks.

Third, we inquire whether, by generating large amounts of scientific language, GenAI might have a fundamental impact on our field by affecting textual characteristics used to measure science, such as authors, words, and references. We argue that careful empirical work and theoretical reflection will be essential to remain capable of interpreting the evolving patterns of knowledge production.

DOI : https://doi.org/10.48550/arXiv.2507.00783

 

Catégories
EN

Scholarly publishing’s hidden diversity: How exclusive databases sustain the oligopoly of academic publishers

Authors : Simon van Bellen, Juan Pablo Alperin, Vincent Larivière

Global scholarly publishing has been dominated by a small number of publishers for several decades. This paper revisits the data on corporate control of scholarly publishing by analyzing the relative shares of scholarly journals and articles published by the major publishers and the “long tail” of smaller, independent publishers, using Dimensions and Web of Science (WoS).

The reduction of expenses for printing and distribution and the availability of open-source journal management tools may have contributed to the emergence of small publishers, while recently developed inclusive databases may allow for the study of these. Dimensions’ inclusive indexing revealed the number of scholarly journals and articles published by smaller publishers has been growing rapidly, especially since the onset of large-scale online publishing around 2000, resulting in a higher share of articles from smaller publishers.

In parallel, WoS shows increasing concentration within a few corporate publishers. For the 1980–2021 period, we retrieved 32% more articles from Dimensions compared to the more selective WoS.

Dimensions’ data showed the expansion of small publishers was most pronounced in the Social Sciences and the Arts and Humanities, but a similar trend is observed in the Natural Sciences and Engineering, and the Health Sciences. A major geographical divergence is also revealed, with English-speaking countries and/or those located in northwestern Europe relying heavily on major publishers for the dissemination of their research, while the rest of the world being relatively independent of the oligopoly.

Finally, independent journals publish more often in open access in general, and in Diamond open access in particular. We conclude that enhanced indexing and visibility of recently created, independent journals may favour their growth and stimulate global scholarly bibliodiversity.

URL : Scholarly publishing’s hidden diversity: How exclusive databases sustain the oligopoly of academic publishers

DOI : https://doi.org/10.1371/journal.pone.0327015

Catégories
EN

Peer Review as Structured Commentary: Immutable Identity, Public Dialogue, and Reproducible Scholarship

Author : Craig Steven Wright

This paper reconceptualises peer review as structured public commentary. Traditional academic validation is hindered by anonymity, latency, and gatekeeping. We propose a transparent, identity-linked, and reproducible system of scholarly evaluation anchored in open commentary.

Leveraging blockchain for immutable audit trails and AI for iterative synthesis, we design a framework that incentivises intellectual contribution, captures epistemic evolution, and enables traceable reputational dynamics.

This model empowers fields from computational science to the humanities, reframing academic knowledge as a living process rather than a static credential.

DOI : https://doi.org/10.48550/arXiv.2506.22497

Catégories
EN

Who funds what: An assessment of research funding networks in data papers

Authors : Yurdagül Ünal, Müge Akbulut

This study examines the role of funding collaborations in shaping the production and dissemination of scientific information through data papers, a rapidly growing academic publication format.

To the best of our knowledge, there are no studies investigating, and evaluating the data paper-funder relationship. The goal of this study was, therefore, to evaluate data papers and funder information in detail, extracted from the data papers themselves, in order to reveal the collaborative characteristics of funders, and to provide guidance to researchers and funding agencies.

Data papers published between 2006–2017 were downloaded from the Web of Science database. The same papers were retrieved from Dimension, which offered more detailed category classifications. These classifications were then utilized for further analysis based on categories. The names of funders were standardized by matching them using the Crossref funder registry, and associated funding metadata.

A statistical, and social network analysis were performed. The top funding country was the USA; the top funding institution was the U.S. Department of Health and Human Services, National Institutes of Health. The collaboration network among funders exhibited relatively low density.

A collaboration network of 1197 links between 69 countries was created. The USA had connections with 62 countries. Our study is important because it standardizes the funding data for data papers by associating them with Crossref funding metadata.

The widespread increase of data papers, and their relatively dispersed funding among a variety of funders points to the need for research evaluating collaborations between funders, as important both for the funded researchers, and for understanding and optimizing the shortcomings of current funding management.

URL : Who funds what: An assessment of research funding networks in data papers

DOI : https://doi.org/10.1177/02666669251352185

Catégories
EN

The role of preprints in open science: Accelerating knowledge transfer from science to technology

Authors : Zhiqi Wang, Yue Chen, Chun Yang

Preprints have become increasingly essential in the landscape of open science, facilitating not only the exchange of knowledge within the scientific community but also bridging the gap between science and technology.

However, the impact of preprints on technological innovation, given their unreviewed nature, remains unclear. This study fills this gap by conducting a comprehensive scientometric analysis of patent citations to bioRxiv preprints submitted between 2013 and 2021, measuring and accessing the contribution of preprints in accelerating knowledge transfer from science to technology.

Our findings reveal a growing trend of patent citations to bioRxiv preprints, with a notable surge in 2020, primarily driven by the COVID-19 pandemic. Preprints play a critical role in accelerating innovation, not only expedite the dissemination of scientific knowledge into technological innovation but also enhance the visibility of early research results in the patenting process, while journals remain essential for academic rigor and reliability. w

The substantial number of post-online-publication patent citations highlights the critical role of the open science model-particularly the « open access » effect of preprints-in amplifying the impact of science on technological innovation.

This study provides empirical evidence that open science policies encouraging the early sharing of research outputs, such as preprints, contribute to more efficient linkage between science and technology, suggesting an acceleration in the pace of innovation, higher innovation quality, and economic benefits.

DOI : https://doi.org/10.48550/arXiv.2506.20225

Catégories
EN

Open access publishing in an African context: Notable improvements and recurring challenges

Authors : Sodiq Onaolapo, Philips Ayeni, Siphamandla Mncube

Open access publishing has been promoted as a pivotal means of bridging the gap in knowledge access and usage. Despite the growing support for open access publishing globally, little is known about African scholars’ engagement with open access publishing and the barriers limiting their open access publishing practices.

Using a survey research design, data was collected from 241 researchers from selected universities in Africa, such as Nigerian, Kenyan and South African universities. The data was collected using online surveys and analysed using the descriptive statistics of frequency counts and percentages. T

he study reveals that while most of the respondents had published open access articles (78.01%) and had a positive perception of the quality of open access journals (73.45%) and editorial teams, more than half were still limited by article processing charges (58.51%) as they had no funding for their research.

Although African researchers are embracing open access publishing more now than they were historically, barriers such as article processing charges and the prolonged response time from reviewers continue to pose a serious challenge to open access uptake in Africa. This study proposes five recommendations for improving open access uptake in African and Global South countries.

URL : Open access publishing in an African context: Notable improvements and recurring challenges

DOI : https://doi.org/10.1177/03400352251351113

Catégories
EN

Linking Data Citation to Repository Visibility: An Empirical Study

Authors  : Fakhri Momeni, Janete Saldanha Bach, Brigitte Mathiak, Peter Mutschke

In today’s data-driven research landscape, dataset visibility and accessibility play a crucial role in advancing scientific knowledge. At the same time, data citation is essential for maintaining academic integrity, acknowledging contributions, validating research outcomes, and fostering scientific reproducibility.

As a critical link, it connects scholarly publications with the datasets that drive scientific progress. This study investigates whether repository visibility influences data citation rates. We hypothesize that repositories with higher visibility, as measured by search engine metrics, are associated with increased dataset citations.

Using OpenAlex data and repository impact indicators (including the visibility index from Sistrix, the h-index of repositories, and citation metrics such as mean and median citations), we analyze datasets in Social Sciences and Economics to explore their relationship. Our findings suggest that datasets hosted on more visible web domains tend to receive more citations, with a positive correlation observed between web domain visibility and dataset citation counts, particularly for datasets with at least one citation. However, when analyzing domain-level citation metrics, such as the h-index, mean, and median citations, the correlations are inconsistent and weaker.

While higher visibility domains tend to host datasets with greater citation impact, the distribution of citations across datasets varies significantly. These results suggest that while visibility plays a role in increasing citation counts, it is not the sole factor influencing dataset citation impact. Other elements, such as dataset quality, research trends, and disciplinary norms, can also contribute to citation patterns.

URL : Linking Data Citation to Repository Visibility: An Empirical Study

DOI : https://doi.org/10.48550/arXiv.2506.09530