Étiquette : Scholarly Publishing

Catégories
EN

Does ChatGPT Ignore Article Retractions and Other Reliability Concerns?

Authors : Mike Thelwall, Marianna Lehtisaari, Irini Katsirea, Kim Holmberg, Er-Te Zheng

Large language models (LLMs) like ChatGPT seem to be increasingly used for information seeking and analysis, including to support academic literature reviews. To test whether the results might sometimes include retracted research, we identified 217 retracted or otherwise concerning academic studies with high altmetric scores and asked ChatGPT 4o-mini to evaluate their quality 30 times each.

Surprisingly, none of its 6510 reports mentioned that the articles were retracted or had relevant errors, and it gave 190 relatively high scores (world leading, internationally excellent, or close). The 27 articles with the lowest scores were mostly accused of being weak, although the topic (but not the article) was described as controversial in five cases (e.g., about hydroxychloroquine for COVID-19).

In a follow-up investigation, 61 claims were extracted from retracted articles from the set, and ChatGPT 4o-mini was asked 10 times whether each was true. It gave a definitive yes or a positive response two-thirds of the time, including for at least one statement that had been shown to be false over a decade ago.

The results therefore emphasise, from an academic knowledge perspective, the importance of verifying information from LLMs when using them for information seeking or analysis.

URL : Does ChatGPT Ignore Article Retractions and Other Reliability Concerns?

DOI : https://doi.org/10.1002/leap.2018

Catégories
EN

Scholarly Publications: Criteria, Types, and Recognition From the Researchers’ Perspective

Authors : Christian Kaier, Lisa Schilhan, Lisa Schilhan, Hilmar Brohmer

Based on a survey, this study investigates the perceptions of researchers in Austria concerning scholarly publications, exploring criteria, types, and emerging types of publication and their future recognition. The findings reveal that researchers value a diverse set of criteria, with content-related factors prioritised over formal ones. While traditional publication types remain dominant, novel forms, such as data publications and replication studies, are gaining recognition.

Researchers (n = 616) express a desire for broader recognition of diverse types of work, particularly data publications, teaching materials, and software or code. The findings also exhibit the predominantly research-to-research focus of scholarly communication, with limited emphasis on science-to-public engagement. An analysis of career stages shows that pre-doctoral and post-doctoral researchers tend to be more open-minded than professors regarding the future recognition of some novel types of publication.

There are evident differences between disciplines, highlighting the need for a nuanced, subject-specific approach to evaluation and documentation. Overall, the survey results call for greater consideration of novel publication types in research assessment and documentation. Accordingly, libraries should enhance their research support services to assist in the publication, documentation, and archiving of additional types of publication.

URL : Scholarly Publications: Criteria, Types, and Recognition From the Researchers’ Perspective

DOI : https://doi.org/10.1002/leap.2019

Catégories
EN

Inequity, precarity, and disparity: Exploring systemic and institutional barriers in open access publishing

Authors : Philips Ayeni, Vincent Larivière

Despite increasing advocacy for open access (OA), its uptake in some disciplines has remained low. Existing studies have linked the low uptake of OA in the humanities and social sciences (HSS) to disciplinary norms, limited funding for article processing charges (APCs), and researchers’ preferences.

However, there is a growing concern about inequity in the scholarly communication landscape, as OA publishing has remained unaffordable to many researchers. This study investigates systemic and institutional barriers to OA publishing in Canada, as well as strategies for improving the uptake of and equity in OA publishing.

Using semi-structured interviews, qualitative data was collected from 20 professors from the HSS disciplines of research-intensive universities in the country. Data was analyzed using the NVivo software, following the reflexive thematic analysis approach.

Findings revealed five systemic and institutional barriers to OA publishing: (1) unaffordable APCs; (2) precarious career stage and tenure requirements; (3) unequal privileges; (4) gender; and (5) conflicting and unsupportive institutional OA policies.

We conclude that there needs to be a concerted effort in promoting and funding viable and sustainable OA models, which removes the financial burden of OA publishing from researchers.

There is also an increasing need to promote OA culture within academia and provide institutional support for OA publishing. Notably, the model of academic scholarship that places prominence on journal metrics for tenure and promotion needs to be reformed. Some recommendations for reducing systemic and institutional barriers to OA publishing are provided.

URL : Inequity, precarity, and disparity: Exploring systemic and institutional barriers in open access publishing

DOI : https://doi.org/10.1177/09610006251353385

 

Catégories
EN

Scholarly publishing’s hidden diversity: How exclusive databases sustain the oligopoly of academic publishers

Authors : Simon van Bellen, Juan Pablo Alperin, Vincent Larivière

Global scholarly publishing has been dominated by a small number of publishers for several decades. This paper revisits the data on corporate control of scholarly publishing by analyzing the relative shares of scholarly journals and articles published by the major publishers and the “long tail” of smaller, independent publishers, using Dimensions and Web of Science (WoS).

The reduction of expenses for printing and distribution and the availability of open-source journal management tools may have contributed to the emergence of small publishers, while recently developed inclusive databases may allow for the study of these. Dimensions’ inclusive indexing revealed the number of scholarly journals and articles published by smaller publishers has been growing rapidly, especially since the onset of large-scale online publishing around 2000, resulting in a higher share of articles from smaller publishers.

In parallel, WoS shows increasing concentration within a few corporate publishers. For the 1980–2021 period, we retrieved 32% more articles from Dimensions compared to the more selective WoS.

Dimensions’ data showed the expansion of small publishers was most pronounced in the Social Sciences and the Arts and Humanities, but a similar trend is observed in the Natural Sciences and Engineering, and the Health Sciences. A major geographical divergence is also revealed, with English-speaking countries and/or those located in northwestern Europe relying heavily on major publishers for the dissemination of their research, while the rest of the world being relatively independent of the oligopoly.

Finally, independent journals publish more often in open access in general, and in Diamond open access in particular. We conclude that enhanced indexing and visibility of recently created, independent journals may favour their growth and stimulate global scholarly bibliodiversity.

URL : Scholarly publishing’s hidden diversity: How exclusive databases sustain the oligopoly of academic publishers

DOI : https://doi.org/10.1371/journal.pone.0327015

Catégories
EN

Attitudes towards Open Access Books in the European Research Area

Authors : Gabriela Manist, Maciej Mary, Magdalena Wnuk

This paper examines the challenges and opportunities of publishing Open Access (OA) books within the European Research Area (ERA), drawing on data collected through the PALOMERA project. Despite the growing interest in OA books, the landscape remains fragmented due to a lack of clear policies.

National policies are often sparse, with institutional and funder mandates typically focused on journal articles rather than monographs. An issue also highlighted is the marginalisation of non-English language works, which receive significantly less visibility than English-language publications.

Additionally, the perceived prestige of OA monographs remains a concern, with some scholars viewing them as less reputable than traditionally published works. This paper synthesises findings from 42 in-depth interviews to offer an overview of the current state of OA book publishing in Europe. It identifies areas for policy improvement to foster a more inclusive and sustainable OA landscape.

URL : Attitudes towards Open Access Books in the European Research Area

DOI : https://doi.org/10.53377/lq.21719

Catégories
FR

Publication en accès ouvert et coûts d’Article Processing Charges (APC) en Argentine

Auteur.ices : Fernanda Beigel, Osvaldo Gallardo, Soledad Gomez, Flavia Prado

La prolifération des revues en libre accès présente un dilemme difficile pour les chercheurs basés en Argentine, en raison des coûts élevés des APC (Article Processing Charges) qui créent un écart entre ceux qui peuvent payer pour publier et ceux qui ne le peuvent pas. Dans la première partie de ce travail, nous analysons le problème des frais APC dans différents pays d’Amérique latine et les leçons des études réalisées sur le cas de l’Argentine.

Nous décrivons ensuite la population de chercheurs faisant l’objet de l’enquête — les directeurs de projets financés au niveau national — ainsi que la méthode utilisée et ses résultats. Nous proposons une classification des pratiques de publication en libre accès avec APC en quatre groupes comprenant des chercheurs de plusieurs disciplines.

Dans chaque groupe, on observe des tendances différentes vers la publication en accès ouvert ou fermé, l’origine des fonds utilisés pour payer les APC et les disciplines dans lesquelles ce phénomène a plus ou moins d’impact. Enfin, nous analysons la section qualitative de l’enquête qui comprend les questions ouvertes auxquelles ont répondu une bonne partie des chercheurs, offrant un aperçu de leurs stratégies face au problème et les voies envisagées pour en atténuer les effets néfastes.

DOI : https://doi.org/10.4000/140p9

Catégories
FR

La publication de revues SHS en accès ouvert par les structures publiques de l’édition scientifique en Auvergne-Rhône-Alpes : une mise en pratique des politiques nationales ?

Autrice : Émilie Pineau

Ce mémoire propose un état des lieux de la publication de revues de sciences humaines et sociales en contexte de science ouverte en Auvergne-Rhône-Alpes. Même si l’objectif est d’évaluer la mise en pratique des politiques nationales, ce mémoire ne fournit pas une analyse exhaustive puisqu’il est spécifiquement ancré dans un espace régional.

L’auteur tente ici de comprendre le poids que la politique nationale exerce sur les structures de la documentation et de l’information scientifique. Comment sont dirigés les financements ? Quelles mutations induisent-ils ? Comment les pratiques éditoriales se transforment ?

URL : La publication de revues SHS en accès ouvert par les structures publiques de l’édition scientifique en Auvergne-Rhône-Alpes : une mise en pratique des politiques nationales ?

DUMAS : https://dumas.ccsd.cnrs.fr/dumas-05093586v1