The Role of Academic Libraries in Scientific Production Evaluation – the Experience of University of Zagreb, Croatia

Authors : Branka Marijanović, Tatijana Petrić, Zrinka Udiljak Bugarinovski, Višnja Novosel

Since internationally visible scientific productivity is a criterion for state evaluation of Croatian academic and scientific institutions and their scientists, Croatian academic libraries have a key role in quantitative evaluation of scientific productivity using methods such as bibliometrics, scientometrics and the like.

The aim of this case study is to identify and illustrate the current situation of library services for evaluating scientific production at the University of Zagreb, Croatia, and to make recommendations for the further development of such services, which could serve as a framework for the systematic implementation of this type of service in all libraries at the University of Zagreb and beyond.

More specifically, the purpose of this paper was to identify the existence of the bibliometric services in the libraries of the University of Zagreb (UNIZG), examine the status and involvement of university librarians in the academic advancement procedures and to identify the required competences for bibliometric experts in Croatia.

The research was conducted using the content analysis method, the survey method, and the focus group method. The research results show that although UNIZG libraries are integrated into the system of academic promotion and the role of UNIZG libraries is enshrined in Croatian regulations, the bibliometric service is not standardised at the University level.

The results also indicate that the service needs to be strengthened in terms of training of professional staff and greater investment in staff capacity and infrastructure.

The fact that the study was conducted at a single Croatian university is a possible limitation that could relate to the application of guidelines for further actions and the development of bibliometric services at national level. It would therefore be desirable to conduct future research to identify the situation at other Croatian universities as well.

It would also be necessary to determine the open science and open access policies at UNIZG through further research and, in this context, to establish guidelines for possible improvements in the processes of evaluating scientific productivity.

The results of this study make an important contribution to the possible future positioning of university libraries and UNIZG librarians in the process of evaluating scientific productivity. In addition, some practical advice is given so that this case study may be a good introductory overview for the wider academic community in relation to this topic.

URL : The Role of Academic Libraries in Scientific Production Evaluation – the Experience of University of Zagreb, Croatia

DOI : https://doi.org/10.53377/lq.13523

Gender diversity and publication activity—an analysis of STEM in the UK

Authors : Yasaman Sarabi, Matthew Smith

Gender diversity in STEM remains a significant issue, as the field continues to be a male dominated one, despite increased attention on the subject. This article examines the interplay between gender diversity on projects funded by a major UK research council, the Engineering and Physical Sciences Research Council, and the publication activity of a project, as measured by the average journal quality of project publication output, over a 10-year period.

The proportion of female representation and leadership on these projects remains very low. For the projects examined as part of this study, over 70% of these projects have no female representation, and less than 15% have a female lead.

This study does not find a significant relationship between gender diversity and journal quality output. This study highlights that an important avenue for future work is the development of alternative metrics to assess the performance of research projects in a discipline characterized by very low levels of gender diversity, to fully unpack the impact of project team gender diversity on project output activity.

URL : Gender diversity and publication activity—an analysis of STEM in the UK

DOI : https://doi.org/10.1093/reseval/rvad008

How unpredictable is research impact? Evidence from the UK’s Research Excellence Framework

Authors : Ohid Yaqub, Dmitry Malkov, Josh Siepel

Although ex post evaluation of impact is increasingly common, the extent to which research impacts emerge largely as anticipated by researchers, or as the result of serendipitous and unpredictable processes, is not well understood.

In this article, we explore whether predictions of impact made at the funding stage align with realized impact, using data from the UK’s Research Excellence Framework (REF). We exploit REF impact cases traced back to research funding applications, as a dataset of 2,194 case–grant pairs, to compare impact topics with funder remits.

For 209 of those pairs, we directly compare their descriptions of ex ante and ex post impact. We find that impact claims in these case–grant pairs are often congruent with each other, with 76% showing alignment between anticipated impact at funding stage and the eventual claimed impact in the REF. Co-production of research, often perceived as a model for impactful research, was a feature of just over half of our cases.

Our results show that, contrary to other preliminary studies of the REF, impact appears to be broadly predictable, although unpredictability remains important. We suggest that co-production is a reasonably good mechanism for addressing the balance of predictable and unpredictable impact outcomes.

URL : How unpredictable is research impact? Evidence from the UK’s Research Excellence Framework

DOI : https://doi.org/10.1093/reseval/rvad019

Enquête quantitative sur les pratiques et les besoins des chercheurs sur la gestion des données de la recherche, algorithmes et codes sources dans les établissements du site toulousain

Authors : Danielle Brunet, Soraya Demay, Pierre Diaz, Borbala Goncz, Laure Leclerc, Flora Poupinot, Sibilla Michelle

Le Comité de réflexion pour le partage et la valorisation des données de la recherche et la coordination de la Science Ouverte (CéSO) de l’Université de Toulouse a réalisé une enquête quantitative sur la gestion des données de la recherche, algorithmes et codes sources.

Adressée à l’ensemble de la communauté scientifique du site toulousain, son objectif était de produire un état des lieux des pratiques, des connaissances et des besoins des chercheurs en matière de gestion des données de la recherche. Les résultats permettront de préciser l’offre de services proposée sur le site toulousain.

Cette enquête concerne les établissements membres de l’Université de Toulouse ainsi que les organismes de recherche partenaires : Université Toulouse Capitole, Université Toulouse – Jean Jaurès, Université Toulouse III – Paul Sabatier, Institut national polytechnique de Toulouse (Toulouse INP), Institut national des sciences appliquées de Toulouse (INSA Toulouse), Institut supérieur de l’aéronautique et de l’espace (ISAE-SUPAERO), Institut national universitaire Champollion (INU Champollion), École nationale de l’aviation civile (ENAC), École nationale d’ingénieurs de Tarbes (ENIT), École nationale supérieure d’architecture de Toulouse (ENSA Toulouse), École nationale vétérinaire de Toulouse (ENVT), École nationale supérieure de formation de l’enseignement agricole (ENSFEA), Institut catholique d’arts et métiers (ICAM), École nationale supérieure des mines d’Albi-Carmaux (IMT Mines d’Albi), Toulouse Business School (TBS), Centre national d’études spatiales (CNES), Centre national de la recherche scientifique (CNRS), Institut national de recherche pour l’agriculture, l’alimentation et l’environnement (INRAE), Institut national de l’a santé et de la recherche médicale (Inserm), Institut de recherche pour le développement (IRD) ; Office national d’études et de recherche aérospatiales (Onera), Météo-France.

URL : Enquête quantitative sur les pratiques et les besoins des chercheurs sur la gestion des données de la recherche, algorithmes et codes sources dans les établissements du site toulousain

Original location : https://ut3-toulouseinp.hal.science/hal-04262708v1/

The use of shadow libraries at Universitas Indonesia

Authors : Fauzan Eka Kusuma, Rahmi Rahmi

Shadow libraries (SLs), such as Sci-Hub, Z-Library, and Library Genesis (LibGen), are online databases that provide content that is otherwise difficult to access (due to paywalls or other copyright controls) using unofficial methods of questionable legality. Interest in the SL phenomenon has focused on copyright infringement that occurs when a database provides library materials, for which access rights need to be purchased, without the knowledge of a given copyright owner.

This study analyzes the use of SLs at the Universitas Indonesia (UI). The research uses a quantitative approach, with a survey distributed to 262 undergraduate students at UI. The frequency of SL use in academic activities of UI students is compared with the use of the UI Online Public Access Catalog (OPAC UI).

The results show that most UI students have not used SLs. However, those who have used SLs report more positive impressions and higher levels of satisfaction compared with OPAC UI.

URL : The use of shadow libraries at Universitas Indonesia

DOI : https://doi.org/10.5210/fm.v28i10.12947

Pour quelles revues et publishers les chercheurs d’une université pluridisciplinaire travaillent-ils ?

Auteur/Author :  Maxence Larrieu

Le document contextualise et présente une cartographie réalisée en 2022 à Université Paris Cité, dans le cadre de la plateforme éditoriale OPUS. Les activités éditoriales visées sont celles nécessaires au fonctionnement d’une revue scientifique, comme rédacteur en chef, relecteur ou plus largement membre des comités éditoriaux. La cartographie décrit les revues dans lesquelles les chercheurs de l’université exercent ces activités.

Elle se démarque par l’utilisation du récent outil OpenEditors, qui partage les données structurées des comités éditoriaux des principaux publishers. Cette méthode, enrichie manuellement, autorise une vue omnidisciplinaire appropriée pour l’université : environ 320 revues sont identifiées, 130 pour la santé, idem pour les SHS et moitié moins pour les sciences et techniques.

Les revues sont ensuite analysées manuellement selon différents critères : gouvernance, plateforme, publisher commercial et modèle économique. Les résultats, composés de 7 graphiques, sont précédés d’une explication de la méthode et du jeu de données réalisé. Enfin, des exemples d’utilisation de la cartographie sont proposés.

URL : https://hal.science/hal-04197253

Is scientific knowledge socially constructed? A Bayesian account of Laboratory Life

Author : Henry Small

In the book Laboratory Life Latour and Woolgar present an account of how scientific “facts” are formed through a process of microsocial interactions among individuals and “inscription devices” in the lab initially described as social construction.

The process moves through a series of steps during which the details and nature of the object become more and more certain until all qualifications are dropped, and the “fact” emerges as secure scientific knowledge. An alternative to this account is described based on a Bayesian probabilistic framework which arrives at the same end point.

The motive force for the constructivist approach appears to involve social processes of convincing colleagues while the Bayesian approach relies on the consistency of theory and evidence as judged by the participants.

The role of social processes is discussed in Bayesian terms, the acquisition and asymmetry of information, and its analogy to puzzle solving. Some parallels between the Bayesian and constructivist accounts are noted especially in relation to information theory.

URL : Is scientific knowledge socially constructed? A Bayesian account of Laboratory Life

DOI : https://doi.org/10.3389/frma.2023.1214512