Gender diversity and publication activity—an analysis of STEM in the UK

Authors : Yasaman Sarabi, Matthew Smith

Gender diversity in STEM remains a significant issue, as the field continues to be a male dominated one, despite increased attention on the subject. This article examines the interplay between gender diversity on projects funded by a major UK research council, the Engineering and Physical Sciences Research Council, and the publication activity of a project, as measured by the average journal quality of project publication output, over a 10-year period.

The proportion of female representation and leadership on these projects remains very low. For the projects examined as part of this study, over 70% of these projects have no female representation, and less than 15% have a female lead.

This study does not find a significant relationship between gender diversity and journal quality output. This study highlights that an important avenue for future work is the development of alternative metrics to assess the performance of research projects in a discipline characterized by very low levels of gender diversity, to fully unpack the impact of project team gender diversity on project output activity.

URL : Gender diversity and publication activity—an analysis of STEM in the UK

DOI : https://doi.org/10.1093/reseval/rvad008

How unpredictable is research impact? Evidence from the UK’s Research Excellence Framework

Authors : Ohid Yaqub, Dmitry Malkov, Josh Siepel

Although ex post evaluation of impact is increasingly common, the extent to which research impacts emerge largely as anticipated by researchers, or as the result of serendipitous and unpredictable processes, is not well understood.

In this article, we explore whether predictions of impact made at the funding stage align with realized impact, using data from the UK’s Research Excellence Framework (REF). We exploit REF impact cases traced back to research funding applications, as a dataset of 2,194 case–grant pairs, to compare impact topics with funder remits.

For 209 of those pairs, we directly compare their descriptions of ex ante and ex post impact. We find that impact claims in these case–grant pairs are often congruent with each other, with 76% showing alignment between anticipated impact at funding stage and the eventual claimed impact in the REF. Co-production of research, often perceived as a model for impactful research, was a feature of just over half of our cases.

Our results show that, contrary to other preliminary studies of the REF, impact appears to be broadly predictable, although unpredictability remains important. We suggest that co-production is a reasonably good mechanism for addressing the balance of predictable and unpredictable impact outcomes.

URL : How unpredictable is research impact? Evidence from the UK’s Research Excellence Framework

DOI : https://doi.org/10.1093/reseval/rvad019

Judging Journals: How Impact Factor and Other Metrics Differ across Disciplines

Authors : Quinn Galbraith, Alexandra Carlile Butterfield, Chase Cardon

Given academia’s frequent use of publication metrics and the inconsistencies in metrics across disciplines, this study examines how various disciplines are treated differently by metric systems. We seek to offer academic librarians, university rank and tenure committees, and other interested individuals guidelines for distinguishing general differences between journal bibliometrics in various disciplines.

This study addresses the following questions: How well represented are different disciplines in the indexing of each metrics system (Eigenfactor, Scopus, Web of Science, Google Scholar)? How does each metrics system treat disciplines differently, and how do these differences compare across metrics systems?

For university libraries and academic librarians, this study may increase understanding of the comparative value of various metrics, which hopefully will facilitate more informed decisions regarding the purchase of journal subscriptions and the evaluation of journals and metrics systems.

This study indicates that different metrics systems prioritize different disciplines, and metrics are not always easily compared across disciplines. Consequently, this study indicates that simple reliance on metrics in publishing or purchasing decisions is often flawed.

URL : Judging Journals: How Impact Factor and Other Metrics Differ across Disciplines

DOI : https://doi.org/10.5860/crl.84.6.888

Why are these publications missing? Uncovering the reasons behind the exclusion of documents in free-access scholarly databases

Authors : Lorena Delgado-QuirósIsidro F. AguilloAlberto Martín-MartínEmilio Delgado López-CózarEnrique Orduña-MaleaJosé Luis Ortega

This study analyses the coverage of seven free-access bibliographic databases (Crossref, Dimensions—non-subscription version, Google Scholar, Lens, Microsoft Academic, Scilit, and Semantic Scholar) to identify the potential reasons that might cause the exclusion of scholarly documents and how they could influence coverage.

To do this, 116 k randomly selected bibliographic records from Crossref were used as a baseline. API endpoints and web scraping were used to query each database. The results show that coverage differences are mainly caused by the way each service builds their databases.

While classic bibliographic databases ingest almost the exact same content from Crossref (Lens and Scilit miss 0.1% and 0.2% of the records, respectively), academic search engines present lower coverage (Google Scholar does not find: 9.8%, Semantic Scholar: 10%, and Microsoft Academic: 12%). Coverage differences are mainly attributed to external factors, such as web accessibility and robot exclusion policies (39.2%–46%), and internal requirements that exclude secondary content (6.5%–11.6%).

In the case of Dimensions, the only classic bibliographic database with the lowest coverage (7.6%), internal selection criteria such as the indexation of full books instead of book chapters (65%) and the exclusion of secondary content (15%) are the main motives of missing publications.

URL : Why are these publications missing? Uncovering the reasons behind the exclusion of documents in free-access scholarly databases

DOI : https://doi.org/10.1002/asi.24839

The Predatory Paradox : Ethics, Politics, and Practices in Contemporary Scholarly Publishing

Authors : Amy Koerber, Jesse C. Starkey, Karin Ardon-Dryer, R. Glenn Cummins, Lyombe Eko, Kerk F. Kee

In today’s ‘publish or perish’ academic setting, the institutional prizing of quantity over quality has given rise to and perpetuated the dilemma of predatory publishing. Upon a close examination, however, the definition of ‘predatory’ itself becomes slippery, evading neat boxes or lists which might seek to easily define and guard against it.

This volume serves to foreground a nuanced representation of this multifaceted issue. In such a rapidly evolving landscape, this book becomes a field guide to its historical, political, and economic aspects, presenting thoughtful interviews, legal analysis and original research. Case studies from both European-American and non-European-American stakeholders emphasize the worldwide nature of the challenge faced by researchers of all levels.

This coauthored book is structured into both textual and supplemental materials. Key takeaways, discussion questions, and complete classroom activities accompanying each chapter provide opportunities for engagement and real-world applications of these concepts.

Crucially relevant to early career researchers and the senior faculty, library scholars, and administrators who mentor and support them, ‘The Predatory Paradox: Ethics, Politics, and Practices in Contemporary Scholarly Publishing’ offers practical recommendations for navigating the complex and often contradictory advice currently available. University instructors and teaching faculty will also find the reading essential in order to properly prepare both graduate and undergraduate students for the potential pitfalls endemic to scholarly publishing.

URL : The Predatory Paradox : Ethics, Politics, and Practices in Contemporary Scholarly Publishing

DOI : https://doi.org/10.11647/OBP.0364

Academic co-authorship is a risky game

Authors : Teddy Lazebnik, Stephan Beck, Labib Shami

Conducting a project with multiple participants is a complex task that involves multiple social, economic, and psychological interactions. Conducting academic research in general and the process of writing an academic manuscript, in particular, is notorious for being challenging to successfully navigate due to the current form of collaboration dynamics common in academia.

In this study, we propose a game-theory-based model for a co-authorship writing project in which authors are allowed to raise an ultimatum, blocking the publishment of the manuscript if they do not get more credit for the work.

Using the proposed model, we explore the influence of the contribution and utility of publishing the manuscript on the rate one or more authors would gain from raising an ultimatum. Similarly, we show that the project’s duration and the current state have a major impact on this rate, as well as the number of authors.

In addition, we examine common student-advisor and colleague-colleague co-authorships scenarios. Our model reveals disturbing results and demonstrates that the current, broadly accepted, academic practices for collaborations are designed in a way that stimulates authors to raise an ultimatum and stopped only by their integrity and not by a systematic design.

URL : Academic co-authorship is a risky game

DOI : https://doi.org/10.1007/s11192-023-04843-x

The use of shadow libraries at Universitas Indonesia

Authors : Fauzan Eka Kusuma, Rahmi Rahmi

Shadow libraries (SLs), such as Sci-Hub, Z-Library, and Library Genesis (LibGen), are online databases that provide content that is otherwise difficult to access (due to paywalls or other copyright controls) using unofficial methods of questionable legality. Interest in the SL phenomenon has focused on copyright infringement that occurs when a database provides library materials, for which access rights need to be purchased, without the knowledge of a given copyright owner.

This study analyzes the use of SLs at the Universitas Indonesia (UI). The research uses a quantitative approach, with a survey distributed to 262 undergraduate students at UI. The frequency of SL use in academic activities of UI students is compared with the use of the UI Online Public Access Catalog (OPAC UI).

The results show that most UI students have not used SLs. However, those who have used SLs report more positive impressions and higher levels of satisfaction compared with OPAC UI.

URL : The use of shadow libraries at Universitas Indonesia

DOI : https://doi.org/10.5210/fm.v28i10.12947