Identification and classification of evaluation indicators for scientific and technical publications and related factors

Authors : Hassan Mahmoudi Topkanlo, Mehrdad CheshmehSohrabi

Introduction

Given the importance of the issue of the widespread impact of scientific and technical publications in today’s world, and the diversity and multiplicity of indicators for measuring these publications, it is a necessity to classify these indicators from different angles and through different tools and methods.

Method

This study used documentary analysis and Delphi technique methods. The members of the Delphi panel were twenty-one experts in metric fields in information science who answered the research questionnaires several times until reaching a consensus.

Analysis

Kendall’s coefficient of concordance and a one-sample t-test were used to measure the agreement of the panel members as raters on the questionnaire items.

Results

A total of thirty-four sub-categories of indicators of assessment were identified which were categorised according to their similarities and differences into eight main categories as follows: measurement method, measurement unit, measurement content, measurement purpose, measurement development, measurement resource, measurability, and measurement environment.

Conclusion

Classification of the indicators of evaluation for scientific and technical publications and related factors can lead to improved understanding, critique, modelling and development of indicators. The findings of this study can be considered a basis for further research and help develop evaluative theoretical foundations in scientific and technical publications and related factors.

URL : Identification and classification of evaluation indicators for scientific and technical publications and related factors

DOI : https://doi.org/10.47989/irpaper953

Supporting diamond open access journals. Interest and feasibility of direct funding mechanisms

Authors : Quentin Dufour, David Pontille, Didier Torny

More and more academics and governements consider that the open access model based on Article Processing Charges (APC) is problematic, not only due to the inequalities it generates and reinforces, but also because it has become unsustainable and even opposed to open access values.

They consider that scientific publishing based on a model where both authors and readers do not pay, the so-called Diamond, or non-APC model, should be developed and supported. However, beyond the display of such a support on an international scale, the landscape of Diamond journals is rather in the form of loosely connected archipelagos, and not systematically funded.

This article explores the practical conditions to implement a direct funding mechanism to such journals, that is reccurent money provided by a funder to support the publication process.

Following several recommendations from institutional actors in the open access world, we consider the hypothesis that such a funding would be fostered by research funding organizations (RFOs), which have been essential to the expansion of the APC model, and now show interest in supporting other models.

Based on a questionnaire survey sent to more thant 1000 Diamond Open Access journals, this article analyzes their financial needs, as well as their capacity to interact with funders. It is structured around four issues regarding the implementation of a direct funding model: do Diamond journals really make use of money, and to what end? Do they need additional money?

Are they able to engage monetary transactions? Are they able to meet RFOs visibility requirements? We show that a majority of OA Diamond journals could make use of a direct funding mechanism with certain adjustments. We conclude on the challenges that such a financial stream would spur.

URL : Supporting diamond open access journals. Interest and feasibility of direct funding mechanisms

DOI : https://doi.org/10.1101/2023.05.03.539231

Alive Publication

Author : Mikhail Gorbunov-Posadov

An alive publication is a new genre for presenting the results of scientific research, where the scientific work is published online, and then is constantly being developed and improved by its author. Serious errors and typos are no longer fatal, nor do they haunt the author for the rest of his or her life. The reader of an alive publication knows that the author is constantly monitoring changes occurring in this branch of science.

Alive publication faces the inertia of scientific publishing traditions and, in particular, traditional bibliometrics. Unfortunately, at present, the author who supports an alive publication is dramatically losing out on many generally accepted bibliometric indicators.

The alive publication encourages the development of the bibliography apparatus. Each bibliographic reference will soon have to contain on-the-fly attributes such as attendance, number of external links, date of the last revision, etc.

In the opinion of the writer of these lines, as the alive publication spreads over to the scientific world, the author’s concern for the publication’s evolution will become like a parent’s care for the development of a child. The Internet will be filled with scientific publications that do not lose their relevance with time.

URL : Alive Publication

DOI : https://doi.org/10.3390/publications11020024

The Landscape of Scholarly Book Publishing in Croatia: Finding Pathways for Viable Open Access Models

Author : Iva Melinščak Zlodi

1) Background: Open access to scholarly works is globally recognized as a goal to be achieved as soon as possible; however, there is not yet a general understanding of how to achieve open access for books. In considering the most appropriate models of transition, an accurate and detailed insight into national and regional specifics can be of great importance.

The aim of this research is to show the current state of scholarly book publishing in Croatia: recognising the key stakeholders, their characteristics, and the current level of open access to scholarly books.

(2) Methods: The existing data from two different sources were used: the data about the public subsidies for book publishers by the Ministry of Science and Education and the data on published books from the Croatian Scientific Bibliography CROSBI, both for the period from 2018 to 2021.

(3) Results: In the four-year period, 224 Croatian publishers were awarded subsidies to publish 2359 book titles. The majority of the publishers received support for only a small number of titles and relatively low amounts of subsidies. More than half of the titles are published by small private commercial publishers.

However, the uptake of digital publishing among commercial publishers is very modest. Open access to scholarly books is almost entirely in the domain of non-commercial publishers. Most open access titles are available on the websites of their publishers.

(4) Conclusions: The analysis of the data from these two sources have resulted in an overview of the current state of book publishing in Croatia. Such an overview provides a good basis for designing future measures and creating a national open science plan and can also be a useful contribution to international discussions.

URL : The Landscape of Scholarly Book Publishing in Croatia: Finding Pathways for Viable Open Access Models

DOI : https://doi.org/10.3390/publications11010017

On the geopolitics of academic publishing: the mislocated centers of scholarly communication

Authors : Franciszek Krawczyk, Emanuel Kulczycki

Knowledge production is an important factor in establishing the geopolitical position of countries. In the recent heated discussion on predatory publishing, the geopolitical dimension of this topic is often ignored or treated superficially.

In this paper, we introduce the term “mislocated centres of scholarly communication” to help better understand the emergence of predatory journals, and journals that bear similarities to them, in geopolitical peripheries. Mislocated centers of scholarly communication are perceived in the peripheries as legitimized by the center but are in fact invisible or illegitimate in the center.

Thus, we argue the importance of viewing these mislocated centers as the result of unequal power relations in academia. To support our argument, we summarize the research on the topic of predatory publishing and demonstrate that predatory journals are a geopolitical problem because the geopolitical peripheries of science are much more often harmed by them than the center.

Unlike predatory journals, mislocated centers of scholarly communication are not necessarily fraudulent but rather they are geopolitical roles imposed on some journals by a dynamic between center and peripheries. Our approach could help to criticize this system without discriminating against peripheral scholars or journals.

URL : On the geopolitics of academic publishing: the mislocated centers of scholarly communication

DOI : https://doi.org/10.1080/25729861.2021.1984641

PreprintMatch: A tool for preprint to publication detection shows global inequities in scientific publication

Authors : Peter Eckmann, Anita Bandrowski

Preprints, versions of scientific manuscripts that precede peer review, are growing in popularity. They offer an opportunity to democratize and accelerate research, as they have no publication costs or a lengthy peer review process. Preprints are often later published in peer-reviewed venues, but these publications and the original preprints are frequently not linked in any way.

To this end, we developed a tool, PreprintMatch, to find matches between preprints and their corresponding published papers, if they exist. This tool outperforms existing techniques to match preprints and papers, both on matching performance and speed. PreprintMatch was applied to search for matches between preprints (from bioRxiv and medRxiv), and PubMed.

The preliminary nature of preprints offers a unique perspective into scientific projects at a relatively early stage, and with better matching between preprint and paper, we explored questions related to research inequity.

We found that preprints from low income countries are published as peer-reviewed papers at a lower rate than high income countries (39.6% and 61.1%, respectively), and our data is consistent with previous work that cite a lack of resources, lack of stability, and policy choices to explain this discrepancy.

Preprints from low income countries were also found to be published quicker (178 vs 203 days) and with less title, abstract, and author similarity to the published version compared to high income countries. Low income countries add more authors from the preprint to the published version than high income countries (0.42 authors vs 0.32, respectively), a practice that is significantly more frequent in China compared to similar countries.

Finally, we find that some publishers publish work with authors from lower income countries more frequently than others.

URL : PreprintMatch: A tool for preprint to publication detection shows global inequities in scientific publication

DOI : https://doi.org/10.1371/journal.pone.0281659

An open automation system for predatory journal detection

Authors : Li‑Xian Chen, Shih‑Wen Su, Chia‑Hung Liao, Kai‑Sin Wong, Shyan‑Ming Yuan

The growing number of online open-access journals promotes academic exchanges, but the prevalence of predatory journals is undermining the scholarly reporting process. Data collection, feature extraction, and model prediction are common steps in tools designed to distinguish between legitimate and predatory academic journals and publisher websites.

The authors include them in their proposed academic journal predatory checking (AJPC) system based on machine learning methods. The AJPC data collection process extracts 833 blacklists and 1213 whitelists information from websites to be used for identifying words and phrases that might indicate the presence of predatory journals.

Feature extraction is used to identify words and terms that help detect predatory websites, and the system’s prediction stage uses eight classification algorithms to distinguish between potentially predatory and legitimate journals.

We found that enhancing the classification efficiency of the bag of words model and TF-IDF algorithm with diff scores (a measure of differences in specific word frequencies between journals) can assist in identifying predatory journal feature words.

Results from performance tests suggest that our system works as well as or better than those currently being used to identify suspect publishers and publications.

The open system only provides reference results rather than absolute opinions and accepts user inquiries and feedback to update the system and optimize performance.

URL : An open automation system for predatory journal detection

DOI : https://doi.org/10.1038/s41598-023-30176-z