Archives des mots-clés : Scientometrics

Distinguishing articles in questionable and non-questionable journals using quantitative indicators associated with quality

Posté le par

Author : Dimity Stephen

This study investigates the viability of distinguishing articles in questionable journals (QJs) from those in non-QJs on the basis of quantitative indicators typically associated with quality. Subsequently, I examine what can be deduced about the quality of articles in QJs based on the differences observed.

I contrast the length of abstracts and full-texts, prevalence of spelling errors, text readability, number of references and citations, the size and internationality of the author team, the documentation of ethics and informed consent statements, and the presence erroneous decisions based on statistical errors in 1,714 articles from 31 QJs, 1,691 articles from 16 journals indexed in Web of Science (WoS), and 1,900 articles from 45 mid-tier journals, all in the field of psychology.

The results suggest that QJ articles do diverge from the disciplinary standards set by peer-reviewed journals in psychology on quantitative indicators of quality that tend to reflect the effect of peer review and editorial processes. However, mid-tier and WoS journals are also affected by potential quality concerns, such as under-reporting of ethics and informed consent processes and the presence of errors in interpreting statistics. Further research is required to develop a comprehensive understanding of the quality of articles in QJs.

Arxiv : https://arxiv.org/abs/2405.06308

Challenges of Open Science: Problems of Metadata Research and Analysis of Scientometric Indicators of Scientists (Experience of the Scientific Library of Yaroslav Mudryi National Law University)

Posté le par

Authors : Margarita Kulyk

Objective

The scientific publication aims to analyze the development of open science based on international and national experience, as well as to show efforts of the National Law University in the direction of promotion of open science and management of metadata related to scientometrics indicators of scientists.

Methods

To attain the indicated objective, theoretical methods of scientific research were used: literature analysis and systematic approach.

Results

The result of this research is systematization of scientometrics services developed by the Scientific Library of Yaroslav Mudryi National Law University to inform scientists about their scientometric indicators that reflect publication activity in the two main international scientometric databases Scopus and Web of Science.

Conclusions

It is important to promote open science in university repositories, which are one of the services that manage metadata.

URL : Challenges of Open Science: Problems of Metadata Research and Analysis of Scientometric Indicators of Scientists (Experience of the Scientific Library of Yaroslav Mudryi National Law University)

DOI : https://doi.org/10.15802/unilib/2023_293991

Beyond views, productivity, and citations: measuring geopolitical differences of scientific impact in communication research

Posté le par

Authors : János József Tóth, Gergő Háló, Manuel Goyanes

Scientometric analyses applying critical sociological frameworks have previously shown that high-prestige research output—with regards to both quantity and impact—is typically clustered in a few core countries and world regions, indicating uneven power relations and systematic biases within global academia.

Although citation count is a common formula in these analyses, only a handful of studies investigated altmetrics (impact measures beyond citation-based metrics) in communication science. In this paper, we explore geopolitical biases of impact amongst the most productive scholars in the field of communication from 11 countries and 3 world regions.

Drawing on SCOPUS data, we test three formulas that measure scholarly performance (citations per document; views per document; and citations per view) to investigate how geographical location affects the impact of scholars. Our results indicate a strong US-dominance with regard to citation-based impact, emphasizing a further need for de-Westernization within the field.

Moreover, the analysis of altmetric formulas revealed that research published by Eastern European and Spanish scholars, although accessed similarly or even more often than American or Western European publications, is less cited than those. Country-level comparisons are also discussed.

URL : Beyond views, productivity, and citations: measuring geopolitical differences of scientific impact in communication research

DOI : https://doi.org/10.1007/s11192-023-04801-7

Identification and classification of evaluation indicators for scientific and technical publications and related factors

Posté le par

Authors : Hassan Mahmoudi Topkanlo, Mehrdad CheshmehSohrabi

Introduction

Given the importance of the issue of the widespread impact of scientific and technical publications in today’s world, and the diversity and multiplicity of indicators for measuring these publications, it is a necessity to classify these indicators from different angles and through different tools and methods.

Method

This study used documentary analysis and Delphi technique methods. The members of the Delphi panel were twenty-one experts in metric fields in information science who answered the research questionnaires several times until reaching a consensus.

Analysis

Kendall’s coefficient of concordance and a one-sample t-test were used to measure the agreement of the panel members as raters on the questionnaire items.

Results

A total of thirty-four sub-categories of indicators of assessment were identified which were categorised according to their similarities and differences into eight main categories as follows: measurement method, measurement unit, measurement content, measurement purpose, measurement development, measurement resource, measurability, and measurement environment.

Conclusion

Classification of the indicators of evaluation for scientific and technical publications and related factors can lead to improved understanding, critique, modelling and development of indicators. The findings of this study can be considered a basis for further research and help develop evaluative theoretical foundations in scientific and technical publications and related factors.

URL : Identification and classification of evaluation indicators for scientific and technical publications and related factors

DOI : https://doi.org/10.47989/irpaper953

Open Editors: A dataset of scholarly journals’ editorial board positions

Posté le par

Authors : Andreas Nishikawa-Pacher, Tamara Heck, Kerstin Schoch

Editormetrics analyses the role of editors of academic journals and their impact on the scientific publication system. Such analyses would best rely on open, structured, and machine-readable data about editors and editorial boards, which still remains rare.

To address this shortcoming, the project Open Editors collects data about academic journal editors on a large scale and structures them into a single dataset. It does so by scraping the websites of 7,352 journals from 26 publishers (including predatory ones), thereby structuring publicly available information (names, affiliations, editorial roles, ORCID etc.) about 594,580 researchers.

The dataset shows that journals and publishers are immensely heterogeneous in terms of editorial board sizes, regional diversity, and editorial role labels. All codes and data are made available at Zenodo, while the result is browsable at a dedicated website (https://openeditors.ooir.org).

This dataset carries implications for both practical purposes of research evaluation and for meta-scientific investigations into the landscape of scholarly publications, and allows for critical inquiries regarding the representation of diversity and inclusivity across academia.

URL : Open Editors: A dataset of scholarly journals’ editorial board positions

DOI : https://doi.org/10.1093/reseval/rvac037

Awareness Mentality and Strategic Behavior in Science

Posté le par

Author : Rafael Ball

Acknowledgement of scientific achievements was and is essentially achieved through the citation of a publication. Increasingly, however, it is no longer just the publication itself that plays an important role, but also the degree of attention that a scientist achieves with this very publication.

Thus, the importance of strategic behavior in science is progressing and an awareness mentality is spreading. In this paper, the causes and backgrounds of this development are discussed, identifying the use of reductionist, quantitative systems in science management and research funding, the loss of critical judgment and technocratic dominance, quantitative assessments used for decision making, altmetrics and the like as alternative views, the use of perception scores in reference databases and universities as well as ambitions of journals as main drivers.

Besides, different forms of strategic behavior in science and the resulting consequences and impacts are being highlighted.

URL : Awareness Mentality and Strategic Behavior in Science

DOI : https://doi.org/10.3389/frma.2021.703159

Which aspects of the Open Science agenda are most relevant to scientometric research and publishing? An opinion paper

Posté le par

Authors : Lutz Bornmann, Raf Guns, Michael Thelwall, Dietmar Wolfram

Open Science is an umbrella term that encompasses many recommendations for possible changes in research practices, management, and publishing with the objective to increase transparency and accessibility.

This has become an important science policy issue that all disciplines should consider. Many Open Science recommendations may be valuable for the further development of research and publishing but not all are relevant to all fields.

This opinion paper considers the aspects of Open Science that are most relevant for scientometricians, discussing how they can be usefully applied.

DOI : https://doi.org/10.1162/qss_e_00121