Étiquette : Bibliometrics

Catégories
EN

Conjoint analysis of researchers’ hidden preferences for bibliometrics, altmetrics, and usage metrics

Authors : Steffen Lemke, Athanasios Mazarakis, Isabella Peters

The amount of annually published scholarly articles is growing steadily, as is the number of indicators through which impact of publications is measured. Little is known about how the increasing variety of available metrics affects researchers’ processes of selecting literature to read.

We conducted ranking experiments embedded into an online survey with 247 participating researchers, most from social sciences. Participants completed series of tasks in which they were asked to rank fictitious publications regarding their expected relevance, based on their scores regarding six prototypical metrics.

Through applying logistic regression, cluster analysis, and manual coding of survey answers, we obtained detailed data on how prominent metrics for research impact influence our participants in decisions about which scientific articles to read.

Survey answers revealed a combination of qualitative and quantitative characteristics that researchers consult when selecting literature, while regression analysis showed that among quantitative metrics, citation counts tend to be of highest concern, followed by Journal Impact Factors.

Our results suggest a comparatively favorable view of many researchers on bibliometrics and widespread skepticism toward altmetrics.

The findings underline the importance of equipping researchers with solid knowledge about specific metrics’ limitations, as they seem to play significant roles in researchers’ everyday relevance assessments.

URL : Conjoint analysis of researchers’ hidden preferences for bibliometrics, altmetrics, and usage metrics

DOI : https://doi.org/10.1002/asi.24445

Catégories
FR

L’effet SIGAPS : La recherche médicale française sous l’emprise de l’évaluation comptable

Auteurs/Authors : Yves Gingras, Mahdi Khelfaoui

Cette recherche a pour but de mettre en évidence les effets pervers générés par l’introduction du système SIGAPS (Système d’interrogation, de gestion, et d’analyse des publications scientifiques) sur la production scientifique française en médecine et en sciences biomédicales.

Cet outil biblio-métrique de gestion et de financement de la recherche présente un exemple emblématique des dé-rives que peuvent générer les méthodes d’évaluation de la recherche reposant sur des critères pu-rement comptables.

Dans cette note, nous présentons d’abord le fonctionnement de SIGAPS, pour ensuite expliquer précisément en quoi les méthodes de calcul des « points SIGAPS », fondés sur les facteurs d’impact des revues et l’ordre des noms des co-auteurs, posent de nombreux problèmes.

Nous identifions notamment les effets du système SIGAPS sur les dynamiques de publications, les choix des lieux de publications, la langue de publication et les critères de recrutement et de promotion des chercheurs.

Finalement, nous montrons que l’utilisation du système SIGAPS ne répond pas bien à tous les critères de ce que l’on pourrait appeler une « éthique de l’évaluation » qui devrait respecter certaines règles, comme la transparence, l’équité et la validité des indicateurs.

URL : https://cirst2.openum.ca/files/sites/179/2020/10/Note_2020-05vf.pdf

Catégories
Non classé

A validation of coauthorship credit models with empirical data from the contributions of PhD candidates

Author : Paul Donner

A perennial problem in bibliometrics is the appropriate distribution of authorship credit for coauthored publications. Several credit allocation methods and formulas have been introduced, but there has been little empirical validation as to which method best reflects the typical contributions of coauthors.

This paper presents a validation of credit allocation methods using a new data set of author-provided percentage contribution figures obtained from the coauthored publications in cumulative PhD theses by authors from three countries that contain contribution statements.

The comparison of allocation schemes shows that harmonic counting performs best and arithmetic and geometric counting also perform well, while fractional counting and first author counting perform relatively poorly.

URL : https://www.mitpressjournals.org/doi/abs/10.1162/qss_a_00048?af=R

Catégories
EN

Scopus as a curated, high-quality bibliometric data source for academic research in quantitative science studies

Authors : Jeroen Baas, Michiel Schotten, Andrew Plume, Grégoire Côté, Reza Karimi

Scopus is among the largest curated abstract and citation databases, with a wide global and regional coverage of scientific journals, conference proceedings, and books, while ensuring only the highest quality data are indexed through rigorous content selection and re-evaluation by an independent Content Selection and Advisory Board.

Additionally, extensive quality assurance processes continuously monitor and improve all data elements in Scopus. Besides enriched metadata records of scientific articles, Scopus offers comprehensive author and institution profiles, obtained from advanced profiling algorithms and manual curation, ensuring high precision and recall.

The trustworthiness of Scopus has led to its use as bibliometric data source for large-scale analyses in research assessments, research landscape studies, science policy evaluations, and university rankings.

Scopus data have been offered for free for selected studies by the academic research community, such as through application programming interfaces, which have led to many publications employing Scopus data to investigate topics such as researcher mobility, network visualizations, and spatial bibliometrics.

In June 2019, the International Center for the Study of Research was launched, with an advisory board consisting of bibliometricians, aiming to work with the scientometric research community and offering a virtual laboratory where researchers will be able to utilize Scopus data.

URL : Scopus as a curated, high-quality bibliometric data source for academic research in quantitative science studies

DOI : https://doi.org/10.1162/qss_a_00019

Catégories
EN

Competence-Based Management Research in the Web of Science and Scopus Databases: Scientific Production, Collaboration, and Impact

Authors : Vítor Vasata Macchi Silva, José Luis Duarte Ribeiro, Gonzalo Rubén Alvarez, Sonia Elisa Caregnato

This paper presents a bibliometric study, which seeks to characterize papers that address competence-based management and that are indexed in the Web of Science and Scopus databases in terms of scientific production, collaboration, and impact.

All the papers published in journals or in conference proceedings that contained the terms “competenc* management” or “compentenc* based management” in their titles, abstracts, or keywords were analyzed.

The results show that computational sciences, human resources management, strategic management, and industrial relations and labor correspond to the macro-categories that characterize competence-based management.

This paper also indicates that collaborations between authors do not establish strong co-authorship networks. It also shows that the most cited papers were published in journals of different areas.

It concludes that studies conducted in the area of competence-based management can be developed in a more assertive way if they take into consideration the context of the current state of research in this area.

URL : Competence-Based Management Research in the Web of Science and Scopus Databases: Scientific Production, Collaboration, and Impact

Alternative location : https://www.mdpi.com/2304-6775/7/4/60

Catégories
EN

Science and its significant other: Representing the humanities in bibliometric scholarship

Authors : Thomas Franssen, Paul Wouters

The cognitive and social structures, and publication practices, of the humanities have been studied bibliometrically for the past 50 years. This article explores the conceptual frameworks, methods, and data sources used in bibliometrics to study the nature of the humanities, and its differences and similarities in comparison with other scientific domains.

We give a historical overview of bibliometric scholarship between 1965 and 2018 that studies the humanities empirically and distinguishes between two periods in which the configuration of the bibliometric system differs remarkably.

The first period, 1965 to the 1980s, is characterized by bibliometric methods embedded in a sociological theoretical framework, the development and use of the Price Index, and small samples of journal publications from which references are used as data sources.

The second period, the 1980s to the present day, is characterized by a new intellectual hinterland—that of science policy and research evaluation—in which bibliometric methods become embedded.

Here metadata of publications becomes the primary data source with which publication profiles of humanistic scholarly communities are analyzed. We unpack the differences between these two periods and critically discuss the analytical avenues that different approaches offer.

URL : Science and its significant other: Representing the humanities in bibliometric scholarship

DOI : https://doi.org/10.1002/asi.24206

Catégories
EN

Ten years of research on ResearchGate, a scoping review using Google Scholar 2008-2017

Authors : Prieto-Gutierrez, Juan Jose

Objective

To analyse quantitatively the articles published during 2008_2017 about the academic social networking site ResearchGate.

Methods

A scoping bibliometric review of documents retrieved using Google Scholar was conducted, limited to publications that contained the word « ResearchGate » in their title and were published from 2008 to 2017.

Results

The search yielded 159 documents, once a preliminary list of 386 documents retrieved from Google Scholar was filtered, which eliminated about 60% of the results that were bibliographic citations and not documents. Papers in journals were the most numerous type of documents (n73; 46%), followed by conference papers (n_31; 19.5 %).

Contributing eight publications, two Spanish scholars (Delgado Lopez-Cozar and Orduna Malea, who were coauthors in each case) were the most prolific authors writing on this topic during the ten-year period. The keywords most used in the documents were « ResearchGate » and « Altmetrics ».

The publications were cited frequently since 2014 (more than 90% of the total cites fell in that period), and those with more than one author were the most cited ones.

The authors of the documents were mainly librarians and information science professionals, who wrote primarily as co-authors with colleagues from their own institutions, mostly published in English.

Conclusions

Interest in ResearchGate has grown since 2015, as evident from the number of articles published and the citations they received.

URL : https://arxiv.org/abs/1908.08752