Archives des mots-clés : Altmetrics

Identification and classification of evaluation indicators for scientific and technical publications and related factors

Posté le par

Authors : Hassan Mahmoudi Topkanlo, Mehrdad CheshmehSohrabi

Introduction

Given the importance of the issue of the widespread impact of scientific and technical publications in today’s world, and the diversity and multiplicity of indicators for measuring these publications, it is a necessity to classify these indicators from different angles and through different tools and methods.

Method

This study used documentary analysis and Delphi technique methods. The members of the Delphi panel were twenty-one experts in metric fields in information science who answered the research questionnaires several times until reaching a consensus.

Analysis

Kendall’s coefficient of concordance and a one-sample t-test were used to measure the agreement of the panel members as raters on the questionnaire items.

Results

A total of thirty-four sub-categories of indicators of assessment were identified which were categorised according to their similarities and differences into eight main categories as follows: measurement method, measurement unit, measurement content, measurement purpose, measurement development, measurement resource, measurability, and measurement environment.

Conclusion

Classification of the indicators of evaluation for scientific and technical publications and related factors can lead to improved understanding, critique, modelling and development of indicators. The findings of this study can be considered a basis for further research and help develop evaluative theoretical foundations in scientific and technical publications and related factors.

URL : Identification and classification of evaluation indicators for scientific and technical publications and related factors

DOI : https://doi.org/10.47989/irpaper953

The Many Publics of Science: Using Altmetrics to Identify Common Communication Channels by Scientific field

Posté le par

Authors : Daniel Torres-Salinas, Domingo Docampo, Wenceslao Arroyo-Machado, Nicolas Robinson-Garcia

Altmetrics have led to new quantitative studies of science through social media interactions. However, there are no models of science communication that respond to the multiplicity of non-academic channels.

Using the 3653 authors with the highest volume of altmetrics mentions from the main channels (Twitter, News, Facebook, Wikipedia, Blog, Policy documents, and Peer reviews) to their publications (2016-2020), it has been analyzed where the audiences of each discipline are located.

The results evidence the generalities and specificities of these new communication models and the differences between areas. These findings are useful for the development of science communication policies and strategies.

URL : https://arxiv.org/abs/2304.05157

Influence of research on open science in the public policy sphere

Posté le par

Authors : Daniela De Filippo, Pablo Sastrón‑Toledo

This paper analyses the scientific activity related to open science in Spain and its influence on public policy from a bibliometric perspective. For this purpose, Spanish centres’ projects and publications on open science from 2010 to 2020 are studied. Subsequently, policy documents using papers related to open science are analysed to study their influence on policymaking.

A total of 142 projects and 1491 publications are analysed, 15% of which are mentioned in policy documents.

The publications cited in policy documents display high proportions of international collaboration, open access publication and publication in first-quartile journals. The findings underline governments’ leading role in the implementation of open science policies and the funding of open science research.

The same government agencies that promote and fund open science research are shown to use that research in their institutional reports, a process known as knowledge flow feedback.

Other non-academic actors are also observed to make use of the knowledge produced by open science research, showing how the open science movement has crossed the boundaries of academia.

URL : Influence of research on open science in the public policy sphere

DOI : https://doi.org/10.1007/s11192-023-04645-1

The Twitter accounts of scientific journals: a dataset

Posté le par

Author : Andreas Nishikawa-Pacher

Twitter harbours dense networks of academics, but to what extent do scientific journals use that platform? This article introduces a dataset of 3,485 Twitter accounts pertaining to a sample of 13,821 journals listed in Web of Science’s three major indices (SCIE, SSCI and AHCI).

The summary statistics indicate that 25.2% of the journals have a dedicated Twitter presence. This number is likely to grow, as, on average, every one and a half days sees yet another journal setting up a new profile. The share of Twitter presence, however, varies strongly by publisher and discipline.

The most active discipline is political science, which has almost 75% of its journals on Twitter, while other research categories have zero. The median account issues 116 messages a year and it interacts with distinct other users once in two to three Tweets. Approximately 600 journals refer to themselves as ‘peer-reviewed’, while 263 journals refer to their citation-based impact (like the impact factor) in their profile description.

All in all, the data convey immense heterogeneity with respect to the Twitter behaviour of scientific journals. As there are numerous deceptive Twitter profile names established by predatory publishers, it is recommended that journals establish their official accounts lest bogus journals mislead the public about scientific findings. The dataset is available for use for further scientometric analyses.

URL : The Twitter accounts of scientific journals: a dataset

DOI : http://doi.org/10.1629/uksg.593

Are patents linked on Twitter? A case study of Google patents

Posté le par

Authors : Enrique Orduña‑Malea, Cristina I. Font‑Julián

This study attempts to analyze patents as cited/mentioned documents to better understand the interest, dissemination and engagement of these documents in social environments, laying the foundations for social media studies of patents (social Patentometrics).

Particularly, this study aims to determine how patents are disseminated on Twitter by analyzing three elements: tweets linking to patents, users linking to patents, and patents linked from Twitter.

To do this, all the tweets containing at least one link to a full-text patent available on Google Patents were collected and analyzed, yielding a total of 126,815 tweets (and 129,001 links) to 86,417 patents. The results evidence an increase of the number of linking tweets over the years, presumably due to the creation of a standardized patent URL ID and the integration of Google Patents and Google Scholar, which took place in 2015.

The engagement achieved by these tweets is limited (80.2% of tweets did not attract likes) but increasing notably since 2018. Two super-publisher twitter bot accounts (dailypatent and uspatentbot) are responsible of 53.3% of all the linking tweets, while most accounts are sporadic users linking to patent as part of a conversation.

The patents most tweeted are, by far, from United States (87.5% of all links to Google Patents), mainly due to the effect of the two super-publishers. The impact of patents in terms of the number of tweets linking to them is unrelated to their year of publication, status or number of patent citations received, while controversial and media topics might be more determinant factors.

However, further research is needed to better understand the topics discussed around patents on Twitter, the users involved, and the metrics attained. Given the increasing number of linking users and linked patents, this study finds Twitter as a relevant source to measure patent-level metrics, shedding light on the impact and interest of patents by the broad public.

URL : Are patents linked on Twitter? A case study of Google patents

DOI : https://doi.org/10.1007/s11192-022-04519-y

Reshaping How Universities Can Evaluate the Research Impact of Open Humanities for Societal Benefit

Posté le par

Authors : Paul Longley Arthur, Lydia Hearn

During the twenty-first century, for the first time, the volume of digital data has surpassed the amount of analog data. As academic practices increasingly become digital, opportunities arise to reshape the future of scholarly communication through more accessible, interactive, open, and transparent methods that engage a far broader and more diverse public.

Yet despite these advances, the research performance of universities and public research institutes remains largely evaluated through publication and citation analysis rather than by public engagement and societal impact.

This article reviews how changes to bibliometric evaluations toward greater use of altmetrics, including social media mentions, could enhance uptake of open scholarship in the humanities.

In addition, the article highlights current challenges faced by the open scholarship movement, given the complexity of the humanities in terms of its sources and outputs that include monographs, book chapters, and journals in languages other than English; the use of popular media not considered as scholarly papers; the lack of time and energy to develop digital skills among research staff; problems of authority and trust regarding the scholarly or non-academic nature of social media platforms; the prestige of large academic publishing houses; and limited awareness of and familiarity with advanced digital applications.

While peer review will continue to be a primary method for evaluating research in the humanities, a combination of altmetrics and other assessment of research impact through different data sources may provide a way forward to ensure the increased use, sustainability, and effectiveness of open scholarship in the humanities.

DOI : https://doi.org/10.3998/jep.788

Article Processing Charges, Altmetrics and Citation Impact: Is there an economic rationale?

Posté le par

Authors : Abdelghani Maddi, David Sapinho

The present study aims to analyze 1) the relationship between Citation Normalized Score of scientific publications and Article Processing Charges (APCs) of Gold Open Access (OA) publications 2) the determinants of APCs.

To do so, we used APCs information provided by the OpenAPC database, citation scores of publications from the WoS database and, for Altmetrics, data from Altmetrics.com database, over the period from 2006 to 2019 for 83,752 articles published in 4751 journals belonging to 267 distinct publishers.

Results show that contrary to common belief, paying high APCs does not necessarily increase the impact of publications. First, large publishers with high impact are not the most expensive. Second, publishers with the highest APCs are not necessarily the best in terms of impact.

Correlation between APCs and impact is moderate. Regarding the determinants, results indicate that APCs are on average 50% higher in hybrid journals than in full OA journals. The results also suggest that Altmetrics do not have a great impact: OA articles that have garnered the most attention on internet are articles with relatively low APCs.

Another interesting result is that the “number of readers” indicator is more effective as it is more correlated with classic bibliometrics indicators than the Altmetrics score.

URL : https://hal.archives-ouvertes.fr/hal-03576911