Étiquette : research impact

Publié le

Research on Research Visibility

Authors : Enrique Orduña-Malea, Cristina I. Font-Julián

This editorial explores the significance of research visibility within the evolving landscape of academic communication, mainly focusing on the role of search engines as online meta-markets shaping the impact of research. With the rapid expansion of scientific output and the increasing reliance on algorithm-driven platforms such as Google and Google Scholar, the online visibility of scholarly work has become an essential factor in determining its reach and influence.

The need for more rigorous research into academic search engine optimization (A-SEO), a field still in its infancy despite its growing relevance, is also discussed, highlighting key challenges in the field, including the lack of robust research methodologies, the skepticism within the academic community regarding the commercialization of science, and the need for standardization in reporting and measurement techniques.

This editorial thus invites a multidisciplinary dialogue on the future of research visibility, with significant implications for academic publishing, science communication, research evaluation, and the global scientific ecosystem.

URL : Research on Research Visibility

DOI : https://doi.org/10.1344/bid2024.53.01

Publié le

Disciplinary variation in scholarly impact from two article title elements

Author : James M Donovan

For understandable reasons, scholarly impact statistics have become a contentious issue for university faculty. They often look to their librarians to advise them on how best to monitor their performance, and what they could do to raise their profile. The present investigation seeks to equip those librarians with background and tools to provide useful perspective to their worried patrons. For over forty years the literature has been debating what characteristics of an article influence its later citation.

While many suppose that outcome is determined solely by the quality and originality of the piece, one of the consistent findings has been that arguably irrelevant features appear to play an important role. The present discussion focuses on two of the most prominent such features, whether the article title includes a colon, and how long that title is. Both of these variables have been widely researched, but the outcomes are not typically offered in a form that will be useful to faculty patrons.

Specifically, while both colons and shorter titles, for whatever reasons, reliably correlate with higher citations, these patterns vary by discipline and are not conveniently aggregated and reported. To fill this need, results have been extracted from seventy-four empirical investigations and presented by discipline. A wide range of disciplinary variance was found for these two variables which can be considered by an author.

This collection of findings also has permitted correction of prior hypotheses about why such apparently irrelevant elements influence citation, which can improve understanding of the drivers of scholarly impact statistics.

URL : Disciplinary variation in scholarly impact from two article title elements

DOI : https://doi.org/10.1177/09610006241311576

Publié le

Social Media Analysis of High-Impact Information and Communication Journals: Adoption, Use, and Content Curation

Authors : Jesús Cascón-Katchadourian, Javier Guallar, Wileidys Artigas

The use of social media to disseminate academic content is increasing, particularly in scientific journals. This study has the following two main objectives: first, exploring the use of social media by high-impact academic journals in two different SJR categories (Library and Information Sciences and Communication), and second, analyzing content curation carried out by the world’s most influential journals in both areas. The research methodology is descriptive with a quantitative approach regarding the items studied.

The study finds that COM journals have a stronger social media presence than LIS journals, and X dominates in both categories and regions as the top social network, with significant influence as the only platform. On the other hand, content curation was found to a high degree in both areas, especially in the LIS area, with 93% vs. 80% in COM. The study highlights that both COM and LIS journals primarily focus on promoting recent articles, with COM diversifying content more than LIS. In terms of the content curation techniques used in both areas, the majority are abstracting and summarizing.

URL : Social Media Analysis of High-Impact Information and Communication Journals: Adoption, Use, and Content Curation

DOI : https://doi.org/10.3390/publications13010005

Publié le

Improving the reporting of research impact assessments: a systematic review of biomedical funder research impact assessments

Authors : Rachel Abudu, Kathryn Oliver, Annette Boaz

The field of research impact assessment (RIA) has seen remarkable growth over the past three decades. Increasing numbers of RIA frameworks have been developed and applied by research funders and new technologies can capture some research impacts automatically. However, RIAs are too different to draw comparable conclusions about what type of methods, data or processes are best suited to assess research impacts of different kinds, or how funders should most efficiently implement RIAs.

To usher in the next era of RIA and mature the field, future RIA methodologies should become more transparent, standardized and easily implementable. Key to these efforts is an improved understanding of how to practically implement and report on RIA at the funder-level. Our aim is to address this gap through two major contributions.

First, we identify common items across existing best practice guidelines for RIA, creating a preliminary reporting checklist for standardized RIA reporting. Next, we systematically reviewed studies examining funders’ assessment of biomedical grant portfolios to examine how funders reported the results of their RIAs across the checklist, as well as the operational steps funders took to perform their RIA and the variation in how funders implemented the same RIA frameworks.

We compare evidence on current RIA practices with the reporting checklist to identify good practice for RIA reporting, gaps in the evidence base for future research, and recommendations for future effective RIA.

URL : Improving the reporting of research impact assessments: a systematic review of biomedical funder research impact assessments

DOI : https://doi.org/10.1093/reseval/rvae060

Publié le

Does Open Access Foster Interdisciplinary Citation? Decomposing Open Access Citation Advantage

Authors : Kai Nishikawa, Akiyoshi Murakami

The existence of an open access (OA) citation advantage, that is, whether OA increases citations, has been a topic of interest for many years. Although numerous previous studies have focused on whether OA increases citations, expectations for OA go beyond that. One such expectation is the promotion of knowledge transfer across various fields.

This study aimed to clarify whether OA, especially gold OA, increases interdisciplinary citations in various natural science fields. Specifically, we measured the effect of OA on interdisciplinary and within-discipline citation counts by decomposing an existing metric of the OA citation advantage.

The results revealed that OA increases both interdisciplinary and within-discipline citations in many fields and increases only interdisciplinary citations in chemistry, computer science, and clinical medicine. Among these fields, clinical medicine tends to obtain more interdisciplinary citations without being influenced by specific journals or papers.

The findings indicate that OA fosters knowledge transfer to different fields, which extends our understanding of its effects.

Arxiv : https://arxiv.org/abs/2411.14653

Publié le

The use of ChatGPT for identifying disruptive papers in science: a first exploration

Authors : Lutz Bornmann, Lingfei Wu, Christoph Ettl

ChatGPT has arrived in quantitative research evaluation. With the exploration in this Letter to the Editor, we would like to widen the spectrum of the possible use of ChatGPT in bibliometrics by applying it to identify disruptive papers.

The identification of disruptive papers using publication and citation counts has become a popular topic in scientometrics. The disadvantage of the quantitative approach is its complexity in the computation. The use of ChatGPT might be an easy to use alternative.

URL : The use of ChatGPT for identifying disruptive papers in science: a first exploration

DOI : https://doi.org/10.1007/s11192-024-05176-z

Publié le

Open access improves the dissemination of science: insights from Wikipedia

Authors : Puyu Yang, Ahad Shoaib, Robert West, Giovanni Colavizza

Wikipedia is a well-known platform for disseminating knowledge, and scientific sources, such as journal articles, play a critical role in supporting its mission. The open access movement aims to make scientific knowledge openly available, and we might intuitively expect open access to help further Wikipedia’s mission. However, the extent of this relationship remains largely unknown.

To fill this gap, we analyse a large dataset of citations from the English Wikipedia and model the role of open access in Wikipedia’s citation patterns. Our findings reveal that Wikipedia relies on open access articles at a higher overall rate (44.1%) compared to their availability in the Web of Science (23.6%) and OpenAlex (22.6%). Furthermore, both the accessibility (open access status) and academic impact (citation count) significantly increase the probability of an article being cited on Wikipedia.

Specifically, open access articles are extensively and increasingly more cited in Wikipedia, as they show an approximately 64.7% higher likelihood of being cited in Wikipedia when compared to paywalled articles, after controlling for confounding factors. This open access citation effect is particularly strong for articles with high citation counts or published in recent years.

Our findings highlight the pivotal role of open access in facilitating the dissemination of scientific knowledge, thereby increasing the likelihood of open access articles reaching a more diverse audience through platforms such as Wikipedia. Simultaneously, open access articles contribute to the reliability of Wikipedia as a source by affording editors timely access to novel results.

URL : Open access improves the dissemination of science: insights from Wikipedia

DOI : https://doi.org/10.1007/s11192-024-05163-4