Archives des mots-clés : research impact

The Journal Impact Factor: A brief history, critique, and discussion of adverse effects

Posté le par

Authors : Vincent Lariviere, Cassidy R. Sugimoto

The Journal Impact Factor (JIF) is, by far, the most discussed bibliometric indicator. Since its introduction over 40 years ago, it has had enormous effects on the scientific ecosystem: transforming the publishing industry, shaping hiring practices and the allocation of resources, and, as a result, reorienting the research activities and dissemination practices of scholars.

Given both the ubiquity and impact of the indicator, the JIF has been widely dissected and debated by scholars of every disciplinary orientation. Drawing on the existing literature as well as on original research, this chapter provides a brief history of the indicator and highlights well-known limitations-such as the asymmetry between the numerator and the denominator, differences across disciplines, the insufficient citation window, and the skewness of the underlying citation distributions.

The inflation of the JIF and the weakening predictive power is discussed, as well as the adverse effects on the behaviors of individual actors and the research enterprise. Alternative journal-based indicators are described and the chapter concludes with a call for responsible application and a commentary on future developments in journal indicators

URL : https://arxiv.org/abs/1801.08992

Comparing scientific and technological impact of biomedical research

Posté le par

Author : Qing Ke

Traditionally, the number of citations that a scholarly paper receives from other papers is used as the proxy of its scientific impact. Yet citations can come from domains outside the scientific community, and one such example is through patented technologies—paper can be cited by patents, achieving technological impact.

While the scientific impact of papers has been extensively studied, the technological aspect remains largely unknown. Here we aim to fill this gap by presenting a comparative study on how 919 thousand biomedical papers are cited by U.S. patents and by other papers over time.

We observe a positive correlation between citations from patents and from papers, but there is little overlap between the two domains in either the most cited papers, or papers with the most delayed recognition.

We also find that the two types of citations exhibit distinct temporal variations, with patent citations lagging behind paper citations for a median of 6 years for the majority of papers. Our work contributes to the understanding of the technological, and societal in general, impact of papers.

URL : https://arxiv.org/abs/1804.04105

Tweet success? Scientific communication correlates with increased citations in Ecology and Conservation

Posté le par

Authors : Clayton T. Lamb​, Sophie L. Gilbert, Adam T. Ford

Science communication is seen as critical for the disciplines of ecology and conservation, where research products are often used to shape policy and decision making. Scientists are increasing their online media communication, via social media and news.

Such media engagement has been thought to influence or predict traditional metrics of scholarship, such as citation rates. Here, we measure the association between citation rates and the Altmetric Attention Score—an indicator of the amount and reach of the attention an article has received—along with other forms of bibliometric performance (year published, journal impact factor, and article type).

We found that Attention Score was positively correlated with citation rates. However, in recent years, we detected increasing media exposure did not relate to the equivalent citations as in earlier years; signalling a diminishing return on investment.

Citations correlated with journal impact factors up to ∼13, but then plateaued, demonstrating that maximizing citations does not require publishing in the highest-impact journals. We conclude that ecology and conservation researchers can increase exposure of their research through social media engagement and, simultaneously, enhance their performance under traditional measures of scholarly activity.

URL : Tweet success? Scientific communication correlates with increased citations in Ecology and Conservation

DOI : https://doi.org/10.7717/peerj.4564

Ethnic Diversity Increases Scientific Impact

Posté le par

Authors : Bedoor K AlShebli, Talal Rahwan, Wei Lee Woon

Inspired by the numerous social and economic benefits of diversity, we analyze over 9 million papers and 6 million scientists spanning 24 fields of study, to understand the relationship between research impact and five types of diversity, reflecting (i) ethnicity, (ii) discipline, (iii) gender, (iv) affiliation and (v) academic age.

For each type, we study group diversity (i.e., the heterogeneity of a paper’s set of authors) and individual diversity (i.e., the heterogeneity of a scientist’s entire set of collaborators). Remarkably, of all the types considered, we find that ethnic diversity is the strongest predictor of a field’s scientific impact (r is 0.77 and 0.55 for group and individual ethnic diversity, respectively).

Moreover, to isolate the effect of ethnic diversity from other confounding factors, we analyze a baseline model in which author ethnicities are randomized while preserving all other characteristics.

We find that the relation between ethnic diversity and impact is stronger in the real data compared to the randomized baseline model, regardless of publication year, number of authors per paper, and number of collaborators per scientist.

Finally, we use coarsened exact matching to infer causality, whereby the scientific impact of diverse papers and scientists are compared against closely matched control groups. In keeping with the other results, we find that ethnic diversity consistently leads to higher scientific impact.

URL : https://arxiv.org/abs/1803.02282

Gathering the Needles: Evaluating the Impact of Gold Open Access Content With Traditional Subscription Journals

Posté le par

Authors : Alison Boba, Jill Emery

Utilizing the Project COUNTER Release 4 JR1-GOA report, two librarians explore these data in comparison to journal package subscriptions represented via the JR1 reports. This paper outlines the methodology and study undertaken at the Portland State University Library and the University of Nebraska Medical Center Library using these reports for the first time.

The initial outcomes of the study are provided in various Tables for 2014 and 2015. The intent of the study was to provide both institutions with a baseline from which to do further study. In addition, some ideas are given for how these reports can be used in vendor negotiations going forward.

URL : Gathering the Needles: Evaluating the Impact of Gold Open Access Content With Traditional Subscription Journals

DOI : http://dx.doi.org/10.1629/uksg.291

Who needs access to research? Exploring the societal impact of open access

Posté le par

Author : ElHassan ElSabry

Studies about open access (OA) have predominantly focused it impact on communication within the scholarly community. For example, many studies have been published on what is called the “Open Access Citation Advantage (OACA)”.

On the other hand, implications of OA in non-academic contexts (e.g. medical practice, policymaking, patient advocacy and citizen science) have been the subject of and the basis for a lot of the advocacy work and many funding agencies’ OA policies, but not so much the subject of original research studies.

To date, this study is the first attempt to collect and synthesize the available evidence on the societal impact of open access. It further builds on this evidence base by introducing a typology of the various science-society interfaces where demand for access to research potentially exists.

The proposed scheme is anticipated to provide guidance for future research on the issue of OA’s societal impact. The paper concludes with a discussion of the implications of non-academic usage of research on the open access debate, especially on the question of who should bear the cost of scholarly publishing.

URL : https://rfsic.revues.org/3271

How quickly do publications get read? The evolution of Mendeley reader counts for new articles

Posté le par

Authors : Nabeil Maflahi, Mike Thelwall

Within science, citation counts are widely used to estimate research impact but publication delays mean that they are not useful for recent research. This gap can be filled by Mendeley reader counts, which are valuable early impact indicators for academic articles because they appear before citations and correlate strongly with them.

Nevertheless, it is not known how Mendeley readership counts accumulate within the year of publication, and so it is unclear how soon they can be used. In response, this paper reports a longitudinal weekly study of the Mendeley readers of articles in six library and information science journals from 2016.

The results suggest that Mendeley readers accrue from when articles are first available online and continue to steadily build. For journals with large publication delays, articles can already have substantial numbers of readers by their publication date.

Thus, Mendeley reader counts may even be useful as early impact indicators for articles before they have been officially published in a journal issue. If field normalised indicators are needed, then these can be generated when journal issues are published using the online first date.

URL : http://hdl.handle.net/2436/620522