Archives des mots-clés : research impact

Research impact: a narrative review

Posté le par

Authors : Trisha Greenhalgh, James Raftery, Steve Hanney, Matthew Glover

Impact occurs when research generates benefits (health, economic, cultural) in addition to building the academic knowledge base. Its mechanisms are complex and reflect the multiple ways in which knowledge is generated and utilised.

Much progress has been made in measuring both the outcomes of research and the processes and activities through which these are achieved, though the measurement of impact is not without its critics.

We review the strengths and limitations of six established approaches (Payback, Research Impact Framework, Canadian Academy of Health Sciences, monetisation, societal impact assessment, UK Research Excellence Framework) plus recently developed and largely untested ones (including metrics and electronic databases).

We conclude that (1) different approaches to impact assessment are appropriate in different circumstances; (2) the most robust and sophisticated approaches are labour-intensive and not always feasible or affordable; (3) whilst most metrics tend to capture direct and proximate impacts, more indirect and diffuse elements of the research-impact link can and should be measured; and (4) research on research impact is a rapidly developing field with new methodologies on the horizon.

URL : Research impact: a narrative review

Alternative location : https://www.ncbi.nlm.nih.gov/pubmed/27211576

Article-Level Metrics (ALMs) of “Nature” Journal

Posté le par

Author : Chintha Nagabhushanam

The main aim of scientific research is to systematically generate valid data which is measurable, reproducible, and testable, contributing to the existing knowledge about the subject.

This paper explains the Altmetrics of Nature Journal that is a summation of the impact of all articles in a journal based on citations. Article-level metrics measured the impact of individual articles, including usage (e.g., pageviews, downloads), citations, and social metrics like Twitter, Facebook and blogs, of non-duplicate online mentions.

Paper discuss article-level metrics from http://www.nature.com web site and analyses the data accordingly.

URL : Article-Level Metrics (ALMs) of “Nature” Journal

Alternative location : http://irjlis.com/article-level-metrics-alms-of-nature-journal/

Revisiting an open access monograph experiment: measuring citations and tweets 5 years later

Posté le par

Author : Ronald Snijder

An experiment run in 2009 could not assess whether making monographs available in open access enhanced scholarly impact. This paper revisits the experiment, drawing on additional citation data and tweets. It attempts to answer the following research question: does open access have a positive influence on the number of citations and tweets a monograph receives, taking into account the influence of scholarly field and language?

The correlation between monograph citations and tweets is also investigated. The number of citations and tweets measured in 2014 reveal a slight open access advantage, but the influence of language or subject should also be taken into account. However, Twitter usage and citation behaviour hardly overlap.

URL : Revisiting an open access monograph experiment

Alternative location : https://rd.springer.com/article/10.1007/s11192-016-2160-6

Impact de l’Open Access sur les citations : une étude de cas

Posté le par

Auteurs/Authors : Frédérique Bordignon, Mathieu Andro

De multiples études, dans la littérature internationale, ont cherché à évaluer l’impact de l’Open Access sur le taux de citation des articles scientifiques. La présente étude, en langue française, reste limitée aux publications 2010 de l’Ecole des Ponts.

Elle offre néanmoins un état de l’art des précédentes études sur le sujet à un lectorat de professionnels francophones et a pour originalité de mesurer le nombre moyen de citations par mois, avant et après “libération” Open Access des articles et d’éviter ainsi la plupart des biais qui peuvent être rencontrés dans ce type de démarche.

En plus de confirmer, comme beaucoup d’autres l’ont fait auparavant, un avantage net de l’Open Access sur le taux de citation en informatique, sciences de la terre et de l’univers, ingénierie, sciences environnementales, mathématiques, physique et astronomie, elle montre aussi qu’une « libération » précoce peut avoir un impact plus favorable qu’une « libération » tardive dans certains champs disciplinaires, comme les mathématiques et physique/astronomie.

URL : Impact de l’Open Access sur les citations : une étude de cas

Measuring Scientific Impact Beyond Citation Counts

Posté le par

Authors : Robert M. Patton, Christopher G. Stahl, Jack C. Wells

The measurement of scientific progress remains a significant challenge exasperated by the use of multiple different types of metrics that are often incorrectly used, overused, or even explicitly abused.

Several metrics such as h-index or journal impact factor (JIF) are often used as a means to assess whether an author, article, or journal creates an “impact” on science. Unfortunately, external forces can be used to manipulate these metrics thereby diluting the value of their intended, original purpose.

This work highlights these issues and the need to more clearly define “impact” as well as emphasize the need for better metrics that leverage full content analysis of publications.

URL : http://www.dlib.org/dlib/september16/patton/09patton.html

Sharing data increases citations

Posté le par

Authors: Thea Marie Drachen, Ole Ellegaard, Asger Væring Larsen, Søren Bertil Fabricius Dorch

This paper presents some indications to the existence of a citation advantage related to sharing data using astrophysics as a case. Through bibliometric analyses we find a citation advantage for astrophysical papers in core journals.

The advantage arises as indexed papers are associated with data by bibliographical links, and consists of papers receiving on average significantly more citations per paper per year, than do papers not associated with links to data.

DOI : https://www.liberquarterly.eu/article/10.18352/lq.10149/

The Post-Embargo Open Access Citation Advantage: It Exists (Probably), Its Modest (Usually), and the Rich Get Richer (of Course)

Posté le par

Author : Jim Ottaviani

Many studies show that open access (OA) articles—articles from scholarly journals made freely available to readers without requiring subscription fees—are downloaded, and presumably read, more often than closed access/subscription-only articles.

Assertions that OA articles are also cited more often generate more controversy. Confounding factors (authors may self-select only the best articles to make OA; absence of an appropriate control group of non-OA articles with which to compare citation figures; conflation of pre-publication vs. published/publisher versions of articles, etc.) make demonstrating a real citation difference difficult.

This study addresses those factors and shows that an open access citation advantage as high as 19% exists, even when articles are embargoed during some or all of their prime citation years. Not surprisingly, better (defined as above median) articles gain more when made OA.

URL : The Post-Embargo Open Access Citation Advantage: It Exists (Probably), Its Modest (Usually), and the Rich Get Richer (of Course)

DOI : http://dx.doi.org/10.1371/journal.pone.0159614