Tag Archives: metrics

The metric tide : Report of the independent review of the role of metrics in research assessment and management

« This report presents the findings and recommendations of the Independent Review of the Role of Metrics in Research Assessment and Management. The review was chaired by Professor James Wilsdon, supported by an independent and multidisciplinary group of experts in scientometrics, research funding, research policy, publishing, university management and administration.

This review has gone beyond earlier studies to take a deeper look at potential uses and limitations of research metrics and indicators. It has explored the use of metrics across different disciplines, and assessed their potential contribution to the development of research excellence and impact. It has analysed their role in processes of research assessment, including the next cycle of the Research Excellence Framework (REF). It has considered the changing ways in which universities are using quantitative indicators in their management systems, and the growing power of league tables and rankings. And it has considered the negative or unintended effects of metrics on various aspects of research culture. »

URL : http://microblogging.infodocs.eu/wp-content/uploads/2015/07/2015_metric_tide.pdf

Related URL : http://www.hefce.ac.uk/media/HEFCE,2014/Content/Pubs/Independentresearch/2015/The,Metric,Tide/2015_metric_tide.pdf


Leave a Comment

31 juillet 2015 · 11 h 42 min

Return on citation: a consistent metric to evaluate papers, journals and researchers

« Evaluating and comparing the academic performance of a journal, a researcher or a single paper has long remained a critical, necessary but also controversial issue. Most of existing metrics invalidate comparison across different fields of science or even between different types of papers in the same field. This paper proposes a new metric, called return on citation (ROC), which is simply a citation ratio but applies to evaluating the paper, the journal and the researcher in a consistent way, allowing comparison across different fields of science and between different types of papers and discouraging unnecessary and coercive/self-citation. »

URL : http://arxiv.org/abs/1412.8420

Commentaires fermés sur Return on citation: a consistent metric to evaluate papers, journals and researchers

30 décembre 2014 · 18 h 10 min

Open Access and the Changing Landscape of Research…

Open Access and the Changing Landscape of Research Impact Indicators: New Roles for Repositories :

« The debate about the need to revise metrics that evaluate research excellence has been ongoing for years, and a number of studies have identified important issues that have yet to be addressed. Internet and other technological developments have enabled the collection of richer data and new approaches to research assessment exercises. Open access strongly advocates for maximizing research impact by enhancing seamless accessibility. In addition, new tools and strategies have been used by open access journals and repositories to showcase how science can benefit from free online dissemination. Latest players in the debate include initiatives based on alt-metrics, which enrich the landscape with promising indicators. To start with, the article gives a brief overview of the debate and the role of open access in advancing a new frame to assess science. Next, the work focuses on the strategy that the Spanish National Research Council’s repository DIGITAL.CSIC is implementing to collect a rich set of statistics and other metrics that are useful for repository administrators, researchers and the institution alike. A preliminary analysis of data hints at correlations between free dissemination of research through DIGITAL.CSIC and enhanced impact, reusability and sharing of CSIC science on the web. »

URL : http://www.mdpi.com/2304-6775/1/2/56

Commentaires fermés sur Open Access and the Changing Landscape of Research…

23 juillet 2013 · 17 h 39 min

Universality of scholarly impact metrics We present…

Universality of scholarly impact metrics:

« We present a method to quantify the disciplinary bias of any scholarly impact metric, and introduce a simple universal metric that allows to compare the impact of scholars across scientific disciplines. »

URL : http://arxiv.org/abs/1305.6339

Commentaires fermés sur Universality of scholarly impact metrics We present…

29 mai 2013 · 17 h 37 min

Repositories in Google Scholar Metrics or what is…

Repositories in Google Scholar Metrics or what is this document type doing in a place as such? :

« The present paper analyzes GS Metrics, Google’s newest product aiming at ranking journals according to their H-Index. Specifically, we analyze GS Metrics’ decision of considering journals and repositories as equal and therefore, including them in the product. In this sense, the authors position themselves against this decision and provide several arguments of different nature warning against the shortcomings this product has. The first one is of a conceptual nature and is related to the definition of journal and repository. Secondly, they refer at the methodological issues mixing repositories and journals can bring out. Then, they deepen on many other flaws GS Metrics presents. Finally, GS Metrics and its possible use as an evaluation tool are discussed and possible solutions to its shortcomings are provided. »

URL : http://cybermetrics.cindoc.csic.es/articles/v16i1p4.html

Commentaires fermés sur Repositories in Google Scholar Metrics or what is…

11 octobre 2012 · 20 h 52 min