Meaningful Metrics: A 21st Century Librarian’s Guide to Bibliometrics, Altmetrics, and Research Impact

What does it mean to have meaningful metrics in today’s complex higher education landscape? With a foreword by Heather Piwowar and Jason Priem, this highly engaging and activity-laden book serves to introduce readers to the fast-paced world of research metrics from the unique perspective of academic librarians and LIS practitioners.

Starting with the essential histories of bibliometrics and altmetrics, and continuing with in-depth descriptions of the core tools and emerging issues at stake in the future of both fields, Meaningful Metrics is a convenient all-in-one resource that is designed to be used by a range of readers, from those with little to no background on the subject to those looking to become movers and shakers in the current scholarly metrics movement. Authors Borchardt and Roemer, offer tips, tricks, and real-world examples illustrate how librarians can support the successful adoption of research metrics, whether in their institutions or across academia as a whole.

URL : http://www.ala.org/acrl/sites/ala.org.acrl/files/content/publications/booksanddigitalresources/digital/9780838987568_metrics_OA.pdf

Tweets Do Measure Non – Citational Intellectual Impact

Purpose

The aim of the paper is to identify the motive behind the social media indicators in focus to tweets and attempts to identify what is measured or indicated by tweets, based on these motives.

Design/methodology/approach

Documents with non zero tweets were manually collected from a source of 5 journals – Nature Biotechnology, Nature Nanotechnology, Nature Physics, Nature Chemistry and Nature Communications for the period January 2014 – October 2014 so as to depict the contemporary trend, as tweets tends to have L shaped curve in time-wise distribution.

Findings

Investigations suggest that the motives behind the tweets are research reach, research acceptance and research usage. Further analysis revealed that the motive behind self – tweets are research visibility, which is one of the attributes of social media and therefore self tweets may not be a complex problem as expected seeing that documents are self tweeted not more than once in most cases.

Furthermore, identifying and classifying tweets based on users – Publishers, Frequent tweeters who apparently tweet all documents of an issue and Authors will increase the effectiveness of altmetrics in research evaluation. It was also found that association between subjects can be identified by the analysis of tweets pattern among subjects.

Originality/value

Study proposes an overall hierarchical structure of impact based on the change/advancement instigated. The study confirms that tweets do measure non – academic intellectual impact that is not captured by traditional metrics.

URL : http://www.itlit.net/v2n2art2.pdf

Altmetrics as traces of the computerization of the research process

I propose a broad, multi-dimensional conception of altmetrics, namely as traces of the computerization of the research process. Computerization should be conceived in its broadest sense, including all recent developments in ICT and software, taking place in society as a whole. I distinguish four aspects of the research process: the collection of research data and development of research methods; scientific information processing; communication and organization; and, last but not least, research assessment.

I will argue that in each aspect, computerization plays a key role, and metrics are being developed to describe this process. I propose to label the total collection of such metrics as Altmetrics. I seek to provide a theoretical foundation of altmetrics, based on notions developed by Michael Nielsen in his monograph Reinventing Discovery: The New Era of Networked Science. Altmetrics can be conceived as tools for the practical realization of the ethos of science and scholarship in a computerized or digital age.

URL : http://arxiv.org/abs/1510.05131

The quandary between communication and certification

Purpose

The purpose of this paper is to understand individual academics’ perception, attitudes and participation in Open Access Publishing and open scholarship and revisit some principles and designs of openness in academic publishing from the perspective of creative end-users, which helps to increase the sustainability and efficiency of open models.

Design/methodology/approach

 This paper draws on a case study of China and empirical data collected through semi-structured interviews with a wide range of academics and stakeholders.

Findings

 A separation between the communication and certification functions of publishing is identified: open initiatives are valued for efficient and interactive communication while traditional publishing still dominates the legitimacy of research publications, which leads to the quandary of individual academics operating within the transitional landscape of scholarly communication.

Practical implications

Practical recommendations for sustainable and efficient openness are derived from discussions on the difficulties associated open/social certification and the shifting maxims that govern academics from “publish or perish” to “be visible or vanish”.

Originality/value

“Openness” is defined in broad sense integrating Open Access and open scholarship to comprehensively reflect individual academics’ views in the transitional landscape of academic publishing. The research findings suggest that new open approaches are needed to address the evolving tension and conflicts between communication and certification.

URL : http://dx.doi.org/10.1108/OIR-04-2015-0129

Interpreting “altmetrics”: viewing acts on social media through the lens of citation and social theories

Statut

“More than 30 years after Cronin’s seminal paper on “the need for a theory of citing” (Cronin, 1981), the metrics community is once again in need of a new theory, this time one for so-called “altmetrics”. Altmetrics, short for alternative (to citation) metrics — and as such a misnomer — refers to a new group of metrics based (largely) on social media events relating to scholarly communication. As current definitions of altmetrics are shaped and limited by active platforms, technical possibilities, and business models of aggregators such as Altmetric.com, ImpactStory, PLOS, and Plum Analytics, and as such constantly changing, this work refrains from defining an umbrella term for these very heterogeneous new metrics. Instead a framework is presented that describes acts leading to (online) events on which the metrics are based. These activities occur in the context of social media, such as discussing on Twitter or saving to Mendeley, as well as downloading and citing. The framework groups various types of acts into three categories — accessing, appraising, and applying — and provides examples of actions that lead to visibility and traceability online. To improve the understanding of the acts, which result in online events from which metrics are collected, select citation and social theories are used to interpret the phenomena being measured. Citation theories are used because the new metrics based on these events are supposed to replace or complement citations as indicators of impact. Social theories, on the other hand, are discussed because there is an inherent social aspect to the measurements.”

URL : http://arxiv.org/abs/1502.05701

Characterizing Social Media Metrics of Scholarly Papers: The Effect of Document Properties and Collaboration Patterns

Statut

“A number of new metrics based on social media platforms—grouped under the term “altmetrics”—have recently been introduced as potential indicators of research impact. Despite their current popularity, there is a lack of information regarding the determinants of these metrics. Using publication and citation data from 1.3 million papers published in 2012 and covered in Thomson Reuters’ Web of Science as well as social media counts from Altmetric.com, this paper analyses the main patterns of five social media metrics as a function of document characteristics (i.e., discipline, document type, title length, number of pages and references) and collaborative practices and compares them to patterns known for citations. Results show that the presence of papers on social media is low, with 21.5% of papers receiving at least one tweet, 4.7% being shared on Facebook, 1.9% mentioned on blogs, 0.8% found on Google+ and 0.7% discussed in mainstream media. By contrast, 66.8% of papers have received at least one citation. Our findings show that both citations and social media metrics increase with the extent of collaboration and the length of the references list. On the other hand, while editorials and news items are seldom cited, it is these types of document that are the most popular on Twitter. Similarly, while longer papers typically attract more citations, an opposite trend is seen on social media platforms. Finally, contrary to what is observed for citations, it is papers in the Social Sciences and humanities that are the most often found on social media platforms. On the whole, these findings suggest that factors driving social media and citations are different. Therefore, social media metrics cannot actually be seen as alternatives to citations; at most, they may function as complements to other type of indicators.”

URL : Characterizing Social Media Metrics of Scholarly Papers

DOI : 10.1371/journal.pone.0120495

New data, new possibilities: Exploring the insides of Altmetric.com

Statut

“This paper analyzes Altmetric.com, one of the most important altmetric data providers currently used. We have analyzed a set of publications with DOI number indexed in the Web of Science during the period 2011-2013 and collected their data with the Altmetric API. 19% of the original set of papers was retrieved from Altmetric.com including some altmetric data. We identified 16 different social media sources from which Altmetric.com retrieves data. However five of them cover 95.5% of the total set. Twitter (87.1%) and Mendeley (64.8%) have the highest coverage. We conclude that Altmetric.com is a transparent, rich and accurate tool for altmetric data. Nevertheless, there are still potential limitations on its exhaustiveness as well as on the selection of social media sources that need further research.”

URL : http://arxiv.org/abs/1408.0135