From academic to media capital: To what extent does the scientific reputation of universities translate into Wikipedia attention?

Authors : Wenceslao Arroyo-MachadoAdrián A. Díaz-FaesEnrique Herrera-ViedmaRodrigo Costas

Universities face increasing demands to improve their visibility, public outreach, and online presence. There is a broad consensus that scientific reputation significantly increases the attention universities receive.

However, in most cases estimates of scientific reputation are based on composite or weighted indicators and absolute positions in university rankings. In this study, we adopt a more granular approach to assessment of universities’ scientific performance using a multidimensional set of indicators from the Leiden Ranking and testing their individual effects on university Wikipedia page views.

We distinguish between international and local attention and find a positive association between research performance and Wikipedia attention which holds for regions and linguistic areas. Additional analysis shows that productivity, scientific impact, and international collaboration have a curvilinear effect on universities’ Wikipedia attention.

This finding suggests that there may be other factors than scientific reputation driving the general public’s interest in universities. Our study adds to a growing stream of work which views altmetrics as tools to deepen science–society interactions rather than direct measures of impact and recognition of scientific outputs.

URL : From academic to media capital: To what extent does the scientific reputation of universities translate into Wikipedia attention?

DOI : https://doi.org/10.1002/asi.24856

How is science clicked on Twitter? Click metrics for Bitly short links to scientific publications

Authors : Zhichao Fang, Rodrigo Costas, Wencan Tian, Xianwen Wang, Paul Wouters

To provide some context for the potential engagement behavior of Twitter users around science, this article investigates how Bitly short links to scientific publications embedded in scholarly Twitter mentions are clicked on Twitter.

Based on the click metrics of over 1.1 million Bitly short links referring to Web of Science (WoS) publications, our results show that around 49.5% of them were not clicked by Twitter users. For those Bitly short links with clicks from Twitter, the majority of their Twitter clicks accumulated within a short period of time after they were first tweeted.

Bitly short links to the publications in the field of Social Sciences and Humanities tend to attract more clicks from Twitter over other subject fields. This article also assesses the extent to which Twitter clicks are correlated with some other impact indicators.

Twitter clicks are weakly correlated with scholarly impact indicators (WoS citations and Mendeley readers), but moderately correlated to other Twitter engagement indicators (total retweets and total likes).

In light of these results, we highlight the importance of paying more attention to the click metrics of URLs in scholarly Twitter mentions, to improve our understanding about the more effective dissemination and reception of science information on Twitter.

URL : How is science clicked on Twitter? Click metrics for Bitly short links to scientific publications

DOI : https://doi.org/10.1002/asi.24458

Open Access uptake by universities worldwide

Authors : Nicolas Robinson-Garcia​, Rodrigo Costas, Thed N. van Leeuwen

The implementation of policies promoting the adoption of an open science (OS) culture must be accompanied by indicators that allow monitoring the uptake of such policies and their potential effects on research publishing and sharing practices.

This study presents indicators of open access (OA) at the institutional level for universities worldwide. By combining data from Web of Science, Unpaywall and the Leiden Ranking disambiguation of institutions, we track OA coverage of universities’ output for 963 institutions.

This paper presents the methodological challenges, conceptual discrepancies and limitations and discusses further steps needed to move forward the discussion on fostering OA and OS practices and policies.

URL : Open Access uptake by universities worldwide

DOI : https://doi.org/10.7717/peerj.9410

 

The stability of Twitter metrics: A study on unavailable Twitter mentions of scientific publications

Authors : Zhichao Fang, Jonathan Dudek, Rodrigo Costas

This paper investigates the stability of Twitter counts of scientific publications over time. For this, we conducted an analysis of the availability statuses of over 2.6 million Twitter mentions received by the 1,154 most tweeted scientific publications recorded by this http URL up to October 2017.

Results show that of the Twitter mentions for these highly tweeted publications, about 14.3% have become unavailable by April 2019. Deletion of tweets by users is the main reason for unavailability, followed by suspension and protection of Twitter user accounts.

This study proposes two measures for describing the Twitter dissemination structures of publications: Degree of Originality (i.e., the proportion of original tweets received by a paper) and Degree of Concentration (i.e., the degree to which retweets concentrate on a single original tweet).

Twitter metrics of publications with relatively low Degree of Originality and relatively high Degree of Concentration are observed to be at greater risk of becoming unstable due to the potential disappearance of their Twitter mentions.

In light of these results, we emphasize the importance of paying attention to the potential risk of unstable Twitter counts, and the significance of identifying the different Twitter dissemination structures when studying the Twitter metrics of scientific publications.

URL : https://arxiv.org/abs/2001.07491

Social media metrics for new research evaluation

Authors : Paul Wouters, Zohreh Zahedi, Rodrigo Costas

This chapter approaches, both from a theoretical and practical perspective, the most important principles and conceptual frameworks that can be considered in the application of social media metrics for scientific evaluation.

We propose conceptually valid uses for social media metrics in research evaluation. The chapter discusses frameworks and uses of these metrics as well as principles and recommendations for the consideration and application of current (and potentially new) metrics in research evaluation.

URL  : https://arxiv.org/abs/1806.10541

Unbundling Open Access dimensions: a conceptual discussion to reduce terminology inconsistencies

Authors : Alberto Martín-Martín, Rodrigo Costas, Thed N. van Leeuwen, Emilio Delgado López-Cózar

The current ways in which documents are made freely accessible in the Web no longer adhere to the models established Budapest/Bethesda/Berlin (BBB) definitions of Open Access (OA). Since those definitions were established, OA-related terminology has expanded, trying to keep up with all the variants of OA publishing that are out there.

However, the inconsistent and arbitrary terminology that is being used to refer to these variants are complicating communication about OA-related issues. This study intends to initiate a discussion on this issue, by proposing a conceptual model of OA.

Our model features six different dimensions (authoritativeness, user rights, stability, immediacy, peer-review, and cost). Each dimension allows for a range of different options. We believe that by combining the options in these six dimensions, we can arrive at all the current variants of OA, while avoiding ambiguous and/or arbitrary terminology.

This model can be an useful tool for funders and policy makers who need to decide exactly which aspects of OA are necessary for each specific scenario.

URL : Unbundling Open Access dimensions: a conceptual discussion to reduce terminology inconsistencies

Alternative location : https://arxiv.org/abs/1806.05029

Evidence of Open Access of scientific publications in Google Scholar: a large-scale analysis

Authors : Alberto Martín-Martín, Rodrigo Costas, Thed van Leeuwen, Emilio López-Cózar

This article uses Google Scholar (GS) as a source of data to analyse Open Access (OA) levels across all countries and fields of research. All articles and reviews with a DOI and published in 2009 or 2014 and covered by the three main citation indexes in the Web of Science (2,269,022 documents) were selected for study.

The links to freely available versions of these documents displayed in GS were collected. To differentiate between more reliable (sustainable and legal) forms of access and less reliable ones, the data extracted from GS was combined with information available in DOAJ, CrossRef, OpenDOAR, and ROAR.

This allowed us to distinguish the percentage of documents in our sample that are made OA by the publisher (23.1%, including Gold, Hybrid, Delayed, and Bronze OA) from those available as Green OA (17.6%), and those available from other sources (40.6%, mainly due to ResearchGate).

The data shows an overall free availability of 54.6%, with important differences at the country and subject category levels. The data extracted from GS yielded very similar results to those found by other studies that analysed similar samples of documents, but employed different methods to find evidence of OA, thus suggesting a relative consistency among methods.

URL : Evidence of Open Access of scientific publications in Google Scholar: a large-scale analysis

Alternative location : https://osf.io/preprints/socarxiv/k54uv/