Do Download Reports Reliably Measure Journal Usage? Trusting the Fox to Count Your Hens?

Authors : Alex Wood-Doughty, Ted Bergstrom, Douglas G. Steigerwald

Download rates of academic journals have joined citation counts as commonly used indicators of the value of journal subscriptions. While citations reflect worldwide influence, the value of a journal subscription to a single library is more reliably measured by the rate at which it is downloaded by local users.

If reported download rates accurately measure local usage, there is a strong case for using them to compare the cost-effectiveness of journal subscriptions. We examine data for nearly 8,000 journals downloaded at the ten universities in the University of California system during a period of six years.

We find that controlling for number of articles, publisher, and year of download, the ratio of downloads to citations differs substantially among academic disciplines.

After adding academic disciplines to the control variables, there remain substantial “publisher effects”, with some publishers reporting significantly more downloads than would be predicted by the characteristics of their journals.

These cross-publisher differences suggest that the currently available download statistics, which are supplied by publishers, are not sufficiently reliable to allow libraries to make subscription decisions based on price and reported downloads, at least without making an adjustment for publisher effects in download reports.

URL : Do Download Reports Reliably Measure Journal Usage? Trusting the Fox to Count Your Hens?

DOI: https://doi.org/10.5860/crl.80.5.694

Share or perish: Social media and the International Journal of Mental Health Nursing

Authors : Paul McNamara, Kim Usher

The impact of published research is sometimes measured by the number of citations an individual article accumulates. However, the time from publication to citation can be extensive. Years may pass before authors are able to measure the impact of their publication. Social media provides individuals and organizations a powerful medium with which to share information.

The power of social media is sometimes harnessed to share scholarly works, especially journal article citations and quotes. A non‐traditional bibliometric is required to understand the impact social media has on disseminating scholarly works/research.

The International Journal of Mental Health Nursing (IJMHN) appointed a social media editor as of 1 January 2017 to implement a strategy to increase the impact and reach of the journal’s articles.

To measure the impact of the IJMHN social media strategy, quantitative data for the eighteen months prior to the social media editor start date, and the eighteen months after that date (i.e.: from 01 July 2015 to 30 June 2018) were acquired and analysed.

Quantitative evidence demonstrates the effectiveness of one journal’s social media strategy in increasing the reach and readership of the articles it publishes.

This information may be of interest to those considering where to publish their research, those wanting to amplify the reach of their research, those who fund research, and journal editors and boards.

DOI : https://doi.org/10.1111/inm.12600

The citation advantage of linking publications to research data

Authors : Giovanni Colavizza, Iain Hrynaszkiewicz, Isla Staden, Kirstie Whitaker, Barbara McGillivray

Efforts to make research results open and reproducible are increasingly reflected by journal policies encouraging or mandating authors to provide data availability statements.

As a consequence of this, there has been a strong uptake of data availability statements in recent literature. Nevertheless, it is still unclear what proportion of these statements actually contain well-formed links to data, for example via a URL or permanent identifier, and if there is an added value in providing them.

We consider 531,889 journal articles published by PLOS and BMC which are part of the PubMed Open Access collection, categorize their data availability statements according to their content and analyze the citation advantage of different statement categories via regression.

We find that, following mandated publisher policies, data availability statements have become common by now, yet statements containing a link to a repository are still just a fraction of the total.

We also find that articles with these statements, in particular, can have up to 25.36% higher citation impact on average: an encouraging result for all publishers and authors who make the effort of sharing their data. All our data and code are made available in order to reproduce and extend our results.

URL : https://arxiv.org/abs/1907.02565

Large publishing consortia produce higher citation impact research but co-author contributions are hard to evaluate

Author : Mike Thelwall

This paper introduces a simple agglomerative clustering method to identify large publishing consortia with at least 20 authors and 80% shared authorship between articles. Based on Scopus journal articles 1996-2018, under these criteria, nearly all (88%) of the large consortia published research with citation impact above the world average, with the exceptions being mainly the newer consortia for which average citation counts are unreliable.

On average, consortium research had almost double (1.95) the world average citation impact on the log scale used (Mean Normalised Log Citation Score). At least partial alphabetical author ordering was the norm in most consortia.

The 250 largest consortia were for nuclear physics and astronomy around expensive equipment, and for predominantly health-related issues in genomics, medicine, public health, microbiology and neuropsychology.

For the health-related issues, except for the first and last few authors, authorship seem to primary indicate contributions to the shared project infrastructure necessary to gather the raw data.

It is impossible for research evaluators to identify the contributions of individual authors in the huge alphabetical consortia of physics and astronomy, and problematic for the middle and end authors of health-related consortia.

For small scale evaluations, authorship contribution statements could be used, when available.

URL : https://arxiv.org/abs/1906.01849

Access to Top-Cited Emergency Care Articles (Published Between 2012 and 2016) Without Subscription

Authors : Murad Al Hamzy, Dominique de Villiers, Megan Banner, Hein Lamprecht, Stevan R. Bruijns

Introduction

Unrestricted access to journal publications speeds research progress, productivity, and knowledge translation, which in turn develops and promotes the efficient dissemination of content.

We describe access to the 500 most-cited emergency medicine (EM) articles (published between 2012 and 2016) in terms of publisher-based access (open access or subscription), alternate access routes (self-archived or author provided), and relative cost of access.

Methods

We used the Scopus database to identify the 500 most-cited EM articles published between 2012 and 2016. Access status was collected from the journal publisher. For studies not available via open access, we searched on Google, Google Scholar, Researchgate, Academia.edu, and the Unpaywall and Open Access Button browser plugins to locate self archived copies.

We contacted corresponding authors of the remaining inaccessible studies for a copy of each of their articles. We collected article processing and access costs from the journal publishers, and then calculated relative cost differences using the World Bank purchasing power parity index for the United States (U.S.), Germany, Turkey, China, Brazil, South Africa, and Australia.

This allows costs to be understood relative to the economic context of the countries from which they originated.

Results

We identified 500 articles for inclusion in the study. Of these, 167 (33%) were published in an open access format. Of the remaining 333 (67%), 204 (61%) were available elsewhere on the internet, 18 (4%) were provided by the authors, and 111 (22%) were accessible by subscription only.

The mean article processing and access charges were $2,518.62 and $44.78, respectively. These costs were 2.24, 1.75, 2.28 and 1.56 times more expensive for South African, Chinese, Turkish, and Brazilian authors, respectively, than for U.S. authors (p<0.001 all).

Conclusion

Despite the advantage of open access publication for knowledge translation, social responsibility, and increased citation, one in five of the 500 EM articles were accessible only via subscription. Access for scientists from upper-middle income countries was significantly hampered by cost.

It is important to acknowledge the value this has for authors from low- and middle-income countries. Authors should also consider the citation advantage afforded by open access publishing when deciding where to publish.

URL : Access to Top-Cited Emergency Care Articles (Published Between 2012 and 2016) Without Subscription

DOI : https://doi.org/10.5811/westjem.2019.2.40957

Impact Assessment of Non-Indexed Open Access Journals: A Case Study

Authors : Daniela Solomon, Mark Eddy

This case study assesses the impact of a small, open-access social sciences journal not included in citation tracking indexes by exploring measures of the journal’s influence beyond the established “impact factor” formula. An analysis of Google Scholar data revealed the journal’s global reach and value to researchers.

This study enabled the journal’s editors to measure the success of their publication according to its professed scope and mission, and to quantify its impact for prospective contributors.

The impact assessment strategies outlined here can be leveraged effectively by academic librarians to provide high-value consultancy for scholar-editors of open access research journals.

URL : https://preprint.press.jhu.edu/portal/sites/ajm/files/19.2solomon.pdf

Aligning Social Media Indicators with the Documents in an Open Access Repository

Authors: Luis Meneses, Alyssa Arbuckle, Hector Lopez, Belaid Moa, Richard Furuta, Ray Siemens

In this paper we describe our current efforts towards building a framework that extends the functionality of an Open Access Repository by implementing processes to incorporate the ongoing trends in social media into the context of a digital collection.

We refer to these processes collectively as the Social Media Engine. The purpose of our framework is twofold: first, we propose to challenge some of the preconceived notions of digital libraries by making repositories more dynamic; and second, by challenging this notion we want to promote public engagement and open scholarship.

As a work in progress, we believe that a real challenge lies in investigating the implications that these two points introduce within the context of the humanities.

URL : Aligning Social Media Indicators with the Documents in an Open Access Repository

DOI : http://doi.org/10.5334/kula.44