How much research shared on Facebook is hidden from public view? A comparison of public and private online activity around PLOS ONE papers

Authors : Asura Enkhbayar, Stefanie Haustein, Germana Barata, Juan Pablo Alperin

Despite its undisputed position as the biggest social media platform, Facebook has never entered the main stage of altmetrics research. In this study, we argue that the lack of attention by altmetrics researchers is not due to a lack of relevant activity on the platform, but because of the challenges in collecting Facebook data have been limited to activity that takes place in a select group of public pages and groups.

We present a new method of collecting shares, reactions, and comments across the platform-including private timelines-and use it to gather data for all articles published between 2015 to 2017 in the journal PLOS ONE.

We compare the gathered data with altmetrics collected and aggregated by Altmetric. The results show that 58.7% of papers shared on the platform happen outside of public view and that, when collecting all shares, the volume of activity approximates patterns of engagement previously only observed for Twitter.

Both results suggest that the role and impact of Facebook as a medium for science and scholarly communication has been underestimated. Furthermore, they emphasise the importance of openness and transparency around the collection and aggregation of altmetrics.

URL : https://arxiv.org/abs/1909.01476

Use of the Journal Impact Factor in academic review, promotion, and tenure evaluations

Authors : Erin C. McKiernan​, Lesley A. Schimanski, Carol Muñoz Nieves, Lisa Matthias, Meredith T. Niles, Juan Pablo Alperin

The Journal Impact Factor (JIF) was originally designed to aid libraries in deciding which journals to index and purchase for their collections. Over the past few decades, however, it has become a relied upon metric used to evaluate research articles based on journal rank. Surveyed faculty often report feeling pressure to publish in journals with high JIFs and mention reliance on the JIF as one problem with current academic evaluation systems.

While faculty reports are useful, information is lacking on how often and in what ways the JIF is currently used for review, promotion, and tenure (RPT). We therefore collected and analyzed RPT documents from a representative sample of 129 universities from the United States and Canada and 381 of their academic units.

We found that 40% of doctoral, research-intensive (R-type) institutions and 18% of master’s, or comprehensive (M-type) institutions explicitly mentioned the JIF, or closely related terms, in their RPT documents.

Undergraduate, or baccalaureate (B-type) institutions did not mention it at all. A detailed reading of these documents suggests that institutions may also be using a variety of terms to indirectly refer to the JIF.

Our qualitative analysis shows that 87% of the institutions that mentioned the JIF supported the metric’s use in at least one of their RPT documents, while 13% of institutions expressed caution about the JIF’s use in evaluations.

None of the RPT documents we analyzed heavily criticized the JIF or prohibited its use in evaluations. Of the institutions that mentioned the JIF, 63% associated it with quality, 40% with impact, importance, or significance, and 20% with prestige, reputation, or status.

In sum, our results show that the use of the JIF is encouraged in RPT evaluations, especially at research-intensive universities, and indicates there is work to be done to improve evaluation processes to avoid the potential misuse of metrics like the JIF.

URL : Use of the Journal Impact Factor in academic review, promotion, and tenure evaluations

DOI : https://doi.org/10.7287/peerj.preprints.27638v2

How significant are the public dimensions of faculty work in review, promotion, and tenure documents?

Authors : Juan Pablo Alperin, Gustavo E. Fischman, Erin C. McKiernan, Carol Muñoz Nieves, Meredith T. Niles, Lesley Schimanski

Much of the work of universities, even private institutions, has significant public dimensions. Faculty work in particular is often funded by public funds, is aimed at serving the public good, and is subject to public evaluation.

To understand how the public dimensions of faculty work are valued, we analyzed review, tenure and promotion documents from a representative sample of 129 Canadian and American universities.

We found terms and concepts related to public and community are mentioned in a large portion of documents, but mostly in ways that relate to service—an undervalued aspect of academic careers.

Moreover, we find significant mentions of traditional research outputs and citation-based metrics. Such outputs and metrics reward faculty work targeted to academics, and mostly disregard the public dimensions.

We conclude that institutions that want to live up to their public mission need to work towards systemic change in how faculty work is assessed and incentivized.

URL : How significant are the public dimensions of faculty work in review, promotion, and tenure documents?

DOI : https://hcommons.org/deposits/item/hc:21015

Is It Such a Big Deal? On the Cost of Journal Use in the Digital Era

Authors : Fei Shu, Philippe Mongeon, Stefanie Haustein, Kyle Siler, Juan Pablo Alperin, Vincent Larivière

Commercial scholarly publishers promote and sell bundles of journals—known as big deals—that provide access to entire collections rather than individual journals. Following this new model, size of serial collections in academic libraries increased almost fivefold from 1986 to 2011.

Using data on library subscriptions and references made for a sample of North American universities, this study provides evidence that, while big deal bundles do decrease the mean price per subscribed journal, academic libraries receive less value for their investment.

We find that university researchers cite only a fraction of journals purchased by their libraries, that this fraction is decreasing, and that the cost per cited journal has increased.

These findings reveal how academic publishers use product differentiation and price strategies to increase sales and profits in the digital era, often at the expense of university and scientific stakeholders.

URL : Is It Such a Big Deal? On the Cost of Journal Use in the Digital Era

DOI : https://doi.org/10.5860/crl.79.6.785

The Public Knowledge Project: Reflections and Directions After Its First Two Decades

Authors : Juan Pablo Alperin, John Willinsky, Brian Owen, James MacGregor, Alec Smecher, Kevin Stranack

As the Public Knowledge Project (PKP) enters its third decade, it faces the responsibilities of supporting the more than 10,000 journals using its software and are dependent on PKP continuing to develop the code.

In the fall of 2017, PKP, with the support of the Arnold Foundation, contracted the consulting services of BlueSky to Blueprint, with its principal Nancy Maron embarking on an exploration of PKP’s standing and prospects among a sample of those in-volved in scholarly publishing, inclu-ding current, former, and potential users of its software (Maron 2018).

This paper presents BlueSky’s findings and PKP’s responses in what may serve as a lesson on the maturing of, and challenges faced by, an open source software project seeking to sustain in-creased global access to research and scholarship.

URL : https://hal.archives-ouvertes.fr/hal-01816677

Authorial and institutional stratification in open access publishing: the case of global health research

Authors : Kyle Siler, Stefanie Haustein, Elise Smith, Vincent Larivière, Juan Pablo Alperin

Using a database of recent articles published in the field of Global Health research, we examine institutional sources of stratification in publishing access outcomes. Traditionally, the focus on inequality in scientific publishing has focused on prestige hierarchies in established print journals.

This project examines stratification in contemporary publishing with a particular focus on subscription vs. various Open Access (OA) publishing options.

Findings show that authors working at lower-ranked universities are more likely to publish in closed/paywalled outlets, and less likely to choose outlets that involve some sort of Article Processing Charge (APCs; gold or hybrid OA).

We also analyze institutional differences and stratification in the APC costs paid in various journals. Authors affiliated with higher-ranked institutions, as well as hospitals and non-profit organizations pay relatively higher APCs for gold and hybrid OA publications.

Results suggest that authors affiliated with high-ranked universities and well-funded institutions tend to have more resources to choose pay options with publishing. Our research suggests new professional hierarchies developing in contemporary publishing, where various OA publishing options are becoming increasingly prominent.

Just as there is stratification in institutional representation between different types of publishing access, there is also inequality within access types.

URL : Authorial and institutional stratification in open access publishing: the case of global health research

DOI : https://doi.org/10.7717/peerj.4269

The State of OA: A large-scale analysis of the prevalence and impact of Open Access articles

Authors : Heather Piwowar, Jason Priem, Vincent Larivière, Juan Pablo Alperin, Lisa Matthias, Bree Norlander, Ashley Farley, Jevin West, Stefanie Haustein

Despite growing interest in Open Access (OA) to scholarly literature, there is an unmet need for large-scale, up-to-date, and reproducible studies assessing the prevalence and characteristics of OA. We address this need using oaDOI, an open online service that determines OA status for 67 million articles.

We use three samples, each of 100,000 articles, to investigate OA in three populations: 1) all journal articles assigned a Crossref DOI, 2) recent journal articles indexed in Web of Science, and 3) articles viewed by users of Unpaywall, an open-source browser extension that lets users find OA articles using oaDOI.

We estimate that at least 28% of the scholarly literature is OA (19M in total) and that this proportion is growing, driven particularly by growth in Gold and Hybrid. The most recent year analyzed (2015) also has the highest percentage of OA (45%). Because of this growth, and the fact that readers disproportionately access newer articles, we find that Unpaywall users encounter OA quite frequently: 47% of articles they view are OA. Notably, the most common mechanism for OA is not Gold, Green, or Hybrid OA, but rather an under-discussed category we dub Bronze: articles made free-to-read on the publisher website, without an explicit Open license.

We also examine the citation impact of OA articles, corroborating the so-called open-access citation advantage: accounting for age and discipline, OA articles receive 18% more citations than average, an effect driven primarily by Green and Hybrid OA. We encourage further research using the free oaDOI service, as a way to inform OA policy and practice.

URL : The State of OA: A large-scale analysis of the prevalence and impact of Open Access articles

DOI : https://doi.org/10.7287/peerj.preprints.3119v1