Inferring the causal effect of journals on citations

Author : Vincent A Traag

Articles in high-impact journals are, on average, more frequently cited. But are they cited more often because those articles are somehow more “citable”? Or are they cited more often simply because they are published in a high-impact journal? Although some evidence suggests the latter, the causal relationship is not clear.

We here compare citations of preprints to citations of the published version to uncover the causal mechanism. We build on an earlier model of citation dynamics to infer the causal effect of journals on citations. We find that high-impact journals select articles that tend to attract more citations.

At the same time, we find that high-impact journals augment the citation rate of published articles. Our results yield a deeper understanding of the role of journals in the research system.

The use of journal metrics in research evaluation has been increasingly criticized in recent years and article-level citations are sometimes suggested as an alternative. Our results show that removing impact factors from evaluation does not negate the influence of journals. This insight has important implications for changing practices of research evaluation.

DOI : https://doi.org/10.1162/qss_a_00128

The relationship between bioRxiv preprints, citations and altmetrics

Authors : Nicholas Fraser, Fakhri Momeni, Philipp Mayr, Isabella Peters

A potential motivation for scientists to deposit their scientific work as preprints is to enhance its citation or social impact. In this study we assessed the citation and altmetric advantage of bioRxiv, a preprint server for the biological sciences.

We retrieved metadata of all bioRxiv preprints deposited between November 2013 and December 2017, and matched them to articles that were subsequently published in peer-reviewed journals.

Citation data from Scopus and altmetric data from Altmetric.com were used to compare citation and online sharing behavior of bioRxiv preprints, their related journal articles, and nondeposited articles published in the same journals. We found that bioRxiv-deposited journal articles had sizably higher citation and altmetric counts compared to nondeposited articles.

Regression analysis reveals that this advantage is not explained by multiple explanatory variables related to the articles’ publication venues and authorship. Further research will be required to establish whether such an effect is causal in nature.

bioRxiv preprints themselves are being directly cited in journal articles, regardless of whether the preprint has subsequently been published in a journal. bioRxiv preprints are also shared widely on Twitter and in blogs, but remain relatively scarce in mainstream media and Wikipedia articles, in comparison to peer-reviewed journal articles.

DOI : https://doi.org/10.1162/qss_a_00043

The citation from patents to scientific output revisited: a new approach to the matching Patstat / Scopus

Authors : Vicente P. Gerrero-Bote, Rodrigo Sánchez-Jiménez, Félix De-Moya-Anegón

Patents include citations, both to other patents and to documents that are not patents (NPL, Non-patent literature). Among the latter include citations to articles published in scientific journals.

Just as the scientific impact is studied through the citation of articles and other scientific works, the technological impact of scientific works can also be studied through the citation they receive from patents.

The NPL references included in the patents are far from being standardized, so determining which scientific article they refer to is not trivial. This paper presents a procedure for linking the NPL references of the patents collected in the Patstat database and the scientific works indexed in the Scopus bibliographic database.

This procedure consists of two phases: a broad generation of candidate couples and another phase of validation of couples. It has been implemented with reasonable good results and affordable costs.

URL : https://recyt.fecyt.es/index.php/EPI/article/view/epi.2019.jul.01

Do all citations value the same? Valuing citations by the value of the citing items

Authors : Cristiano Giuffrida, Giovanni Abramo, Ciriaco Andrea D’Angelo

Bibliometricians have long recurred to citation counts to measure the impact of publications on the advancement of science. However, since the earliest days of the field, some scholars have questioned whether all citations should value the same, and have gone on to weight them by a variety of factors.

However sophisticated the operationalization of the measures, the methodologies used in weighting citations still present limits in their underlying assumptions. This work takes an alternate approach to resolving the underlying problem: the proposal is to value citations by the impact of the citing articles.

As well as conceptualizing a new indicator of impact, the work illustrates its application to the 2004-2012 Italian scientific production indexed in the WoS.

The new indicator appears highly correlated to traditional field normalized citations, however the shifts observed between the two measures are frequent and the number of outliers not at all negligible. Moreover, the new indicator seems to show greater “sensitivity” when used in identification of the top-cited papers.

URL : https://arxiv.org/abs/1809.06088

Relationship between Online Journal Usage and their Citations in the Academic Publications: A Case Study

Authors : Jessy Abdul, Mahabaleshwara Rao, Amitha Puranik

The advancement of science and technology has impacted functioning of the libraries of higher educational institutions, and the mode of providing resources for various academic activities.

For many years, libraries attached to educational institutions have been labouring with the question of how to determine the value of journals in their specific library collection. The Health Sciences Library of Manipal Academy of Higher Education at Manipal, subscribed a vast number of online journals for their users.

A relation between the usage and citations of subscribed online journals might provide a basis for the collection management in the libraries of academic and research institutions.

The current study resolved to identify whether relationship exists between usage of subscribed online journals and their citations in the academic publications of the health science professionals from 2010 to 2015.

The study found a statistically significant relationship between subscribed online journal usage and their citations in the publications through the inferential test of Spearman’s rank-order correlation.

For collection development of online journals, libraries can utilise the usage or citation data of journals as a decision making tool.

URL : Relationship between Online Journal Usage and their Citations in the Academic Publications: A Case Study

Alternative location : http://publications.drdo.gov.in/ojs/index.php/djlit/article/view/13114

Understanding the Changing Roles of Scientific Publications via Citation Embeddings

Authors : Jiangen He, Chaomei Chen

Researchers may describe different aspects of past scientific publications in their publications and the descriptions may keep changing in the evolution of science. The diverse and changing descriptions (i.e., citation context) on a publication characterize the impact and contributions of the past publication.

In this article, we aim to provide an approach to understanding the changing and complex roles of a publication characterized by its citation context. We described a method to represent the publications’ dynamic roles in science community in different periods as a sequence of vectors by training temporal embedding models.

The temporal representations can be used to quantify how much the roles of publications changed and interpret how they changed.

Our study in the biomedical domain shows that our metric on the changes of publications’ roles is stable over time at the population level but significantly distinguish individuals. We also show the interpretability of our methods by a concrete example.

URL : https://arxiv.org/abs/1711.05822

Science and Facebook: the same popularity law!

Authors : Zoltán Néda, Levente Varga, Tamás S. Biró

The distribution of scientific citations for publications selected with different rules (author, topic, institution, country, journal, etc.) collapse on a single curve if one plots the citations relative to their mean value.

We find that the distribution of shares for the Facebook posts re-scale in the same manner to the very same curve with scientific citations. This finding suggests that citations are subjected to the same growth mechanism with Facebook popularity measures, being influenced by a statistically similar social environment and selection mechanism.

In a simple master-equation approach the exponential growth of the number of publications and a preferential selection mechanism leads to a Tsallis-Pareto distribution offering an excellent description for the observed statistics.

Based on our model and on the data derived from PubMed we predict that according to the present trend the average citations per scientific publications exponentially relaxes to about 4.

URL : https://arxiv.org/abs/1701.05347