Étiquette : citations

Publié le

The weakening relationship between the Impact Factor and papers’ citations in the digital age

Authors : George A. Lozano, Vincent Lariviere, Yves Gingras

Historically, papers have been physically bound to the journal in which they were published but in the electronic age papers are available individually, no longer tied to their respective journals. Hence, papers now can be read and cited based on their own merits, independently of the journal’s physical availability, reputation, or Impact Factor.

We compare the strength of the relationship between journals’ Impact Factors and the actual citations received by their respective papers from 1902 to 2009. Throughout most of the 20th century, papers’ citation rates were increasingly linked to their respective journals’ Impact Factors.

However, since 1990, the advent of the digital age, the strength of the relation between Impact Factors and paper citations has been decreasing. This decrease began sooner in physics, a field that was quicker to make the transition into the electronic domain.

Furthermore, since 1990, the proportion of highly cited papers coming from highly cited journals has been decreasing, and accordingly, the proportion of highly cited papers not coming from highly cited journals has also been increasing.

Should this pattern continue, it might bring an end to the use of the Impact Factor as a way to evaluate the quality of journals, papers and researchers.”

URL : http://arxiv.org/abs/1205.4328

Publié le

Beyond citations Scholars’ visibility on the social Web…

Beyond citations: Scholars’ visibility on the social Web :

“Traditionally, scholarly impact and visibility have been measured by counting publications and citations in the scholarly literature. However, increasingly scholars are also visible on the Web, establishing presences in a growing variety of social ecosystems. But how wide and established is this presence, and how do measures of social Web impact relate to their more traditional counterparts? To answer this, we sampled 57 presenters from the 2010 Leiden STI Conference, gathering publication and citations counts as well as data from the presenters’ Web “footprints.” We found Web presence widespread and diverse: 84% of scholars had homepages, 70% were on LinkedIn, 23% had public Google Scholar profiles, and 16% were on Twitter. For sampled scholars’ publications, social reference manager bookmarks were compared to Scopus and Web of Science citations; we found that Mendeley covers more than 80% of sampled articles, and that Mendeley bookmarks are significantly correlated (r=.45) to Scopus citation counts.”

URL : http://arxiv.org/abs/1205.5611

Publié le

How the Scientific Community Reacts to Newly Submitted…

How the Scientific Community Reacts to Newly Submitted Preprints: Article Downloads, Twitter Mentions, and Citations :

“We analyze the online response of the scientific community to the preprint publication of scholarly articles. We employ a cohort of 4,606 scientific articles submitted to the preprint database arXiv.org between October 2010 and April 2011. We study three forms of reactions to these preprints: how they are downloaded on the arXiv.org site, how they are mentioned on the social media site Twitter, and how they are cited in the scholarly record. We perform two analyses. First, we analyze the delay and time span of article downloads and Twitter mentions following submission, to understand the temporal configuration of these reactions and whether significant differences exist between them. Second, we run correlation tests to investigate the relationship between Twitter mentions and both article downloads and article citations. We find that Twitter mentions follow rapidly after article submission and that they are correlated with later article downloads and later article citations, indicating that social media may be an important factor in determining the scientific impact of an article.”

URL : http://arxiv.org/abs/1202.2461

Publié le

The Effect of Free Access on the Diffusion…

The Effect of Free Access on the Diffusion of Scholarly Ideas :

“This study examines a relationship between free access to research articles and the diffusion of their ideas as measured by citation counts. While free access should, in theory, help the diffusion of ideas, many researchers have debated the existence of the benefit of free access: reported empirical findings range from zero or negative effect to an over 300% increase of citations of non-free articles. By using a dataset from the Social Science Research Network (SSRN), an open repository of research articles, and employing a natural experiment that allows the estimation of the value of free access separate from confounding factors such as early viewership and quality differential, this study identifies the causal effect of free access on the citation counts. The natural experiment in this study is that a select group of published articles is posted on SSRN at a time chosen by their authors’ affiliated organizations or SSRN, not by their authors. Using a difference-in-difference method and comparing the citation profiles of the articles before and after the posting time on SSRN against a group of control articles with similar characteristics, I stimated the effect of the SSRN posting on citation counts. The articles posted on SSRN receive more citations even prior to being posted on SSRN, suggesting that they are of higher quality. Their citation counts further increase after being posted, gaining an additional 10-20% of citations. This gain is likely to be caused by the free access that SSRN provides.”

URL : http://mis.eller.arizona.edu/events/speakers_series/2012/mis_speaker_series_Heekyung_Kim.asp

Publié le

Citations to Wikipedia in Chemistry Journals: A Preliminary Study

Wikipedia has been the subject of an increasing number of studies. Many of these have focused on the quality of Wikipedia articles and the use of Wikipedia by students. Little research has focused on the use of Wikipedia by scholars. This study helps to fill that gap by examining citations to Wikipedia in chemistry journals from three major publishers over a five year period.

The study reports the number of citations to Wikipedia and describes how Wikipedia is being cited. The results show that, while only a small percentage of all articles contained a citation to Wikipedia, it is in fact being cited as a credible information source in articles in major chemistry journals.

URL : http://www.istl.org/11-fall/refereed2.html

Publié le

Is scientific literature subject to a sell by…

Is scientific literature subject to a sell-by-date? A general methodology to analyze the durability of scientific documents :

“The study of the citation histories and ageing of documents are topics that have been addressed from several perspectives, especially in the analysis of documents with delayed recognition or sleeping beauties. However, there is no general methodology that can be extensively applied for different time periods and/or research fields. In this paper a new methodology for the general analysis of the ageing and durability of scientific papers is presented. This methodology classifies documents into three general types: Delayed documents, which receive the main part of their citations later than normal documents; Flash in the pans, which receive citations immediately after their publication but they are not cited in the long term; and Normal documents, documents with a typical distribution of citations over time. These three types of durability have been analyzed considering the whole population of documents in the Web of Science with at least 5 external citations (i.e. not considering self-citations). Several patterns related to the three types of durability have been found and the potential for further research of the developed methodology is discussed.”

URL : http://arxiv.org/abs/0907.1455

Publié le

Linking to Data Effect on Citation Rates in…

Linking to Data – Effect on Citation Rates in Astronomy :

“Is there a difference in citation rates between articles that were published with links to data and articles that were not? Besides being interesting from a purely academic point of view, this question is also highly relevant for the process of furthering science. Data sharing not only helps the process of verification of claims, but also the discovery of new findings in archival data. However, linking to data still is a far cry away from being a “practice”, especially where it comes to authors providing these links during the writing and submission process. You need to have both a willingness and a publication mechanism in order to create such a practice. Showing that articles with links to data get higher citation rates might increase the willingness of scientists to take the extra steps of linking data sources to their publications. In this presentation we will show this is indeed the case: articles with links to data result in higher citation rates than articles without such links. The ADS is funded by NASA Grant NNX09AB39G.”

URL : http://arxiv.org/abs/1111.3618