Comparing scientific and technological impact of biomedical research

Author : Qing Ke

Traditionally, the number of citations that a scholarly paper receives from other papers is used as the proxy of its scientific impact. Yet citations can come from domains outside the scientific community, and one such example is through patented technologies—paper can be cited by patents, achieving technological impact.

While the scientific impact of papers has been extensively studied, the technological aspect remains largely unknown. Here we aim to fill this gap by presenting a comparative study on how 919 thousand biomedical papers are cited by U.S. patents and by other papers over time.

We observe a positive correlation between citations from patents and from papers, but there is little overlap between the two domains in either the most cited papers, or papers with the most delayed recognition.

We also find that the two types of citations exhibit distinct temporal variations, with patent citations lagging behind paper citations for a median of 6 years for the majority of papers. Our work contributes to the understanding of the technological, and societal in general, impact of papers.

URL : https://arxiv.org/abs/1804.04105

Tweet success? Scientific communication correlates with increased citations in Ecology and Conservation

Authors : Clayton T. Lamb​, Sophie L. Gilbert, Adam T. Ford

Science communication is seen as critical for the disciplines of ecology and conservation, where research products are often used to shape policy and decision making. Scientists are increasing their online media communication, via social media and news.

Such media engagement has been thought to influence or predict traditional metrics of scholarship, such as citation rates. Here, we measure the association between citation rates and the Altmetric Attention Score—an indicator of the amount and reach of the attention an article has received—along with other forms of bibliometric performance (year published, journal impact factor, and article type).

We found that Attention Score was positively correlated with citation rates. However, in recent years, we detected increasing media exposure did not relate to the equivalent citations as in earlier years; signalling a diminishing return on investment.

Citations correlated with journal impact factors up to ∼13, but then plateaued, demonstrating that maximizing citations does not require publishing in the highest-impact journals. We conclude that ecology and conservation researchers can increase exposure of their research through social media engagement and, simultaneously, enhance their performance under traditional measures of scholarly activity.

URL : Tweet success? Scientific communication correlates with increased citations in Ecology and Conservation

DOI : https://doi.org/10.7717/peerj.4564

Ethnic Diversity Increases Scientific Impact

Authors : Bedoor K AlShebli, Talal Rahwan, Wei Lee Woon

Inspired by the numerous social and economic benefits of diversity, we analyze over 9 million papers and 6 million scientists spanning 24 fields of study, to understand the relationship between research impact and five types of diversity, reflecting (i) ethnicity, (ii) discipline, (iii) gender, (iv) affiliation and (v) academic age.

For each type, we study group diversity (i.e., the heterogeneity of a paper’s set of authors) and individual diversity (i.e., the heterogeneity of a scientist’s entire set of collaborators). Remarkably, of all the types considered, we find that ethnic diversity is the strongest predictor of a field’s scientific impact (r is 0.77 and 0.55 for group and individual ethnic diversity, respectively).

Moreover, to isolate the effect of ethnic diversity from other confounding factors, we analyze a baseline model in which author ethnicities are randomized while preserving all other characteristics.

We find that the relation between ethnic diversity and impact is stronger in the real data compared to the randomized baseline model, regardless of publication year, number of authors per paper, and number of collaborators per scientist.

Finally, we use coarsened exact matching to infer causality, whereby the scientific impact of diverse papers and scientists are compared against closely matched control groups. In keeping with the other results, we find that ethnic diversity consistently leads to higher scientific impact.

URL : https://arxiv.org/abs/1803.02282

Gathering the Needles: Evaluating the Impact of Gold Open Access Content With Traditional Subscription Journals

Authors : Alison Boba, Jill Emery

Utilizing the Project COUNTER Release 4 JR1-GOA report, two librarians explore these data in comparison to journal package subscriptions represented via the JR1 reports. This paper outlines the methodology and study undertaken at the Portland State University Library and the University of Nebraska Medical Center Library using these reports for the first time.

The initial outcomes of the study are provided in various Tables for 2014 and 2015. The intent of the study was to provide both institutions with a baseline from which to do further study. In addition, some ideas are given for how these reports can be used in vendor negotiations going forward.

URL : Gathering the Needles: Evaluating the Impact of Gold Open Access Content With Traditional Subscription Journals

DOI : http://dx.doi.org/10.1629/uksg.291

Who needs access to research? Exploring the societal impact of open access

Author : ElHassan ElSabry

Studies about open access (OA) have predominantly focused it impact on communication within the scholarly community. For example, many studies have been published on what is called the “Open Access Citation Advantage (OACA)”.

On the other hand, implications of OA in non-academic contexts (e.g. medical practice, policymaking, patient advocacy and citizen science) have been the subject of and the basis for a lot of the advocacy work and many funding agencies’ OA policies, but not so much the subject of original research studies.

To date, this study is the first attempt to collect and synthesize the available evidence on the societal impact of open access. It further builds on this evidence base by introducing a typology of the various science-society interfaces where demand for access to research potentially exists.

The proposed scheme is anticipated to provide guidance for future research on the issue of OA’s societal impact. The paper concludes with a discussion of the implications of non-academic usage of research on the open access debate, especially on the question of who should bear the cost of scholarly publishing.

URL : https://rfsic.revues.org/3271

How quickly do publications get read? The evolution of Mendeley reader counts for new articles

Authors : Nabeil Maflahi, Mike Thelwall

Within science, citation counts are widely used to estimate research impact but publication delays mean that they are not useful for recent research. This gap can be filled by Mendeley reader counts, which are valuable early impact indicators for academic articles because they appear before citations and correlate strongly with them.

Nevertheless, it is not known how Mendeley readership counts accumulate within the year of publication, and so it is unclear how soon they can be used. In response, this paper reports a longitudinal weekly study of the Mendeley readers of articles in six library and information science journals from 2016.

The results suggest that Mendeley readers accrue from when articles are first available online and continue to steadily build. For journals with large publication delays, articles can already have substantial numbers of readers by their publication date.

Thus, Mendeley reader counts may even be useful as early impact indicators for articles before they have been officially published in a journal issue. If field normalised indicators are needed, then these can be generated when journal issues are published using the online first date.

URL : http://hdl.handle.net/2436/620522

 

Prevalence and citation advantage of gold open access in the subject areas of the Scopus database

Authors : Pablo Dorta-González, Yolanda Santana-Jiménez

The potential benefit of open access (OA) in relation to citation impact has been discussed in the literature in depth. The methodology used to test the OA citation advantage includes comparing OA vs. non-OA journal impact factors and citations of OA versus non-OA articles published in the same non-OA journals.

However, one problem with many studies is that they are small -restricted to a discipline or set of journals-. Moreover, conclusions are not entirely consistent among research areas and ‘early view’ and ‘selection bias’ have been suggested as possible explications. In the present paper, an analysis of gold OA from across all areas of research -the 27 subject areas of the Scopus database- is realized.

As a novel contribution, this paper takes a journal-level approach to assessing the OA citation advantage, whereas many others take a paper-level approach. Data were obtained from Scimago Lab, sorted using Scopus database, and tagged as OA/non-OA using the DOAJ list.

Jointly with the OA citation advantage, the OA prevalence as well as the differences between access types (OA vs. non-OA) in production and referencing are tested. A total of 3,737 OA journals (16.8%) and 18,485 non-OA journals (83.2%) published in 2015 are considered. As the main conclusion, there is no generalizable gold OA citation advantage at journal level.

URL : https://arxiv.org/abs/1708.06242