Étiquette : research impact

Catégories
EN

Large publishing consortia produce higher citation impact research but co-author contributions are hard to evaluate

Author : Mike Thelwall

This paper introduces a simple agglomerative clustering method to identify large publishing consortia with at least 20 authors and 80% shared authorship between articles. Based on Scopus journal articles 1996-2018, under these criteria, nearly all (88%) of the large consortia published research with citation impact above the world average, with the exceptions being mainly the newer consortia for which average citation counts are unreliable.

On average, consortium research had almost double (1.95) the world average citation impact on the log scale used (Mean Normalised Log Citation Score). At least partial alphabetical author ordering was the norm in most consortia.

The 250 largest consortia were for nuclear physics and astronomy around expensive equipment, and for predominantly health-related issues in genomics, medicine, public health, microbiology and neuropsychology.

For the health-related issues, except for the first and last few authors, authorship seem to primary indicate contributions to the shared project infrastructure necessary to gather the raw data.

It is impossible for research evaluators to identify the contributions of individual authors in the huge alphabetical consortia of physics and astronomy, and problematic for the middle and end authors of health-related consortia.

For small scale evaluations, authorship contribution statements could be used, when available.

URL : https://arxiv.org/abs/1906.01849

Catégories
EN

Access to Top-Cited Emergency Care Articles (Published Between 2012 and 2016) Without Subscription

Authors : Murad Al Hamzy, Dominique de Villiers, Megan Banner, Hein Lamprecht, Stevan R. Bruijns

Introduction

Unrestricted access to journal publications speeds research progress, productivity, and knowledge translation, which in turn develops and promotes the efficient dissemination of content.

We describe access to the 500 most-cited emergency medicine (EM) articles (published between 2012 and 2016) in terms of publisher-based access (open access or subscription), alternate access routes (self-archived or author provided), and relative cost of access.

Methods

We used the Scopus database to identify the 500 most-cited EM articles published between 2012 and 2016. Access status was collected from the journal publisher. For studies not available via open access, we searched on Google, Google Scholar, Researchgate, Academia.edu, and the Unpaywall and Open Access Button browser plugins to locate self archived copies.

We contacted corresponding authors of the remaining inaccessible studies for a copy of each of their articles. We collected article processing and access costs from the journal publishers, and then calculated relative cost differences using the World Bank purchasing power parity index for the United States (U.S.), Germany, Turkey, China, Brazil, South Africa, and Australia.

This allows costs to be understood relative to the economic context of the countries from which they originated.

Results

We identified 500 articles for inclusion in the study. Of these, 167 (33%) were published in an open access format. Of the remaining 333 (67%), 204 (61%) were available elsewhere on the internet, 18 (4%) were provided by the authors, and 111 (22%) were accessible by subscription only.

The mean article processing and access charges were $2,518.62 and $44.78, respectively. These costs were 2.24, 1.75, 2.28 and 1.56 times more expensive for South African, Chinese, Turkish, and Brazilian authors, respectively, than for U.S. authors (p<0.001 all).

Conclusion

Despite the advantage of open access publication for knowledge translation, social responsibility, and increased citation, one in five of the 500 EM articles were accessible only via subscription. Access for scientists from upper-middle income countries was significantly hampered by cost.

It is important to acknowledge the value this has for authors from low- and middle-income countries. Authors should also consider the citation advantage afforded by open access publishing when deciding where to publish.

URL : Access to Top-Cited Emergency Care Articles (Published Between 2012 and 2016) Without Subscription

DOI : https://doi.org/10.5811/westjem.2019.2.40957

Catégories
EN

Impact Assessment of Non-Indexed Open Access Journals: A Case Study

Authors : Daniela Solomon, Mark Eddy

This case study assesses the impact of a small, open-access social sciences journal not included in citation tracking indexes by exploring measures of the journal’s influence beyond the established « impact factor » formula. An analysis of Google Scholar data revealed the journal’s global reach and value to researchers.

This study enabled the journal’s editors to measure the success of their publication according to its professed scope and mission, and to quantify its impact for prospective contributors.

The impact assessment strategies outlined here can be leveraged effectively by academic librarians to provide high-value consultancy for scholar-editors of open access research journals.

URL : https://preprint.press.jhu.edu/portal/sites/ajm/files/19.2solomon.pdf

Catégories
EN

Aligning Social Media Indicators with the Documents in an Open Access Repository

Authors: Luis Meneses, Alyssa Arbuckle, Hector Lopez, Belaid Moa, Richard Furuta, Ray Siemens

In this paper we describe our current efforts towards building a framework that extends the functionality of an Open Access Repository by implementing processes to incorporate the ongoing trends in social media into the context of a digital collection.

We refer to these processes collectively as the Social Media Engine. The purpose of our framework is twofold: first, we propose to challenge some of the preconceived notions of digital libraries by making repositories more dynamic; and second, by challenging this notion we want to promote public engagement and open scholarship.

As a work in progress, we believe that a real challenge lies in investigating the implications that these two points introduce within the context of the humanities.

URL : Aligning Social Media Indicators with the Documents in an Open Access Repository

DOI : http://doi.org/10.5334/kula.44

Catégories
EN

From closed to open access: A case study of flipped journals

Authors : Fakhri Momeni, Nicholas Fraser, Isabella Peters, Philipp Mayr

In recent years, increased stakeholder pressure to transition research to Open Access has led to many journals « flipping » from a toll access to an open access publishing model. Changing the publishing model can influence the decision of authors to submit their papers to a journal, and increased article accessibility may influence citation behaviour.

The aim of this paper is to show changes in the number of published articles and citations after the flipping of a journal. We analysed a set of 171 journals in the Web of Science (WoS) which flipped to open access.

In addition to comparing the number of articles, average relative citation (ARC) and normalized impact factor (IF) are applied, respectively, as bibliometric indicators at the article and journal level, to trace the transformation of flipped journals covered.

Our results show that flipping mostly has had positive effects on journal’s IF. But it has had no obvious citation advantage for the articles. We also see a decline in the number of published articles after flipping.

We can conclude that flipping to open access can improve the performance of journals, despite decreasing the tendency of authors to submit their articles and no better citation advantages for articles.

URL : https://arxiv.org/abs/1903.11682

Catégories
EN

Highly cited references in PLOS ONE and their in-text usage over time

Authors : Wolfgang Otto, Behnam Ghavimi, Philipp Mayr, Rajesh Piryani, Vivek Kumar Singh

In this article, we describe highly cited publications in a PLOS ONE full-text corpus. For these publications, we analyse the citation contexts concerning their position in the text and their age at the time of citing.

By selecting the perspective of highly cited papers, we can distinguish them based on the context during citation even if we do not have any other information source or metrics.

We describe the top cited references based on how, when and in which context they are cited. The focus of this study is on a time perspective to explain the nature of the reception of highly cited papers.

We have found that these references are distinguishable by the IMRaD sections of their citation. And further, we can show that the section usage of highly cited papers is time-dependent.

The longer the citation interval, the higher the probability that a reference is cited in a method section.

URL : https://arxiv.org/abs/1903.11693

Catégories
EN

Can Google Scholar and Mendeley help to assess the scholarly impacts of dissertations?

Authors : Kayvan Kousha, Mike Thelwall

Dissertations can be the single most important scholarly outputs of junior researchers. Whilst sets of journal articles are often evaluated with the help of citation counts from the Web of Science or Scopus, these do not index dissertations and so their impact is hard to assess.

In response, this article introduces a new multistage method to extract Google Scholar citation counts for large collections of dissertations from repositories indexed by Google.

The method was used to extract Google Scholar citation counts for 77,884 American doctoral dissertations from 2013-2017 via ProQuest, with a precision of over 95%. Some ProQuest dissertations that were dual indexed with other repositories could not be retrieved with ProQuest-specific searches but could be found with Google Scholar searches of the other repositories.

The Google Scholar citation counts were then compared with Mendeley reader counts, a known source of scholarly-like impact data. A fifth of the dissertations had at least one citation recorded in Google Scholar and slightly fewer had at least one Mendeley reader.

Based on numerical comparisons, the Mendeley reader counts seem to be more useful for impact assessment purposes for dissertations that are less than two years old, whilst Google Scholar citations are more useful for older dissertations, especially in social sciences, arts and humanities.

Google Scholar citation counts may reflect a more scholarly type of impact than that of Mendeley reader counts because dissertations attract a substantial minority of their citations from other dissertations.

In summary, the new method now makes it possible for research funders, institutions and others to systematically evaluate the impact of dissertations, although additional Google Scholar queries for other online repositories are needed to ensure comprehensive coverage.

URL : https://arxiv.org/abs/1902.08746