Archives des mots-clés : citation impact

On The Peer Review Reports: Does Size Matter?

Posté le par

Authors : Abdelghani Maddi, Luis Miotti

Amidst the ever-expanding realm of scientific production and the proliferation of predatory journals, the focus on peer review remains paramount for scientometricians and sociologists of science. Despite this attention, there is a notable scarcity of empirical investigations into the tangible impact of peer review on publication quality.

This study aims to address this gap by conducting a comprehensive analysis of how peer review contributes to the quality of scholarly publications, as measured by the citations they receive. Utilizing an adjusted dataset comprising 57,482 publications from Publons to Web of Science and employing the Raking Ratio method, our study reveals intriguing insights. Specifically, our findings shed light on a nuanced relationship between the length of reviewer reports and the subsequent citations received by publications.

Through a robust regression analysis, we establish that, beginning from 947 words, the length of reviewer reports is significantly associated with an increase in citations. These results not only confirm the initial hypothesis that longer reports indicate requested improvements, thereby enhancing the quality and visibility of articles, but also underscore the importance of timely and comprehensive reviewer reports.

Furthermore, insights from Publons’ data suggest that open access to reports can influence reviewer behavior, encouraging more detailed reports. Beyond the scholarly landscape, our findings prompt a reevaluation of the role of reviewers, emphasizing the need to recognize and value this resource-intensive yet underappreciated activity in institutional evaluations.

Additionally, the study sounds a cautionary note regarding the challenges faced by peer review in the context of an increasing volume of submissions, potentially compromising the vigilance of peers in swiftly assessing numerous articles.

HAL : https://cnrs.hal.science/hal-04492274

Impact factions: assessing the citation impact of different types of open access repositories

Posté le par

Authors : Jonathan Wheeler, Ngoc‑Minh Pham, Kenning Arlitsch, Justin D. Shanks

Institutional repositories (IR) maintained by research libraries play a central role in providing open access to taxpayer-funded research products. It is difficult to measure the extent to which IR contribute to new scholarship because publisher self-archiving policies typically require researchers to cite the “version of record” of a manuscript even when an IR copy is accessed to conduct the research.

While some studies report an open access (OA) citation advantage resulting from the availability of self-archived or “green” OA manuscripts, few have sought to measure an OA citation effect of IR separately from disciplinary repositories, including arXiv and PubMed Central.

In this study, the authors present a bibliometric analysis examining correlations between search engine performance of items in IR, OA availability from different types of repositories, and citations. The analysis uses a novel, open dataset of IR access and usage derived from five months of Google search engine results pages (SERP) data, which were aggregated by the Repository Analytics and Metrics Portal (RAMP) web service.

Findings indicate that making OA copies of manuscripts available in self-archiving or “green” repositories results in a positive citation effect, although the disciplinary repositories within the sample significantly outperform the other types of OA services analyzed. Also evident is an increase in citations when a single manuscript is available in multiple OA sources.

URL : Impact factions: assessing the citation impact of different types of open access repositories

DOI : https://doi.org/10.1007/s11192-022-04467-7

Article Processing Charges, Altmetrics and Citation Impact: Is there an economic rationale?

Posté le par

Authors : Abdelghani Maddi, David Sapinho

The present study aims to analyze 1) the relationship between Citation Normalized Score of scientific publications and Article Processing Charges (APCs) of Gold Open Access (OA) publications 2) the determinants of APCs.

To do so, we used APCs information provided by the OpenAPC database, citation scores of publications from the WoS database and, for Altmetrics, data from Altmetrics.com database, over the period from 2006 to 2019 for 83,752 articles published in 4751 journals belonging to 267 distinct publishers.

Results show that contrary to common belief, paying high APCs does not necessarily increase the impact of publications. First, large publishers with high impact are not the most expensive. Second, publishers with the highest APCs are not necessarily the best in terms of impact.

Correlation between APCs and impact is moderate. Regarding the determinants, results indicate that APCs are on average 50% higher in hybrid journals than in full OA journals. The results also suggest that Altmetrics do not have a great impact: OA articles that have garnered the most attention on internet are articles with relatively low APCs.

Another interesting result is that the “number of readers” indicator is more effective as it is more correlated with classic bibliometrics indicators than the Altmetrics score.

URL : https://hal.archives-ouvertes.fr/hal-03576911

Does Quantity Make a Difference? The importance of publishing many papers

Statut

Do highly productive researchers have significantly higher probability to produce top cited papers? Or does the increased productivity in science only result in a sea of irrelevant papers as a perverse effect of competition and the increased use of indicators for research evaluation and accountability focus? We use a Swedish author disambiguated data set consisting of 48,000 researchers and their WoS-publications during the period of 2008 2011 with citations until 2014 to investigate the relation between productivity and production of highly cited papers. As the analysis shows, quantity does make a difference.

URL : http://arxiv.org/abs/1510.01871

Tenure Track Science Faculty and the ‘Open Access…

Statut

Tenure-Track Science Faculty and the ‘Open Access Citation Effect’ :

“INTRODUCTION : The observation that open access (OA) articles receive more citations than subscription-based articles is known as the OA citation effect (OACE). Implicit in many OACE studies is the belief that authors are heavily invested in the number of citations their articles receive. This study seeks to determine what influence the OACE has on the decision-making process of tenure-track science faculty when they consider where to submit a manuscript for publication.

METHODS : Fifteen tenure-track faculty members in the Departments of Biology and Chemistry at the University of North Carolina at Chapel Hill participated in semi-structured interviews employing a variation of the critical incident tecnique.

RESULTS Seven of the fifteen faculty members said they would consider making a future article freely-available based on the OACE. Due to dramatically different expectations with respect to the size of the OACE, however, only one of them is likely to seriously consider the OACE when deciding where to submit their next manuscript for publication.

DISCUSSION Journal reputation and audience, and the quality of the editorial and review process are the most important factors in deciding where to submit a manuscript for publication. Once a subset of journals has satisfied these criteria, financial and access issues compete with the OACE in making a final decision.

CONCLUSION In order to increase the number of OA materials, librarians should continue to emphasize depositing pre- and post-prints in disciplinary and institutional repositories and retaining the author rights prior to publication in order to make it possible to do so.”

URL : http://jlsc-pub.org/jlsc/vol1/iss3/6/

Linking to Data Effect on Citation Rates in…

Posté le par

Linking to Data – Effect on Citation Rates in Astronomy :

“Is there a difference in citation rates between articles that were published with links to data and articles that were not? Besides being interesting from a purely academic point of view, this question is also highly relevant for the process of furthering science. Data sharing not only helps the process of verification of claims, but also the discovery of new findings in archival data. However, linking to data still is a far cry away from being a “practice”, especially where it comes to authors providing these links during the writing and submission process. You need to have both a willingness and a publication mechanism in order to create such a practice. Showing that articles with links to data get higher citation rates might increase the willingness of scientists to take the extra steps of linking data sources to their publications. In this presentation we will show this is indeed the case: articles with links to data result in higher citation rates than articles without such links. The ADS is funded by NASA Grant NNX09AB39G.”

URL : http://arxiv.org/abs/1111.3618

Self-Selected or Mandated, Open Access I…

Posté le par

Self-Selected or Mandated, Open Access Increases Citation Impact for Higher Quality Research :

“Background
Articles whose authors have supplemented subscription-based access to the publisher’s version by self-archiving their own final draft to make it accessible free for all on the web (“Open Access”, OA) average twice as many citations as articles in the same journal and year that have not been made OA. Some have suggested that this “OA Advantage” may not be causal but just a self-selection bias, because authors preferentially make higher-quality articles OA. To test this we compared self-selective
self-archiving with mandatory self-archiving for a sample of 27,197 articles published 2002-2006 in 1,984 journals.
Methdology
Principal Findings: The OA Advantage proved just as high for both. Logistic regression analysis showed that the advantage is independent of other correlates of citations (article age; journal impact factor; number of co-authors, references or pages; field; article type; or country) and greatest for the most highly cited articles. The OA Advantage is real, independent and causal, but skewed. Its size is indeed correlated with quality, just as citations themselves are (the top 20% of articles receive about 80% of all citations).
Conclusions/Significance
The OA advantage is greater for the more citable articles, not because of a quality bias from authors self-selecting what to make OA, but because of a quality advantage, from users self-selecting what to use and cite, freed by OA from the constraints of selective accessibility to subscribers only. It is hoped that these findings will help motivate the adoption of OA self-archiving mandates by universities, research institutions and research funders.”

URL : http://eprints.ecs.soton.ac.uk/18493/58/MandateOA_PLOSpostprint.pdf