Archives des mots-clés : Scholarly Publishing

Prevalence of nonsensical algorithmically generated papers in the scientific literature

Posté le par

Authors : Guillaume Cabanac, Cyril Labbé

In 2014 leading publishers withdrew more than 120 nonsensical publications automatically generated with the SCIgen program. Casual observations suggested that similar problematic papers are still published and sold, without follow-up retractions.

No systematic screening has been performed and the prevalence of such nonsensical publications in the scientific literature is unknown. Our contribution is 2-fold.

First, we designed a detector that combs the scientific literature for grammar-based computer-generated papers. Applied to SCIgen, it has a 83.6% precision. Second, we performed a scientometric study of the 243 detected SCIgen-papers from 19 publishers.

We estimate the prevalence of SCIgen-papers to be 75 per million papers in Information and Computing Sciences. Only 19% of the 243 problematic papers were dealt with: formal retraction (12) or silent removal (34).

Publishers still serve and sometimes sell the remaining 197 papers without any caveat. We found evidence of citation manipulation via edited SCIgen bibliographies. This work reveals metric gaming up to the point of absurdity: fraudsters publish nonsensical algorithmically generated papers featuring genuine references.

It stresses the need to screen papers for nonsense before peer-review and chase citation manipulation in published papers. Overall, this is yet another illustration of the harmful effects of the pressure to publish or perish.

URL : Prevalence of nonsensical algorithmically generated papers in the scientific literature

DOI : https://doi.org/10.1002/asi.24495

Publication by association: how the COVID-19 pandemic has shown relationships between authors and editorial board members in the field of infectious diseases

Posté le par

Authors : Clara Locher, David Moher, Ioana Alina Cristea, Florian Naudet

During the COVID-19 pandemic, the rush to scientific and political judgements on the merits of hydroxychloroquine was fuelled by dubious papers which may have been published because the authors were not independent from the practices of the journals in which they appeared.

This example leads us to consider a new type of illegitimate publishing entity, ‘self-promotion journals’ which could be deployed to serve the instrumentalisation of productivity-based metrics, with a ripple effect on decisions about promotion, tenure and grant funding, but also on the quality of manuscripts that are disseminated to the medical community and form the foundation of evidence-based medicine.

DOI : http://dx.doi.org/10.1136/bmjebm-2021-111670

Scaling Small; Or How to Envision New Relationalities for Knowledge Production

Posté le par

Authors: Janneke Adema, Samuel A. Moore

Within the field of open access (OA) publishing, community-led publishing projects are experimenting increasingly with new forms of collaboration and organisation. They do so by focusing on setting up horizontal alliances between independent projects within a certain sector (e.g., scholar-led presses), or vertically across sectors with other not-for-profit organisations (e.g., through collaborations with libraries, universities, and funders), in order to create multi-stakeholder ecologies within scholarly publishing.

Yet at the same time, imaginaries for future modes of OA knowledge production are still controlled through demands for ‘scalability’ and ‘sustainability’, which are both seen as preconditions for scholarly communication models and practices to succeed and to be efficient. But they are also prerequi­sites to receive funding for publishing projects or infrastructure development.

The scalability of open models is perceived as essential to compete in a landscape dominated by a handful of major corporate players.Drawing on our work with the Radical Open Access Collective, the ScholarLed consortium, and the Community-led Open Publishing Infrastructures for Mono­graphs (COPIM) project, this article outlines an alternative organisational prin­ciple for governing community-led publishing projects based on mutual reliance, care, and other forms of commoning.

Termed ‘scaling small’, this principle eschews standard approaches to organisational growth that tend to flatten community diversity through economies of scale. Instead, it puts forward the idea that scale can be nurtured through intentional collaborations between community-driven pro­jects that promote a bibliodiverse ecosystem while providing resilience through resource sharing and other kinds of collaboration.

Following Anna Tsing’s recom­mendations to keep in mind how reimagining our knowledge practices requires we pay particular attention to articulations between the scalable and the nonscalable (Tsing, 2012), what is needed to enable this is, first and foremost, a rethinking of existing systems and infrastructures and how they currently function – systems that have historically developed and been continuously remade to encourage fur­ther scalability.

We further explore the possibilities of scaling small with particular reference to Anna Tsing’s work on the ‘latent commons’ and Massimo De Angelis’ discussion of ‘boundary commoning’, examining how these concepts are on display within the Radical Open Access Collective, ScholarLed and the COPIM project.

As we will argue, reimagining the relations within publishing beyond a mere calcula­tive logic, i.e., one that is focused on assessing the sustainability of alternative models, is essential in not-for-profit OA publishing environments, particularly if we want new forms of collaboration to arise and to redefine the future of scholarly publishing in communal settings.

URL : Scaling Small; Or How to Envision New Relationalities for Knowledge Production

DOI : https://doi.org/10.16997/wpcc.918

Requiem for impact factors and high publication charges

Posté le par

Authors : Chris R Triggle, Ross MacDonald, David J. Triggle, Donald Grierson

Journal impact factors, publication charges and assessment of quality and accuracy of scientific research are critical for researchers, managers, funders, policy makers, and society. Editors and publishers compete for impact factor rankings, to demonstrate how important their journals are, and researchers strive to publish in perceived top journals, despite high publication and access charges.

This raises questions of how top journals are identified, whether assessments of impacts are accurate and whether high publication charges borne by the research community are justified, bearing in mind that they also collectively provide free peer-review to the publishers.

Although traditional journals accelerated peer review and publication during the COVID-19 pandemic, preprint servers made a greater impact with over 30,000 open access articles becoming available and accelerating a trend already seen in other fields of research.

We review and comment on the advantages and disadvantages of a range of assessment methods and the way in which they are used by researchers, managers, employers and publishers.

We argue that new approaches to assessment are required to provide a realistic and comprehensive measure of the value of research and journals and we support open access publishing at a modest, affordable price to benefit research producers and consumers.

URL : Requiem for impact factors and high publication charges

DOI : https://doi.org/10.1080/08989621.2021.1909481

Open Access Models, Pirate Libraries and Advocacy Repertoires: Policy Options for Academics to Construct and Govern Knowledge Commons

Posté le par

Author : Melanie Dulong de Rosnay

In this article, I propose exploring open access publishing through the lenses of Knowledge Commons. Instead of focusing on users’ rights to access and reuse the output under open copyright licensing conditions, I study the governance of the academic publishing ecosystem, and its political economy, technical and labour infrastructure. Based on selected examples, I discuss how they comply with the concept of the commons.

I use analytical frameworks from the Ostromian literature of the governance of Knowledge Commons to provide insights on the various steps of academic publishing work as a process. I then analyse a scope of open access publishing projects, including gold, green, diamond, platinum and pirate libraries. Finally, I draw from practices a repertoire of advocacy actions and I make recommendations for academics to develop policies supporting Academic Commons.

URL : Open Access Models, Pirate Libraries and Advocacy Repertoires: Policy Options for Academics to Construct and Govern Knowledge Commons

DOI : https://doi.org/10.16997/wpcc.913

What happens when a journal converts to Open Access? A bibliometric analysis

Posté le par

Authors : Fakhri Momeni, Philipp Mayr, Nicholas Fraser, Isabella Peters

In recent years, increased stakeholder pressure to transition research to Open Access has led to many journals converting, or ‘flipping’, from a closed access (CA) to an open access (OA) publishing model.

Changing the publishing model can influence the decision of authors to submit their papers to a journal, and increased article accessibility may influence citation behaviour. In this paper we aimed to understand how flipping a journal to an OA model influences the journal’s future publication volumes and citation impact.

We analysed two independent sets of journals that had flipped to an OA model, one from the Directory of Open Access Journals (DOAJ) and one from the Open Access Directory (OAD), and compared their development with two respective control groups of similar journals. For bibliometric analyses, journals were matched to the Scopus database.

We assessed changes in the number of articles published over time, as well as two citation metrics at the journal and article level: the normalised impact factor (IF) and the average relative citations (ARC), respectively. Our results show that overall, journals that flipped to an OA model increased their publication output compared to journals that remained closed.

Mean normalised IF and ARC also generally increased following the flip to an OA model, at a greater rate than was observed in the control groups. However, the changes appear to vary largely by scientific discipline. Overall, these results indicate that flipping to an OA publishing model can bring positive changes to a journal.

URL : https://arxiv.org/abs/2103.14522

What is the benefit from publishing a working paper in a journal in terms of citations? Evidence from economics

Posté le par

Authors : Klaus Wohlraben, Constantin Bürgi

Many papers in economics that are published in peer reviewed journals are initially released in widely circulated working paper series. This raises the question about the benefit of publishing in a peer-reviewed journal in terms of citations.

Specifically, we address the question: to what extent does the stamp of approval obtained by publishing in a peer-reviewed journal lead to more subsequent citations for papers that are already available in working paper series? Our data set comprises about 28,000 working papers from four major working paper series in economics.

Using panel data methods, we show that the publication in a peer reviewed journal results in around twice the number of yearly citations relative to working papers that never get published in a journal. Our results hold in several robustness checks.

URL : What is the benefit from publishing a working paper in a journal in terms of citations? Evidence from economics

DOI : https://doi.org/10.1007/s11192-021-03942-x