Fast, Furious and Dubious? MDPI and the Depth of Peer Review Reports

Authors : Abdelghani Maddi, Chérifa Boukacem-Zeghmouri

Peer review is a central component of scholarly communication as it brings trust and quality control for scientific knowledge. One of its goals is to improve the quality of manuscripts and prevent the publication of work resulting from dubious or misconduct practices.

In a context marked by a massification of scientific production, the reign of Publish or Perish rule and the acceleration of research, journals are leaving less and less time to reviewers to produce their reports. It is therefore is crucial to study whether these regulations have an impact on the length of reviewer reports.

Here, we address the example of MDPI, a Swiss Open Access publisher, depicted as a Grey Publisher and well known for its short deadlines, by analyzing the depth of its reviewer reports and its counterparts. For this, we used Publons data with 61,197 distinct publications reviewed by 86,628 reviewers.

Our results show that, despite the short deadlines, when they accept to review a manuscript, reviewers assume their responsibility and do their job in the same way regardless of the publisher, and write on average the same number of words.

Our results suggest that, even if MDPI’s editorial practices may be questionable, as long as peer review is assured by researchers themselves, publications are evaluated similarly.

URL : Fast, Furious and Dubious? MDPI and the Depth of Peer Review Reports

DOI : https://doi.org/10.21203/rs.3.rs-3027724/v1

The Platformisation of Scholarly Information and How to Fight It

Author : Lai Ma

The commercial control of academic publishing and research infrastructure by a few oligopolistic companies has crippled the development of open access movement and interfered with the ethical principles of information access and privacy.

In recent years, vertical integration of publishers and other service providers throughout the research cycle has led to platformisation, characterized by datafication and commodification similar to practices on social media platforms. Scholarly publications are treated as user-generated contents for data tracking and surveillance, resulting in profitable data products and services for research assessment, benchmarking and reporting.

Meanwhile, the bibliodiversity and equal open access are denied by the dominant gold open access model and the privacy of researchers is being compromised by spyware embedded in research infrastructure.

This article proposes four actions to fight the platformisation of scholarly information after a brief overview of the market of academic journals and research assessments and their implications for bibliodiversity, information access, and privacy: (1) Educate researchers about commercial publishers and APCs; (2) Allocate library budget to support scholar-led and library publishing; (3) Engage in the development of public research infrastructures and copyright reform; and (4) Advocate for research assessment reforms.

URL : The Platformisation of Scholarly Information and How to Fight It

DOI : https://doi.org/10.53377/lq.13561

Roles and Responsibilities for Peer Reviewers of International Journals

Author : Carol Nash

There is a noticeable paucity of recently published research on the roles and responsibilities of peer reviewers for international journals. Concurrently, the pool of these peer reviewers is decreasing. Using a narrative research method developed by the author, this study questioned these roles and responsibilities through the author’s assessment in reviewing for five publishing houses July–December 2022, in comparison with two recent studies regarding peer review, and the guidelines of the five publishing houses.

What should be most important in peer review is found discrepant among the author, those judging peer review in these publications, and the five publishing houses. Furthermore, efforts to increase the pool of peer reviewers are identified as ineffective because they focus on the reviewer qua reviewer, rather than on their primary role as researchers.

To improve consistency, authors have regularly called for peer review training. Yet, this advice neglects to recognize the efforts of journals in making their particular requirements for peer review clear, comprehensive and readily accessible.

Consequently, rather than peer reviewers being trained and rewarded as peer reviewers, journals are advised to make peer review a requirement for research publication, and their guidelines necessary reading and advice to follow for peer reviewers.

URL : Roles and Responsibilities for Peer Reviewers of International Journals

DOI : https://doi.org/10.3390/publications11020032

Academia should stop using beall’s lists and review their use in previous studies

Authors : Jaime A. Teixeira da Silva, Graham Kendall

Academics (should) strive to submit to journals which are academically sound and scholarly. To achieve this, they could either submit to journals that appear exclusively on safelists (occasionally referred to as whitelists, although this term tends to be avoided), or avoid submitting to journals on watchlists (occasionally referred to as blacklists, although this term tends to be avoided).

The most well-known of these lists was curated by Jeffrey Beall. Beall’s Lists (there are two, one for stand-alone journals and one for publishers) were taken offline by Beall himself in January 2017.

Prior to 2017, Beall’s Lists were widely cited and utilized, including to make quantitative claims about scholarly publishing. Even after Beall’s Lists became obsolete (they have not been maintained for the past six years), they continue to be widely cited and used. This paper argues that the use of Beall’s Lists, pre- and post-2017, may constitute a methodological error and, even if papers carry a disclaimer or limitations section noting this weakness, their conclusions cannot always be relied upon.

This paper also argues for the need to conduct a detailed post-publication assessment of reports in the literature that used Beall’s Lists to validate their findings and conclusions, assuming that it becomes accepted that Beall’s Lists are not a reliable resource for scientific investigation.

Finally, this paper contends that any papers that have identified methodological errors should be corrected. Several lists that were cloned from Beall’s Lists have also emerged and are also being cited. These should also be included in any post-publication investigation that is conducted.

URL : Academia should stop using beall’s lists and review their use in previous studies

DOI : https://doi.org/10.47316/cajmhe.2023.4.1.04

Reflecting on motivations: How reasons to publish affect research behaviour in astronomy

Author : Julia Heuritsch

Recent research in the field of reflexive metrics, which analyses the effects of the use of performance indicators on scientific conduct, has studied the emergence and consequences of evaluation gaps in science.

The concept of evaluation gaps captures potential discrepancies between what researchers value about their research, in particular research quality, and what metrics measure. In the language of rational choice theory, an evaluation gap persists if motivational factors arising out of the internal component of an actor’s situation are incongruent with those arising out of the external components.

The aim of this research is therefore to study and compare autonomous and controlled motivations to become an astronomer, to do research in astronomy and to publish scientific papers. This study is based on a comprehensive quantitative survey of academic and non-academic astronomers worldwide with 3509 responses.

By employing verified instruments to measure perceived publication pressure, distributive & procedural justice, overcommitment to work and observation of scientific misconduct, this paper also investigates how these different motivational factors affect research output and behaviour.

I find evidence for an evaluation gap and that controlled motivational factors arising from evaluation procedures based on publication record drives up publication pressure, which, in turn, was found to increase the likelihood of perceived frequency of misbehaviour.

URL : Reflecting on motivations: How reasons to publish affect research behaviour in astronomy

DOI : https://doi.org/10.1371/journal.pone.0281613

Assessing the publishing priorities and preferences among STEM researchers at a large R1 institution

Authors : Ibraheem Ali, Jason Burton, M. Wynn Tranfield

The cost of academic publishing has increased substantially despite the ease with which information can be shared on the web. Open Access publishing is a key mechanism for amplifying research access, inclusivity, and impact.

Despite this, shifting to a free-to-read publishing environment requires navigating complex barriers that vary by career status and publishing expectations. In this article, we investigate the motivations and preferences of researchers situated within our large research institution as a case study for publishing attitudes at similar institutions.

We surveyed the publishing priorities and preferences of researchers at various career stages in STEM fields as they relate to openness, data practices, and assessment of research impact. Our results indicate that publishing preferences, data management experience and research impact assessment vary by career status and departmental approaches to promotion.

We find that open access publishing is widely appreciated regardless of career status, but financial limitations and publishing expectations were common barriers to publishing in Open Access journals.

Our findings shed light on publishing attitudes and preferences among researchers at a major R1 research institution, and offer insight into advocacy strategies that incentivize open access publishing.

URL : Assessing the publishing priorities and preferences among STEM researchers at a large R1 institution

DOI : https://doi.org/10.1016/j.heliyon.2023.e16316

Enter the dragon: China and global academic publishing

Author : Ken Hyland

One of the most dramatic changes in global publishing in the last decade has been the emergence of China. China now has more researchers than the United States, outspends the United States and European Union in research and publishes more scientific papers each year than any other nation in the world.

The quality of these papers is also increasing, with more appearing in top-ranked journals and gaining more citations overall. Despite this success, China has gained an unenviable reputation for research misconduct and geopolitical issues threaten its continuation.

Given the impact of China’s growing presence on editors, publishers and non-Chinese authors seeking to publish in the same journals, it is important to understand the reasons, directions and outcomes of these changes, their effect on Chinese scholars and local Chinese journals, and where they might be leading.

In this review paper I explore the rise of Chinese scholarship, its influence on global publishing and on Chinese scholars, and how the Chinese government is responding to its new role in global academic publishing.

URL : Enter the dragon: China and global academic publishing

DOI : https://doi.org/10.1002/leap.1545