Academia should stop using beall’s lists and review their use in previous studies

Authors : Jaime A. Teixeira da Silva, Graham Kendall

Academics (should) strive to submit to journals which are academically sound and scholarly. To achieve this, they could either submit to journals that appear exclusively on safelists (occasionally referred to as whitelists, although this term tends to be avoided), or avoid submitting to journals on watchlists (occasionally referred to as blacklists, although this term tends to be avoided).

The most well-known of these lists was curated by Jeffrey Beall. Beall’s Lists (there are two, one for stand-alone journals and one for publishers) were taken offline by Beall himself in January 2017.

Prior to 2017, Beall’s Lists were widely cited and utilized, including to make quantitative claims about scholarly publishing. Even after Beall’s Lists became obsolete (they have not been maintained for the past six years), they continue to be widely cited and used. This paper argues that the use of Beall’s Lists, pre- and post-2017, may constitute a methodological error and, even if papers carry a disclaimer or limitations section noting this weakness, their conclusions cannot always be relied upon.

This paper also argues for the need to conduct a detailed post-publication assessment of reports in the literature that used Beall’s Lists to validate their findings and conclusions, assuming that it becomes accepted that Beall’s Lists are not a reliable resource for scientific investigation.

Finally, this paper contends that any papers that have identified methodological errors should be corrected. Several lists that were cloned from Beall’s Lists have also emerged and are also being cited. These should also be included in any post-publication investigation that is conducted.

URL : Academia should stop using beall’s lists and review their use in previous studies

DOI : https://doi.org/10.47316/cajmhe.2023.4.1.04

The rise of preprints in earth sciences

Authors : Olivier Pourret, Daniel Enrique Ibarra

The rate of science information’s spread has accelerated in recent years. In this context, it appears that many scientific disciplines are beginning to recognize the value and possibility of sharing open access (OA) online manuscripts in their preprint form.

Preprints are academic papers that are published but have not yet been evaluated by peers. They have existed in research at least since the 1960s and the creation of ArXiv in physics and mathematics. Since then, preprint platforms—which can be publisher- or community-driven, profit or not for profit, and based on proprietary or free and open source software—have gained popularity in many fields (for example, bioRxiv for the biological sciences).

Today, there are many platforms that are either disciplinary-specific or cross-domain, with exponential development over the past ten years. Preprints as a whole still make up a very small portion of scholarly publishing, but a large group of early adopters are testing out these value-adding tools across a much wider range of disciplines than in the past.

In this opinion article, we provide perspective on the three main options available for earth scientists, namely EarthArXiv, ESSOAr/ESS Open Archive and EGUsphere.

Reflecting on motivations: How reasons to publish affect research behaviour in astronomy

Author : Julia Heuritsch

Recent research in the field of reflexive metrics, which analyses the effects of the use of performance indicators on scientific conduct, has studied the emergence and consequences of evaluation gaps in science.

The concept of evaluation gaps captures potential discrepancies between what researchers value about their research, in particular research quality, and what metrics measure. In the language of rational choice theory, an evaluation gap persists if motivational factors arising out of the internal component of an actor’s situation are incongruent with those arising out of the external components.

The aim of this research is therefore to study and compare autonomous and controlled motivations to become an astronomer, to do research in astronomy and to publish scientific papers. This study is based on a comprehensive quantitative survey of academic and non-academic astronomers worldwide with 3509 responses.

By employing verified instruments to measure perceived publication pressure, distributive & procedural justice, overcommitment to work and observation of scientific misconduct, this paper also investigates how these different motivational factors affect research output and behaviour.

I find evidence for an evaluation gap and that controlled motivational factors arising from evaluation procedures based on publication record drives up publication pressure, which, in turn, was found to increase the likelihood of perceived frequency of misbehaviour.

URL : Reflecting on motivations: How reasons to publish affect research behaviour in astronomy

DOI : https://doi.org/10.1371/journal.pone.0281613

Biomedical supervisors’ role modeling of open science practices

AuthorsTamarinde L Haven, Susan Abunijela, Nicole Hildebrand

Supervision is one important way to socialize Ph.D. candidates into open and responsible research. We hypothesized that one should be more likely to identify open science practices (here publishing open access and sharing data) in empirical publications that were part of a Ph.D. thesis when the Ph.D. candidates’ supervisors engaged in these practices compared to those whose supervisors did not or less often did.

Departing from thesis repositories at four Dutch University Medical centers, we included 211 pairs of supervisors and Ph.D. candidates, resulting in a sample of 2062 publications. We determined open access status using UnpaywallR and Open Data using Oddpub, where we also manually screened publications with potential open data statements. Eighty-three percent of our sample was published openly, and 9% had open data statements.

Having a supervisor who published open access more often than the national average was associated with an odds of 1.99 to publish open access. However, this effect became nonsignificant when correcting for institutions. Having a supervisor who shared data was associated with 2.22 (CI:1.19–4.12) times the odds to share data compared to having a supervisor that did not.

This odds ratio increased to 4.6 (CI:1.86–11.35) after removing false positives. The prevalence of open data in our sample was comparable to international studies; open access rates were higher. Whilst Ph.D. candidates spearhead initiatives to promote open science, this study adds value by investigating the role of supervisors in promoting open science.

URL : Biomedical supervisors’ role modeling of open science practices

DOI : https://doi.org/10.7554/eLife.83484

Ups and downs on “r/science” — exploring the dynamics of science communication on Reddit

Authors : Jonas Kaiser, Birte Fähnrich, Laura Heintz

This exploratory study analyzed user-generated science communication on Reddit from May 2007 to October 2018 (n = 694.147 posts). We used automated content analyses and topic modelling to explore patterns that the user-generated communication exhibits.

Results indicate that science communication on r/science refers to a broad range of different topics and disciplines. Specific upvote features of Reddit result in increased attention to sources and topics.

Especially, social media sources and content that is self-referential to Reddit lead to high controversy in discussions.

URL : Ups and downs on “r/science” — exploring the dynamics of science communication on Reddit

DOI : https://doi.org/10.22323/2.22020208

Citation differences across research funding and access modalities

Authors : Pablo Dorta-González, María Isabel Dorta-González

This research provides insight into the complex relationship between open access, funding, and citation advantage. It presents an analysis of research articles and their citations in the Scopus database across 40 subject categories.

The sample includes 12 categories from Health Sciences, 7 from Life Sciences, 10 from Physical Sciences & Engineering, and 11 from Social Sciences & Humanities. Specifically, the analysis focuses on articles published in 2016 and the citations they received from 2016 to 2020.

Our findings show that open access articles published in hybrid journals receive considerably more citations than those published in gold open access journals. Articles under the hybrid gold modality are cited on average twice as much as those in the gold modality, regardless of funding.

Furthermore, we found that funded articles generally obtain 50 % more citations than unfunded ones within the same publication modality. Open access repositories significantly increase citations, particularly for articles without funding. Thus, articles in open access repositories receive 50 % more citations than paywalled ones.

URL : Citation differences across research funding and access modalities

DOI : https://doi.org/10.1016/j.acalib.2023.102734

Making science public: a review of journalists’ use of Open Science research

Authors : Alice Fleerackers, Natascha Chten, Stephen Pinfield, Juan Pablo Alperin, Germana Barata, Monique Oliveira, Isabella Peters

Science journalists are uniquely positioned to increase the societal impact of open science by contextualizing and communicating research findings in ways that highlight their relevance and implications for non-specialist audiences.

Through engagement with and coverage of open research outputs, journalists can help align the ideals of openness, transparency, and accountability with the wider public sphere and its democratic potential.

Yet, it is unclear to what degree journalists use open research outputs in their reporting, what factors motivate or constrain this use, and how the recent surge in openly available research seen during the COVID-19 pandemic has affected the relationship between open science and science journalism.

This literature review thus examines journalists’ use of open research outputs, specifically open access publications and preprints. We focus on literature published from 2018 onwards—particularly literature relating to the COVID-19 pandemic—but also include seminal articles outside the search dates.

We find that, despite journalists’ potential to act as critical brokers of open access knowledge, their use of open research outputs is hampered by an overreliance on traditional criteria for evaluating scientific quality; concerns about the trustworthiness of open research outputs; and challenges using and verifying the findings.

We also find that, while the COVID-19 pandemic encouraged journalists to explore open research outputs such as preprints, the extent to which these explorations will become established journalistic practices remains unclear.

Furthermore, we note that current research is overwhelmingly authored and focused on the Global North, and the United States specifically.

Finally, given the dearth of research in this area, we conclude with recommendations for future research that attend to issues of equity and diversity, and more explicitly examine the intersections of open science and science journalism.

URL : Making science public: a review of journalists’ use of Open Science research

DOI : https://doi.org/10.12688/f1000research.133710.1