Who reviews for predatory journals? A study on reviewer characteristics

Authors : Anna Severin, Michaela Strinzel, Matthias Egger, Marc Domingo, Tiago Barros

Background

While the characteristics of scholars who publish in predatory journals are relatively well-understood, nothing is known about the scholars who review for these journals.

We aimed to answer the following questions: Can we observe patterns of reviewer characteristics for scholars who review for predatory journals and for legitimate journals? Second, how are reviews for potentially predatory journals distributed globally?

Methods

We matched random samples of 1,000 predatory journals and 1,000 legitimate journals of the Cabells Scholarly Analytics’ journal lists with the Publons database of review reports, using the Jaro-Winkler string metric.

For reviewers of matched reviews, we descriptively analysed meta-data on reviewing and publishing behaviour.

Results

We matched 183,743 unique Publons reviews that were claimed by 19,598 reviewers. 6,077 reviews were conducted for 1160 unique predatory journals (3.31% of all reviews). 177,666 were claimed for 6,403 legitimate journals (96.69% of all reviews).

The vast majority of scholars either never or only occasionally submitted reviews for predatory journals to Publons (89.96% and 7.55% of all reviewers, respectively). Smaller numbers of scholars claimed reviews predominantly or exclusively for predatory journals (0.26% and 0.35% of all reviewers, respectively).

The two latter groups of scholars are of younger academic age and have fewer publications and fewer reviews than the first two groups of scholars.Developing regions feature larger shares of reviews for predatory reviews than developed regions.

Conclusion

The characteristics of scholars who review for potentially predatory journals resemble those of authors who publish their work in these outlets. In order to combat potentially predatory journals, stakeholders will need to adopt a holistic approach that takes into account the entire research workflow.

DOI : https://doi.org/10.1101/2020.03.09.983155

“Blacklists” and “whitelists” to tackle predatory publishing : A cross-sectional comparison and thematic analysis

Authors : Michaela Strinzel​, Anna Severin, Katrin Milzow, Matthias Egger

Background

Despite growing awareness of predatory publishing and research on its market characteristics, the defining attributes of fraudulent journals remain controversial.

We aimed to develop a better understanding of quality criteria for scholarly journals by analysing journals and publishers indexed in blacklists of predatory journals and whitelists of legitimate journals and the lists’ inclusion criteria.

Methods

We searched for blacklists and whitelists in early 2018. Lists that included journals across disciplines were eligible. We used a mixed methods approach, combining quantitative and qualitative analyses.

To quantify overlaps between lists in terms of indexed journals and publishers we employed the Jaro-Winkler string metric and Venn diagrams. To identify topics addressed by the lists’ inclusion criteria and to derive their broader conceptual categories, we used a qualitative coding approach.

Results

Two blacklists (Beall’s and Cabell’s) and two whitelists (DOAJ and Cabell’s) were eligible. The number of journals per list ranged from 1404 to 12357 and the number of publishers from 473 to 5638. Seventy-three journals and 42 publishers were included both in a blacklist and whitelist. A total of 198 inclusion criteria were examined.

Seven thematic themes were identified: (i) peer review, (ii) editorial services, (iii) policy, (iv) business practices, (v) publishing, archiving and access, (vi) website and (vii) indexing and metrics.

Business practices accounted for almost half of blacklists’ criteria, whereas whitelists gave more emphasis to criteria related to policy and guidelines. Criteria were grouped into four broad concepts: (i) transparency, (ii) ethics, (iii) professional standards and (iv) peer review and other services.

Whitelists gave more weight to transparency whereas blacklists focused on ethics and professional standards. The criteria included in whitelists were easier to verify than those used in blacklists. Both types of list gave relatively little emphasis to the quality of peer review.

Conclusions

There is overlap between journals and publishers included in blacklists and whitelists. Blacklists and whitelists differ in their criteria for quality and the weight given to different dimensions of quality. Aspects that are central but difficult to verify receive insufficient attention.

URL : “Blacklists” and “whitelists” to tackle predatory publishing : A cross-sectional comparison and thematic analysis

DOI : https://doi.org/10.7287/peerj.preprints.27532v1

Discipline-specific open access publishing practices and barriers to change: an evidence-based review

Authors : Anna Severin, Matthias Egger, Martin Paul Eve, Daniel Hürlimann

Background

Many of the discussions surrounding Open Access (OA) revolve around how it affects publishing practices across different academic disciplines. It was a long-held view that it would be only a matter of time for all disciplines to fully and relatively homogeneously implement OA.

Recent large-scale bibliometric studies show however that the uptake of OA differs substantially across disciplines. This study investigates the underlying mechanisms that cause disciplines to vary in their OA publishing practices.

We aimed to answer two questions: First, how do different disciplines adopt and shape OA publishing practices? Second, what discipline-specific barriers to and potentials for OA can be identified?

Methods

In a first step, we identified and synthesized relevant bibliometric studies that assessed OA prevalence and publishing patterns across disciplines. In a second step, and adopting a social shaping of technology perspective, we studied evidence on the socio-technical forces that shape OA publishing practices.

We examined a variety of data sources, including, but not limited to, publisher policies and guidelines, OA mandates and policies and author surveys.

Results

Over the last three decades, scholarly publishing has experienced a shift from “closed” access to OA as the proportion of scholarly literature that is openly accessible has increased continuously.

The shift towards OA is however uneven across disciplines in two respects: first, the growth of OA has been uneven across disciplines, which manifests itself in varying OA prevalence levels. Second, disciplines use different OA publishing channels to make research outputs OA.

Conclusions

We conclude that historically grown publishing practices differ in terms of their compatibility with OA, which is the reason why OA can be assumed to be a natural continuation of publishing cultures in some disciplines, whereas in other disciplines, the implementation of OA faces major barriers and would require a change of research culture.

URL : Discipline-specific open access publishing practices and barriers to change: an evidence-based review

DOI : https://doi.org/10.12688/f1000research.17328.1