Journal data policies: Exploring how the understanding of editors and authors corresponds to the policies themselves

Authors : Thu-Mai Christian, Amanda Gooch, Todd Vision, Elizabeth Hull

Despite the increase in the number of journals issuing data policies requiring authors to make data underlying reporting findings publicly available, authors do not always do so, and when they do, the data do not always meet standards of quality that allow others to verify or extend published results.

This phenomenon suggests the need to consider the effectiveness of journal data policies to present and articulate transparency requirements, and how well they facilitate (or hinder) authors’ ability to produce and provide access to data, code, and associated materials that meet quality standards for computational reproducibility.

This article describes the results of a research study that examined the ability of journal-based data policies to: 1) effectively communicate transparency requirements to authors, and 2) enable authors to successfully meet policy requirements.

To do this, we conducted a mixed-methods study that examined individual data policies alongside editors’ and authors’ interpretation of policy requirements to answer the following research questions.

Survey responses from authors and editors along with results from a content analysis of data policies found discrepancies among editors’ assertion of data policy requirements, authors’ understanding of policy requirements, and the requirements stated in the policy language as written.

We offer explanations for these discrepancies and offer recommendations for improving authors’ understanding of policies and increasing the likelihood of policy compliance.

URL : Journal data policies: Exploring how the understanding of editors and authors corresponds to the policies themselves

DOI : https://doi.org/10.1371/journal.pone.0230281

Access to Scientific Literature by the Conservation Community

Authors : Daisy Larios, Thomas M. Brooks, Nicholas B.W. Macfarlane, Sugoto Roy

Access to the scientific literature is perceived to be a challenge to the biodiversity conservation community, but actual level of literature access relative to needs has never been assessed globally.

We examined this question by surveying the constituency of the International Union for Conservation of Nature (IUCN) as a proxy for the conservation community, generating 2,285 responses. Of these respondents, ∼97% need to use the scientific literature in order to support their IUCN-related conservation work, with ∼50% needing to do so at least once per week.

The crux of the survey revolved around the question, “How easy is it for you currently to obtain the scientific literature you need to carry out your IUCN-related work?” and revealed that roughly half (49%) of the respondents find it not easy or not at all easy to access scientific literature.

We fitted a binary logistic regression model to explore factors predicting ease of literature access. Whether the respondent had institutional literature access (55% do) is the strongest predictor, with region (Western Europe, the United States, Canada, Australia and New Zealand) and gender (male) also significant predictors.

Approximately 60% of respondents from Western Europe, the United States, Canada, Australia and New Zealand have institutional access compared to ∼50% in Asia and Latin America, and ∼40% in Eastern Europe and in Africa. Nevertheless, accessing free online material is a popular means of accessing literature for both those with and without institutional access.

The four journals most frequently mentioned when asked which journal access would deliver the greatest improvements to the respondent’s IUCN-related work were Conservation Biology, Biological Conservation, Nature, and Science.

The majority prefer to read journal articles on screen but prefer to read books in hard copy. Overall, it is apparent that access to the literature is a challenge facing roughly half of the conservation community worldwide.

URL : Access to Scientific Literature by the Conservation Community

GitHub Repositories with Links to Academic Papers: Open Access, Traceability, and Evolution

Authors : Supatsara Wattanakriengkrai, Bodin Chinthanet, Hideaki Hata, Raula Gaikovina Kula, Christoph Treude, Jin Guo, Kenichi Matsumoto

Traceability between published scientific breakthroughs and their implementation is essential, especially in the case of Open Source Software implements bleeding edge science into its code. However, aligning the link between GitHub repositories and academic papers can prove difficult, and the link impact remains unknown.

This paper investigates the role of academic paper references contained in these repositories. We conducted a large-scale study of 20 thousand GitHub repositories to establish prevalence of references to academic papers. We use a mixed-methods approach to identify Open Access (OA), traceability and evolutionary aspects of the links.

Although referencing a paper is not typical, we find that a vast majority of referenced academic papers are OA. In terms of traceability, our analysis revealed that machine learning is the most prevalent topic of repositories. These repositories tend to be affiliated with academic communities. More than half of the papers do not link back to any repository.

A case study of referenced arXiv paper shows that most of these papers are high-impact and influential and do align with academia, referenced by repositories written in different programming languages. From the evolutionary aspect, we find very few changes of papers being referenced and links to them.

URL : https://arxiv.org/abs/2004.00199

Digital Objects – FAIR Digital Objects: Which Services Are Required?

Author : Ulrich Schwardmann

Some of the early Research Data Alliance working groups reused the notion of digital objects as digital entities described by metadata and referenced by a persistent identifier. In recent times the FAIR principles became a prominent role as framework for the sustainability of scientific data.

Both approaches had always machine actionability, the capability of computational systems to use services on data without human intervention, in their focus. The more technical approach of digital objects turned out to provide a complementary view on several aspects of the policy framework of FAIR from a technical perspective.

After a deeper analysis and integration of these concepts by a group of European data experts the discussion intensified on so called FAIR digital objects. But they need to be accompanied by services as building blocks for automated processes. We will describe the components of this framework and its potentials here, and also which services inside this framework are required.

URL : Digital Objects – FAIR Digital Objects: Which Services Are Required?

DOI : http://doi.org/10.5334/dsj-2020-015

Lessons From the Open Library of Humanities

Authors : Martin Paul Eve, Paula Clemente Vega, Caroline Edwards

The Open Library of Humanities was launched almost half a decade ago with funding from the Andrew W. Mellon Foundation. In this article, we outline the problems we set out to address and the lessons we learned.

Specifically, we note that, as we hypothesized, academic libraries are not necessarily classical economic actors; that implementing consortial funding models requires much marketing labour; that there are substantial governance and administrative overheads in our model; that there are complex tax and VAT considerations for consortial arrangements; and that diverse revenue sources remain critical to our success.

URL : Lessons From the Open Library of Humanities

DOI : http://doi.org/10.18352/lq.10327

Comfortably Numb? Researchers’ Satisfaction with the Publication System and a Proposal for Radical Change

Authors : Hans van Dijk, Marino van Zelst

In this preregistered study we evaluate current attitudes towards, and experiences with, publishing research and propose an alternative system of publishing. Our main hypothesis is that researchers tend to become institutionalized, such that they are generally discontent with the current publication system, but that this dissatisfaction fades over time as they become tenured.

A survey was distributed to the first authors of papers published in four recent issues of top-15 Work and Organizational Psychology (WOP) journals. Even among this positively biased sample, we found that the time it takes to publish a manuscript is negatively associated with whether authors perceive this time to be justifiable and worthwhile relative to the amount their manuscript has changed. Review quality and tenure buffer the negative relationship with perceived justifiability, but not for perceived worth.

The findings suggest that untenured (WOP) researchers are dissatisfied with the publishing times of academic journals, which adds to the pile of criticisms of the journal-based publication system. Since publishing times are inherent to the journal-based publication system, we suggest that incremental improvements may not sufficiently address the problems associated with publishing times.

We therefore propose the adoption of a modular publication system to improve (WOP) publishing experiences.

URL : Comfortably Numb? Researchers’ Satisfaction with the Publication System and a Proposal for Radical Change

DOI : https://doi.org/10.3390/publications8010014

Who reviews for predatory journals? A study on reviewer characteristics

Authors : Anna Severin, Michaela Strinzel, Matthias Egger, Marc Domingo, Tiago Barros

Background

While the characteristics of scholars who publish in predatory journals are relatively well-understood, nothing is known about the scholars who review for these journals.

We aimed to answer the following questions: Can we observe patterns of reviewer characteristics for scholars who review for predatory journals and for legitimate journals? Second, how are reviews for potentially predatory journals distributed globally?

Methods

We matched random samples of 1,000 predatory journals and 1,000 legitimate journals of the Cabells Scholarly Analytics’ journal lists with the Publons database of review reports, using the Jaro-Winkler string metric.

For reviewers of matched reviews, we descriptively analysed meta-data on reviewing and publishing behaviour.

Results

We matched 183,743 unique Publons reviews that were claimed by 19,598 reviewers. 6,077 reviews were conducted for 1160 unique predatory journals (3.31% of all reviews). 177,666 were claimed for 6,403 legitimate journals (96.69% of all reviews).

The vast majority of scholars either never or only occasionally submitted reviews for predatory journals to Publons (89.96% and 7.55% of all reviewers, respectively). Smaller numbers of scholars claimed reviews predominantly or exclusively for predatory journals (0.26% and 0.35% of all reviewers, respectively).

The two latter groups of scholars are of younger academic age and have fewer publications and fewer reviews than the first two groups of scholars.Developing regions feature larger shares of reviews for predatory reviews than developed regions.

Conclusion

The characteristics of scholars who review for potentially predatory journals resemble those of authors who publish their work in these outlets. In order to combat potentially predatory journals, stakeholders will need to adopt a holistic approach that takes into account the entire research workflow.

DOI : https://doi.org/10.1101/2020.03.09.983155