Two years into the Brazilian Reproducibility Initiative: reflections on conducting a large-scale replication of Brazilian biomedical science

Author : Kleber Neves, Clarissa FD Carneiro, Ana Paula Wasilewska-Sampaio, Mariana Abreu, Bruna Valério-Gomes, Pedro B Tan, Olavo B Amaral

Scientists have increasingly recognised that low methodological and analytical rigour combined with publish-or-perish incentives can make the published scientific literature unreliable.

As a response to this, large-scale systematic replications of the literature have emerged as a way to assess the problem empirically. The Brazilian Reproducibility Initiative is one such effort, aimed at estimating the reproducibility of Brazilian biomedical research.

Its goal is to perform multicentre replications of a quasi-random sample of at least 60 experiments from Brazilian articles published over a 20-year period, using a set of common laboratory methods.

In this article, we describe the challenges of managing a multicentre project with collaborating teams across the country, as well as its successes and failures over the first two years.

We end with a brief discussion of the Initiative’s current status and its possible future contributions after the project is concluded in 2021.

URL : Two years into the Brazilian Reproducibility Initiative: reflections on conducting a large-scale replication of Brazilian biomedical science

DOI : https://doi.org/10.1590/0074-02760200328

The Enlightenment of Peer Review : How Academic Librarians Can Utilize Open Peer Review Methods to Advance Information Literacy

Author : Sandra Moore

In today’s world of digital scholarly publishing, it is increasingly clear that movements such as open access (OA), Open Science, and open peer review (OPR) are increasingly impactful and gaining momentum.

The shift towards openness in the academy reveals a transformation of traditional structures that compose scholarly communication as well as changing attitudes about the nature of authority and access within these systems.

These new directions in the scholarly information landscape have created a need for academic librarians to realign roles and respond in ways that build resiliency in an era of rapid change.

Recognizing that many core elements of scholarly communication are powerful tools for teaching students about information literacy can lead to transformative instructional strategies.

This paper explores how academic librarians can leverage the innovative traits of OPR to advance information literacy through experiential student learning opportunities grounded in the ACRL (2016) Framework for Information Literacy for Higher Education.

URL : The Enlightenment of Peer Review : How Academic Librarians Can Utilize Open Peer Review Methods to Advance Information Literacy

DOI : https://doi.org/10.5206/elip.v3i1.8618

Gender gaps in research productivity and recognition among elite scientists in the U.S., Canada, and South Africa

Authors : Creso Sá, Summer Cowley, Magdalena Martinez, Nadiia Kachynska, Emma Sabzalieva

This study builds upon the literature documenting gender disparities in science by investigating research productivity and recognition among elite scientists in three countries. This analysis departs from both the general comparison of researchers across organizational settings and academic appointments on one hand, and the definition of “elite” by the research outcome variables on the other, which are common in previous studies.

Instead, this paper’s approach considers the stratification of scientific careers by carefully constructing matched samples of men and women holding research chairs in Canada, the United States and South Africa, along with a control group of departmental peers.

The analysis is based on a unique, hand-curated dataset including 943 researchers, which allows for a systematic comparison of successful scientists vetted through similar selection mechanisms.

Our results show that even among elite scientists a pattern of stratified productivity and recognition by gender remains, with more prominent gaps in recognition. Our results point to the need for gender equity initiatives in science policy to critically examine assessment criteria and evaluation mechanisms to emphasize multiple expressions of research excellence.

URL : Gender gaps in research productivity and recognition among elite scientists in the U.S., Canada, and South Africa

DOI : https://doi.org/10.1371/journal.pone.0240903

Scientific data management in the federal government: A case study of NOAA and responsibility for preserving digital data

Authors : Adam Kriesberg, Jacob Kowall

In this paper, we examine the ways in which the evolution of federal and agency‐specific data management policies has affected and continues to affect the long‐term preservation of digital scientific data produced by the United States government.

After reviewing the existing literature on the role of archival theory and practice in the preservation of scientific data, we present the case of the National Oceanic and Atmospheric Administration (NOAA) to analyze how data management activities at this agency are shaped by legislative mandates as well as both government‐wide and agency‐specific information‐management policies.

Through the connected network of law, federal policy, agency policy, and the records schedules which govern recordkeeping practice in the federal government, we propose a number of further questions on how government agencies can effectively provide for the management of scientific data as federal records.

DOI : https://doi.org/10.1002/pra2.266

Data sharing policies of journals in life, health, and physical sciences indexed in Journal Citation Reports

Authors : Jihyun Kim, Soon Kim, Hye-Min Cho, Jae Hwa Chang, Soo Young Kim

Background

Many scholarly journals have established their own data-related policies, which specify their enforcement of data sharing, the types of data to be submitted, and their procedures for making data available.

However, except for the journal impact factor and the subject area, the factors associated with the overall strength of the data sharing policies of scholarly journals remain unknown.

This study examines how factors, including impact factor, subject area, type of journal publisher, and geographical location of the publisher are related to the strength of the data sharing policy.

Methods

From each of the 178 categories of the Web of Science’s 2017 edition of Journal Citation Reports, the top journals in each quartile (Q1, Q2, Q3, and Q4) were selected in December 2018. Of the resulting 709 journals (5%), 700 in the fields of life, health, and physical sciences were selected for analysis.

Four of the authors independently reviewed the results of the journal website searches, categorized the journals’ data sharing policies, and extracted the characteristics of individual journals.

Univariable multinomial logistic regression analyses were initially conducted to determine whether there was a relationship between each factor and the strength of the data sharing policy.

Based on the univariable analyses, a multivariable model was performed to further investigate the factors related to the presence and/or strength of the policy.

Results

Of the 700 journals, 308 (44.0%) had no data sharing policy, 125 (17.9%) had a weak policy, and 267 (38.1%) had a strong policy (expecting or mandating data sharing). The impact factor quartile was positively associated with the strength of the data sharing policies.

Physical science journals were less likely to have a strong policy relative to a weak policy than Life science journals (relative risk ratio [RRR], 0.36; 95% CI [0.17–0.78]). Life science journals had a greater probability of having a weak policy relative to no policy than health science journals (RRR, 2.73; 95% CI [1.05–7.14]).

Commercial publishers were more likely to have a weak policy relative to no policy than non-commercial publishers (RRR, 7.87; 95% CI, [3.98–15.57]). Journals by publishers in Europe, including the majority of those located in the United Kingdom and the Netherlands, were more likely to have a strong data sharing policy than a weak policy (RRR, 2.99; 95% CI [1.85–4.81]).

Conclusions

These findings may account for the increase in commercial publishers’ engagement in data sharing and indicate that European national initiatives that encourage and mandate data sharing may influence the presence of a strong policy in the associated journals.

Future research needs to explore the factors associated with varied degrees in the strength of a data sharing policy as well as more diverse characteristics of journals related to the policy strength.

URL : Data sharing policies of journals in life, health, and physical sciences indexed in Journal Citation Reports

DOI : https://doi.org/10.7717/peerj.9924

Who’s writing open access (OA) articles? Characteristics of OA authors at Ph.D.-granting institutions in the United States

Authors : Anthony J. Olejniczak, Molly J. Wilson

The open access (OA) publication movement aims to present research literature to the public at no cost and with no restrictions.

While the democratization of access to scholarly literature is a primary focus of the movement, it remains unclear whether OA has uniformly democratized the corpus of freely available research, or whether authors who choose to publish in OA venues represent a particular subset of scholars—those with access to resources enabling them to afford article processing charges (APCs).

We investigated the number of OA articles with article processing charges (APC OA) authored by 182,320 scholars with known demographic and institutional characteristics at American research universities across 11 broad fields of study.

The results show, in general, that the likelihood for a scholar to author an APC OA article increases with male gender, employment at a prestigious institution (AAU member universities), association with a STEM discipline, greater federal research funding, and more advanced career stage (i.e., higher professorial rank).

Participation in APC OA publishing appears to be skewed toward scholars with greater access to resources and job security.

DOI : https://doi.org/10.1162/qss_a_00091

Authorship in top-ranked mathematical and physical journals: Role of gender on self-perceptions and bibliographic evidence

Authors : Helena Mihaljevi, Lucía Santamaría

Despite increasing rates of women researching in math-intensive fields, publications by female authors remain underrepresented. By analyzing millions of records from the dedicated bibliographic databases zbMATH, arXiv, and ADS, we unveil the chronological evolution of authorships by women in mathematics, physics, and astronomy.

We observe a pronounced shortage of female authors in top-ranked journals, with quasi-stagnant figures in various distinguished periodicals in the first two disciplines and a significantly more equitable situation in the latter.

Additionally, we provide an interactive open-access web interface to further examine the data. To address whether female scholars submit fewer articles for publication to relevant journals or whether they are consciously or unconsciously disadvantaged by the peer review system, we also study authors’ perceptions of their submission practices and analyze around 10,000 responses, collected as part of a recent global survey of scientists.

Our analysis indicates that men and women perceive their submission practices to be similar, with no evidence that a significantly lower number of submissions by women is responsible for their underrepresentation in top-ranked journals.

According to the self-reported responses, a larger number of articles submitted to prestigious venues correlates rather with aspects associated with pronounced research activity, a well-established network, and academic seniority.

DOI : https://doi.org/10.1162/qss_a_00090