Investigation of potential gender bias in the peer review system at Reproduction

Authors : Marie BiolkováTom MooreKaren SchindlerKarl SwannAndy VailLindsay FlookHelen DickGreg FitzharrisChristopher A. PriceNorah Spears

This study examined whether publication outcome was affected by the gender of author, handling associate editor (AE), or reviewer, and whether there was gender bias in reviewer selection, in the journal Reproduction.

Analyses were carried out on 4289 original research manuscripts submitted to the journal between 2007 and 2019. Both female and male AEs appointed more male reviewers than female reviewers, but female AEs were significantly more likely to appoint female reviewers than male AEs were (p < 0.001).

When examining the gender of either first or last author manuscripts, those with female authors that were reviewed by female reviewers received better scores than those with male authors that were reviewed by female reviewers (p < 0.05): where the reviewer was male, no such effect was observed.

Acceptance rates of manuscripts were similar for both female and male authors, whether first or last, regardless of AE gender. Overall, there was no significant correlation between gender of first or last author, or of AE, on the likelihood of acceptance of a research paper.

These data suggest no bias against female authors during the peer review process in this reproductive biology journal.

URL : Investigation of potential gender bias in the peer review system at Reproduction

DOI : https://doi.org/10.1002/leap.1537

Leveraging Open Tools to Realize the Potential of Self-Archiving: A Cohort Study in Clinical Trials

Author : Delwen L. Franzen

While open access (OA) is growing, many publications remain behind a paywall. This limits the impact of research and entrenches global inequalities by restricting access to knowledge to those that can afford it.

Many journal policies allow researchers to make a version of their publication openly accessible through self-archiving in a repository, sometimes after an embargo period (green OA). Unpaywall and Shareyourpaper are open tools that help users find OA articles and support authors to legally self-archive their papers, respectively.

This study leveraged these tools to assess the potential of green OA to increase discoverability in a cohort of clinical trial results publications from German university medical centers. Of the 1897 publications in this cohort, 46% (n = 871/1897, 95% confidence interval (CI) 44% to 48%) were neither openly accessible via a journal or a repository. Of these, 85% (n = 736/871, 95% CI 82% to 87%) had a permission to self-archive the accepted or published version in an institutional repository.

Thus, most of the closed-access clinical trial results in this cohort could be made openly accessible in a repository, in line with World Health Organization (WHO) recommendations.

In addition to providing further evidence of the unrealized potential of green OA, this study demonstrates the use of open tools to obtain actionable information on self-archiving at scale and empowers efforts to increase science discoverability.

URL : Leveraging Open Tools to Realize the Potential of Self-Archiving: A Cohort Study in Clinical Trials

DOI : https://doi.org/10.3390/publications11010004

`Pandem-icons’ — exploring the characteristics of highly visible scientists during the Covid-19 pandemic

Authors : Marina Joubert, Lars Guenther, Jenni Metcalfe, Michelle Riedlinger, Anwesha Chakraborty, Toss Gascoigne, Bernard Schiele, Ayelet Baram-Tsabari, Dmitry Malkov, Eliana Fattorini, Gema Revuelta, Germana Barata, Jan Riise, Justin T. Schröder, Maja Horst, Margaret Kaseje, Marnell Kirsten, Martin W. Bauer, Massimiano Bucchi, Natália Flores, Orli Wolfson, Tingjie Chen

The Covid-19 pandemic escalated demand for scientific explanations and guidance, creating opportunities for scientists to become publicly visible. In this study, we compared characteristics of visible scientists during the first year of the Covid-19 pandemic (January to December 2020) across 16 countries.

We find that the scientists who became visible largely matched socio-cultural criteria that have characterised visible scientists in the past (e.g., age, gender, credibility, public image, involvement in controversies).

However, there were limited tendencies that scientists commented outside their areas of expertise. We conclude that the unusual circumstances created by Covid-19 did not change the phenomenon of visible scientists in significant ways.

URL : `Pandem-icons’ — exploring the characteristics of highly visible scientists during the Covid-19 pandemic

DOI : https://doi.org/10.22323/2.22010204

Science knowledge and trust in science in biodiversity citizen science projects

Authors : Baptiste Bedessem, Anne Dozières, Anne-Caroline Prévot, Romain Julliard

Citizen science projects are valued for their impact on participants’ knowledge, attitude and behavior towards science. In this paper, we explore how participation in biodiversity citizen science projects is correlated to different dimensions of trust in science.

We conduct a quantitative study through an online survey of 1,199 individuals, 586 of them being part of a biodiversity citizen science program in France. Our results suggest that participation-related trust is more exhaustive — it covers more dimensions of the scientific endeavor — than education-related trust.

This exploratory study calls for more empirical research on the links between citizen science and the different dimensions of public trust in science.

URL : Science knowledge and trust in science in biodiversity citizen science projects

DOI : https://doi.org/10.22323/2.22010205

The Rise of GitHub in Scholarly Publications

Authors : Emily Escamilla, Martin Klein, Talya Cooper, Vicky Rampin, Michele C. Weigle, Michael L. Nelson

The definition of scholarly content has expanded to include the data and source code that contribute to a publication. While major archiving efforts to preserve conventional scholarly content, typically in PDFs (e.g., LOCKSS, CLOCKSS, Portico), are underway, no analogous effort has yet emerged to preserve the data and code referenced in those PDFs, particularly the scholarly code hosted online on Git Hosting Platforms (GHPs).

Similarly, the Software Heritage Foundation is working to archive public source code, but there is value in archiving the issue threads, pull requests, and wikis that provide important context to the code while maintaining their original URLs. In current implementations, source code and its ephemera are not preserved, which presents a problem for scholarly projects where reproducibility matters.

To understand and quantify the scope of this issue, we analyzed the use of GHP URIs in the arXiv and PMC corpora from January 2007 to December 2021. In total, there were 253,590 URIs to GitHub, SourceForge, Bitbucket, and GitLab repositories across the 2.66 million publications in the corpora.

We found that GitHub, GitLab, SourceForge, and Bitbucket were collectively linked to 160 times in 2007 and 76,746 times in 2021. In 2021, one out of five publications in the arXiv corpus included a URI to GitHub.

The complexity of GHPs like GitHub is not amenable to conventional Web archiving techniques. Therefore, the growing use of GHPs in scholarly publications points to an urgent and growing need for dedicated efforts to archive their holdings in order to preserve research code and its scholarly ephemera.

URL : https://arxiv.org/abs/2208.04895

Data Management Plans: Implications for Automated Analyses

Authors : Ngoc-Minh Pham, Heather Moulaison-Sandy, Bradley Wade Bishop, Hannah Gunderman

Data management plans (DMPs) are an essential part of planning data-driven research projects and ensuring long-term access and use of research data and digital objects; however, as text-based documents, DMPs must be analyzed manually for conformance to funder requirements.

This study presents a comparison of DMPs evaluations for 21 funded projects using 1) an automated means of analysis to identify elements that align with best practices in support of open research initiatives and 2) a manually-applied scorecard measuring these same elements.

The automated analysis revealed that terms related to availability (90% of DMPs), metadata (86% of DMPs), and sharing (81% of DMPs) were reliably supplied. Manual analysis revealed 86% (n = 18) of funded DMPs were adequate, with strong discussions of data management personnel (average score: 2 out of 2), data sharing (average score 1.83 out of 2), and limitations to data sharing (average score: 1.65 out of 2).

This study reveals that the automated approach to DMP assessment yields less granular yet similar results to manual assessments of the DMPs that are more efficiently produced. Additional observations and recommendations are also presented to make data management planning exercises and automated analysis even more useful going forward.

URL : Data Management Plans: Implications for Automated Analyses

DOI : http://doi.org/10.5334/dsj-2023-002

Creating research ethics and integrity country report cards: Case study from Europe

Authors : Andrijana Perković Paloš, Rea Roje, Vicko Tomić, Ana Marušić

Structures for and practices of research integrity (RI) and research ethics (RE) differ among countries. This study analyzed the processes and structures for RI and RE in Europe, following the framework developed at the World Conferences on Research Integrity.

We present RI and RE Country Report Cards for 16 European countries, which included the information on RI and RE structures, processes and outcomes. While some of the countries are front-runners when it comes to RI and RE, with well-established and continually developing policies and structures, others are just starting their journey in RI and RE.

Although RI and RE contextual divergences must be taken into account, a level of harmonization among the countries is necessary so that researchers working in the European area can similarly handle RI and RE issues and have similar expectations regardless of the organization in which they work. RI and RE Country Report Cards can be a tool to monitor, compare, and strengthen RE and integrity across countries through empowerment and inspiration by examples of good practices and developed systems.

URL : Creating research ethics and integrity country report cards Case study from Europe

DOI : https://doi.org/10.1080/08989621.2022.2163632