Archives des mots-clés : scientific communication

Innovations in peer review in scholarly publishing: a meta-summary

Posté le par

Authors : Helen Buckley Woods, Johanna Brumberg, Wolfgang Kaltenbrunner, Stephen Pinfield, Ludo Waltman

Background

There are currently numerous innovations in peer review and quality assurance in scholarly publishing. The Research on Research Institute conducted a programme of co-produced projects investigating these innovations.

This literature review was part of one such project ‘Experiments in peer review’ (Kaltenbrunner et al, 2022), which created an inventory and framework of peer review innovations. The aim of this literature review was to aid the development of the inventory by identifying innovations in peer review reported in the scholarly literature and by providing a summary of the different approaches.

Methods

This meta-summary is based on data identified from Web of Science and Scopus limited from 2010 to 2021. A total of 247 papers were screened, with 6 review articles chosen for the focus of the literature review. Items were selected that described approaches to innovating peer review or illustrated examples.

Results

The summary of innovations are drawn from 6 review articles: Bruce et al (2016); Tennant et al (2017); Burley (2017); Horbach and Halffman (2018); Tennant (2018); Barroga (2020). The innovations are divided into three high-level categories: approaches to peer review, reviewer focussed initiatives and technology to support peer review with sub-categories of results presented in tabular form and summarised. A summary of all innovations found is also presented.

Conclusions

From a simple synthesis of the review authors’ conclusions, three key messages are presented: observations on current practice; authors’ views on the implications of innovations in peer review; and calls for action in peer review research and practice.

URL : https://osf.io/preprints/socarxiv/qaksd/

The Essence and Transcendence of Scientific Publishing

Posté le par

Authors : José L. Medina-Franco, Edgar López-López

Disseminating the results of scientific research in various forms (typically, peer-reviewed papers, conferences, and so on) nurtures and shapes the advancement of science. Scientific publishing is highly attached to the four well-known Mertonian norms and values that comprise the character or ethos of modern science, namely: communism, universalism, disinterestedness, and organized skepticism (Merton, 1973).

This is particularly true for publications that follow a rigorous peer-review and editorial process. Alongside dissemination of science that arguably is the primary reason for scientific publishing, it has other scientific, academic, and professional benefits on the large.

However, the pressure of publishing as a documented proof of productivity in academic and other professional settings has led to the “publish or perish’ aphorism (Neill, 2008; Publish or perish, 2010). In many cases, such paradigms obscure or alter the actual reasons and motivations for publishing, making it a “survival mechanism.”

This manuscript aims to share the authors’ opinions and revisit the right and fundamental reasons for scientific publishing. This Opinion is mainly directed to the students and young researchers that sometimes struggle at the beginning to organize, plan, and develop a manuscript.

The younger generations (and other more advanced or senior researchers) should consider scientific publishing as more than a survival mechanism to not perish, because such a focused motivation is counterproductive and burdens these initial steps.

Here, we highlight several other valid and collateral reasons for publishing beyond academic survival. Other important aspects of scientific publishing are not addressed in detail here, such as peer-review, the cost associated with open access, metrics to evaluate and rank the journals’ quality, and ethics in publishing. Instead, they are mentioned and discussed in the context of the primary goals and collateral benefits of publishing.

URL : The Essence and Transcendence of Scientific Publishing

DOI : https://doi.org/10.3389/frma.2022.822453

Examining linguistic shifts between preprints and publications

Posté le par

Authors : David N. Nicholson, Vincent Rubinetti, Dongbo Hu, Marvin Thielk, Lawrence E. Hunter, Casey S. Greene

Preprints allow researchers to make their findings available to the scientific community before they have undergone peer review. Studies on preprints within bioRxiv have been largely focused on article metadata and how often these preprints are downloaded, cited, published, and discussed online.

A missing element that has yet to be examined is the language contained within the bioRxiv preprint repository. We sought to compare and contrast linguistic features within bioRxiv preprints to published biomedical text as a whole as this is an excellent opportunity to examine how peer review changes these documents.

The most prevalent features that changed appear to be associated with typesetting and mentions of supporting information sections or additional files. In addition to text comparison, we created document embeddings derived from a preprint-trained word2vec model.

We found that these embeddings are able to parse out different scientific approaches and concepts, link unannotated preprint–peer-reviewed article pairs, and identify journals that publish linguistically similar papers to a given preprint.

We also used these embeddings to examine factors associated with the time elapsed between the posting of a first preprint and the appearance of a peer-reviewed publication. We found that preprints with more versions posted and more textual changes took longer to publish.

Lastly, we constructed a web application (https://greenelab.github.io/preprint-similarity-search/) that allows users to identify which journals and articles that are most linguistically similar to a bioRxiv or medRxiv preprint as well as observe where the preprint would be positioned within a published article landscape.

URL : Examining linguistic shifts between preprints and publications

DOI : https://doi.org/10.1371/journal.pbio.3001470

More journal articles and fewer books: Publication practices in the social sciences in the 2010’s

Posté le par

Authors : William E. Savage, Anthony J. Olejniczak

The number of scholarly journal articles published each year is growing, but little is known about the relationship between journal article growth and other forms of scholarly dissemination (e.g., books and monographs).

Journal articles are the de facto currency of evaluation and prestige in STEM fields, but social scientists routinely publish books as well as articles, representing a unique opportunity to study increased article publications in disciplines with other dissemination options.

We studied the publishing activity of social science faculty members in 12 disciplines at 290 Ph.D. granting institutions in the United States between 2011 and 2019, asking: 1) have publication practices changed such that more or fewer books and articles are written now than in the recent past?; 2) has the percentage of scholars actively participating in a particular publishing type changed over time?; and 3) do different age cohorts evince different publication strategies?

In all disciplines, journal articles per person increased between 3% and 64% between 2011 and 2019, while books per person decreased by at least 31% and as much as 54%. All age cohorts show increased article authorship over the study period, and early career scholars author more articles per person than the other cohorts in eight disciplines.

The article-dominated literatures of the social sciences are becoming increasingly similar to those of STEM disciplines.

URL : More journal articles and fewer books: Publication practices in the social sciences in the 2010’s

DOI : https://doi.org/10.1371/journal.pone.0263410

Gender disparity in publication records: a qualitative study of women researchers in computing and engineering

Posté le par

Authors : Mohammad Hosseini, Shiva Sharifzad

Background

The current paper follows up on the results of an exploratory quantitative analysis that compared the publication and citation records of men and women researchers affiliated with the Faculty of Computing and Engineering at Dublin City University (DCU) in Ireland.

Quantitative analysis of publications between 2013 and 2018 showed that women researchers had fewer publications, received fewer citations per person, and participated less often in international collaborations.

Given the significance of publications for pursuing an academic career, we used qualitative methods to understand these differences and explore factors that, according to women researchers, have contributed to this disparity.

Methods

Sixteen women researchers from DCU’s Faculty of Computing and Engineering were interviewed using a semi-structured questionnaire. Once interviews were transcribed and anonymised, they were coded by both authors in two rounds using an inductive approach.

Results

Interviewed women believed that their opportunities for research engagement and research funding, collaborations, publications and promotions are negatively impacted by gender roles, implicit gender biases, their own high professional standards, family responsibilities, nationality and negative perceptions of their expertise and accomplishments.

Conclusions

Our study has found that women in DCU’s Faculty of Computing and Engineering face challenges that, according to those interviewed, negatively affect their engagement in various research activities, and, therefore, have contributed to their lower publication record.

We suggest that while affirmative programmes aiming to correct disparities are necessary, they are more likely to  improve organisational culture if they are implemented in parallel with bottom-up initiatives that engage all parties, including men researchers and non-academic partners, to inform and sensitise them about the significance of gender equity.

URL : Gender disparity in publication records: a qualitative study of women researchers in computing and engineering

DOI : https://doi.org/10.1186/s41073-021-00117-3

Publishing of COVID-19 preprints in peer-reviewed journals, preprinting trends, public discussion and quality issues

Posté le par

Authors : Ivan Kodvanj, Jan Homolak, Vladimir Trkulja

COVID-19-related (vs. non-related) articles appear to be more expeditiously processed and published in peer-reviewed journals.

We aimed to evaluate: (i) whether COVID-19-related preprints were favored for publication, (ii) preprinting trends and public discussion of the preprints, and (iii) the relationship between the publication topic (COVID-19-related or not) and quality issues.

Manuscripts deposited at bioRxiv and medRxiv between January 1 and September 27 2020 were assessed for the probability of publishing in peer-reviewed journals, and those published were evaluated for submission-to-acceptance time. The extent of public discussion was assessed based on Altmetric and Disqus data.

The Retraction Watch Database and PubMed were used to explore the retraction of COVID-19 and non-COVID-19 articles and preprints. With adjustment for the preprinting server and number of deposited versions, COVID-19-related preprints were more likely to be published within 120 days since the deposition of the first version (OR = 1.96, 95% CI: 1.80–2.14) as well as over the entire observed period (OR = 1.39, 95% CI: 1.31–1.48). Submission-to-acceptance was by 35.85 days (95% CI: 32.25–39.45) shorter for COVID-19 articles.

Public discussion of preprints was modest and COVID-19 articles were overrepresented in the pool of retracted articles in 2020. Current data suggest a preference for publication of COVID-19-related preprints over the observed period.

URL : https://doi.org/10.1007/s11192-021-04249-7