Is rapid scientific publication also high quality? Bibliometric analysis of highly disseminated COVID-19 research papers

Authors : Amandeep Khatter, Michael Naughton, Hajira Dambha-Miller, Patrick Redmond

The impact of COVID-19 has underlined the need for reliable information to guide clinical practice and policy. This urgency has to be balanced against disruption to journal handling capacity and the continued need to ensure scientific rigour.

We examined the reporting quality of highly disseminated COVID-19 research papers using a bibliometric analysis examining reporting quality and risk of bias (RoB) amongst 250 top scoring Altmetric Attention Score (AAS) COVID-19 research papers between January and April 2020.

Method-specific RoB tools were used to assess quality. After exclusions, 84 studies from 44 journals were included. Forty-three (51%) were case series/studies, and only one was an randomized controlled trial.

Most authors were from institutions based in China (n = 44, 52%). The median AAS and impact factor was 2015 (interquartile range [IQR] 1,105–4,051.5) and 12.8 (IQR 5–44.2) respectively. Nine studies (11%) utilized a formal reporting framework, 62 (74%) included a funding statement, and 41 (49%) were at high RoB.

This review of the most widely disseminated COVID-19 studies highlights a preponderance of low-quality case series with few research papers adhering to good standards of reporting. It emphasizes the need for cautious interpretation of research and the increasingly vital responsibility that journals have in ensuring high-quality publications.

URL : Is rapid scientific publication also high quality? Bibliometric analysis of highly disseminated COVID-19 research papers

DOI : https://doi.org/10.1002/leap.1403

Total SciComm: A Strategy for Communicating Open Science

Authors : Manh-Toan Ho, Manh-Tung Ho, Quan-Hoang Vuong

This paper seeks to introduce a strategy of science communication: Total SciComm or all-out science communication. We proposed that to maximize the outreach and impact, scientists should use different media to communicate different aspects of science, from core ideas to methods.

The paper uses an example of a debate surrounding a now-retracted article in the Nature journal, in which open data, preprints, social media, and blogs are being used for a meaningful scientific conversation.

The case embodied the central idea of Total SciComm: the scientific community employs every medium to communicate scientific ideas and engages all scientists in the process.

URL : Total SciComm: A Strategy for Communicating Open Science

DOI : https://doi.org/10.3390/publications9030031

Data sharing practices and data availability upon request differ across scientific disciplines

Authors : Leho tedersoo, Rainer Küngas, Ester Oras, Kajar Köster, Helen Eenmaa, Äli Leijen, Margus Pedaste, Marju Raju, Anastasiya Astapova, Heli Lukner, Karin Kogermann, Tuul Sepp

Data sharing is one of the cornerstones of modern science that enables large-scale analyses and reproducibility. We evaluated data availability in research articles across nine disciplines in Nature and Science magazines and recorded corresponding authors’ concerns, requests and reasons for declining data sharing.

Although data sharing has improved in the last decade and particularly in recent years, data availability and willingness to share data still differ greatly among disciplines. We observed that statements of data availability upon (reasonable) request are inefficient and should not be allowed by journals.

To improve data sharing at the time of manuscript acceptance, researchers should be better motivated to release their data with real benefits such as recognition, or bonus points in grant and job applications.

We recommend that data management costs should be covered by funding agencies; publicly available research data ought to be included in the evaluation of applications; and surveillance of data sharing should be enforced by both academic publishers and funders. These cross-discipline survey data are available from the plutoF repository.

URL : Data sharing practices and data availability upon request differ across scientific disciplines

DOI : https://doi.org/10.1038/s41597-021-00981-0

Institutional Data Repository Development, a Moving Target

Authors : Colleen Fallaw, Genevieve Schmitt, Hoa Luong, Jason Colwell, Jason Strutz

At the end of 2019, the Research Data Service (RDS) at the University of Illinois at Urbana-Champaign (UIUC) completed its fifth year as a campus-wide service. In order to gauge the effectiveness of the RDS in meeting the needs of Illinois researchers, RDS staff developed a five-year review consisting of a survey and a series of in-depth focus group interviews.

As a result, our institutional data repository developed in-house by University Library IT staff, Illinois Data Bank, was recognized as the most useful service offering by our unit. When launched in 2016, storage resources and web servers for Illinois Data Bank and supporting systems were hosted on-premises at UIUC.

As anticipated, researchers increasingly need to share large, and complex datasets. In a responsive effort to leverage the potentially more reliable, highly available, cost-effective, and scalable storage accessible to computation resources, we migrated our item bitstreams and web services to the cloud. Our efforts have met with success, but also with painful bumps along the way.

This article describes how we supported data curation workflows through transitioning from on-premises to cloud resource hosting. It details our approaches to ingesting, curating, and offering access to dataset files up to 2TB in size–which may be archive type files (e.g., .zip or .tar) containing complex directory structures.

URL : https://journal.code4lib.org/articles/15821

Article processing charge expenditure in Chile: The current situation

Author : Erwin Krauskopf

The National Agency of Research and Development from Chile is proposing, for the first time, a national OA policy aiming to ensure access to the scientific knowledge contained in publications resulting from research projects and graduate thesis.

Since no information regarding APC expenditure in Chile is available, this study examined the cost of APC for the 2019 publications that included at least one Chilean affiliation. The total expenditure for the year 2019 was estimated at USD 9,129,939.

The results confirm that almost one third of the total APC was spent on publications from Health & Medical Sciences, research area with the highest APC (USD 6000). Furthermore, five commercial publishers collected 52% of the total APC expenditure.

Unfortunately, the cost of publishing in some journals is so high that it causes detrimental effects on the research capacity of under resourced individuals. In the Chilean scenario, APC is not well suited to scale as most universities do not have an OA budget to support researchers that are eager to publish their work in OA journals.

Perhaps the implementation of an OA policy ought to be accompanied by sustainable APC funding grants aimed at supporting under resourced researchers that want to make their research freely available.

URL : Article processing charge expenditure in Chile: The current situation

DOI : https://doi.org/10.1002/leap.1413

Good friend or good student? An interview study of perceived conflicts between personal and academic integrity among students in three European countries

Authors : Mads Paludan Goddiksen, Una Quinn, Nóra Kovács, Thomas Bøker Lund, Peter Sandøe, Orsolya Varga, Mikkel Willum Johansen

Students are often reluctant to report the academic dishonesty of their peers. Loyalty to friends and classmates has previously been identified as an important reason for this. This paper explores loyalty conflicts among students from upper secondary school, through bachelor’s, to Ph.D. level.

Drawing on semi-structured qualitative interviews (N = 72) conducted in Denmark, Ireland and Hungary, we show that loyalty considerations among students can be complex and draw on a range of norms including responsibility.

The study demonstrates how students are often willing to assume substantial personal responsibility for dealing with the academic dishonesty of a peer, often preferring this to reporting.

However, when deciding on the right course of action, they also perceive tensions between the norms of the good researcher and student and their own norms of being a good friend and person.

The loyalty considerations and tension were identified in all three countries and across the educational levels, which suggests that this is a cross-cultural challenge.

We argue that institutions should formally decide whether they want students to take some degree of responsibility themselves for addressing less serious cases of academic dishonesty and communicate their decision to their students.

URL : Good friend or good student? An interview study of perceived conflicts between personal and academic integrity among students in three European countries

DOI : https://doi.org/10.1080/08989621.2020.1826319

Over-promotion and caution in abstracts of preprints during the COVID-19 crisis

Authors : Frederique Bordignon, Liana Ermakova, Marianne Noel

The abstract is known to be a promotional genre where researchers tend to exaggerate the benefit of their research and use a promotional discourse to catch the reader’s attention. The COVID-19 pandemic has prompted intensive research and has changed traditional publishing with the massive adoption of preprints by researchers.

Our aim is to investigate whether the crisis and the ensuing scientific and economic competition have changed the lexical content of abstracts. We propose a comparative study of abstracts associated with preprints issued in response to the pandemic relative to abstracts produced during the closest pre-pandemic period.

We show that with the increase (on average and in percentage) of positive words (especially effective) and the slight decrease of negative words, there is a strong increase in hedge words (the most frequent of which are the modal verbs can and may).

Hedge words counterbalance the excessive use of positive words and thus invite the readers, who go probably beyond the ‘usual’ audience, to be cautious with the obtained results.

The abstracts of preprints urgently produced in response to the COVID-19 crisis stand between uncertainty and over-promotion, illustrating the balance that authors have to achieve between promoting their results and appealing for caution.

DOI : https://doi.org/10.1002/leap.1411