Catégories
EN

Is rapid scientific publication also high quality? Bibliometric analysis of highly disseminated COVID-19 research papers

Authors : Amandeep Khatter, Michael Naughton, Hajira Dambha-Miller, Patrick Redmond

The impact of COVID-19 has underlined the need for reliable information to guide clinical practice and policy. This urgency has to be balanced against disruption to journal handling capacity and the continued need to ensure scientific rigour.

We examined the reporting quality of highly disseminated COVID-19 research papers using a bibliometric analysis examining reporting quality and risk of bias (RoB) amongst 250 top scoring Altmetric Attention Score (AAS) COVID-19 research papers between January and April 2020.

Method-specific RoB tools were used to assess quality. After exclusions, 84 studies from 44 journals were included. Forty-three (51%) were case series/studies, and only one was an randomized controlled trial.

Most authors were from institutions based in China (n = 44, 52%). The median AAS and impact factor was 2015 (interquartile range [IQR] 1,105–4,051.5) and 12.8 (IQR 5–44.2) respectively. Nine studies (11%) utilized a formal reporting framework, 62 (74%) included a funding statement, and 41 (49%) were at high RoB.

This review of the most widely disseminated COVID-19 studies highlights a preponderance of low-quality case series with few research papers adhering to good standards of reporting. It emphasizes the need for cautious interpretation of research and the increasingly vital responsibility that journals have in ensuring high-quality publications.

URL : Is rapid scientific publication also high quality? Bibliometric analysis of highly disseminated COVID-19 research papers

DOI : https://doi.org/10.1002/leap.1403

Catégories
EN

Total SciComm: A Strategy for Communicating Open Science

Authors : Manh-Toan Ho, Manh-Tung Ho, Quan-Hoang Vuong

This paper seeks to introduce a strategy of science communication: Total SciComm or all-out science communication. We proposed that to maximize the outreach and impact, scientists should use different media to communicate different aspects of science, from core ideas to methods.

The paper uses an example of a debate surrounding a now-retracted article in the Nature journal, in which open data, preprints, social media, and blogs are being used for a meaningful scientific conversation.

The case embodied the central idea of Total SciComm: the scientific community employs every medium to communicate scientific ideas and engages all scientists in the process.

URL : Total SciComm: A Strategy for Communicating Open Science

DOI : https://doi.org/10.3390/publications9030031

Catégories
EN

Data sharing practices and data availability upon request differ across scientific disciplines

Authors : Leho tedersoo, Rainer Küngas, Ester Oras, Kajar Köster, Helen Eenmaa, Äli Leijen, Margus Pedaste, Marju Raju, Anastasiya Astapova, Heli Lukner, Karin Kogermann, Tuul Sepp

Data sharing is one of the cornerstones of modern science that enables large-scale analyses and reproducibility. We evaluated data availability in research articles across nine disciplines in Nature and Science magazines and recorded corresponding authors’ concerns, requests and reasons for declining data sharing.

Although data sharing has improved in the last decade and particularly in recent years, data availability and willingness to share data still differ greatly among disciplines. We observed that statements of data availability upon (reasonable) request are inefficient and should not be allowed by journals.

To improve data sharing at the time of manuscript acceptance, researchers should be better motivated to release their data with real benefits such as recognition, or bonus points in grant and job applications.

We recommend that data management costs should be covered by funding agencies; publicly available research data ought to be included in the evaluation of applications; and surveillance of data sharing should be enforced by both academic publishers and funders. These cross-discipline survey data are available from the plutoF repository.

URL : Data sharing practices and data availability upon request differ across scientific disciplines

DOI : https://doi.org/10.1038/s41597-021-00981-0

Catégories
EN

Article processing charge expenditure in Chile: The current situation

Author : Erwin Krauskopf

The National Agency of Research and Development from Chile is proposing, for the first time, a national OA policy aiming to ensure access to the scientific knowledge contained in publications resulting from research projects and graduate thesis.

Since no information regarding APC expenditure in Chile is available, this study examined the cost of APC for the 2019 publications that included at least one Chilean affiliation. The total expenditure for the year 2019 was estimated at USD 9,129,939.

The results confirm that almost one third of the total APC was spent on publications from Health & Medical Sciences, research area with the highest APC (USD 6000). Furthermore, five commercial publishers collected 52% of the total APC expenditure.

Unfortunately, the cost of publishing in some journals is so high that it causes detrimental effects on the research capacity of under resourced individuals. In the Chilean scenario, APC is not well suited to scale as most universities do not have an OA budget to support researchers that are eager to publish their work in OA journals.

Perhaps the implementation of an OA policy ought to be accompanied by sustainable APC funding grants aimed at supporting under resourced researchers that want to make their research freely available.

URL : Article processing charge expenditure in Chile: The current situation

DOI : https://doi.org/10.1002/leap.1413

Catégories
EN

Over-promotion and caution in abstracts of preprints during the COVID-19 crisis

Authors : Frederique Bordignon, Liana Ermakova, Marianne Noel

The abstract is known to be a promotional genre where researchers tend to exaggerate the benefit of their research and use a promotional discourse to catch the reader’s attention. The COVID-19 pandemic has prompted intensive research and has changed traditional publishing with the massive adoption of preprints by researchers.

Our aim is to investigate whether the crisis and the ensuing scientific and economic competition have changed the lexical content of abstracts. We propose a comparative study of abstracts associated with preprints issued in response to the pandemic relative to abstracts produced during the closest pre-pandemic period.

We show that with the increase (on average and in percentage) of positive words (especially effective) and the slight decrease of negative words, there is a strong increase in hedge words (the most frequent of which are the modal verbs can and may).

Hedge words counterbalance the excessive use of positive words and thus invite the readers, who go probably beyond the ‘usual’ audience, to be cautious with the obtained results.

The abstracts of preprints urgently produced in response to the COVID-19 crisis stand between uncertainty and over-promotion, illustrating the balance that authors have to achieve between promoting their results and appealing for caution.

DOI : https://doi.org/10.1002/leap.1411

Catégories
EN

Do researchers know what the h-index is? And how do they estimate its importance?

Authors : Pantea Kamrani, Isabelle Dorsch, Wolfgang G. Stock

The h-index is a widely used scientometric indicator on the researcher level working with a simple combination of publication and citation counts. In this article, we pursue two goals, namely the collection of empirical data about researchers’ personal estimations of the importance of the h-index for themselves as well as for their academic disciplines, and on the researchers’ concrete knowledge on the h-index and the way of its calculation.

We worked with an online survey (including a knowledge test on the calculation of the h-index), which was finished by 1081 German university professors. We distinguished between the results for all participants, and, additionally, the results by gender, generation, and field of knowledge.

We found a clear binary division between the academic knowledge fields: For the sciences and medicine the h-index is important for the researchers themselves and for their disciplines, while for the humanities and social sciences, economics, and law the h-index is considerably less important.

Two fifths of the professors do not know details on the h-index or wrongly deem to know what the h-index is and failed our test. The researchers’ knowledge on the h-index is much smaller in the academic branches of the humanities and the social sciences.

As the h-index is important for many researchers and as not all researchers are very knowledgeable about this author-specific indicator, it seems to be necessary to make researchers more aware of scholarly metrics literacy.

URL : Do researchers know what the h-index is? And how do they estimate its importance?

DOI : https://doi.org/10.1007/s11192-021-03968-1

Catégories
EN

TeamTree analysis: A new approach to evaluate scientific production

Author : Frank W. Pfrieger

Advances in science and technology depend on the work of research teams and the publication of results through peer-reviewed articles representing a growing socio-economic resource. Current methods to mine the scientific literature regarding a field of interest focus on content, but the workforce credited by authorship remains largely unexplored.

Notably, appropriate measures of scientific production are debated. Here, a new bibliometric approach named TeamTree analysis is introduced that visualizes the development and composition of the workforce driving a field.

A new citation-independent measure that scales with the H index estimates impact based on publication record, genealogical ties and collaborative connections.

This author-centered approach complements existing tools to mine the scientific literature and to evaluate research across disciplines.

URL : TeamTree analysis: A new approach to evaluate scientific production

DOI : https://doi.org/10.1371/journal.pone.0253847