EN – Page 79 – InfoDoc MicroVeille

Integrating Qualitative Methods and Open Science: Five Principles for More Trustworthy Research

Posté le 13 août 2021 par Hans Dillaerts

Authors : Lee Humphreys, Neil A Lewis Jr, Katherine Sender, Andrea Stevenson Won

Recent initiatives toward open science in communication have prompted vigorous debate. In this article, we draw on qualitative and interpretive research methods to expand the key priorities that the open science framework addresses, namely producing trustworthy and quality research.

This article contributes to communication research by integrating qualitative methodological literature with open communication science research to identify five broader commitments for all communication research: validity, transparency, ethics, reflexivity, and collaboration.

We identify key opportunities where qualitative and quantitative communication scholars can leverage the momentum of open science to critically reflect on and improve our knowledge production processes.

We also examine competing values that incentivize dubious practices in communication research, and discuss several metascience initiatives to enhance diversity, equity, and inclusion in our field and value multiple ways of knowing.

URL : Integrating Qualitative Methods and Open Science: Five Principles for More Trustworthy Research

DOI : https://doi.org/10.1093/joc/jqab026

Publication patterns’ changes due to the COVID-19 pandemic: a longitudinal and short-term scientometric analysis

Posté le 12 août 2021 par Hans Dillaerts

Authors : Shir Aviv-Reuven, Ariel Rosenfeld

In recent months the COVID-19 (also known as SARS-CoV-2 and Coronavirus) pandemic has spread throughout the world. In parallel, extensive scholarly research regarding various aspects of the pandemic has been published. In this work, we analyse the changes in biomedical publishing patterns due to the pandemic.

We study the changes in the volume of publications in both peer reviewed journals and preprint servers, average time to acceptance of papers submitted to biomedical journals, international (co-)authorship of these papers (expressed by diversity and volume), and the possible association between journal metrics and said changes.

We study these possible changes using two approaches: a short-term analysis through which changes during the first six months of the outbreak are examined for both COVID-19 related papers and non-COVID-19 related papers; and a longitudinal approach through which changes are examined in comparison to the previous four years.

Our results show that the pandemic has so far had a tremendous effect on all examined accounts of scholarly publications: A sharp increase in publication volume has been witnessed and it can be almost entirely attributed to the pandemic; a significantly faster mean time to acceptance for COVID-19 papers is apparent, and it has (partially) come at the expense of non-COVID-19 papers; and a significant reduction in international collaboration for COVID-19 papers has also been identified.

As the pandemic continues to spread, these changes may cause a slow down in research in non-COVID-19 biomedical fields and bring about a lower rate of international collaboration.

DOI : https://doi.org/10.1007/s11192-021-04059-x

Manuscript Accepted!: Collaborating on a scholarly publishing symposium for graduate students and early career academic faculty

Posté le 11 août 2021 par Hans Dillaerts

Authors : Teresa Auch Schultz, Rosalind Bucy, Amy Hunsaker, Amy Shannon, Chrissy Klenke, Iñaki Arrieta Baro

INTRODUCTION

As academic libraries expand their scholarly communication support, they also need to find ways to help educate graduate students about this area as well as market themselves.

DESCRIPTION OF PROGRAM

The University of Nevada, Reno Libraries created a one-day symposium, called Manuscript Accepted!, aimed at graduate students and early career faculty that would use faculty and library expertise to lead panels and workshops.

This article discusses planning for the event, including collaborating with other on-campus groups, working with publishers for financial support, and planning a program that would meet a variety of needs. Assessment of the first two symposiums, held in 2019 and 2020, shows that attendees valued the event while also highlighting the need for more targeted support for specific areas, such as the humanities.

NEXT STEPS

The Libraries plans to continue Manuscript Accepted! as a one-day symposium, although it will also look to ways to expand attendance. Finally, the Libraries is investigating ways to create smaller events that could be tied into the Manuscript Acceptance! brand but that help meet other needs of our attendees.

URL : Manuscript Accepted!: Collaborating on a scholarly publishing symposium for graduate students and early career academic faculty

DOI : https://doi.org/10.7710/2162-3309.2385

Measuring academic entities’ impact by content-based citation analysis in a heterogeneous academic network

Posté le 11 août 2021 par Hans Dillaerts

Authors : Fang Zhang, Shengli Wu

Evaluating the impact of papers, researchers and venues objectively is of great significance to academia and beyond. This may help researchers, research organizations, and government agencies in various ways, such as helping researchers find valuable papers and authoritative venues and helping research organizations identify good researchers.

A few studies find that rather than treating citations equally, differentiating them is a promising way for impact evaluation of academic entities. However, most of those methods are metadata-based only and do not consider contents of cited and citing papers; while a few content-based methods are not sophisticated, and further improvement is possible.

In this paper, we study the citation relationships between entities by content-based approaches. Especially, an ensemble learning method is used to classify citations into different strength types, and a word-embedding based method is used to estimate topical similarity of the citing and cited papers.

A heterogeneous network is constructed with the weighted citation links and several other features. Based on the heterogeneous network that consists of three types of entities, we apply an iterative PageRank-like method to rank the impact of papers, authors and venues at the same time through mutual reinforcement.

Experiments are conducted on an ACL dataset, and the results demonstrate that our method greatly outperforms state-of-the art competitors in improving ranking effectiveness of papers, authors and venues, as well as in being robust against malicious manipulation of citations.

URL : Measuring academic entities’ impact by content‑based citation analysis in a heterogeneous academic network

DOI : https://doi.org/10.1007/s11192-021-04063-1

Replication and trustworthiness

Posté le 10 août 2021 par Hans Dillaerts

Authors : Rik Peels, Lex Bouter

This paper explores various relations that exist between replication and trustworthiness. After defining “trust”, “trustworthiness”, “replicability”, “replication study”, and “successful replication”, we consider, respectively, how trustworthiness relates to each of the three main kinds of replication: reproductions, direct replications, and conceptual replications.

Subsequently, we explore how trustworthiness relates to the intentionality of a replication. After that, we discuss whether the trustworthiness of research findings depends merely on evidential considerations or also on what is at stake.

We conclude by adding replication to the other issues that should be considered in assessing the trustworthiness of research findings: (1) the likelihood of the findings before the primary study was done (that is, the prior probability of the findings), (2) the study size and the methodological quality of the primary study, (3) the number of replications that were performed and the quality and consistency of their aggregated findings, and (4) what is at stake.

URL : Replication and trustworthiness

DOI : https://doi.org/10.1080/08989621.2021.1963708

Invisible science: publication of negative research results

Posté le 10 août 2021 par Hans Dillaerts

Authors : Luis Fernando Sayão, Luana Farias Sales, Carla Beatriz Marques Felipe

An important part of scientific research activities yield negative results – non-confirmatory and null data, inconclusive experiments, unexpected data. These results permeate the entire research cycle and constitute an important part of the full scientific knowledge flow generation.

However, despite the acknowledgment that it is the non-confirmatory findings that result in the rejection of consolidated hypotheses that drive the progress of science, most of these investigation routes are not documented.

Growing competition for resources, tenure, and impact publications induces researchers to produce “positive” results that are more likely to be published, interfering with the principles of science reproducibility and self-correction and in the scientific communication cycle.

This study aims to review negative results incorporation in the traditional academic publication cycle. It also seeks to identify and systematize the main barriers that prevent researchers from publishing negative results.

This exploratory study is based methodologically on the scarce literature on the subject. It confirms the initial assumption that few scientific journals accept, edit special issues or are dedicated to the publication of negative results.

URL : Invisible science: publication of negative research results

DOI : https://doi.org/10.1590/2318-0889202133e200009