Altmetrics and societal impact measurements: Match or mismatch? A literature review

Authors : Iman Tahamtan, Lutz Bornmann

Can alternative metrics (altmetrics) data be used to measure societal impact? We wrote this literature overview of empirical studies in order to find an answer to this question. The overview includes two parts.

The first part, “societal impact measurements”, explains possible methods and problems in measuring the societal impact of research, case studies for societal impact measurement, societal impact considerations at funding organizations, and the societal problems that should be solved by science.

The second part of the review, “altmetrics”, addresses a major question in research evaluation, which is whether altmetrics are proper indicators for measuring the societal impact of research. In the second part we explain the data sources used for altmetrics studies and the importance of field-normalized indicators for impact measurements.

This review indicates that it should be relevant for impact measurements to be oriented towards pressing societal problems. Case studies in which societal impact of certain pieces of research is explained seem to provide a legitimate method for measuring societal impact.

In the use of altmetrics, field-specific differences should be considered by applying field normalization (in cross-field comparisons). Altmetrics data such as social media counts might mainly reflect the public interest and discussion of scholarly works rather than their societal impact.

Altmetrics (Twitter data) might be especially fruitfully employed for research evaluation purposes, if they are used in the context of network approaches. Conclusions based on altmetrics data in research evaluation should be drawn with caution.

URL : Altmetrics and societal impact measurements: Match or mismatch? A literature review

Original location : https://recyt.fecyt.es/index.php/EPI/article/view/epi.2020.ene.02

Results dissemination of registered clinical trials across Polish academic institutions: a cross-sectional analysis

Authors : Karolina Strzebonska, Mateusz T Wasylewski, Lucja Zaborowska, Nico Riede, Susanne Wieschowski, Daniel Strech, Marcin Waligora

Objectives

To establish the rates of publication and reporting of results for interventional clinical trials across Polish academic medical centres (AMCs) completed between 2009 and 2013. We aim also to compare the publication and reporting success between adult and paediatric trials.

Design

Cross-sectional study.

Setting

AMCs in Poland.

Participants

AMCs with interventional trials registered on ClinicalTrials.gov.

Main outcome measure

Results reporting on ClinicalTrials.gov and publishing via journal publication.

Results

We identified 305 interventional clinical trials registered on ClinicalTrials.gov, completed between 2009 and 2013 and affiliated with at least one AMC. Overall, 243 of the 305 trials (79.7%) had been published as articles or posted their summary results on ClinicalTrials.gov.

Results were posted within a year of study completion and/or published within 2 years of study completion for 131 trials (43.0%). Dissemination by both posting and publishing results in a timely manner was achieved by four trials (1.3%).

Conclusions

Our cross-sectional analysis revealed that Polish AMCs fail to meet the expectation for timely disseminating the findings of all interventional clinical trials. Delayed dissemination and non-dissemination of trial results negatively affects decisions in healthcare.

URL : Results dissemination of registered clinical trials across Polish academic institutions: a cross-sectional analysis

DOI : http://dx.doi.org/10.1136/bmjopen-2019-034666

Does Academic Publishing Lead to Work-Related Stress or Happiness?

Author : Jaroslava Kubátová

The topic of work-related stress and happiness has recently been of interest to science as well as in practice. Work-related stress has negative effects on workers, organizations, and the whole of society, whereas happiness has positive effects. It is therefore important to monitor the wellbeing of workers.

This article deals with stress and happiness as related to academic publishing. To answer the research question of whether academic publishing leads to stress or happiness, a narrative analysis was conducted.

Narratives from ten Czech academics were collected and analyzed with the use of a categorical-content approach. The categories used are the general causes of work-related stress and happiness as identified in the literature: work overload, ambiguity, conflict, the sense of meaningful work, job satisfaction, and affective organizational commitment.

It was found that academic publishing leads to both work-related stress and happiness. However, stress is more prevalent. Not only do academics experience all the general causes of work-related stress, unfortunately they often lack the sources of happiness. Many specific causes of stress and happiness, as well as unhappiness, were discovered in the narratives.

Several ways to improve the situation have been suggested. Refining policies in human resources is particularly important if universities wish to retain their academics.

URL : Does Academic Publishing Lead to Work-Related Stress or Happiness?

DOI : https://doi.org/10.3390/publications7040066

Open Science in the Humanities, or: Open Humanities?

Author : Marcel Knöchelmann

Open science refers to both the practices and norms of more open and transparent communication and research in scientific disciplines and the discourse on these practices and norms.

There is no such discourse dedicated to the humanities. Though the humanities appear to be less coherent as a cluster of scholarship than the sciences are, they do share unique characteristics which lead to distinct scholarly communication and research practices.

A discourse on making these practices more open and transparent needs to take account of these characteristics. The prevalent scientific perspective in the discourse on more open practices does not do so, which confirms that the discourse’s name, open science, indeed excludes the humanities so that talking about open science in the humanities is incoherent.

In this paper, I argue that there needs to be a dedicated discourse for more open research and communication practices in the humanities, one that integrates several elements currently fragmented into smaller, unconnected discourses (such as on open access, preprints, or peer review).

I discuss three essential elements of open science—preprints, open peer review practices, and liberal open licences—in the realm of the humanities to demonstrate why a dedicated open humanities discourse is required.

URL : Open Science in the Humanities, or: Open Humanities?

DOI : https://doi.org/10.3390/publications7040065

A Team Approach: Library Publishing Partnerships with Scholarly Societies

Author : Suzanne Cady Stapleton

INTRODUCTION

The journal publishing service at the University of Florida George A. Smathers Libraries is structured to use a team-based approach that integrates subject specialists across the library.

DESCRIPTION OF PROGRAM

Since 2012, the UF Libraries have worked in partnership with a number of scholarly societies to publish their research. The focus, to date, of academic library publishing on institutional publications belies potential partnerships with scholarly societies and organizations external to the library’s institution.

Services provided, challenges faced, and examples of successful publishing partnerships with UF Libraries are described. The team approach enables the library to be innovative and nimble in response to publishing opportunities.

Scholarly societies most interested in entering publishing contracts with the Libraries publishing program are those that share aspects of the library mission such as accessibility and innovation.

NEXT STEPS

Academic library publishing offers unique partnership opportunities for scholarly societies and external organizations that are mutually beneficial and that complement library publishing of institutional material.

URL : A Team Approach: Library Publishing Partnerships with Scholarly Societies

DOI : https://doi.org/10.7710/2162-3309.2326

bioRxiv: the preprint server for biology

Authors : Richard Sever, Ted Roeder, Samantha Hindle, Linda Sussman, Kevin-John Black, Janet Argentine, Wayne Manos, John R. Inglis

The traditional publication process delays dissemination of new research, often by months, sometimes by years. Preprint servers decouple dissemination of research papers from their evaluation and certification by journals, allowing researchers to share work immediately, receive feedback from a much larger audience, and provide evidence of productivity long before formal publication.

Launched in 2013 as a non-profit community service, the bioRxiv server has brought preprint practice to the life sciences and recently posted its 64,000th manuscript.

The server now receives more than four million views per month and hosts papers spanning all areas of biology. Initially dominated by evolutionary biology, genetics/genomics and computational biology, bioRxiv has been increasingly populated by papers in neuroscience, cell and developmental biology, and many other fields.

Changes in journal and funder policies that encourage preprint posting have helped drive adoption, as has the development of bioRxiv technologies that allow authors to transfer papers easily between the server and journals.

A bioRxiv user survey found that 42% of authors post their preprints prior to journal submission whereas 37% post concurrently with journal submission. Authors are motivated by a desire to share work early; they value the feedback they receive, and very rarely experience any negative consequences of preprint posting.

Rapid dissemination via bioRxiv is also encouraging new initiatives that experiment with the peer review process and the development of novel approaches to literature filtering and assessment.

URL : bioRxiv: the preprint server for biology

DOI : https://doi.org/10.1101/833400

« Pour commencer, pourriez-vous définir ‘données de la recherche’ ? » Une tentative de réponse

Auteurs/Authors : Joachim Schöpfel, Eric Kergosien, Hélène Prost

Le projet D4Humanities s’inscrit dans le champ des Humanités numériques – comment permettre l’exploration des données de la recherche en SHS (corpus textuels ou oraux, données brutes, images…) avec des techniques numériques (text and data mining, cartographie, visualisation…) afin de construire un sens nouveau ?

Il s’inscrit dans la continuité des travaux du laboratoire GERiiCO et de ses partenaires à l’Université de Lille Sciences Humaines et Sociales (SCD, ED SHS, ANRT…) avec comme objectif d’accélérer la démarche des données de la recherche notamment par rapport aux doctorants et jeunes chercheurs, et de faciliter le montage d’un projet de recherche international.

En particulier, le projet contient trois volets : (1) Pratiques et besoins dans le domaine des données de la recherche (enquête qualitative des comportements, attitudes, motivations et besoins par rapport à la gestion et au partage des données de la recherche) ; (2) workflow pour le dépôt des données des doctorants en SHS (dépôt, préservation et diffusion des données via le service NAKALA de la TGIR Huma-Num) ; (3) recherche sur les données et les thèses (concept et typologie des données en SHS ; évolution des contenus, formats, structures et prescriptions des thèses dans l’environnement de l’Open Science).

Le projet sera mené avec l’ISN Oldenburg et d’autres partenaires étrangers ; il facilitera la création d’un consortium et le montage d’un projet de recherche dans les Humanités numériques sur les thèses de doctorat de l’avenir, avec un financement européen (H2020) ou franco-allemand (ANR/DFG).

Cette communication présente les grandes lignes de l’étude sur les données de l’axe 3, c’est-à-dire l’analyse du concept de données de la recherche, pour mieux cerner l’identification (granularité), pour mieux comprendre la distinction et les relations entre données primaires et secondaires et pour affiner la catégorisation des données en SHS. L’accent est mis sur une triple approche, conceptuelle, typologique et fonctionnelle.

URL : http://hal.univ-lille3.fr/hal-01530937