Archives des mots-clés : research impact

Biosecurity in an age of open science

Posté le par

Authors : James Andrew Smith, Jonas B. Sandbrink

The risk of accidental or deliberate misuse of biological research is increasing as biotechnology advances. As open science becomes widespread, we must consider its impact on those risks and develop solutions that ensure security while facilitating scientific progress.

Here, we examine the interaction between open science practices and biosecurity and biosafety to identify risks and opportunities for risk mitigation. Increasing the availability of computational tools, datasets, and protocols could increase risks from research with misuse potential.

For instance, in the context of viral engineering, open code, data, and materials may increase the risk of release of enhanced pathogens. For this dangerous subset of research, both open science and biosecurity goals may be achieved by using access-controlled repositories or application programming interfaces. While preprints accelerate dissemination of findings, their increased use could challenge strategies for risk mitigation at the publication stage.

This highlights the importance of oversight earlier in the research lifecycle. Preregistration of research, a practice promoted by the open science community, provides an opportunity for achieving biosecurity risk assessment at the conception of research.

Open science and biosecurity experts have an important role to play in enabling responsible research with maximal societal benefit.

URL : Biosecurity in an age of open science

DOI : https://doi.org/10.1371/journal.pbio.3001600

Free access to scientific literature and its influence on the publishing activity in developing countries: The effect of Sci-Hub in the field of mathematics

Posté le par

Authors : Kilian Buehling, Matthias Geissler, Dorothea Strecker

This paper investigates whether free access to scientific literature increases the participation of under-represented groups in scientific discourse. To this end, we aggregate and match data tracing access to Sci-Hub, a widely used black open access (OA) repository or shadow library, and publication data from the Web of Science (WoS).

We treat the emergence of Sci-Hub as an exogenous event granting relatively unrestricted access to publications, which are otherwise hidden behind a paywall. We analyze changes in the publication count of researchers from developing countries in a given journal as a proxy for general participation in scientific discourse.

Our results indicate that in the exemplary field of mathematics, free access to academic knowledge is likely to improve the representation of authors from developing countries in international journals.

Assuming the desirability of greater international diversity in science (e.g., to generate more original work, reproduce empirical findings in different settings, or shift the research focus toward topics that are overlooked by researchers from more developed countries), our findings lend evidence to the claim of the OA movement that scientific knowledge should be free and widely distributed.

URL : Free access to scientific literature and its influence on the publishing activity in developing countries: The effect of Sci-Hub in the field of mathematics

DOI : https://doi.org/10.1002/asi.24636

Reshaping How Universities Can Evaluate the Research Impact of Open Humanities for Societal Benefit

Posté le par

Authors : Paul Longley Arthur, Lydia Hearn

During the twenty-first century, for the first time, the volume of digital data has surpassed the amount of analog data. As academic practices increasingly become digital, opportunities arise to reshape the future of scholarly communication through more accessible, interactive, open, and transparent methods that engage a far broader and more diverse public.

Yet despite these advances, the research performance of universities and public research institutes remains largely evaluated through publication and citation analysis rather than by public engagement and societal impact.

This article reviews how changes to bibliometric evaluations toward greater use of altmetrics, including social media mentions, could enhance uptake of open scholarship in the humanities.

In addition, the article highlights current challenges faced by the open scholarship movement, given the complexity of the humanities in terms of its sources and outputs that include monographs, book chapters, and journals in languages other than English; the use of popular media not considered as scholarly papers; the lack of time and energy to develop digital skills among research staff; problems of authority and trust regarding the scholarly or non-academic nature of social media platforms; the prestige of large academic publishing houses; and limited awareness of and familiarity with advanced digital applications.

While peer review will continue to be a primary method for evaluating research in the humanities, a combination of altmetrics and other assessment of research impact through different data sources may provide a way forward to ensure the increased use, sustainability, and effectiveness of open scholarship in the humanities.

DOI : https://doi.org/10.3998/jep.788

Article Processing Charges, Altmetrics and Citation Impact: Is there an economic rationale?

Posté le par

Authors : Abdelghani Maddi, David Sapinho

The present study aims to analyze 1) the relationship between Citation Normalized Score of scientific publications and Article Processing Charges (APCs) of Gold Open Access (OA) publications 2) the determinants of APCs.

To do so, we used APCs information provided by the OpenAPC database, citation scores of publications from the WoS database and, for Altmetrics, data from Altmetrics.com database, over the period from 2006 to 2019 for 83,752 articles published in 4751 journals belonging to 267 distinct publishers.

Results show that contrary to common belief, paying high APCs does not necessarily increase the impact of publications. First, large publishers with high impact are not the most expensive. Second, publishers with the highest APCs are not necessarily the best in terms of impact.

Correlation between APCs and impact is moderate. Regarding the determinants, results indicate that APCs are on average 50% higher in hybrid journals than in full OA journals. The results also suggest that Altmetrics do not have a great impact: OA articles that have garnered the most attention on internet are articles with relatively low APCs.

Another interesting result is that the “number of readers” indicator is more effective as it is more correlated with classic bibliometrics indicators than the Altmetrics score.

URL : https://hal.archives-ouvertes.fr/hal-03576911

Why does library holding format really matter for book impact assessment?: Modelling the relationship between citations and altmetrics with print and electronic holdings

Posté le par

Author : Ashraf Maleki

Scholarly books are important outputs in some fields and their many publishing formats seem to introduce opportunities to scrutinize their impact. As there is a growing interest in the publisher-enforced massive collection of ebooks in libraries in the past decade, this study examined how this influences the relationship that library print holdings (LPH), library electronic holdings (LEH) and total library holdings (TLH) have with other metrics.

As a follow up study to a previous research on OCLC library holdings, the relationship between library holdings and twelve other metrics including Scopus Citations, Google Books (GB) Citations, Goodreads engagements, and Altmetric indicators were examined for 119,794 Scopus-indexed book titles across 26 fields.

Present study confirms the weak correlation levels observed between TLH and other indicators in previous studies and contributes additional evidence that print holdings can moderately reflect research, educational and online impact of books consistently more efficient than eholdings and total holdings across fields and over time, except for Mendeley for which eholdings slightly prevailed.

Regression models indicated that along with other dimensions, Google Books Citations frequently best explained LPH (in 14 out of 26 fields), whereas Goodreads User counts were weak, but the best predictor of both LEH and TLH (in 15 fields out of 26), suggesting significant association of eholdings with online uptake of books.

Overall, findings suggest that inclusion of eholdings overrides the more impactful counts of print holdings in Total Library Holdings metric and therefore undermines the statistical results, whilst print holdings has both statistically and theoretically promising underlying assumptions for prediction of impact of books and shows greater promise than the general Library Holding metric for book impact assessment.

Thus, there is a need for a distinction between print and electronic holding counts to be made, otherwise total library holding data need to be interpreted with caution.

URL : Why does library holding format really matter for book impact assessment?: Modelling the relationship between citations and altmetrics with print and electronic holdings

DOI : https://doi.org/10.1007/s11192-021-04239-9

How do scientific papers with different levels of journals spread online? Exploring the temporal dynamics in the diffusion processes

Posté le par

Authors : Renmeng Cao, Xiaoke Xu, Yunxue Cui, Zhizhao Fang, Xianwen Wang

Social media has become an important channel for publicizing academic research, which provides an opportunity for each scientific paper to become a hit.

Employing a dataset of about 10 million tweets of 584,264 scientific papers from 2012 to 2018, this study investigates the differential diffusion of elite and non-elite journal papers (divided by Average journal impact factor percentile).

We find that non-elite journal papers are diffused deeper and farther than elite journal papers, showing a diffusion trend with multiple rounds, sparse, short-duration and small-scale bursts.

In contrast, the bursts of elite journals are characterized by a small number of persistent, dense and large-scale bursts. We also discover that elite journal papers are more inclined to broadcast diffusion while non-elite journal papers prefer viral diffusion.

Elite journal papers are generally disseminated to many loosely connected communities, while non-elite journal papers are diffused to several densely connected communities.

URL : https://arxiv.org/abs/2112.03506

The production of scientific and societal value in research evaluation: a review of societal impact assessment methods

Posté le par

Authors : Jorrit P Smit, Laurens K Hessels

Over the past two decades, several methods have been developed to evaluate the societal impact of research. Compared to the practical development of the field, the conceptual development is relatively weak.

This review article contributes to the latter by elucidating the theoretical aspects of the dominant methods for evaluating societal impact of research, in particular, their presuppositions about the relationship between scientific and societal value of research. We analyse 10 approaches to the assessment of the societal impact of research from a constructivist perspective.

The methods represent different understandings of knowledge exchange, which can be understood in terms of linear, cyclical, and co-production models. In addition, the evaluation methods use a variety of concepts for the societal value of research, which suggest different relationships with scientific value.

While some methods rely on a clear and explicit distinction between the two types of value, other methods, in particular Evaluative Inquiry, ASIRPA, Contribution Mapping, Public Value Mapping, and SIAMPI, consider the mechanisms for producing societal value integral to the research process.

We conclude that evaluation methods must balance between demarcating societal value as a separate performance indicator for practical purposes and doing justice to the (constructivist) science studies’ findings about the integration of scientific and societal value of research.

Our analytic comparison of assessment methods can assist research evaluators in the conscious and responsible selection of an approach that fits with the object under evaluation. As evaluation actively shapes knowledge production, it is important not to use oversimplified concepts of societal value.

URL : The production of scientific and societal value in research evaluation: a review of societal impact assessment methods

DOI : https://doi.org/10.1093/reseval/rvab002