Archives des mots-clés : scientific communication

How transformative are transformative agreements? Evidence from Germany across disciplines

Posté le par

Author : W. Benedikt Schmal

Research institutions across the globe attempt to change the academic publishing system as digitization opens up new opportunities, and subscriptions to the large journal bundles of the leading publishers put library budgets under pressure. One approach is the negotiation of so-called transformative agreements.

I study the ‘DEAL’ contracts between nearly all German research institutions and Springer Nature and Wiley. I investigate 6.1 million publications in 5,862 journals covering eight fields in the years 2016–2022 and apply a causal difference-in-differences design to identify whether the likelihood of a paper appearing in an eligible journal increases. The effect strongly depends on the discipline.

While material science, chemistry, and economics s tend to hift towards these journals, all other disciplines in my sample do not react. Suggestive evidence hints at the market position of the encompassed publishers before the ‘DEAL’ was established: Springer Nature and Wiley appear to benefit more from the contracts in disciplines in which they possessed a higher market share ex ante.

The transformative vigor of these agreements in terms of publication behavior seems to be limited. It and highlights that the developments in this intertwined market require further examination.

URL : How transformative are transformative agreements? Evidence from Germany across disciplines

DOI : https://doi.org/10.1007/s11192-024-04955-y

Scholar Metrics Scraper (SMS): automated retrieval of citation and author data

Posté le par

Authors : Yutong Cao, Nicole A. Cheung, Dean Giustini, Jeffrey LeDue, Timothy H. Murphy

Academic departments, research clusters and evaluators analyze author and citation data to measure research impact and to support strategic planning. We created Scholar Metrics Scraper (SMS) to automate the retrieval of bibliometric data for a group of researchers.

The project contains Jupyter notebooks that take a list of researchers as an input and exports a CSV file of citation metrics from Google Scholar (GS) to visualize the group’s impact and collaboration. A series of graph outputs are also available. SMS is an open solution for automating the retrieval and visualization of citation data.

URL : Scholar Metrics Scraper (SMS): automated retrieval of citation and author data

DOI : https://doi.org/10.3389/frma.2024.1335454

Bibliometric analysis of Sci-Hub downloads by Egyptian researchers

Posté le par

Authors : Ismail Ragab Osman, Hendy Abdullah Hendy Ahmed

In this study we present an in-depth bibliometric analysis of Sci-Hub downloads by Egyptian researchers based on the 2017 download log file. The study reveals that Egyptian researchers heavily rely on Sci-Hub, generating a substantial 1,357,526 download requests in 2017, with 65% of these occurring outside regular working hours. Cairo emerges as a central hub for this activity, contributing 81.58% of total downloads.

Journal articles constitute the majority of downloads at 82.36%, followed by conference papers (12.89%). A discernible trend shows a preference for recent papers published between 2012 and 2017, highlighting the demand for up-to-date research. The analysis also highlights prominent publishers, including IEEE, Elsevier, Wiley, and Springer, as preferred sources for Egyptian researchers. “Journal of the American Chemical Society” and “Journal of Applied Physics” stand out among accessed journals, while IEEE-associated conferences, notably “IEEE Power and Energy Society General Meeting,” dominate conference paper downloads. Examining journal accessibility via the Egyptian Knowledge Bank (EKB) reveals that 62.84% of journals are accessible, with Science Direct as the leading provider (28.37%).

However, a significant gap emerges as 87.39% of downloaded conference papers remain inaccessible through EKB. Furthermore, a semantic analysis highlights recurring themes such as “systems,” “review,” “analysis,” “treatment,” “power,” and “energy,” reflecting the key research areas of Egyptian researchers. Overall, this study offers valuable insights into Sci-Hub’s role in supplementing Egyptian researchers’ resource access and underscores the need for comprehensive resource coverage and accessibility enhancements.

URL : Bibliometric analysis of Sci-Hub downloads by Egyptian researchers

DOI : https://doi.org/10.1007/s11192-024-04951-2

Beyond journals and peer review: towards a more flexible ecosystem for scholarly communication

Posté le par

Author : Michael Wood

This article challenges the assumption that journals and peer review are essential for developing,evaluating and disseminating scientific and other academic knowledge. It suggests a more flexible ecosystem, and examines some of the possibilities this might facilitate. The market for academic outputs should be opened up by encouraging the separation of the dissemination service from the evaluation service.

Publishing research in subject-specific journals encourages compartmentalising research into rigid categories. The dissemination of knowledge would be better served by an open access, web-based repository system encompassing all disciplines. There would then be a role for organisations to assess the items in this repository to help users find relevant, high-quality work.

There could be a variety of such organisations which could enable reviews from peers to be supplemented with evaluation by non-peers from a variety of different perspectives: user reviews, statistical reviews, reviews from the perspective of different disciplines, and so on. This should reduce the inevitably conservative influence of relying on two or three peers, and make the evaluation system more critical, multi-dimensional and responsive to the requirements of different audience groups, changing circumstances, and new ideas.

Non-peer review might make it easier to challenge dominant paradigms, and expanding the potential audience beyond a narrow group of peers might encourage the criterion of simplicity to be taken more seriously – which is essential if human knowledge is to continue to progress.

Arxiv : https://arxiv.org/abs/1311.4566

Dataset Artefacts are the Hidden Drivers of the Declining Disruptiveness in Science

Posté le par

Authors : Vincent Holst, Andres Algaba, Floriano Tori, Sylvia Wenmackers, Vincent Ginis

Park et al. [1] reported a decline in the disruptiveness of scientific and technological knowledge over time. Their main finding is based on the computation of CD indices, a measure of disruption in citation networks [2], across almost 45 million papers and 3.9 million patents.

Due to a factual plotting mistake, database entries with zero references were omitted in the CD index distributions, hiding a large number of outliers with a maximum CD index of one, while keeping them in the analysis [1]. Our reanalysis shows that the reported decline in disruptiveness can be attributed to a relative decline of these database entries with zero references. Notably, this was not caught by the robustness checks included in the manuscript.

The regression adjustment fails to control for the hidden outliers as they correspond to a discontinuity in the CD index. Proper evaluation of the Monte-Carlo simulations reveals that, because of the preservation of the hidden outliers, even random citation behaviour replicates the observed decline in disruptiveness.

Finally, while these papers and patents with supposedly zero references are the hidden drivers of the reported decline, their source documents predominantly do make references, exposing them as pure dataset artefacts.

URL : Dataset Artefacts are the Hidden Drivers of the Declining Disruptiveness in Science

DOI : https://zenodo.org/doi/10.5281/zenodo.10656940

Additional experiments required: A scoping review of recent evidence on key aspects of Open Peer Review

Posté le par

Authors : Tony Ross-Hellauer, Serge P.J.M. Horbach

Diverse efforts are underway to reform the journal peer review system. Combined with growing interest in Open Science practices, Open Peer Review (OPR) has become of central concern to the scholarly community. However, what OPR is understood to encompass and how effective some of its elements are in meeting the expectations of diverse communities, are uncertain.

This scoping review updates previous efforts to summarize research on OPR to May 2022. Following the PRISMA methodological framework, it addresses the question: “What evidence has been reported in the scientific literature from 2017 to May 2022 regarding uptake, attitudes, and efficacy of two key aspects of OPR (Open Identities and Open Reports)?”

The review identifies, analyses and synthesizes 52 studies matching inclusion criteria, finding that OPR is growing, but still far from common practice. Our findings indicate positive attitudes towards Open Reports and more sceptical approaches to Open Identities.

Changes in reviewer behaviour seem limited and no evidence for lower acceptance rates of review invitations or slower turnaround times is reported in those studies examining those issues. Concerns about power dynamics and potential backfiring on critical reviews are in need of further experimentation.

We conclude with an overview of evidence gaps and suggestions for future research. Also, we discuss implications for policy and practice, both in the scholarly communications community and the research evaluation community more broadly.

URL : Additional experiments required: A scoping review of recent evidence on key aspects of Open Peer Review

DOI : https://doi.org/10.1093/reseval/rvae004

Is gold open access helpful for academic purification? A causal inference analysis based on retracted articles in biochemistry

Posté le par

Authors : Er-Te Zheng, Zhichao Fang, Hui-Zhen Fu

The relationship between transparency and credibility has long been a subject of theoretical and analytical exploration within the realm of social sciences, and it has recently attracted increasing attention in the context of scientific research. Retraction serves as a pivotal mechanism in addressing concerns about research integrity.

This study aims to empirically examining the relationship between open access level and the effectiveness of current mechanism, specifically academic purification centered on retracted articles. In this study, we used matching and Difference-in-Difference (DiD) methods to examine whether gold open access is helpful for academic purification in biochemistry field.

We collected gold open access (Gold OA) and non-open access (non-OA) biochemistry retracted articles as the treatment group, and matched them with corresponding unretracted articles as the control group from 2005 to 2021 based on Web of Science and Retraction Watch database.

The results showed that compared to non-OA, Gold OA is advantageous in reducing the retraction time of flawed articles, but does not demonstrate a significant advantage in reducing citations after retraction. This indicates that Gold OA may help expedite the detection and retraction of flawed articles, ultimately promoting the practice of responsible research.

DOI : https://doi.org/10.1016/j.ipm.2023.103640