Archives des mots-clés : scientific communication

How open are hybrid journals included in transformative agreements?

Posté le par

Author : Najko Jahn

The ongoing controversy surrounding transformative agreements, which aim to transition journal publishing to full open access, highlight the need for large-scale studies assessing the uptake of open access in hybrid journals. This includes evaluating the extent to which transformative agreements enabled open access.

By combining publicly available data from various sources, including cOAlition S Journal Checker, Crossref, and OpenAlex, this study presents a novel approach that analyses over 700 agreements and nine million journal articles published in more than 11.000 hybrid journals. Estimates suggest a strong growth in open access between 2018 and 2022 from 4.3% to 15%. In 2022, 58% of hybrid open access was enabled by transformative agreements.

This trend was largely driven by the three commercial publishers Elsevier, Springer Nature, and Wiley, but the open access uptake varied substantially across journals, publishers, disciplines, and country affiliations. In particular, comparing the developments in the OECD and BRICS areas revealed different publication trends relative to hybrid open access.

In conclusion, estimates suggest that current levels of implementation of transformative agreements is insufficient to bring about a large-scale transition to full open access.

URL : How open are hybrid journals included in transformative agreements?

Arxiv : https://arxiv.org/abs/2402.18255

Peer review’s irremediable flaws: Scientists’ perspectives on grant evaluation in Germany

Posté le par

Authors : Eva Barlösius, Laura Paruschke, Axel Philipps

Peer review has developed over time to become the established procedure for assessing and assuring the scientific quality of research. Nevertheless, the procedure has also been variously criticized as conservative, biased, and unfair, among other things. Do scientists regard all these flaws as equally problematic?

Do they have the same opinions on which problems are so serious that other selection procedures ought to be considered? The answers to these questions hints at what should be modified in peer review processes as a priority objective. The authors of this paper use survey data to examine how members of the scientific community weight different shortcomings of peer review processes.

Which of those processes’ problems do they consider less relevant? Which problems, on the other hand, do they judge to be beyond remedy? Our investigation shows that certain defects of peer review processes are indeed deemed irreparable: (1) legitimate quandaries in the process of fine-tuning the choice between equally eligible research proposals and in the selection of daring ideas; and (2) illegitimate problems due to networks. Science-policy measures to improve peer review processes should therefore clarify the distinction between field-specific remediable and irremediable flaws than is currently the case.

URL : Peer review’s irremediable flaws: Scientists’ perspectives on grant evaluation in Germany

DOI : https://doi.org/10.1093/reseval/rvad032

How transformative are transformative agreements? Evidence from Germany across disciplines

Posté le par

Author : W. Benedikt Schmal

Research institutions across the globe attempt to change the academic publishing system as digitization opens up new opportunities, and subscriptions to the large journal bundles of the leading publishers put library budgets under pressure. One approach is the negotiation of so-called transformative agreements.

I study the ‘DEAL’ contracts between nearly all German research institutions and Springer Nature and Wiley. I investigate 6.1 million publications in 5,862 journals covering eight fields in the years 2016–2022 and apply a causal difference-in-differences design to identify whether the likelihood of a paper appearing in an eligible journal increases. The effect strongly depends on the discipline.

While material science, chemistry, and economics s tend to hift towards these journals, all other disciplines in my sample do not react. Suggestive evidence hints at the market position of the encompassed publishers before the ‘DEAL’ was established: Springer Nature and Wiley appear to benefit more from the contracts in disciplines in which they possessed a higher market share ex ante.

The transformative vigor of these agreements in terms of publication behavior seems to be limited. It and highlights that the developments in this intertwined market require further examination.

URL : How transformative are transformative agreements? Evidence from Germany across disciplines

DOI : https://doi.org/10.1007/s11192-024-04955-y

Scholar Metrics Scraper (SMS): automated retrieval of citation and author data

Posté le par

Authors : Yutong Cao, Nicole A. Cheung, Dean Giustini, Jeffrey LeDue, Timothy H. Murphy

Academic departments, research clusters and evaluators analyze author and citation data to measure research impact and to support strategic planning. We created Scholar Metrics Scraper (SMS) to automate the retrieval of bibliometric data for a group of researchers.

The project contains Jupyter notebooks that take a list of researchers as an input and exports a CSV file of citation metrics from Google Scholar (GS) to visualize the group’s impact and collaboration. A series of graph outputs are also available. SMS is an open solution for automating the retrieval and visualization of citation data.

URL : Scholar Metrics Scraper (SMS): automated retrieval of citation and author data

DOI : https://doi.org/10.3389/frma.2024.1335454

Bibliometric analysis of Sci-Hub downloads by Egyptian researchers

Posté le par

Authors : Ismail Ragab Osman, Hendy Abdullah Hendy Ahmed

In this study we present an in-depth bibliometric analysis of Sci-Hub downloads by Egyptian researchers based on the 2017 download log file. The study reveals that Egyptian researchers heavily rely on Sci-Hub, generating a substantial 1,357,526 download requests in 2017, with 65% of these occurring outside regular working hours. Cairo emerges as a central hub for this activity, contributing 81.58% of total downloads.

Journal articles constitute the majority of downloads at 82.36%, followed by conference papers (12.89%). A discernible trend shows a preference for recent papers published between 2012 and 2017, highlighting the demand for up-to-date research. The analysis also highlights prominent publishers, including IEEE, Elsevier, Wiley, and Springer, as preferred sources for Egyptian researchers. “Journal of the American Chemical Society” and “Journal of Applied Physics” stand out among accessed journals, while IEEE-associated conferences, notably “IEEE Power and Energy Society General Meeting,” dominate conference paper downloads. Examining journal accessibility via the Egyptian Knowledge Bank (EKB) reveals that 62.84% of journals are accessible, with Science Direct as the leading provider (28.37%).

However, a significant gap emerges as 87.39% of downloaded conference papers remain inaccessible through EKB. Furthermore, a semantic analysis highlights recurring themes such as “systems,” “review,” “analysis,” “treatment,” “power,” and “energy,” reflecting the key research areas of Egyptian researchers. Overall, this study offers valuable insights into Sci-Hub’s role in supplementing Egyptian researchers’ resource access and underscores the need for comprehensive resource coverage and accessibility enhancements.

URL : Bibliometric analysis of Sci-Hub downloads by Egyptian researchers

DOI : https://doi.org/10.1007/s11192-024-04951-2

Beyond journals and peer review: towards a more flexible ecosystem for scholarly communication

Posté le par

Author : Michael Wood

This article challenges the assumption that journals and peer review are essential for developing,evaluating and disseminating scientific and other academic knowledge. It suggests a more flexible ecosystem, and examines some of the possibilities this might facilitate. The market for academic outputs should be opened up by encouraging the separation of the dissemination service from the evaluation service.

Publishing research in subject-specific journals encourages compartmentalising research into rigid categories. The dissemination of knowledge would be better served by an open access, web-based repository system encompassing all disciplines. There would then be a role for organisations to assess the items in this repository to help users find relevant, high-quality work.

There could be a variety of such organisations which could enable reviews from peers to be supplemented with evaluation by non-peers from a variety of different perspectives: user reviews, statistical reviews, reviews from the perspective of different disciplines, and so on. This should reduce the inevitably conservative influence of relying on two or three peers, and make the evaluation system more critical, multi-dimensional and responsive to the requirements of different audience groups, changing circumstances, and new ideas.

Non-peer review might make it easier to challenge dominant paradigms, and expanding the potential audience beyond a narrow group of peers might encourage the criterion of simplicity to be taken more seriously – which is essential if human knowledge is to continue to progress.

Arxiv : https://arxiv.org/abs/1311.4566

Dataset Artefacts are the Hidden Drivers of the Declining Disruptiveness in Science

Posté le par

Authors : Vincent Holst, Andres Algaba, Floriano Tori, Sylvia Wenmackers, Vincent Ginis

Park et al. [1] reported a decline in the disruptiveness of scientific and technological knowledge over time. Their main finding is based on the computation of CD indices, a measure of disruption in citation networks [2], across almost 45 million papers and 3.9 million patents.

Due to a factual plotting mistake, database entries with zero references were omitted in the CD index distributions, hiding a large number of outliers with a maximum CD index of one, while keeping them in the analysis [1]. Our reanalysis shows that the reported decline in disruptiveness can be attributed to a relative decline of these database entries with zero references. Notably, this was not caught by the robustness checks included in the manuscript.

The regression adjustment fails to control for the hidden outliers as they correspond to a discontinuity in the CD index. Proper evaluation of the Monte-Carlo simulations reveals that, because of the preservation of the hidden outliers, even random citation behaviour replicates the observed decline in disruptiveness.

Finally, while these papers and patents with supposedly zero references are the hidden drivers of the reported decline, their source documents predominantly do make references, exposing them as pure dataset artefacts.

URL : Dataset Artefacts are the Hidden Drivers of the Declining Disruptiveness in Science

DOI : https://zenodo.org/doi/10.5281/zenodo.10656940