Archives des catégories : EN

Evaluations in science communication. Current state and future directions

Posté le par

Authors : Sophia C. Volk , Mike S. Schäfer

Evaluations are becoming more important in science communication. But both science communication practitioners and researchers are not sufficiently utilizing the potential of evaluations yet. In this essay, we first define four requirements for rigorous evaluations of science communication activities and projects.

To substantiate our argument, we take stock of the scientific literature, uncover deficiencies in current evaluation practices and identify potential causes. We conclude with laying out how different actors in the field — including science communication practitioners, professional associations, scientific institutions and funding bodies as well as researchers — can contribute to advancing evaluation practices in science communication as well as research on it.

URL : Evaluations in science communication. Current state and future directions

DOI : https://doi.org/10.22323/2.23060401

Status of peer review guidelines in international surgical journals: A cross-sectional survey

Posté le par

Authors : Min Dong, Wenjing Wang, Xuemei Liu, Fang Lei, Yunmei Luo

Aim

To gain insight into the current status of peer review guidelines in international surgical journals and to offer guidance for the development of peer review guidelines for surgical journals.

Methods

We selected the top 100 journals in the category of ‘Surgery’ according to the Journal Citation Report 2021. We conducted a search of the websites of these journals, and Web of Science, PubMed, other databases, in order to gather the peer review guidelines published by these top 100 journals up until June 30, 2022. Additionally, we analysed the contents of these peer review guidelines.

Results

Only 52% (52/100) of journals provided guidelines for reviewers. Sixteen peer review guidelines which were published by these 52 surgical journals were included in this study. The contents of these peer review guidelines were classified into 33 items. The most common item was research methodology, which was mentioned by 13 journals (25%, 13/52). Other important items include statistical methodology, mentioned by 11 journals (21.2%), the rationality of figures, tables, and data, mentioned by 11 journals (21.2%), innovation of research, mentioned by nine journals (17.3%), and language expression, readability of papers, ethical review, references, and so forth, mentioned by eight journals (15.4%).

Two journals described items for quality assessment of peer review. Forty-three journals offered a checklist to guide reviewers on how to write a review report. Some surgical journals developed peer review guidelines for reviewers with different academic levels, such as professional reviewers and patient/public reviewers. Additionally, some surgical journals provided specific items for different types of papers, such as original articles, reviews, surgical videos, surgical database research, surgery-related outcome measurements, and case reports in their peer review guidelines.

Conclusions

Key contents of peer review guidelines for the reviewers of surgical journals not only include items relating to reviewing research methodology, statistical methods, figures, tables and data, research innovation, ethical review, but also cover items concerning reviewing surgical videos, surgical database research, surgery-related outcome measurements, instructions on how to write a review report, and guidelines on how to assess quality of peer review.

URL : Status of peer review guidelines in international surgical journals: A cross-sectional survey

DOI : https://doi.org/10.1002/leap.1624

The State of Reproducibility Stamps for Visualization Research Papers

Posté le par

Author : Tobias Isenberg

I analyze the evolution of papers certified by the Graphics Replicability Stamp Initiative (GRSI) to be reproducible, with a specific focus on the subset of publications that address visualization-related topics. With this analysis I show that, while the number of papers is increasing overall and within the visualization field, we still have to improve quite a bit to escape the replication crisis.

I base my analysis on the data published by the GRSI as well as publication data for the different venues in visualization and lists of journal papers that have been presented at visualization-focused conferences. I also analyze the differences between the involved journals as well as the percentage of reproducible papers in the different presentation venues.

Furthermore, I look at the authors of the publications and, in particular, their affiliation countries to see where most reproducible papers come from. Finally, I discuss potential reasons for the low reproducibility numbers and suggest possible ways to overcome these obstacles.

This paper is reproducible itself, with source code and data available from this http URL as well as a free paper copy and all supplemental materials at this http URL.

Arxiv : https://arxiv.org/abs/2408.03889

Is open access disrupting the journal business? A perspective from comparing full adopters, partial adopters, and non-adopters

Posté le par

Author : Xijie Zhang

Two decades after the inception of open access publishing (OA), its impact has remained a focal point in academic discourse. This study adopted a disruptive innovation framework to examine OA’s influence on the traditional subscription market. It assesses the market power of gold journals (OA full adopters) in comparison with hybrid journals and closed-access journals (partial adopters and non-adopters). Additionally, it contrasts the market power between hybrid journals (partial adopters) and closed-access journals (non-adopters).

Using the Lerner index to measure market power through price elasticity of demand, this study employs difference tests and multiple regressions. These findings indicate that OA full adopters disrupt the market power of non-adopting incumbents. However, by integrating the OA option into their business models, partial adopters can effectively mitigate this disruption and expand their influence from the traditional subscription market to the emerging OA paradigm.

URL : Is open access disrupting the journal business? A perspective from comparing full adopters, partial adopters, and non-adopters

DOI : https://doi.org/10.1016/j.joi.2024.101574

“Academic Publishing is a Business Interest”: Reconciling Faculty Serials Needs and Economic Realities at a Carnegie R2 University

Posté le par

Authors : Rachel E. Scott, Anne Shelley, Chad E. Buckley, Cassie Thayer-Styes, Julie A. Murphy

Introduction

This article explores faculty conceptions of academic publishers, their willingness to circumvent paywalls and share content, and their understanding of who holds the responsibility to pay for this body of scholarly work to which they all contribute.

Methods

The authors conducted semi-structured interviews with 25 faculty at their Carnegie R2 university to explore scholars’ perspectives with respect to the costs of serials and the responsibilities of the University and library in support of scholarly publishing.

Results

Participants reported a broad spectrum of perspectives with respect to circumventing publisher paywalls and offered nuanced practices for interacting with paywalled content. They explained which library services work well and offered suggestions on how best to support faculty needs for serial literature. Although most participants agree that the University has the responsibility of making academic literature available to the community, they differ in their conceptions of academic publishers as good-faith partners in the knowledge enterprise.

Discussion

The results suggest a great deal of ambiguity and diversity of beliefs among faculty: some would support boycotting all commercial publishers; some understand academic publishers to be integral to the dissemination of their work, not to mention tenure and promotion processes; and many acknowledge a variety of tensions in what feels to them an exploitative and fraught relationship.

These findings have implications for library services in acquisitions, collection management, scholarly communication, discovery, and access.

Conclusion

The data provide insight into the nuanced perceptions that faculty members at a Carnegie R2 hold concerning the costs of scholarly publishing and the role of academic publishers within scholarly communication.

URL : “Academic Publishing is a Business Interest”: Reconciling Faculty Serials Needs and Economic Realities at a Carnegie R2 University

DOI : https://doi.org/10.31274/jlsc.16232

Closing the Loop: Automating Links to Open Access Versions of Articles in Faculty Profiles at a Large Research Institution

Posté le par

Authors : Andrew M. Johnson, Don Elsborg

Introduction

Universities implement faculty profile systems for a variety of reasons, including to increase visibility of research produced at the institution. These profiles often connect with other campus systems, particularly institutional repositories.

This article describes a collaboration at the University of Colorado Boulder aimed at integrating the institutional repository with the faculty profile system, which then expanded to encompass the automated creation of profile links to open access versions of faculty articles from any journal or repository.

Description of Program

To achieve the initial project goals, a cross-campus team from the University Libraries and the Faculty Information System developed a strategy of using Unpaywall as an intermediary data source to connect the institutional repository with the faculty profile system.

This also allowed for the development of an automated process for generating links to open access content from any journal or repository, which resulted in the creation of over 35,000 links to openly available content in faculty profiles, including over 2,900 links to content in the institutional repository.

These links provide public users of the faculty profile system with a simple way to access all openly available research produced at the university. This article describes the development and implementation of this project as well as lessons learned.

Next Steps

The ongoing collaboration provides additional opportunities to unlock data for monitoring rates of open access publishing and self-archiving, informing library collection development decisions, and connecting to other data sources to reveal further insights.

URL : Closing the Loop: Automating Links to Open Access Versions of Articles in Faculty Profiles at a Large Research Institution

DOI : https://doi.org/10.31274/jlsc.17242

Reproducible and Attributable Materials Science Curation Practices: A Case Study

Posté le par

Authors : Ye Li, Sarah Laura Wilson, Micah Altman

While small labs produce much of the fundamental experimental research in Material Science and Engineering (MSE), little is known about their data management and sharing practices and the extent to which they promote trust in, and transparency of, the published research.

In this research, we conduct a case study of a leading MSE research lab to characterize the limits of current data management and sharing practices concerning reproducibility and attribution. We systematically reconstruct the workflows, underpinning four research projects by combining interviews, document review, and digital forensics. We then apply information graph analysis and computer-assisted retrospective auditing to identify where critical research information is unavailable or at risk.

We find that while data management and sharing practices in this leading lab protect against computer and disk failure, they are insufficient to ensure reproducibility or correct attribution of work — especially when a group member withdraws before project completion.

We conclude with recommendations for adjustments to MSE data management and sharing practices to promote trustworthiness and transparency by adding lightweight automated file-level auditing and automated data transfer processes.

URL : Reproducible and Attributable Materials Science Curation Practices: A Case Study

DOI : https://doi.org/10.2218/ijdc.v18i1.940