Identification and classification of evaluation indicators for scientific and technical publications and related factors

Posté le par

Authors : Hassan Mahmoudi Topkanlo, Mehrdad CheshmehSohrabi

Introduction

Given the importance of the issue of the widespread impact of scientific and technical publications in today’s world, and the diversity and multiplicity of indicators for measuring these publications, it is a necessity to classify these indicators from different angles and through different tools and methods.

Method

This study used documentary analysis and Delphi technique methods. The members of the Delphi panel were twenty-one experts in metric fields in information science who answered the research questionnaires several times until reaching a consensus.

Analysis

Kendall’s coefficient of concordance and a one-sample t-test were used to measure the agreement of the panel members as raters on the questionnaire items.

Results

A total of thirty-four sub-categories of indicators of assessment were identified which were categorised according to their similarities and differences into eight main categories as follows: measurement method, measurement unit, measurement content, measurement purpose, measurement development, measurement resource, measurability, and measurement environment.

Conclusion

Classification of the indicators of evaluation for scientific and technical publications and related factors can lead to improved understanding, critique, modelling and development of indicators. The findings of this study can be considered a basis for further research and help develop evaluative theoretical foundations in scientific and technical publications and related factors.

URL : Identification and classification of evaluation indicators for scientific and technical publications and related factors

DOI : https://doi.org/10.47989/irpaper953

The Invisible Workload of Open Research

Posté le par

Author : Thomas J. Hostler

It is acknowledged that conducting open research requires additional time and effort compared to conducting ‘closed’ research. However, this additional work is often discussed only in abstract terms, a discourse which ignores the practicalities of how researchers are expected to find the time to engage with these practices in the context of their broader role as multifaceted academics.

In the context of a sector that is blighted by stress, burnout, untenable workloads, and hyper-competitive pressures to produce, there is a clear danger that additional expectations to engage in open practices add to the workload burden and increase pressure on academics even further. In this article, the theories of academic capitalism and workload creep are used to explore how workload models currently exploit researchers by mismeasuring academic labour.

The specific increase in workload resulting from open practices and associated administration is then outlined, including via the cumulative effects of administrative burden.

It is argued that there is a high chance that without intervention, increased expectations to engage in open research practices may lead to unacceptable increases in demands on academics. Finally, the individual and systematic responsibilities to mitigate this are discussed.

URL : The Invisible Workload of Open Research

DOI : https://doi.org/10.36850/mr5

Iranian researchers’ perspective about concept and effect of open science on research publication

Posté le par

Authors : Maryam Zarghani, Leila Nemati-Anaraki, Shahram Sedghi, Abdolreza Noroozi Chakoli, Anisa Rowhani-Farid

Background

Sharing research outputs with open science methods for different stakeholders causes better access to different studies to solve problems in diverse fields, which leads to equal access conditions to research resources, as well as greater scientific productivity. Therefore, the aim of this study was to perceive the concept of openness in research among Iranian health researchers.

Methods

From the beginning of August to the middle of November 2021, twenty semi-structured interviews were held with Iranian health researchers from different fields using purposeful, snowball, and convenience sampling. The interviews continued until data saturation. Data analysis was performed with thematic analysis using MAXQDA 20. Finally, seven main issues related to open science were identified.

Results

Through analysis of the interviews, 235 primary codes and 173 main codes were extracted in 22 subclasses. After careful evaluation and integration of subclasses and classes, they were finally classified into nine categories and three main themes. Analysis showed that openness in research was related to three main themes: researchers’ understanding of open science, the impact of open science on publication and sharing of research, concerns and reluctance to open research.

Conclusion

The conditions of access to research output should be specified given the diversity of studies conducted in the field of health; issues like privacy as an important topic of access to data and information in the health system should also be specified. Our analysis indicated that the conditions of publication and sharing of research processes should be stated according to different scopes of health fields.

The concept of open science was related to access to findings and other research items regardless of cost, political, social, or racial barriers, which could create collective wisdom in the development of knowledge. The process of publication and sharing of research related to open access applies to all types of outputs, conditions of access, increasing trust in research, creation of diverse publication paths, and broader participation of citizens in research.

Open science practices should be promoted to increase the circulation and exploitation rates of knowledge while adjusting and respecting the limits of privacy, intellectual property and national security rights of countries.

URL : Iranian researchers’ perspective about concept and effect of open science on research publication

DOI : https://doi.org/10.1186/s12913-023-09420-9

Initial insight into three modes of data sharing: Prevalence of primary reuse, data integration and dataset release in research articles

Posté le par

Authors : Yukiko Sakai, Yosuke Miyata, Keiko Yokoi, Yuqing Wang, Keiko Kurata

While data sharing has received research interest in recent times, its real status remains unclear, owing to its ambiguous concept. To understand the current status of data sharing, this study examined primary reuse, data integration, and dataset release as the actual practices of data sharing.

A total of 963 articles, chosen from those published in 2018 and registered in the Web of Science global citation database, were manually checked. Existing data were reused in the mode of data integration (13.3%) as frequently as they were for the mode of primary reuse (12.1%). Dataset release was the least common mode (9.0%).

The results show the variation in data sharing and indicate the need for standardization of data description in articles based on thorough registration and expansion in public data archives to close the loop that results in the virtuous cycle of research data.

URL : Initial insight into three modes of data sharing: Prevalence of primary reuse, data integration and dataset release in research articles

DOI : https://doi.org/10.1002/leap.1546

Towards a new relevance for research libraries

Posté le par

Author : Leo Waaijers

The invention of printing in 1455 by Johann Gutenberg and the invention of the World Wide Web in 1991 by Tim Berners-Lee have often been compared when it comes to making knowledge accessible. Both events marked a breakthrough with far-reaching social consequences.

The printing press led to the disappearance of monastic libraries and their scriptoriums as sources of knowledge, to make way for university libraries and publishers. The Web is again a revolution in the distribution of knowledge, embraced by the academic community and culminating in the Open Science movement. This editorial is an exploration into the challenges that this development poses for the roles of publishers and libraries.

URL : Towards a new relevance for research libraries

DOI : https://doi.org/10.53377/lq.13657

Understanding differences of the OA uptake within the German university landscape (2010–2020): part 1—journal-based OA

Posté le par

Authors : Niels Taubert, Anne Hobert, Najko Jahn, Andre Bruns, Elham Iravan

This study investigates the determinants for the uptake of Full and Hybrid Open Access (OA) in the university landscape of Germany and distinguishes between three factors: The disciplinary profile, infrastructures and services of universities that aim to support OA, and large transformative agreements.

The uptake of OA, the influence of the disciplinary profile of universities and the influence of transformative agreements is measured by combining several data sources (incl. Web of Science, Unpaywall, an authority file of standardised German affiliation information, the ISSN-Gold-OA 4.0 list, and lists of publications covered by transformative agreements).

For infrastructures and services that support OA, a structured data collection was created by harvesting different sources of information and by manual online search. To determine the explanatory power of the different factors, a series of regression analyses was performed for different periods and for both Full as well as Hybrid OA.

As a result of the regression analyses, the most determining factor for the explanation of differences in the uptake of both OA-types turned out to be the disciplinary profile. For the year 2020, Hybrid OA transformative agreements have become a second relevant factor.

However, all variables that reflect local infrastructural support and services for OA turned out to be non-significant. To deepen the understanding of the adoption of OA on the level of institutions, the outcomes of the regression analyses are contextualised by an interview study conducted with 20 OA officers of German universities.

URL : Understanding differences of the OA uptake within the German university landscape (2010–2020): part 1—journal-based OA

DOI : https://doi.org/10.1007/s11192-023-04716-3

Contours of a research ethics and integrity perspective on open science

Posté le par

Authors : Tom Lindemann, Lisa Häberlein

This article argues that adopting a research ethics and integrity perspective could support researchers in operationalizing the open science guiding principle “as open as possible, as closed as necessary” in a responsible and context-sensitive manner.

To that end, the article points out why the guiding principle as such provides only a limited extent of action-guidance and outlines the practical value of ethical reflection when it comes to translating open science into responsible research practice.

The article illustrates how research ethics and integrity considerations may help researchers understand the ethical rationale underpinning open science as well as recognize that limiting openness is necessary or at least normatively permissible in some situations.

Finally, the article briefly discusses possible consequences of integrating open science into a responsibility-centered framework and implications on research assessment.

URL : Contours of a research ethics and integrity perspective on open science

DOI : https://doi.org/10.3389/frma.2023.1052353