Archives des mots-clés : scientific communication

Identification and classification of evaluation indicators for scientific and technical publications and related factors

Posté le par

Authors : Hassan Mahmoudi Topkanlo, Mehrdad CheshmehSohrabi

Introduction

Given the importance of the issue of the widespread impact of scientific and technical publications in today’s world, and the diversity and multiplicity of indicators for measuring these publications, it is a necessity to classify these indicators from different angles and through different tools and methods.

Method

This study used documentary analysis and Delphi technique methods. The members of the Delphi panel were twenty-one experts in metric fields in information science who answered the research questionnaires several times until reaching a consensus.

Analysis

Kendall’s coefficient of concordance and a one-sample t-test were used to measure the agreement of the panel members as raters on the questionnaire items.

Results

A total of thirty-four sub-categories of indicators of assessment were identified which were categorised according to their similarities and differences into eight main categories as follows: measurement method, measurement unit, measurement content, measurement purpose, measurement development, measurement resource, measurability, and measurement environment.

Conclusion

Classification of the indicators of evaluation for scientific and technical publications and related factors can lead to improved understanding, critique, modelling and development of indicators. The findings of this study can be considered a basis for further research and help develop evaluative theoretical foundations in scientific and technical publications and related factors.

URL : Identification and classification of evaluation indicators for scientific and technical publications and related factors

DOI : https://doi.org/10.47989/irpaper953

Iranian researchers’ perspective about concept and effect of open science on research publication

Posté le par

Authors : Maryam Zarghani, Leila Nemati-Anaraki, Shahram Sedghi, Abdolreza Noroozi Chakoli, Anisa Rowhani-Farid

Background

Sharing research outputs with open science methods for different stakeholders causes better access to different studies to solve problems in diverse fields, which leads to equal access conditions to research resources, as well as greater scientific productivity. Therefore, the aim of this study was to perceive the concept of openness in research among Iranian health researchers.

Methods

From the beginning of August to the middle of November 2021, twenty semi-structured interviews were held with Iranian health researchers from different fields using purposeful, snowball, and convenience sampling. The interviews continued until data saturation. Data analysis was performed with thematic analysis using MAXQDA 20. Finally, seven main issues related to open science were identified.

Results

Through analysis of the interviews, 235 primary codes and 173 main codes were extracted in 22 subclasses. After careful evaluation and integration of subclasses and classes, they were finally classified into nine categories and three main themes. Analysis showed that openness in research was related to three main themes: researchers’ understanding of open science, the impact of open science on publication and sharing of research, concerns and reluctance to open research.

Conclusion

The conditions of access to research output should be specified given the diversity of studies conducted in the field of health; issues like privacy as an important topic of access to data and information in the health system should also be specified. Our analysis indicated that the conditions of publication and sharing of research processes should be stated according to different scopes of health fields.

The concept of open science was related to access to findings and other research items regardless of cost, political, social, or racial barriers, which could create collective wisdom in the development of knowledge. The process of publication and sharing of research related to open access applies to all types of outputs, conditions of access, increasing trust in research, creation of diverse publication paths, and broader participation of citizens in research.

Open science practices should be promoted to increase the circulation and exploitation rates of knowledge while adjusting and respecting the limits of privacy, intellectual property and national security rights of countries.

URL : Iranian researchers’ perspective about concept and effect of open science on research publication

DOI : https://doi.org/10.1186/s12913-023-09420-9

Understanding differences of the OA uptake within the German university landscape (2010–2020): part 1—journal-based OA

Posté le par

Authors : Niels Taubert, Anne Hobert, Najko Jahn, Andre Bruns, Elham Iravan

This study investigates the determinants for the uptake of Full and Hybrid Open Access (OA) in the university landscape of Germany and distinguishes between three factors: The disciplinary profile, infrastructures and services of universities that aim to support OA, and large transformative agreements.

The uptake of OA, the influence of the disciplinary profile of universities and the influence of transformative agreements is measured by combining several data sources (incl. Web of Science, Unpaywall, an authority file of standardised German affiliation information, the ISSN-Gold-OA 4.0 list, and lists of publications covered by transformative agreements).

For infrastructures and services that support OA, a structured data collection was created by harvesting different sources of information and by manual online search. To determine the explanatory power of the different factors, a series of regression analyses was performed for different periods and for both Full as well as Hybrid OA.

As a result of the regression analyses, the most determining factor for the explanation of differences in the uptake of both OA-types turned out to be the disciplinary profile. For the year 2020, Hybrid OA transformative agreements have become a second relevant factor.

However, all variables that reflect local infrastructural support and services for OA turned out to be non-significant. To deepen the understanding of the adoption of OA on the level of institutions, the outcomes of the regression analyses are contextualised by an interview study conducted with 20 OA officers of German universities.

URL : Understanding differences of the OA uptake within the German university landscape (2010–2020): part 1—journal-based OA

DOI : https://doi.org/10.1007/s11192-023-04716-3

Supporting diamond open access journals. Interest and feasibility of direct funding mechanisms

Posté le par

Authors : Quentin Dufour, David Pontille, Didier Torny

More and more academics and governements consider that the open access model based on Article Processing Charges (APC) is problematic, not only due to the inequalities it generates and reinforces, but also because it has become unsustainable and even opposed to open access values.

They consider that scientific publishing based on a model where both authors and readers do not pay, the so-called Diamond, or non-APC model, should be developed and supported. However, beyond the display of such a support on an international scale, the landscape of Diamond journals is rather in the form of loosely connected archipelagos, and not systematically funded.

This article explores the practical conditions to implement a direct funding mechanism to such journals, that is reccurent money provided by a funder to support the publication process.

Following several recommendations from institutional actors in the open access world, we consider the hypothesis that such a funding would be fostered by research funding organizations (RFOs), which have been essential to the expansion of the APC model, and now show interest in supporting other models.

Based on a questionnaire survey sent to more thant 1000 Diamond Open Access journals, this article analyzes their financial needs, as well as their capacity to interact with funders. It is structured around four issues regarding the implementation of a direct funding model: do Diamond journals really make use of money, and to what end? Do they need additional money?

Are they able to engage monetary transactions? Are they able to meet RFOs visibility requirements? We show that a majority of OA Diamond journals could make use of a direct funding mechanism with certain adjustments. We conclude on the challenges that such a financial stream would spur.

URL : Supporting diamond open access journals. Interest and feasibility of direct funding mechanisms

DOI : https://doi.org/10.1101/2023.05.03.539231

In which fields are citations indicators of research quality?

Posté le par

Authors : Mike Thelwall, Kayvan Kousha, Emma Stuart, Meiko Makita, Mahshid Abdoli, Paul Wilson, Jonathan Levitt

Citation counts are widely used as indicators of research quality to support or replace human peer review and for lists of top cited papers, researchers, and institutions. Nevertheless, the relationship between citations and research quality is poorly evidenced. We report the first large-scale science-wide academic evaluation of the relationship between research quality and citations (field normalized citation counts), correlating them for 87,739 journal articles in 34 field-based UK Units of Assessment (UoA).

The two correlate positively in all academic fields, from very weak (0.1) to strong (0.5), reflecting broadly linear relationships in all fields. We give the first evidence that the correlations are positive even across the arts and humanities. The patterns are similar for the field classification schemes of Scopus and Dimensions.ai, although varying for some individual subjects and therefore more uncertain for these.

We also show for the first time that no field has a citation threshold beyond which all articles are excellent quality, so lists of top cited articles are not pure collections of excellence, and neither is any top citation percentile indicator. Thus, while appropriately field normalized citations associate positively with research quality in all fields, they never perfectly reflect it, even at high values.

URL : In which fields are citations indicators of research quality?

DOI : https://doi.org/10.1002/asi.24767

Rhetorical Features and Functions of Data References in Academic Articles

Posté le par

Authors : Sara Lafia, Andrea Thomer, Elizabeth Moss, David Bleckley, Libby Hemphill

Data reuse is a common practice in the social sciences. While published data play an essential role in the production of social science research, they are not consistently cited, which makes it difficult to assess their full scholarly impact and give credit to the original data producers.

Furthermore, it can be challenging to understand researchers’ motivations for referencing data. Like references to academic literature, data references perform various rhetorical functions, such as paying homage, signaling disagreement, or drawing comparisons. This paper studies how and why researchers reference social science data in their academic writing.

We develop a typology to model relationships between the entities that anchor data references, along with their features (access, actions, locations, styles, types) and functions (critique, describe, illustrate, interact, legitimize). We illustrate the use of the typology by coding multidisciplinary research articles (n = 30) referencing social science data archived at the Inter-university Consortium for Political and Social Research (ICPSR).

We show how our typology captures researchers’ interactions with data and purposes for referencing data. Our typology provides a systematic way to document and analyze researchers’ narratives about data use, extending our ability to give credit to data that support research.

URL : Rhetorical Features and Functions of Data References in Academic Articles

DOI : https://doi.org/10.5334/dsj-2023-010

To Preprint or Not to Preprint: Experience and Attitudes of Researchers Worldwide

Posté le par

Authors : Rong Ni, Ludo Waltman

The pandemic has underlined the significance of open science and spurred further growth of preprinting. Nevertheless, preprinting has been adopted at varying rates across different countries/regions.

To investigate researchers’ experience with and attitudes toward preprinting, we conducted a survey of authors of research papers published in 2021 or 2022. We find that respondents in the US and Europe had a higher level of familiarity with and adoption of preprinting than those in China and the rest of the world. Respondents in China were most worried about the lack of recognition for preprinting and the risk of getting scooped.

US respondents were very concerned about premature media coverage of preprints, the reliability and credibility of preprints, and public sharing of information before peer review. Respondents identified integration of preprinting in journal submission processes as the most important way to promote preprinting.

DOI : https://doi.org/10.55835/6442f782b2b5580ba561406b