The role of non-scientific factors vis-à-vis the quality of publications in determining their scholarly impact

Authors : Giovanni Abramo, Ciriaco Andrea D’Angelo, Leonardo Grilli

In the evaluation of scientific publications’ impact, the interplay between intrinsic quality and non-scientific factors remains a subject of debate. While peer review traditionally assesses quality, bibliometric techniques gauge scholarly impact.

This study investigates the role of non-scientific attributes alongside quality scores from peer review in determining scholarly impact. Leveraging data from the first Italian Research Assessment Exercise (VTR 2001–2003) and Web of Science citations, we analyse the relationship between quality scores, non-scientific factors, and publication short- and long-term impact.

Our findings shed light on the significance of non-scientific elements overlooked in peer review, offering policymakers and research management insights in choosing evaluation methodologies. Sections delve into the debate, identify non-scientific influences, detail methodologies, present results, and discuss implications.

URL : The role of non-scientific factors vis-à-vis the quality of publications in determining their scholarly impact

DOI : https://doi.org/10.1007/s11192-024-05106-z

Practices and Attitudes of the Research and Teaching Staff at the University of Split about the Online Encyclopedia Wikipedia

Author : Mirko Duić

The goal of this study was to investigate the practices and attitudes of the research and teaching staff at the University of Split (Croatia) about the online encyclopedia Wikipedia. The method of a questionnaire-based survey was used to gain insights related to this topic. During February 2024, the survey was completed by 226 respondents.

The results show that almost all respondents read Wikipedia articles and believe that the level of their accuracy is quite high. Almost half of the respondents strongly agree with the statement that it would be desirable for faculty staff to write Wikipedia articles with the aim of spreading knowledge about topics from their professional fields.

However, a very small number of respondents participated in writing articles for Wikipedia. Also, the respondents answered that to them, the greatest motivations to write articles on Wikipedia would be if this activity were evaluated for the advancement to a higher work position and the correction of errors in Wikipedia articles.

It was also found that most respondents are not very familiar with how Wikipedia works or how to add new content to it. These and other insights from this study can be used to conceive and initiate various activities that can contribute to greater participation of scientific and teaching staff of higher education institutions in writing quality content on Wikipedia, as well as activities that can contribute to a better familiarization with the principles and procedures to write and enhance its content.

Other research methods, such as interviews with scientific and teaching staff of higher education institutions, could be used to acquire further, more detailed answers related to this topic.

URL : Practices and Attitudes of the Research and Teaching Staff at the University of Split about the Online Encyclopedia Wikipedia

Original location : https://www.mdpi.com/2304-6775/12/3/20

The promotion and implementation of open science measures among high-performing journals from Brazil, Mexico, Portugal, and Spain

Authors : Chris Fradkin, Rogério Mugnaini

This study empirically examined the promotion and implementation of open science measures among high-performing journals of Brazil, Mexico, Portugal, and Spain. Journal policy related to data sharing, materials sharing, preregistration, open peer review, and consideration of preprints and replication studies was gathered from the websites of the journals.

Four hundred articles were coded for the inclusion of data availability statements, conflict of interest disclosures, funding disclosures, DOI, ORCID, and continuous publishing. Analyses found a higher promotion of open science measures among Brazilian journals than their Portuguese counterparts, and higher promotion of open science measures among international journals than their domestic counterparts.

Analyses found higher implementation of open science measures among Brazilian journals than their Portuguese and Mexican counterparts. One journal out of 40 encouraged preregistration of studies; none encouraged replication studies and none had implemented open peer review.

These findings reveal reasonably strong implementation of secondary open science measures (e.g., DOI, ORCID, conflict of interest and funding source disclosure) among the sample, but weaker implementation of primary measures (e.g., open data, open materials, replication studies and open peer review).

The implications of these findings are considered and suggestions are made to bolster the adoption of open science measures among Ibero-American scientific journals.

URL : The promotion and implementation of open science measures among high-performing journals from Brazil, Mexico, Portugal, and Spain

Stratégies et comportements de communication scientifique de chercheurs en sciences humaines et sociales face à l’évaluation de la recherche publique

Auteur/Author : Cheikh Ndiaye

Cette thèse se penche sur les enjeux de la communication et de l’évaluation dans le domaine de la recherche en Sciences de l’Information et de la Communication. Partant du principe que la science contribue au progrès d’une société en lui permettant de répondre à ses préoccupations (santé, économie, etc.), divers pays industrialisés comme la France investissent des sommes importantes pour son essor. Ces investissements suscitant, à leur tour, des prescrits afin d’en assurer une gestion efficiente et un impact en adéquation avec les objectifs de développement. Ainsi ont été institutionnalisées l’évaluation de la recherche publique et sa valorisation.

Leur montée en puissance a eu des effets bouleversants sur le paysage scientifique, notamment la gouvernance des universités, leurs missions et rapports au monde économique ou encore la production des connaissances. Au cœur de ses changements, l’évaluation impacte les orientations politiques autour de la recherche, en particulier le choix des priorités thématiques et la distribution des financements. Elle induit un besoin de valorisation individuelle qui semble obliger les chercheurs à intégrer davantage dans leurs activités la quête construite d’autorité, donc de reconnaissance scientifique.Ayant toujours été un régulateur de la compétition entre savants et un vecteur de diffusion de leurs connaissances produites, la communication scientifique est-elle devenue un outil de stratégie ?

Le but de cette recherche est de répondre à cette interrogation. En se fondant sur un modèle psychosociologique, la théorie du comportement planifié, il s’agit d’examiner la construction de ce changement comportemental éventuel, à partir de la motivation, de l’attitude, des perceptions des normes sociales et de la capacité à conduire le changement et l’intention comportementale. Il s’agit également de voir les liens existant entre ces variables et l’intention de s’adapter à l’évaluation, voire le comportement final adopté.

La première partie de l’étude pose les bases conceptuelles de la thèse en examinant les relations entre les Sciences Humaines et Sociales, l’espace scientifique, l’économie et les politiques publiques. Elle explore la dualité entre les SHS et les sciences exactes, ainsi que l’impact du numérique sur la recherche.

La deuxième partie se concentre sur le chercheur en tant que communicateur et objet d’évaluation. Elle aborde les différents moyens de communication scientifique, y compris les publications, les médias sociaux, et les médias alternatifs, ainsi que les enjeux sociaux de la communication dans le domaine académique.

La troisième et dernière partie examine le chercheur en tant qu’acteur central de la recherche. D’une part, elle se penche sur les aspects de l’évaluation de la recherche, notamment la bibliométrie et les classements universitaires. De l’autre, elle expose les théories du comportement humain, le modèle théorique et la méthodologie de la recherche. Ce qui permet de présenter les résultats de l’enquête par un questionnaire auprès des chercheurs.

En conclusion, l’étude met en évidence une perception contraignante de l’évaluation scientifique au-delà d’une incitation à publier. Elle apparaît, en effet, comme une obligation professionnelle dont l’inexécution peut avoir des effets néfastes sur la carrière.

Son attitude est plutôt favorable au changement, et les normes sociales perçues l’y poussent alors qu’il a confiance en ses capacités à intégrer les prescriptions dans sa stratégie de communication. De ce fait, le chercheur en SHS à l’intention de s’adapter en construisant une communication adaptative, en sélectionnant les prescrits lui convenant.

Au final, son comportement adopté consiste à élaborer une stratégie au cas par cas, basée sur la publication évaluée par les pairs afin d’obtenir divers bénéfices : visibilité et reconnaissance scientifiques, intégration sociale, accès aux médias et autorités politiques, responsabilités administratives ou scientifiques.

URL : https://theses.fr/2023MON30038

The oligopoly of academic publishers persists in exclusive database

Authors : Simon van Bellen, Juan Pablo Alperin, Vincent Larivière

Global scholarly publishing has been dominated by a small number of publishers for several decades. We aimed to revisit the debate on corporate control of scholarly publishing by analyzing the relative shares of major publishers and smaller, independent publishers. Using the Web of Science, Dimensions and OpenAlex, we managed to retrieve twice as many articles indexed in Dimensions and OpenAlex, compared to the rather selective Web of Science.

As a result of excluding smaller publishers, the ‘oligopoly’ of scholarly publishers persists, at least in appearance, according to the Web of Science. However, both Dimensions’ and OpenAlex’ inclusive indexing revealed the share of smaller publishers has been growing rapidly, especially since the onset of large-scale online publishing around 2000, resulting in a current cumulative dominance of smaller publishers.

While the expansion of small publishers was most pronounced in the social sciences and humanities, the natural and medical sciences showed a similar trend. A major geographical divergence is also revealed, with some countries, mostly Anglo-Saxon and/or located in northwestern Europe, relying heavily on major publishers for the dissemination of their research, while others being relatively independent of the oligopoly, such as those in Latin America, northern Africa, eastern Europe and parts of Asia.

The emergence of digital publishing, the reduction of expenses for printing and distribution and open-source journal management tools may have contributed to the emergence of small publishers, while the development of inclusive bibliometric databases has allowed for the effective indexing of journals and articles. We conclude that enhanced visibility to recently created, independent journals may favour their growth and stimulate global scholarly bibliodiversity.

Arxiv : https://arxiv.org/abs/2406.17893

Exploring scholarly perceptions of preprint servers

Authors : Shir Aviv-Reuven, Jenny Bronstein, Ariel Rosenfeld

Introduction

Preprint servers play an important role in scholarly communication.  The study investigates scholars’ engagement, experiences, and perceptions regarding the use of these servers, both as information sources and publishing venues. This qualitative study seeks to extend our understanding of how these servers operate within the academic ecosystem and influence scholarly communication.

Method

Data was collected through 32 semi-structured interviews with scholars from different disciplines, to explore their engagement, experiences and perceptions in using these platforms.

Analysis

The data collected from these interviews underwent thematic content analysis using ATLAS.ti software. This analysis facilitated the organization and thematic examination of the textual narratives derived from the interviews.

Results

In this study, scholars discussed their perceptions about the benefits of using preprint servers in scholarly work such as rapid dissemination of information and open access, but also raised concerns regarding the lack of peer review for the studies uploaded to these servers.

Conclusion

These findings emphasize the growing, yet diverse, role preprint servers play in scholarly communication and their differential impact across academic disciplines.

URL : Exploring scholarly perceptions of preprint servers

DOI : https://doi.org/10.47989/ir292820

Virtual academic conferencing: a scoping review of 1984-2021 literature. Novel modalities vs. long standing challenges in scholarly communication

Authors : Agnieszka Olechnicka, Adam Ploszaj, Ewa Zegler-Poleska

This study reviews the literature on virtual academic conferences, which have gained significant attention due to the COVID-19 pandemic. We conducted a scoping review, analyzing 147 documents available up to October 5th, 2021.

We categorized this literature, identified main themes, examined theoretical approaches, evaluated empirical findings, and synthesized the advantages and disadvantages of virtual academic conferences. We find that the existing literature on virtual academic conferences is mainly descriptive and lacks a solid theoretical framework for studying the phenomenon.

Despite the rapid growth of the literature documenting and discussing virtual conferencing induced by the pandemic, the understanding of the phenomenon is limited. We provide recommendations for future research on academic virtual conferences: their impact on research productivity, quality, and collaboration; relations to social, economic, and geopolitical inequalities in science; and their environmental aspects.

We stress the need for further research encompassing the development of a theoretical framework that will guide empirical studies.

URL : https://arxiv.org/abs/2406.11583