Archives des auteurs : Hans Dillaerts

Indicators of research quality, quantity, openness and responsibility in institutional review, promotion and tenure policies across seven countries

Posté le par

Authors : Nancy Pontika, Thomas Klebel, Antonia Correia, Hannah Metzler, Petr Knoth, Tony Ross-Hellauer

The need to reform research assessment processes related to career advancement at research institutions has become increasingly recognised in recent years, especially to better foster open and responsible research practices. Current assessment criteria are believed to focus too heavily on inappropriate criteria related to productivity and quantity as opposed to quality, collaborative open research practices, and the socio-economic impact of research.

Evidence of the extent of these issues is urgently needed to inform actions for reform, however. We analyse current practices as revealed by documentation on institutional review, promotion and tenure processes in seven countries (Austria, Brazil, Germany, India, Portugal, United Kingdom and United States of America).

Through systematic coding and analysis of 143 RPT policy documents from 107 institutions for the prevalence of 17 criteria (including those related to qualitative or quantitative assessment of research, service to the institution or profession, and open and responsible research practices), we compare assessment practices across a range of international institutions to significantly broaden this evidence-base.

Although prevalence of indicators varies considerably between countries, overall we find that currently open and responsible research practices are minimally rewarded and problematic practices of quantification continue to dominate.

URL : Indicators of research quality, quantity, openness and responsibility in institutional review, promotion and tenure policies across seven countries

DOI : https://doi.org/10.1162/qss_a_00224

Data Quality Assurance at Research Data Repositories

Posté le par

Authors : Maxi Kindling, Dorothea Strecker

This paper presents findings from a survey on the status quo of data quality assurance practices at research data repositories. The personalised online survey was conducted among repositories indexed in re3data in 2021. It covered the scope of the repository, types of data quality assessment, quality criteria, responsibilities, details of the review process, and data quality information and yielded 332 complete responses.

The results demonstrate that most repositories perform data quality assurance measures, and overall, research data repositories significantly contribute to data quality. Quality assurance at research data repositories is multifaceted and nonlinear, and although there are some common patterns, individual approaches to ensuring data quality are diverse.

The survey showed that data quality assurance sets high expectations for repositories and requires a lot of resources. Several challenges were discovered: for example, the adequate recognition of the contribution of data reviewers and repositories, the path dependence of data review on review processes for text publications, and the lack of data quality information. The study could not confirm that the certification status of a repository is a clear indicator of whether a repository conducts in-depth quality assurance.

URL : Data Quality Assurance at Research Data Repositories

DOI : http://doi.org/10.5334/dsj-2022-018

The APC-Effect: Stratification in Open Access Publishing

Posté le par

Authors : Thomas Klebel,Tony Ross-Hellauer

Current implementations of Open Access (OA) publishing frequently involve Article Publishing Charges (APCs). Increasing evidence emerges that APCs impede researchers with fewer resources in publishing their research OA.

We analysed 1.5 million scientific articles from journals listed in the Directory of Open Access Journals to assess average APCs and their determinants for a comprehensive set of journal publications, across scientific disciplines, world regions and through time. Levels of APCs were strongly stratified by scientific fields and the institutions’ countries, corroborating previous findings on publishing cultures and the impact of mandates of research funders.

After controlling for country and scientific field with a multilevel mixture model, however, we found small to moderate effects of levels of institutional resourcing on the level of APCs. This is what we call the APC-Effect.

Effects were largest in countries with low GDP, suggesting decreasing marginal effects of institutional resources when general levels of funding are high. Our findings provide further evidence on how APCs stratify OA publishing and highlight the need for alternative publishing models.

DOI : https://doi.org/10.31222/osf.io/w5szk

Overlay journals: A study of the current landscape

Posté le par

Authors : Antti Mikael Rousi, Mikael Laakso

Overlay journals are characterised by their articles being published on open access repositories, often already starting in their initial preprint form as a prerequisite for submission to the journal prior to initiating the peer-review process.

In this study we aimed to identify currently active overlay journals and examine their characteristics. We utilised an explorative web search and contacted key service providers for additional information. The final sample consisted of 34 overlay journals.

While the results show that new overlay journals have been actively established within recent years, the current presence of overlay journals remains diminutive compared to the overall number of open access journals. Most overlay journals publish articles in natural sciences, mathematics or computer sciences, and are commonly published by groups of academics rather than formal organisations.

They may also rank highly within the traditional journal citation metrics. None of the investigated journals required fees from authors, which is likely related to the cost-effective aspects of the overlay publishing model.

Both the growth in adoption of open access preprint repositories and researchers’ willingness to publish in overlay journals will determine the model’s wider impact on scholarly publishing.

URL : Overlay journals: A study of the current landscape

DOI : https://doi.org/10.1177/09610006221125208

Who Writes Scholarly Code?

Posté le par

Authors : Sarah Nguyễn, Vicky Rampin

This paper presents original research about the behaviours, histories, demographics, and motivations of scholars who code, specifically how they interact with version control systems locally and on the Web.

By understanding patrons through multiple lenses – daily productivity habits, motivations, and scholarly needs – librarians and archivists can tailor services for software management, curation, and long-term reuse, raising the possibility for long-term reproducibility of a multitude of scholarship.

URL : Who Writes Scholarly Code?

DOI: https://doi.org/10.2218/ijdc.v17i1.839

Research integrity guidelines in the academic environment: The context of Brazilian institutions with retracted publications in health and life sciences

Posté le par

Authors : Rafaelly Stavale, Vanja Pupovac, Graziani Izidoro Ferreira, Dirce Bellezi Guilhem

Although research misconduct is responsible for most retractions in health and life sciences from authors affiliated with Brazilian institutions, there are few studies evaluating retraction notices and research misconduct in the country.

Understanding the form of research misconduct may share light on the weaknesses and strengths of individual, organizational, and structural factors toward the implementation of a research integrity culture.

This review on policies and practices aims to access the available information from research integrity offices and the guidelines from Brazilian funding institutions and universities who were involved in retractions in health and life science publications based on a previously published systematic review.

Additionally, we summarize the available guidelines and policies for research integrity in the country. Additionally, we searched publicly available guidelines and offices for research integrity.

In total, 15 institutions were analyzed: five funding agencies and 10 universities. Approximately 40% of the funding agencies promoted local research, and 60% promoted national research. Considering national funding agencies, 66% had the commission on research integrity. Approximately 30% of the universities do not have the official office for research integrity or any publicly available guidelines.

Most institutions involved in retractions due to some form of research misconduct. Brazilian institutions involved in publication retractions lack instruments to prevent, supervise, and sanction research misconduct. Institutions of the country have insufficiently developed a system to promote and sustain research integrity practices.

Nevertheless, there is a positive movement of researchers who are engaged in the investigation of research integrity, policy creation and training.

This study emphasizes increased influence of Brazilian scientific collaboration and production globally as well as the impact of retractions in medical sciences. In contrast, it addresses the need for clear research integrity policies to foster high-quality and trustworthy research.

URL : Research integrity guidelines in the academic environment: The context of Brazilian institutions with retracted publications in health and life sciences

DOI : https://doi.org/10.3389/frma.2022.991836

Analysis of predatory emails in early career academia and attempts at prevention

Posté le par

Author : Owen W. Tomlinson

Predatory publishers—those who do not adhere to rigorous standards of academic practice such as peer review—are increasingly infiltrating biomedical databases, to the detriment of the wider scientific community. These publishers frequently send unsolicited ‘spam’ emails to generate submission to their journals, with early career researchers (ECR) particularly susceptible to these practices because of pressures such as securing employment and promotion.

This analysis sought to record and characterize the emails received over the course of a PhD and post-doctoral position (~8 years), as well as attempts to unsubscribe from such emails, using a progressive and step-wise manner. A total of 1,280 emails identified as academic spam were received (990 journal invitations, 220 conference invitations, 70 ‘other’).

The first email was received 3 months after registration for an international conference. Attempts at unsubscribing were somewhat effective, whereby implications of reporting to respective authorities resulted in a 43% decrease in emails, although did not eliminate them completely, and therefore alternative approaches to eliminating academic spam may be needed.

Ongoing education about predatory publishers, as well as action by key academic stakeholders, should look to reduce the impact these predatory publishers have upon the wider literature base.

URL : Analysis of predatory emails in early career academia and attempts at prevention

DOI : https://doi.org/10.1002/leap.1500