Catégorie : EN

Publié le

What Is Wrong With the Current Evaluative Bibliometrics?

Author : Endel Põder

Bibliometric data are relatively simple and describe objective processes of publishing articles and citing others. It seems quite straightforward to define reasonable measures of a researcher’s productivity, research quality, or overall performance based on these data. Why do we still have no acceptable bibliometric measures of scientific performance?

Instead, there are hundreds of indicators with nobody knowing how to use them. At the same time, an increasing number of researchers and some research fields have been excluded from the standard bibliometric analysis to avoid manifestly contradictive conclusions.

I argue that the current biggest problem is the inadequate rule of credit allocation for multiple authored articles in mainstream bibliometrics. Clinging to this historical choice excludes any systematic and logically consistent bibliometrics-based evaluation of researchers, research groups, and institutions.

During the last 50 years, several authors have called for a change. Apparently, there are no serious methodologically justified or evidence-based arguments in the favor of the present system.

However, there are intractable social, psychological, and economical issues that make adoption of a logically sound counting system almost impossible.

URL : What Is Wrong With the Current Evaluative Bibliometrics?

DOI : https://doi.org/10.3389/frma.2021.824518

Publié le

Evaluation and Merit-Based Increase in Academia: A Case Study in the First Person

Author : Christine Musselin

This article provides a reflexive account of the process of defining and implementing a mechanism to evaluate a group of academics in a French higher education institution. The situation is a rather unusual case for France, as the assessed academics are not civil servants but are employed by their university and this evaluation leads to merit-based salary increases.

To improve and implement this strategy was one of the author’s tasks, when she was vice-president for research at the institution in this case.

The article looks at this experience retrospectively, emphasizing three issues of particular relevance in the context of discussions about valuation studies and management proposed in this symposium: (1) the decision to distinguish between different types of profiles and thus categorize, or to apply the same criteria to all; (2) the concrete forms of commensuration to be developed in order to be able to evaluate and rank individuals from different disciplines; (3) the quantification of qualitative appreciation, i.e. their transformation into merit-based salary increases.

URL : Evaluation and Merit-Based Increase in Academia: A Case Study in the First Person

DOI : https://doi.org/10.3384/VS.2001-5992.2021.8.2.73-88

Publié le

The Rise of the Guest Editor—Discontinuities of Editorship in Scholarly Publishing

Authors : Marcel Knöchelmann, Felicitas Hesselmann, Martin Reinhart, Cornelia Schendzielorz

Scholarly publishing lives on traditioned terminology that gives meaning to subjects such as authors, inhouse editors and external guest editors, artifacts such as articles, journals, special issues, and collected editions, or practices of acquisition, selection, and review.

These subjects, artifacts, and practices ground the constitution of scholarly discourse. And yet, the meaning ascribed to each of these terms shifts, blurs, or is disguised as publishing culture shifts, which becomes manifest in new digital publishing technology, new forms of publishing management, and new forms of scholarly knowledge production.

As a result, we may come to over- or underestimate changes in scholarly communication based on traditioned but shifting terminology. In this article, we discuss instances of scholarly publishing whose meaning shifted.

We showcase the cultural shift that becomes manifest in the new, prolific guest editor. Though the term suggests an established subject, this editorial role crystallizes a new cultural setting of loosened discourse communities and temporal structures, a blurring of publishing genres and, ultimately, the foundations of academic knowledge production.

URL : The Rise of the Guest Editor—Discontinuities of Editorship in Scholarly Publishing

DOI : https://doi.org/10.3389/frma.2021.748171

Publié le

Barriers to Full Participation in the Open Science Life Cycle among Early Career Researchers

Authors : Natasha J. Gownaris, Koen Vermeir, Martin-Immanuel Bittner, Lasith Gunawardena, Sandeep Kaur-Ghumaan, Robert Lepenies, Godswill Ntsomboh Ntsefong, Ibrahim Sidi Zakari

Open science (OS) is currently dominated by a small subset of practices that occur late in the scientific process. Early career researchers (ECRs) will play a key role in transitioning the scientific community to more widespread use of OS from pre-registration to publication, but they also face unique challenges in adopting these practices. Here, we discuss these challenges across the OS life cycle.

Our essay relies on the published literature, an informal survey of 32 ECRs from 14 countries, and discussions among members of the Global Working Group on Open Science (Global Young Academy and National Young Academies).

We break the OS life cycle into four stages—study design and tracking (pre-registration, open processes), data collection (citizen science, open hardware, open software, open data), publication (open access publishing, open peer review, open data), and outreach (open educational resources, citizen science)—and map potential barriers at each stage.

The most frequently discussed barriers across the OS life cycle were a lack of awareness and training, prohibitively high time commitments, and restrictions and/or a lack of incentives by supervisors.

We found that OS practices are highly fragmented and that awareness is particularly low for OS practices that occur during the study design and tracking stage, possibly creating ‘path-dependencies’ that reduce the likelihood of OS practices at later stages.

We note that, because ECRs face unique barriers to adopting OS, there is a need for specifically targeted policies such as mandatory training at the graduate level and promotion incentives.

URL : Barriers to Full Participation in the Open Science Life Cycle among Early Career Researchers

DOI : http://doi.org/10.5334/dsj-2022-002

Publié le

Two-dimensional books for the new Open Access academic publishing

Author : Fulvio Guatelli

Metadata have become a key element of scientific communication. Indeed, the content of a publication – that is, what we love, discuss and judge – is no longer the alpha and omega of a scientific publication nor its exclusive centre of gravity. Books are gradually taking the form of an iceberg, whose visible part is represented by the content, while the submerged part is constituted by metadata.

In the current communication approach of scientific research, metadata and dissemination go hand in hand, as metadata provide a huge contribution to the success of the research itself.

In this paper, I will illustrate how – in the field of today’s scholarly publishing – best practices, simple metadata, and cataloguing indicators such as DOI and ORCID are taking on the task that was once accomplished by chariots pulled by sturdy horses coming out of Aldo Manuzio’s workshop: spreading books and the discoveries of scientific research all over the world.

URL : Two-dimensional books for the new Open Access academic publishing

Original location : https://jlis.fupress.net/index.php/jlis/article/view/425

Publié le

The impact of the pandemic on early career researchers: what we already know from the internationally published literature

Authors : Eti Herman, David Nicholas, Anthony Watkinson, Blanca Rodríguez-Bravo, Abdullah Abrizah, Chérifa Boukacem-Zeghmouri, Hamid R. Jamali, David Sims, Suzie Allard, Carol Tenopir, Jie Xu, Marzena Świgoń, Galina Serbina, Leah Parke Cannon

In order to take account of the impact of the pandemic on the already changing scholarly communications and work-life of early career researchers (ECRs), the 4-year long Harbingers study was extended for another two years.

As a precursor to the study (featuring interviews and a questionnaire survey), currently underway, an analytic review of the pertinent literature was undertaken and its results are presented here.

The review focuses on the challenges faced by ECRs and how these compare to the ones more senior researchers have to tackle. In the examination of the literature three general questions are posed: Q1) What are the identifiable and forthcoming impacts of the pandemic-induced financial pressures felt in the Higher Education sector on ECRs’ employment and career development prospects? Q2) What are the identifiable and forthcoming pandemic-associated disruptions in the pace/focus/direction of the research undertaking? Have any disruptions been predicted to exert an impact on ECRs’ research activities, and if so, with what scholarly consequences? Q3) How is the work-life of ECRs shaping up under the virus-dictated rules of the ‘new normal’ in the research undertaking? What challenges, if any, arise from the changes in practices identified, and what might their potential consequences be for ECRs?

The broad conclusion of the study is that the literature leaves little room for doubt: junior researchers are already disproportionally affected by and bear the burden of the ongoing pandemic-incurred hardships and they are likely to remain similarly impacted when more trials, still unfolding, materialise.

DOI : https://doi.org/10.3145/epi.2021.mar.08