Evaluation and Merit-Based Increase in Academia: A Case Study in the First Person

Author : Christine Musselin

This article provides a reflexive account of the process of defining and implementing a mechanism to evaluate a group of academics in a French higher education institution. The situation is a rather unusual case for France, as the assessed academics are not civil servants but are employed by their university and this evaluation leads to merit-based salary increases.

To improve and implement this strategy was one of the author’s tasks, when she was vice-president for research at the institution in this case.

The article looks at this experience retrospectively, emphasizing three issues of particular relevance in the context of discussions about valuation studies and management proposed in this symposium: (1) the decision to distinguish between different types of profiles and thus categorize, or to apply the same criteria to all; (2) the concrete forms of commensuration to be developed in order to be able to evaluate and rank individuals from different disciplines; (3) the quantification of qualitative appreciation, i.e. their transformation into merit-based salary increases.

URL : Evaluation and Merit-Based Increase in Academia: A Case Study in the First Person

DOI : https://doi.org/10.3384/VS.2001-5992.2021.8.2.73-88

The Rise of the Guest Editor—Discontinuities of Editorship in Scholarly Publishing

Authors : Marcel Knöchelmann, Felicitas Hesselmann, Martin Reinhart, Cornelia Schendzielorz

Scholarly publishing lives on traditioned terminology that gives meaning to subjects such as authors, inhouse editors and external guest editors, artifacts such as articles, journals, special issues, and collected editions, or practices of acquisition, selection, and review.

These subjects, artifacts, and practices ground the constitution of scholarly discourse. And yet, the meaning ascribed to each of these terms shifts, blurs, or is disguised as publishing culture shifts, which becomes manifest in new digital publishing technology, new forms of publishing management, and new forms of scholarly knowledge production.

As a result, we may come to over- or underestimate changes in scholarly communication based on traditioned but shifting terminology. In this article, we discuss instances of scholarly publishing whose meaning shifted.

We showcase the cultural shift that becomes manifest in the new, prolific guest editor. Though the term suggests an established subject, this editorial role crystallizes a new cultural setting of loosened discourse communities and temporal structures, a blurring of publishing genres and, ultimately, the foundations of academic knowledge production.

URL : The Rise of the Guest Editor—Discontinuities of Editorship in Scholarly Publishing

DOI : https://doi.org/10.3389/frma.2021.748171

Barriers to Full Participation in the Open Science Life Cycle among Early Career Researchers

Authors : Natasha J. Gownaris, Koen Vermeir, Martin-Immanuel Bittner, Lasith Gunawardena, Sandeep Kaur-Ghumaan, Robert Lepenies, Godswill Ntsomboh Ntsefong, Ibrahim Sidi Zakari

Open science (OS) is currently dominated by a small subset of practices that occur late in the scientific process. Early career researchers (ECRs) will play a key role in transitioning the scientific community to more widespread use of OS from pre-registration to publication, but they also face unique challenges in adopting these practices. Here, we discuss these challenges across the OS life cycle.

Our essay relies on the published literature, an informal survey of 32 ECRs from 14 countries, and discussions among members of the Global Working Group on Open Science (Global Young Academy and National Young Academies).

We break the OS life cycle into four stages—study design and tracking (pre-registration, open processes), data collection (citizen science, open hardware, open software, open data), publication (open access publishing, open peer review, open data), and outreach (open educational resources, citizen science)—and map potential barriers at each stage.

The most frequently discussed barriers across the OS life cycle were a lack of awareness and training, prohibitively high time commitments, and restrictions and/or a lack of incentives by supervisors.

We found that OS practices are highly fragmented and that awareness is particularly low for OS practices that occur during the study design and tracking stage, possibly creating ‘path-dependencies’ that reduce the likelihood of OS practices at later stages.

We note that, because ECRs face unique barriers to adopting OS, there is a need for specifically targeted policies such as mandatory training at the graduate level and promotion incentives.

URL : Barriers to Full Participation in the Open Science Life Cycle among Early Career Researchers

DOI : http://doi.org/10.5334/dsj-2022-002

The impact of the pandemic on early career researchers: what we already know from the internationally published literature

Authors : Eti Herman, David Nicholas, Anthony Watkinson, Blanca Rodríguez-Bravo, Abdullah Abrizah, Chérifa Boukacem-Zeghmouri, Hamid R. Jamali, David Sims, Suzie Allard, Carol Tenopir, Jie Xu, Marzena Świgoń, Galina Serbina, Leah Parke Cannon

In order to take account of the impact of the pandemic on the already changing scholarly communications and work-life of early career researchers (ECRs), the 4-year long Harbingers study was extended for another two years.

As a precursor to the study (featuring interviews and a questionnaire survey), currently underway, an analytic review of the pertinent literature was undertaken and its results are presented here.

The review focuses on the challenges faced by ECRs and how these compare to the ones more senior researchers have to tackle. In the examination of the literature three general questions are posed: Q1) What are the identifiable and forthcoming impacts of the pandemic-induced financial pressures felt in the Higher Education sector on ECRs’ employment and career development prospects? Q2) What are the identifiable and forthcoming pandemic-associated disruptions in the pace/focus/direction of the research undertaking? Have any disruptions been predicted to exert an impact on ECRs’ research activities, and if so, with what scholarly consequences? Q3) How is the work-life of ECRs shaping up under the virus-dictated rules of the ‘new normal’ in the research undertaking? What challenges, if any, arise from the changes in practices identified, and what might their potential consequences be for ECRs?

The broad conclusion of the study is that the literature leaves little room for doubt: junior researchers are already disproportionally affected by and bear the burden of the ongoing pandemic-incurred hardships and they are likely to remain similarly impacted when more trials, still unfolding, materialise.

DOI : https://doi.org/10.3145/epi.2021.mar.08

We Can Make a Better Use of ORCID: Five Observed Misapplications

Authors : Miriam Baglioni, Paolo Manghi, Andrea Mannocci, Alessia Bardi

Since 2012, the “Open Researcher and Contributor ID” organisation (ORCID) has been successfully running a worldwide registry, with the aim of “providing a unique, persistent identifier for individuals to use as they engage in research, scholarship, and innovation activities”.

Any service in the scholarly communication ecosystem (e.g., publishers, repositories, CRIS systems, etc.) can contribute to a non-ambiguous scholarly record by including, during metadata deposition, referrals to iDs in the ORCID registry.

The OpenAIRE Research Graph is a scholarly knowledge graph that aggregates both records from the ORCID registry and publication records with ORCID referrals from publishers and repositories worldwide to yield research impact monitoring and Open Science statistics.

Graph data analytics revealed “anomalies” due to ORCID registry “misapplications”, caused by wrong ORCID referrals and misexploitation of the ORCID registry. Albeit these affect just a minority of ORCID records, they inevitably affect the quality of the ORCID infrastructure and may fuel the rise of detractors and scepticism about the service.

In this paper, we classify and qualitatively document such misapplications, identifying five ORCID registrant-related and ORCID referral-related anomalies to raise awareness among ORCID users.

We describe the current countermeasures taken by ORCID and, where applicable, provide recommendations. Finally, we elaborate on the importance of a community-steered Open Science infrastructure and the benefits this approach has brought and may bring to ORCID.

URL : We Can Make a Better Use of ORCID: Five Observed Misapplications

DOI : http://doi.org/10.5334/dsj-2021-038