Problematizing Peer Review: Academic Librarians’ Pedagogical Approaches to Peer Review

Posté le par

Authors : Lana Mariko Wood, Gr Keer

INTRODUCTION

This study is the first to consider how academic librarians’ understanding of and participation in the peer review process influences their information literacy pedagogy and practice.

METHODS

This mixed-methods study uses a modified sequential explanatory design, beginning with a survey of academic librarians in the United States and Canada, followed by interviews with interested study participants.

RESULTS & DISCUSSION

The researchers find that academic librarians frequently teach about peer review, but approaches vary widely, and though some have adapted the Framework to fit their instruction about peer review, there are no best practices.

Instructor demands, the length of instructional sessions, and student level influence whether and how academic librarians contextualize the peer review process. While some academic librarians draw from their personal experience in the peer review process as authors, reviewers, and/or editors in their teaching, academic librarians do not consistently report their personal experience as an influence on their teaching of the peer review process to students.

CONCLUSION

This article argues that academic librarians should consider the place of peer review in information literacy instruction, including interrogating how scaffolding instruction about peer review may provide a disservice to students from an equity perspective.

The authors urge academic librarians who have it to draw on personal experience to contextualize their instruction about peer review.

URL : Problematizing Peer Review: Academic Librarians’ Pedagogical Approaches to Peer Review

DOI : https://doi.org/10.7710/2162-3309.2399

Does Conflict of Interest Distort Global University Rankings?

Posté le par

Author : Igor Chirikov

Global university rankings influence students’ choices and higher education policies throughout the world. When rankers not only evaluate universities but also provide them with consulting, analytics, or advertising services rankers are vulnerable to conflicts of interest that may potentially distort their rankings.

The paper assesses the impact of contracting with rankers on university ranking outcomes using difference-in-difference research design. The study matches data on the positions of 28 Russian universities in QS World University Rankings between 2016 and 2021 with information on contracts these universities had for services from QS – a company that produces these rankings.

The study estimates the effects of the conflicts of interest with two difference-in-difference models. The first model compares the difference in five-year change in rankings between QS rankings and Times Higher Education (THE) rankings across two groups of universities – those that frequently (five times or more) contracted for QS services, and those that never or seldomly contracted for QS services.

The second model compares the difference in five-year change in faculty-student ratios – between scores in QS rankings, THE rankings, and scores recorded by national statistics – across the same two groups of universities.

The results suggest universities with frequent QS-related contracts had an increase of 0.75 standard deviations (~140 positions) in QS World University Rankings and an increase of 0.9 standard deviations in reported QS faculty-student ratio scores over five years, regardless of changes in the institutional quality.

The study calls for universities, governments, and prospective students to reconsider their use of global rankings where conflicts of interest may be generated by the ranker’s business activities.

URL : https://escholarship.org/uc/item/8hk672nh

Data Management Plans in Horizon 2020: what beneficiaries think and what we can learn from their experience

Posté le par

Author : Daniel Spichtinger

Background

Data Management Plans (DMPs) are at the heart of many research funder requirements for data management and open data, including the EU’s Framework Programme for Research and Innovation, Horizon 2020. This article provides a summary of the findings of the DMP Use Case study, conducted as part of OpenAIRE Advance.

Methods

As part of the study we created a vetted collection of over 800 Horizon 2020 DMPs. Primarily, however, we report the results of qualitative interviews and a quantitative survey on the experience of Horizon 2020 projects with DMPs.

Results & Conclusions

We find that a significant number of projects had to develop a DMP for the first time in the context of Horizon 2020, which points to the importance of funder requirements in spreading good data management practices. In total, 82% of survey respondents found DMPs useful or partially useful, beyond them being “just” an European Commission (EC) requirement.

DMPs are most prominently developed within a project’s Management Work Package. Templates were considered important, with 40% of respondents using the EC/European Research Council template. However, some argue for a more tailor-made approach.

The most frequent source for support with DMPs were other project partners, but many beneficiaries did not receive any support at all. A number of survey respondents and interviewees therefore ask for a dedicated contact point at the EC, which could take the form of an EC Data Management Helpdesk, akin to the IP helpdesk.

If DMPs are published, they are most often made available on the project website, which, however, is often taken offline after the project ends. There is therefore a need to further raise awareness on the importance of using repositories to ensure preservation and curation of DMPs.

The study identifies IP and licensing arrangements for DMPs as promising areas for further research.

URL : Data Management Plans in Horizon 2020: what beneficiaries think and what we can learn from their experience

DOI : https://doi.org/10.12688/openreseurope.13342.1

The Changing Landscape of Open Access Publishing: Can Open Access Publishing Make the Scholarly World More Equitable and Productive?

Posté le par

Author : Richard G. Dudley

Almost 50% of scholarly articles are now open access in some form. This greatly benefits scholars at most institutions and is especially helpful to independent scholars and those without access to libraries. It also furthers the long-standing idea of knowledge as a public good.

The changing dynamics of open access (OA) threaten this positive development by solidifying the pay-to-publish OA model which further marginalizes peripheral scholars and incentivizes the development of sub-standard and predatory journals. Causal loop diagrams (CLDs) are used to illustrate these interactions.

URL : The Changing Landscape of Open Access Publishing: Can Open Access Publishing Make the Scholarly World More Equitable and Productive?

DOI : https://doi.org/10.7710/2162-3309.2345

Le partage des données vu par les chercheurs : une approche par la valeur

Posté le par

Auteur/Author : Violaine Rebouillat

Le propos de cet article porte sur la compréhension des logiques qui interviennent dans la définition de la valeur des données de la recherche, celles-ci pouvant avoir une influence sur les critères déterminant leur motivation au partage.

L’approche méthodologique repose sur une enquête qualitative, menée dans le cadre d’une recherche doctorale, qui a déployé 57 entretiens semi-directifs. Alors que les travaux menés autour des données sont focalisés sur les freins et motivations du partage, l’originalité de cette recherche consiste à identifier les différents prismes par lesquels la question de la valeur des données impacte la motivation et la décision de leur partage.

L’analyse des résultats montre que, tous domaines confondus, la valeur des données reste encore cristallisée autour de la publication et de la reconnaissance symbolique du travail du chercheur.

Les résultats permettent de comprendre que la question du partage est confrontée à un impensé : celui du cadre actuel de l’évaluation de la recherche, qui met l’article scientifique au cœur de son dispositif.

Ce travail contribue donc à montrer que l’avenir du partage des données dépend des systèmes alternatifs futurs d’évaluation de la recherche, associés à la science ouverte.

URL : https://lesenjeux.univ-grenoble-alpes.fr/2021/varia/03-le-partage-des-donnees-vu-par-les-chercheurs-une-approche-par-la-valeur/

Transparency, provenance and collections as data: the National Library of Scotland’s Data Foundry

Posté le par

Author : Sarah Ames

‘Collections as data’ has become a core activity for libraries in recent years: it is important that we make collections available in machine-readable formats to enable and encourage computational research. However, while this is a necessary output, discussion around the processes and workflows required to turn collections into data, and to make collections data available openly, are just as valuable.

With libraries increasingly becoming producers of their own collections – presenting data from digitisation and digital production tools as part of datasets, for example – and making collections available at scale through mass-digitisation programmes, the trustworthiness of our processes comes into question.

In a world of big data, often of unclear origins, how can libraries be transparent about the ways in which collections are turned into data, how do we ensure that biases in our collections are recognised and not amplified, and how do we make these datasets available openly for reuse?

This paper presents a case study of work underway at the National Library of Scotland to present collections as data in an open and transparent way – from establishing a new Digital Scholarship Service, to workflows and online presentation of datasets.

It considers the changes to existing processes needed to produce the Data Foundry, the National Library of Scotland’s open data delivery platform, and explores the practical challenges of presenting collections as data online in an open, transparent and coherent manner.

URL : Transparency, provenance and collections as data: the National Library of Scotland’s Data Foundry

Original location : https://www.liberquarterly.eu/article/10.18352/lq.10371/

Modes d’évaluation ouverte par les pairs : de la revue à la plateforme

Posté le par

Auteurs/Authors : Evelyne Broudoux, Madjid Ihadjadene

Cet article a pour but de proposer un état de l’art des différentes formes de l’évaluation d’articles ou de communications par les pairs. De l’évaluation « aveugle» à l’évaluation « ouverte », de multiples possibilités existent et sont expérimentées.

C’est dans le champ des sciences que l’on trouve le plus d’innovations sociotechniques s’appuyant sur des plateformes de publication modélisant des workflows éditoriaux originaux.

L’ouverture de l’évaluation peut se produire entre pairs, en rendant publiques les identités et/ou les rapports des évaluateurs, à différents stades de l’article scientifique : préprint, en cours de rédaction, ou encore après publication.

Cet état de l’art est basé sur un ensemble de publications essentiellement produites par les acteurs de l’évaluation ouverte, issus principalement des disciplines STM.

URL : Modes d’évaluation ouverte par les pairs : de la revue à la plateforme

URL : https://revue-cossi.numerev.com/articles/revue-9/2496-modes-d-evaluation-ouverte-par-les-pairs-de-la-revue-a-la-plateforme