Beyond journals and peer review: towards a more flexible ecosystem for scholarly communication

Author : Michael Wood

This article challenges the assumption that journals and peer review are essential for developing,evaluating and disseminating scientific and other academic knowledge. It suggests a more flexible ecosystem, and examines some of the possibilities this might facilitate. The market for academic outputs should be opened up by encouraging the separation of the dissemination service from the evaluation service.

Publishing research in subject-specific journals encourages compartmentalising research into rigid categories. The dissemination of knowledge would be better served by an open access, web-based repository system encompassing all disciplines. There would then be a role for organisations to assess the items in this repository to help users find relevant, high-quality work.

There could be a variety of such organisations which could enable reviews from peers to be supplemented with evaluation by non-peers from a variety of different perspectives: user reviews, statistical reviews, reviews from the perspective of different disciplines, and so on. This should reduce the inevitably conservative influence of relying on two or three peers, and make the evaluation system more critical, multi-dimensional and responsive to the requirements of different audience groups, changing circumstances, and new ideas.

Non-peer review might make it easier to challenge dominant paradigms, and expanding the potential audience beyond a narrow group of peers might encourage the criterion of simplicity to be taken more seriously – which is essential if human knowledge is to continue to progress.

Arxiv : https://arxiv.org/abs/1311.4566

Impact of publisher’s commercial or non-profit orientation on editorial practices: Moving towards a more strategic approach to supporting editorial staff

Author : Katarina Krapež

This study was guided by previous research highlighting the significance of journal publishers’ commercial or non-profit orientations in shaping academic editors’ perspectives regarding the necessity of enhancing editorial and business practices. There is limited understanding of how the editor–publisher relationship varies based on publishers’ commercial orientation.

This study revealed five key factors influencing editors’ attitudes towards how publishers strive to provide high-quality publications: (i) availability of high-quality publication services; (ii) sufficient technological support and access to visibility-related data; (iii) accessible marketing and indexing services; (iv) access to continuous education for the editorial team; and (v) a balance between editorial autonomy and publisher support in managing the journal.

The study indicated that editors partnering with commercial publishers tended to receive more extensive and advanced services, better technological support, and more training opportunities, contributing to the production of superior end products.

However, working with commercial publishers resulted in the trade-off of less editorial independence, which sometimes compromised editors’ decision-making ability and made them feel uncertain about their further involvement. The study’s findings highlighted the importance of publishers adopting a more strategic approach to support their editorial staff, while considering the unique needs of each journal.

URL : Impact of publisher’s commercial or non-profit orientation on editorial practices: Moving towards a more strategic approach to supporting editorial staff

DOI : https://doi.org/10.1002/leap.1575

Implementing the Declaration on Research Assessment: a publisher case study

Authors : Victoria Gardner, Mark Robinson, Elisabetta O’Connell

There has been much debate around the role of metrics in scholarly communication, with particular focus on the misapplication of journal metrics, such as the impact factor in the assessment of research and researchers.

Various initiatives have advocated for a change in this culture, including the Declaration on Research Assessment (DORA), which invites stakeholders throughout the scholarly communication ecosystem to sign up and show their support for practices designed to address the misuse of metrics.

This case study provides an overview of the process undertaken by a large academic publisher (Taylor & Francis Group) in signing up to DORA and implementing some of its key practices in the hope that it will provide some guidance to others considering becoming a signatory.

Our experience suggests that research, consultation and flexibility are crucial components of the process. Additionally, approaching signing with a project mindset versus a ‘sign and forget’ mentality can help organizations to understand the practical implications of signing, to anticipate and mitigate potential obstacles and to support cultural change.

URL : Implementing the Declaration on Research Assessment: a publisher case study

DOI : http://doi.org/10.1629/uksg.573

Reshaping How Universities Can Evaluate the Research Impact of Open Humanities for Societal Benefit

Authors : Paul Longley Arthur, Lydia Hearn

During the twenty-first century, for the first time, the volume of digital data has surpassed the amount of analog data. As academic practices increasingly become digital, opportunities arise to reshape the future of scholarly communication through more accessible, interactive, open, and transparent methods that engage a far broader and more diverse public.

Yet despite these advances, the research performance of universities and public research institutes remains largely evaluated through publication and citation analysis rather than by public engagement and societal impact.

This article reviews how changes to bibliometric evaluations toward greater use of altmetrics, including social media mentions, could enhance uptake of open scholarship in the humanities.

In addition, the article highlights current challenges faced by the open scholarship movement, given the complexity of the humanities in terms of its sources and outputs that include monographs, book chapters, and journals in languages other than English; the use of popular media not considered as scholarly papers; the lack of time and energy to develop digital skills among research staff; problems of authority and trust regarding the scholarly or non-academic nature of social media platforms; the prestige of large academic publishing houses; and limited awareness of and familiarity with advanced digital applications.

While peer review will continue to be a primary method for evaluating research in the humanities, a combination of altmetrics and other assessment of research impact through different data sources may provide a way forward to ensure the increased use, sustainability, and effectiveness of open scholarship in the humanities.

DOI : https://doi.org/10.3998/jep.788

We Can Make a Better Use of ORCID: Five Observed Misapplications

Authors : Miriam Baglioni, Paolo Manghi, Andrea Mannocci, Alessia Bardi

Since 2012, the “Open Researcher and Contributor ID” organisation (ORCID) has been successfully running a worldwide registry, with the aim of “providing a unique, persistent identifier for individuals to use as they engage in research, scholarship, and innovation activities”.

Any service in the scholarly communication ecosystem (e.g., publishers, repositories, CRIS systems, etc.) can contribute to a non-ambiguous scholarly record by including, during metadata deposition, referrals to iDs in the ORCID registry.

The OpenAIRE Research Graph is a scholarly knowledge graph that aggregates both records from the ORCID registry and publication records with ORCID referrals from publishers and repositories worldwide to yield research impact monitoring and Open Science statistics.

Graph data analytics revealed “anomalies” due to ORCID registry “misapplications”, caused by wrong ORCID referrals and misexploitation of the ORCID registry. Albeit these affect just a minority of ORCID records, they inevitably affect the quality of the ORCID infrastructure and may fuel the rise of detractors and scepticism about the service.

In this paper, we classify and qualitatively document such misapplications, identifying five ORCID registrant-related and ORCID referral-related anomalies to raise awareness among ORCID users.

We describe the current countermeasures taken by ORCID and, where applicable, provide recommendations. Finally, we elaborate on the importance of a community-steered Open Science infrastructure and the benefits this approach has brought and may bring to ORCID.

URL : We Can Make a Better Use of ORCID: Five Observed Misapplications

DOI : http://doi.org/10.5334/dsj-2021-038

Trust in Scholarly Communications and Infrastructure: Indigenous Data Sovereignty

Author : Katharina Ruckstuhl

Many Indigenous people have a deep mistrust of research, with some describing research as one of the “dirtiest” words in Indigenous language. The histories and experiences behind such mistrust are long and painful.

Given what has been perceived as Indigenous objectification at the hands of largely Anglo-European others for research from which they fail to benefit, many communities now refuse research unless it is undertaken under certain, Indigenous-defined circumstances.

Such refusal is a move away from others’ purposes and a move towards autonomy and self-determination. For some, this is a statement of sovereignty and it applies to all areas of endeavour, including the new frontiers of research and the structures that support them, such as datification of knowledge.

This article examines data sovereignty from the perspective of Indigenous peoples. While data sovereignty has become a ubiquitous concern, Indigenous data sovereignty arises from contexts specific to Indigenous peoples.

The focus of this article is to provide a brief overview of recent data sovereignty developments, along with the context that lies behind these activities. Through this examination, implications for trust in scholarly communications will be discussed.

URL : Trust in Scholarly Communications and Infrastructure: Indigenous Data Sovereignty

DOI : https://doi.org/10.3389/frma.2021.752336

Perspectives on Open Science and The Future of Scholarly Communication: Internet Trackers and Algorithmic Persuasion

Authors : Tiberius Ignat, Paul Ayris, Beatrice Gini, Olga Stepankova, Deniz Özdemir, Damla Bal, Yordanka Deyanov

The current digital content industry is heavily oriented towards building platforms that track users’ behaviour and seek to convince them to stay longer and come back sooner onto the platform. Similarly, authors are incentivised to publish more and to become champions of dissemination.

Arguably, these incentive systems are built around public reputation supported by a system of metrics, hard to be assessed. Generally, the digital content industry is permeable to non-human contributors (algorithms that are able to generate content and reactions), anonymity and identity fraud. It is pertinent to present a perspective paper about early signs of track and persuasion in scholarly communication.

Building our views, we have run a pilot study to determine the opportunity for conducting research about the use of “track and persuade” technologies in scholarly communication. We collected observations on a sample of 148 relevant websites and we interviewed 15 that are experts related to the field.

Through this work, we tried to identify 1) the essential questions that could inspire proper research, 2) good practices to be recommended for future research, and 3) whether citizen science is a suitable approach to further research in this field.

The findings could contribute to determining a broader solution for building trust and infrastructure in scholarly communication. The principles of Open Science will be used as a framework to see if they offer insights into this work going forward.

URL : Perspectives on Open Science and The Future of Scholarly Communication: Internet Trackers and Algorithmic Persuasion

DOI : https://doi.org/10.3389/frma.2021.748095