Open Up: A Survey on Open and Non-anonymized Peer Reviewing

Authors : Lonni Besançon, Niklas Rönnberg, Jonas Löwgren, Jonathan P. Tennant, Matthew Cooper

We present a discussion and analysis regarding the benefits and limitations of open and non-anonymized peer review based on literature results and responses to a survey on the reviewing process of alt.chi, a more or less open-review track within the CHI conference, the predominant conference in the field of human-computer interaction (HCI).

This track currently is the only implementation of an open-peer-review process in the field of HCI while, with the recent increase in interest in open science practices, open review is now being considered and used in other fields.

We collected 30 responses from alt.chi authors and reviewers and found that, while the benefits are quite clear and the system is generally well liked by alt.chi participants, they are reluctant to see it used in other venues.

This concurs with a number of recent studies that suggest a divergence between support for a more open review process and its practical implementation. The data and scripts are available on https://osf.io/vuw7h/, and the figures and follow-up work on http://tiny.cc/OpenReviews.

URL : Open Up: A Survey on Open and Non-anonymized Peer Reviewing

Alternative location : https://www.preprints.org/manuscript/201905.0098/v2

 

A Crisis in “Open Access”: Should Communication Scholarly Outputs Take 77 Years to Become Open Access?

Authors : Abbas Ghanbari Baghestan, Hadi Khaniki, Abdolhosein Kalantari, Mehrnoosh Akhtari-Zavare, Elaheh Farahmand, Ezhar Tamam, Nader Ale Ebrahim, Havva Sabani, Mahmoud Danaee

This study diachronically investigates the trend of the “open access” in the Web of Science (WoS) category of “communication.” To evaluate the trend, data were collected from 184 categories of WoS from 1980 to 2017.

A total of 87,997,893 documents were obtained, of which 95,304 (0.10%) were in the category of “communication.” In average, 4.24% of the documents in all 184 categories were open access. While in communication, it was 3.29%, which ranked communication 116 out of 184.

An Open Access Index (OAI) was developed to predict the trend of open access in communication. Based on the OAI, communication needs 77 years to fully reach open access, which undeniably can be considered as “crisis in scientific publishing” in this field.

Given this stunning information, it is the time for a global call for “open access” by communication scholars across the world. Future research should investigate whether the current business models of publications in communication scholarships are encouraging open access or pose unnecessary restrictions on knowledge development.

URL : A Crisis in “Open Access”: Should Communication Scholarly Outputs Take 77 Years to Become Open Access?

DOI : https://doi.org/10.1177/2158244019871044

Evolution of an Institutional Repository: A Case History from Nebraska

Author : Paul Royster

The 13-year history of the institutional repository (IR) at the University of Nebraska–Lincoln is recounted with emphasis on local conditions, administrative support, recruitment practices, and management philosophy.

Practices included offering new services, hosting materials outside the conventional tenure stream, using student employees, and providing user analytics on global dissemination. Acquiring trust of faculty depositors enhanced recruitment and extra-library support.

Evolution of policies on open access, copyright, metadata, and third-party vendors are discussed, with statistics illustrating the growth, contents, and outreach of the repository over time.

A final section discusses future directions for scholarly communications and IRs in particular.

URL : https://digitalcommons.unl.edu/libraryscience/382/

Assessing the Quality of Scientific Papers

Authors : Roman Vainshtein, Gilad Katz, Bracha Shapira, Lior Rokach

A multitude of factors are responsible for the overall quality of scientific papers, including readability, linguistic quality, fluency,semantic complexity, and of course domain-specific technical factors.

These factors vary from one field of study to another. In this paper, we propose a measure and method for assessing the overall quality of the scientific papers in a particular field of study.

We evaluate our method in the computer science domain, but it can be applied to other technical and scientific fields.Our method is based on the corpus linguistics technique. This technique enables the extraction of required information and knowledge associated with a specific domain.

For this purpose, we have created a large corpus, consisting of papers from very high impact conferences. First, we analyze this corpus in order to extract rich domain-specific terminology and knowledge.

Then we use the acquired knowledge to estimate the quality of scientific papers by applying our proposed measure. We examine our measure on high and low scientific impact test corpora.

Our results show a significant difference in the measure scores of the high and low impact test corpora. Second, we develop a classifier based on our proposed measure and compare it to the baseline classifier.

Our results show that the classifier based on our measure over-performed the baseline classifier. Based on the presented results the proposed measure and the technique can be used for automated assessment of scientific papers.

URL : https://arxiv.org/abs/1908.04200

Meta-Research: Use of the Journal Impact Factor in academic review, promotion, and tenure evaluations

Authors : Erin C McKiernan, Lesley A Schimanski, Carol Muñoz Nieves, Lisa Matthias, Meredith T Niles, Juan P Alperin

We analyzed how often and in what ways the Journal Impact Factor (JIF) is currently used in review, promotion, and tenure (RPT) documents of a representative sample of universities from the United States and Canada. 40% of research-intensive institutions and 18% of master’s institutions mentioned the JIF, or closely related terms.

Of the institutions that mentioned the JIF, 87% supported its use in at least one of their RPT documents, 13% expressed caution about its use, and none heavily criticized it or prohibited its use. Furthermore, 63% of institutions that mentioned the JIF associated the metric with quality, 40% with impact, importance, or significance, and 20% with prestige, reputation, or status.

We conclude that use of the JIF is encouraged in RPT evaluations, especially at research-intensive universities, and that there is work to be done to avoid the potential misuse of metrics like the JIF.

URL : Meta-Research: Use of the Journal Impact Factor in academic review, promotion, and tenure evaluations

DOI : https://doi.org/10.7554/eLife.47338.001

The Transcript OPEN Library Political Science Model: A Sustainable Way into Open Access for E-Books in the Humanities and Social Science

Authors : Alexandra Jobmann, Nina Schönfelder

The strategic goal of the project “National Contact Point Open Access OA2020-DE” is to create the conditions for a large-scale open-access transformation in accordance with the Alliance of German Science Organizations.

In close collaboration with the publisher transcript, we developed a business model that strengthens the transformation process for e-books in the humanities and social sciences.

It largely addresses the drawbacks of existing models. Moreover, it is manageable, sustainable, transparent, and scalable for both publishers and libraries. This case report describes the setup of the model, its successful implementation for the branch “political science” of transcript in 2019, and provides a Strengths–Weaknesses–Opportunities–Threats (SWOT) analysis.

We believe that it has the potential to become one of the major open-access business models for research monographs and anthologies in the humanities and social sciences, especially for non-English e-books.

URL : The Transcript OPEN Library Political Science Model: A Sustainable Way into Open Access for E-Books in the Humanities and Social Science

DOI : https://doi.org/10.3390/publications7030055