Opening Academic Publishing – Development and application of systematic evaluation criteria

Authors : Anna Björk, Juho-Matti Paavola, Teemu Ropponen, Mikael Laakso, Leo Lahti

This report summarizes the development of a standardized scorecard for evaluating the openness of academic publishers. The assessment was completed in January 2018 as part of the Open Science and Research Initiative of the Finnish Ministry of Education and Culture.

The project complements the previous reports published by the Open Science and Research Initiative and the Finnish Ministry of Education and Culture, which have covered (i) the openness of universities and polytechnics, (ii) the overall situation of OA publishing costs in Finland, and (iii) research organization and research funding organizations, including selected European research funders.

The project mapped and evaluated the openness of selected major academic publishers: Association for Computing Machinery (ACM), American Chemical Society (ACS), Elsevier, Institute of Electrical and Electronic Engineering (IEEE), Lippincott, Williams & Wilkins (LWW), Sage, Springer Nature, Taylor & Francis, and Wiley-Blackwell. The dimensions of publisher openness were summarized in a scorecard of seven key factors, providing a new tool for systematic and standardized evaluation.

We used data from the publisher websites to compare the key factors of openness, and the publishers were given a chance to provide comments on the collected information. As complementary sources, we utilized data from commonly acknowledged, open databases: Directory of OA Journals (DOAJ), Gold OA Journals 2011-2016 (GOAJ2), Scopus (title list + Scimago), and Sherpa / Romeo.

The main results include the scorecard and the evaluation of openness of the selected major academic publishers. These are based on seven key factors: (i) Fraction of open access (OA) journals and their articles of the total publication output, (ii) costs of OA publishing (article processing charges, APC), (iii) use of Creative Commons (CC) licensing, (iv) self-archiving policies, (v) access to text and data mining (TDM), (vi) openness of citation data, and (vii) accessibility of information relating to OA practices.

To take a look beyond the publisher level into journal level practices we also sampled individual journals. We use the samples to discuss the distribution of journals according to APCs, their licensing and three impact metrics (CiteScore 2016, Scimago Journal & Country Ranks (SJR) 2016, and Source Normalized Impact per Paper (SNIP) 2016).

The evaluation of the selected publishers with the scorecard indicates, for example, that the fraction of OA journals and their articles of the total publication output runs low within this group. In our sample of journals, the most expensive OA journals also seem to bear the highest impact metrics.

A definite view on the matter, however, would require more extensive data and further research. We
conclude by discussing key aspects and complexities in quantitative evaluation and in the design of a standardized assessment of publisher openness, and note also further factors that could be included in future versions of the scorecard.

URL : Opening Academic Publishing – Development and application of systematic evaluation criteria

Alternative location :

Alchemy & algorithms: perspectives on the philosophy and history of open science

Authors : Leo Lahti, Filipe da Silva, Markus Petteri Laine, Viivi Lähteenoja, Mikko Tolonen

This paper gives the reader a chance to experience, or revisit, PHOS16: a conference on the History and Philosophy of Open Science.

In the winter of 2016, we invited a varied international group to engage with these topics at the University of Helsinki, Finland. Our aim was a critical assessment of the defining features, underlying narratives, and overall objectives of the contemporary open science movement.

The event brought together contemporary open science scholars, publishers, and advocates to discuss the philosophical foundations and historical roots of openness in academic research.

The eight sessions combined historical views with more contemporary perspectives on topics such as transparency, reproducibility, collaboration, publishing, peer review, research ethics, as well as societal impact and engagement.

We gathered together expert panelists and 15 invited speakers who have published extensively on these topics, which allowed us to engage in a thorough and multifaceted discussion.

Together with our involved audience we charted the role and foundations of openness of research in our time, considered the accumulation and dissemination of scientific knowledge, and debated the various technical, legal, and ethical challenges of the past and present.

In this article, we provide an overview of the topics covered at the conference as well as individual video interviews with each speaker. In addition to this, all the talks were recorded and they are offered here as an openly licensed community resource in both video and audio form.

URL : Alchemy & algorithms: perspectives on the philosophy and history of open science