Opening Academic Publishing – Development and application of systematic evaluation criteria

Authors : Anna Björk, Juho-Matti Paavola, Teemu Ropponen, Mikael Laakso, Leo Lahti

This report summarizes the development of a standardized scorecard for evaluating the openness of academic publishers. The assessment was completed in January 2018 as part of the Open Science and Research Initiative of the Finnish Ministry of Education and Culture.

The project complements the previous reports published by the Open Science and Research Initiative and the Finnish Ministry of Education and Culture, which have covered (i) the openness of universities and polytechnics, (ii) the overall situation of OA publishing costs in Finland, and (iii) research organization and research funding organizations, including selected European research funders.

The project mapped and evaluated the openness of selected major academic publishers: Association for Computing Machinery (ACM), American Chemical Society (ACS), Elsevier, Institute of Electrical and Electronic Engineering (IEEE), Lippincott, Williams & Wilkins (LWW), Sage, Springer Nature, Taylor & Francis, and Wiley-Blackwell. The dimensions of publisher openness were summarized in a scorecard of seven key factors, providing a new tool for systematic and standardized evaluation.

We used data from the publisher websites to compare the key factors of openness, and the publishers were given a chance to provide comments on the collected information. As complementary sources, we utilized data from commonly acknowledged, open databases: Directory of OA Journals (DOAJ), Gold OA Journals 2011-2016 (GOAJ2), Scopus (title list + Scimago), and Sherpa / Romeo.

The main results include the scorecard and the evaluation of openness of the selected major academic publishers. These are based on seven key factors: (i) Fraction of open access (OA) journals and their articles of the total publication output, (ii) costs of OA publishing (article processing charges, APC), (iii) use of Creative Commons (CC) licensing, (iv) self-archiving policies, (v) access to text and data mining (TDM), (vi) openness of citation data, and (vii) accessibility of information relating to OA practices.

To take a look beyond the publisher level into journal level practices we also sampled individual journals. We use the samples to discuss the distribution of journals according to APCs, their licensing and three impact metrics (CiteScore 2016, Scimago Journal & Country Ranks (SJR) 2016, and Source Normalized Impact per Paper (SNIP) 2016).

The evaluation of the selected publishers with the scorecard indicates, for example, that the fraction of OA journals and their articles of the total publication output runs low within this group. In our sample of journals, the most expensive OA journals also seem to bear the highest impact metrics.

A definite view on the matter, however, would require more extensive data and further research. We
conclude by discussing key aspects and complexities in quantitative evaluation and in the design of a standardized assessment of publisher openness, and note also further factors that could be included in future versions of the scorecard.

URL : Opening Academic Publishing – Development and application of systematic evaluation criteria

Alternative location : https://avointiede.fi/documents/10864/12232/OPENING+ACADEMIC+PUBLISHING+.pdf/a4358f81-88cf-4915-92db-88335092c992

The counting house: measuring those who count. Presence of Bibliometrics, Scientometrics, Informetrics, Webometrics and Altmetrics in the Google Scholar Citations, ResearcherID, ResearchGate, Mendeley & Twitter

Authors : Alberto Martin-Martin, Enrique Orduna-Malea, Juan M. Ayllon, Emilio Delgado Lopez-Cozar

Following in the footsteps of the model of scientific communication, which has recently gone through a metamorphosis (from the Gutenberg galaxy to the Web galaxy), a change in the model and methods of scientific evaluation is also taking place.

A set of new scientific tools are now providing a variety of indicators which measure all actions and interactions among scientists in the digital space, making new aspects of scientific communication emerge.

In this work we present a method for capturing the structure of an entire scientific community (the Bibliometrics, Scientometrics, Informetrics, Webometrics, and Altmetrics community) and the main agents that are part of it (scientists, documents, and sources) through the lens of Google Scholar Citations.

Additionally, we compare these author portraits to the ones offered by other profile or social platforms currently used by academics (ResearcherID, ResearchGate, Mendeley, and Twitter), in order to test their degree of use, completeness, reliability, and the validity of the information they provide.

A sample of 814 authors (researchers in Bibliometrics with a public profile created in Google Scholar Citations was subsequently searched in the other platforms, collecting the main indicators computed by each of them.

The data collection was carried out on September, 2015. The Spearman correlation was applied to these indicators (a total of 31) , and a Principal Component Analysis was carried out in order to reveal the relationships among metrics and platforms as well as the possible existence of metric cluster.

URL : https://arxiv.org/abs/1602.02412

Open access policies of high impact medical journals: a cross-sectional study

Authors : Tim Ellison, Tim Koder, Laura Schmidt, Amy Williams, Christopher Winchester

Introduction

Journal publishers increasingly offer governmental and charitable research funders the option to pay for open access with a Creative Commons Attribution (CC BY) licence, which allows sharing and adaptation of published materials for commercial as well as non-commercial use.

The Open Access Scholarly Publishers Association recommends this licence as the least restrictive Creative Commons licence available. We set out to investigate whether pharmaceutical companies are offered the same options.

Methods

Using Journal Selector (Sylogent, Newtown, PA, USA), we identified journals with a 2015 impact factor of at least 15 on 24 May 2017, and excluded journals that only publish review articles from the analysis.

Between 29 June 2017 and 26 July 2017, we collected information about the journals’ open access policies from their websites and/or by email contact. We contacted the journals by email again between 6 December 2017 and 2 January 2018 to confirm our findings.

Results

Thirty-seven non-review journals listed in the Journal Selector database, from 14 publishers, had a 2015 impact factor of at least 15. All 37 journals offered some form of access with varying embargo periods of up to 12 months.

Of these journals, 23 (62%) offered immediate open access with a CC BY licence under certain circumstances (e.g. to specific research funders). Of these 23, only one journal confirmed that it offered a CC BY licence to commercial funders/pharmaceutical companies.

Conclusion

The open access policies of most medical journals with high impact factors restrict the dissemination of medical research funded by the pharmaceutical industry.

To give the scientific community freedom to read, reuse and adapt medical publications, publishers and academic journal editors would ideally allow pharmaceutical companies to fund unrestricted and immediate open access with a CC BY licence.

URL : Open access policies of high impact medical journals: a cross-sectional study

DOI : https://doi.org/10.1101/250613

Open scientific journals: Emerging practices and approaches

Authors : Andre Luiz Appel, Sarita Albagli, Maria Lucia Maciel

This study aims to show how the concept of openness has been manifested and amplified in the universe of open access scholarly journals, pointing out emerging characteristics and practices linked to processes of submission, evaluation, revision, editing, publishing, editing, distribution, access and use of texts for publication.

We proceeded to an overview and discussion of the pertinent literature and the identification and analysis of open access journals which have addressed the issue, and to the identification and analysis of cases of open access journals which have been adopting innovative practices, based on information on editorial policies available on their websites.

Among the results, we have pointed out aspects of the publications examined, such as the types of licenses used, policies regarding access to research data, publishing formats, charges and alternative metrics of evaluation.

URL : Open scientific journals: Emerging practices and approaches

Alternative location : https://content.iospress.com/articles/information-services-and-use/isu862

 

How Many More Cites is a $3,000 Open Access Fee Buying You? Empirical Evidence from a Natural Experiment

Authors :  Frank Mueller-Langer, Richard Watt

This paper analyzes the effect of open access (OA) status of published journal articles on peer recognition, as measured by the number of citations. Using cross-sectional and panel data from interdisciplinary mathematics and economics journals, we perform negative binomial, Poisson and linear regressions together with generalized method of moments/instrumental variable methods regressions.

We benefit from a natural experiment via hybrid OA pilot agreements. Under these agreements, OA status is exogenously assigned to all articles of authors affiliated with hybrid OA pilot institutions.

Our cross-sectional analysis of the full sample suggests that there is no citation benefit associated with hybrid OA. In contrast, for the subpopulation of journal articles for which neither OA pre-prints nor OA post-prints are available, we find positive hybrid OA effects for the full sample and each discipline separately.

We address the issue of selection bias by exploiting a panel of journal articles for which OA pre-prints are available. Citations to pre-prints allow us to identify the intrinsic quality of articles prior to publication in a journal.

The results from the panel analysis provide additional empirical evidence for a negligible hybrid OA citation effect.

URL : https://ssrn.com/abstract=3096572

Open Access and the Theological Imagination

Authors : Talea Anderson, David Squires

The past twenty years have witnessed a mounting crisis in academic publishing. Companies such as Reed-Elsevier, Wiley-Blackwell, and Taylor and Francis have earned unprecedented profits by controlling more and more scholarly output while increasing subscription rates to academic journals.

Thus publishers have consolidated their influence despite widespread hopes that digital platforms would disperse control over knowledge production. Open access initiatives dating back to the mid-1990s evidence a religious zeal for overcoming corporate interests in academic publishing, with key advocates branding their efforts as archivangelism.

Little attention has been given to the legacy or implications of religious rhetoric in open access debates despite its increasing pitch in recent years. This essay shows how the Protestant imaginary reconciles–rather than opposes–open access initiatives with market economics by tracing the rhetoric of openness to free-market liberalism.

Working against the tendency to accept the Reformation as an analogy for the relationship between knowledge production, publishers, and academics, we read Protestantism as a counterproductive element of the archivangelist inheritance.

URL : http://www.digitalhumanities.org/dhq/vol/11/4/000340/000340.html