Peer Review in Academic Promotion and Publishing: Its Meaning, Locus, and Future

Since 2005, and with generous support from the A.W. Mellon Foundation, The Future of Scholarly Communication Project at UC Berkeley’s Center for Studies in Higher Education (CSHE) has been exploring how academic values—including those related to peer review, publishing, sharing, and collaboration—influence scholarly communication practices and engagement with new technological affordances, open access publishing, and the public good.

The current phase of the project focuses on peer review in the Academy; this deeper look at peer review is a natural extension of our findings in Assessing the Future Landscape of Scholarly Communication: An Exploration of Faculty Values and Needs in Seven Disciplines (Harley et al. 2010), which stressed the need for a more nuanced academic reward system that is less dependent on citation metrics, the slavish adherence to marquee journals and university presses, and the growing tendency of institutions to outsource assessment of scholarship to such proxies as default promotion criteria.

This investigation is made urgent by a host of new challenges facing institutional peer review, such as assessing interdisciplinary scholarship, hybrid disciplines, the development of new online forms of edition making and collaborative curation for community resource use, heavily computational subdisciplines, large-scale collaborations around grand challenge questions, an increase in multiple authorship, a growing flood of low-quality publications, and the call by governments, funding bodies, universities, and individuals for the open access publication of taxpayer-subsidized research, including original data sets.

The challenges of assessing the current and future state of peer review are exacerbated by pressing questions of how the significant costs of high-quality scholarly publishing can be borne in the face of calls for alternative, usually university-based and open access, publishing models for both journals and books.

There is additionally the insidious and destructive “trickle down” of tenure and promotion requirements from elite research universities to less competitive and non-research-intensive institutions.

The entire system is further stressed by the mounting—and often unrealistic—government pressure on scholars in developed and emerging economies alike to publish their research in the most select peer-reviewed outlets, ostensibly to determine the distribution of government funds (via research assessment exercises) and/or to meet national imperatives to achieve research distinction internationally.

The global effect is a growing glut of low-quality publications that strains the efficient and effective practice of peer review, a practice that is, itself, primarily subsidized by universities in the form of faculty salaries. Library budgets and preservation services for this expansion of peer-reviewed publication have run out. Faculty time spent on peer review, in all of its guises, is being exhausted.

As part of our ongoing research, CSHE hosted two meetings to address the relationship between peer review in publication and that carried out for tenure and promotion. Our discussions included: The Dominant System of Peer Review: Types, Standards, Uses, Abuses, and Costs; A Very Tangled Web: Alternatives to the Current System of Peer Review; Creating New Models: The Role of Societies, Presses, Libraries, Information Technology Organizations, Commercial Publishers, and Other Stakeholders; and Open Access “Mandates” and Resolutions versus Developing New Models.

This report includes (1) an overview of the state of peer review in the Academy at large, (2) a set of recommendations for moving forward, (3) a proposed research agenda to examine in depth the effects of academic status-seeking on the entire academic enterprise, (4) proceedings from the workshop on the four topics noted above, and (5) four substantial and broadly conceived background papers on the workshop topics, with associated literature reviews.

The document explores, in particular, the tightly intertwined phenomena of peer review in publication and academic promotion, the values and associated costs to the Academy of the current system, experimental forms of peer review in various disciplinary areas, the effects of scholarly practices on the publishing system, and the possibilities and real costs of creating alternative loci for peer review and publishing that link scholarly societies, libraries, institutional repositories, and university presses.

We also explore the motivations and ingredients of successful open access resolutions that are directed at peer-reviewed article-length material. In doing so, this report suggests that creating a wider array of institutionally acceptable and cost-effective alternatives to peer reviewing and publishing scholarly work could maintain the quality of academic peer review, support greater research productivity, reduce the explosive growth of low-quality publications, increase the purchasing power of cash-strapped libraries, better support the free flow and preservation of ideas, and relieve the burden on overtaxed faculty of conducting too much peer review.”

URL : http://cshe.berkeley.edu/publications/publications.php?id=379

A report of the AAUP Task Force on…

A report of the AAUP Task Force on Economic Models for Scholarly Publishing :

“Within the scholarly communications ecosystem, scholarly publishers are a keystone species. University presses—as well as academic societies, research institutions, and other scholarly publishers—strive to fulfill our mission of “making public the fruits of scholarly research” as effectively as possible within that ecosystem. While that mission has remained constant, in recent years the landscape in which we carry out this mission has altered dramatically.

The expertise residing within university presses can help the scholarly enterprise prosper in both influence and impact as it moves ever more fully digital. However, the simple product-sales models of the twentieth century, devised when information was scarce and expensive, are clearly inappropriate for the twenty-first century scholarly ecosystem.

This report a) identifies elements of the current scholarly publishing systems that are worth protecting and retaining throughout this and future periods of transition; b) explores business models of existing projects which hold promise; c) outlines the characteristics of effective business models; d) addresses the challenges of the transitional period we are entering; and e) arrives at recommendations that might allow us to sustain high-quality scholarship at a time when the fundamental expectations of publishing are changing.

URL : http://aaupnet.org/resources/reports/business_models/

Support for gold open access publishing …

Support for gold open access publishing strategies at QUT :

INTRODUCTION : Since the introduction of its QUT ePrints institutional repository of published research outputs, together with the world’s first mandate for author contributions to an institutional repository, Queensland University of Technology (QUT) has been a leader in support of green road open access. With QUT ePrints providing our mechanism for supporting the green road to open access, QUT has since then also continued to expand its secondary open access strategy supporting gold road open access, which is also designed to assist QUT researchers to maximise the accessibility and so impact of their research.

METHODS : QUT Library has adopted the position of selectively supporting true gold road open access publishing by using the Library Resource Allocation budget to pay the author publication fees for QUT authors wishing to publish in the open access journals of a range of publishers including BioMed Central, Public Library of Science and Hindawi. QUT Library has been careful to support only true open access publishers and not those open access publishers with hybrid models which “double dip” by charging authors publication fees and libraries subscription fees for the same journal content. QUT Library has maintained a watch on the growing number of open access journals available from gold road open access publishers and their increased rate of success as measured by publication impact.

RESULTS : This paper reports on the successes and challenges of QUT’s efforts to support true gold road open access publishers and promote these publishing strategy options to researchers at QUT. The number and spread of QUT papers submitted and published in the journals of each publisher is provided. Citation counts for papers and authors are also presented and analysed, with the intention of identifying the benefits to accessibility and research impact for early career and established researchers.

CONCLUSIONS : QUT Library is eager to continue and further develop support for this publishing strategy, and makes a number of recommendations to other research institutions, on how they can best achieve success with this strategy.”

URL : http://eprints.qut.edu.au/39416/

Scaling Vectors: Thoughts on the Future …

Scaling Vectors: Thoughts on the Future of Scholarly Communication :

“This essay proposes that bold new forms of experimentation and bookishness are necessary if we are to advance (and perhaps save) scholarly publishing in the humanities. Possible issues facing presses are considered through consideration of two examples in scholarly publishing that involve the author. The first example, the experimental journal Vectors, highlights the advantages and limits of certain types of multimodal scholarly communication for the humanities. The second example, the new Alliance for Networking Visual Culture, points toward new methods of workflow and publishing that link archives, scholars, and presses. The essay ends with a list of key questions that presses will need to address as various stakeholders collectively expand what we understand humanities publishing to be.”

URL : http://quod.lib.umich.edu/cgi/t/text/text-idx?c=jep;view=text;rgn=main;idno=3336451.0013.208

Le libre accès : entre idéal et nécessit…

Le libre accès : entre idéal et nécessité :

“Les débats qui se développent autour de la question du libre accès sont bien souvent menés comme des combats idéologiques, mobilisant des registres d’expression militants autour des notions de biens publics. La très grande visibilité de ces débats occulte deux éléments qui pourraient en relativiser la portée. L’analyse du développement des initiatives de libre accès montre que la dimension politique de la question est loin d’être prédominante dans toutes les disciplines et varie considérablement selon les communautés. Par ailleurs, les modifications profondes que le développement des réseaux numériques entraîne dans les pratiques de communication scientifique pourraient rendre moins pertinente l’approche volontariste et militante du libre accès. La multiplication du nombre de documents disponibles, l’effacement relatif des frontières entre les différents modes de publication, l’abaissement des barrières d’accès à la publication contribuent à relativiser la portée des dispositifs de fabrication de rareté artificielle et à soumettre progressivement le système de communication scientifique à un régime d’économie de l’attention. Il est dès lors possible que le secteur de l’édition scientifique connaisse une évolution comparable à celle des secteurs de la presse et de l’édition musicale.”

URL : http://archivesic.ccsd.cnrs.fr/sic_00534136/fr/

New Value-Added Services for Classics E-Journals

This paper examines issues related to electronic journal publishing in the field of Classics with a specific focus on the discussion of new value-added services for e-journals. Preliminary experimental data from a survey that explored the diffusion of digital technologies into the publishing workflow of Italian Classics journals identified two new value-added services: reference linking to primary sources and semantic indexing.

This paper also emphasizes the importance of supporting citation persistence for electronic resources. Finally, it will describe the significance and overall functioning of these services and then conclude with an outline of the characteristics of the main technical components needed for an e-journal implementation that provides these identified services through an extension of the Open Journal Systems (OJS) platform.

URL : http://eprints.rclis.org/15006/

Implementing Open Access: Policy Case St…

Implementing Open Access: Policy Case Studies :

“Implementing open access is a tough job. Legitimate authority, sufficient resources and the right timing are crucial. Pioneers, role models and flagship institutions all have faced considerable challenges in meeting their own aims and achieving a recognized success. Professionals charged with implementing policy typically need several years to accomplish significant progress. Many institutions adopting open access policies probably need to do more, much more, if the commitment to open access is to be meaningful.
A first generation of open access policy development and implementation is coming to a close. It is thus possible to begin evaluation. Evaluating implementation establishes evidence, enables reflection, and may foster the emergence of a second generation of open access policies.
This study is based on a small number of cases, examining the implementation of open access around the world. Some of the pioneer institutions with open access mandates have been included, as well as some newer cases. The emergence of the new stakeholders in publishing is examined, such as digital repositories, research funders and research organisations.
Because this is a groundbreaking study, no claim is made that the results are representative. The emphasis is on variety and on defining a methodological standard. Each case is reconstructed individually on the basis of public documents and background information, and supported by interviews with professionals responsible for open access implementation.
Implementation is typically based on targeting researchers as authors. Indeed, the author is pivotal to any open access solution. This is the ‘tertium comparationis’ that facilitates an examination of the similarities and differences across instances in an effort to build a broader policy research agenda.
In a final section, open access is placed in the wider context of the evolution of digital scholarship. This clarifies how published research results are destined to become a key component of digital research infrastructures that provide inputs and outputs for research, teaching and learning in real time.
The ten cases examined in detail are:
– Refining green open access policy: Queensland University of Technology (September 2003)
– Refining policy to foster deposit: University of Zurich (July 2005)
– National platform, open collection, decentralized policy: the HAL platform (June-October 2006)
– Maximising a funder’s impact: The Wellcome Trust (October 2006)
– Implementing open access as a digital infrastructure: UK PMC (January 2007)
– Learning from global research infrastructure: SCOAP3 (April 2007)
– Linking public access to open data: Howard Hughes Medical Institute (January 2008)
– Open access to all publications, internationally: Austrian Science Fund (FWF, March 2008)
– One policy, sixty publication strategies: Fraunhofer-Gesellschaft (July 2008)
– Open Access complements the Research Information System: The University of Pretoria (May 2009)”.

URL : http://papers.ssrn.com/sol3/papers.cfm?abstract_id=1685855