Indicators of research quality, quantity, openness and responsibility in institutional review, promotion and tenure policies across seven countries

Authors : Nancy Pontika, Thomas Klebel, Antonia Correia, Hannah Metzler, Petr Knoth, Tony Ross-Hellauer

The need to reform research assessment processes related to career advancement at research institutions has become increasingly recognised in recent years, especially to better foster open and responsible research practices. Current assessment criteria are believed to focus too heavily on inappropriate criteria related to productivity and quantity as opposed to quality, collaborative open research practices, and the socio-economic impact of research.

Evidence of the extent of these issues is urgently needed to inform actions for reform, however. We analyse current practices as revealed by documentation on institutional review, promotion and tenure processes in seven countries (Austria, Brazil, Germany, India, Portugal, United Kingdom and United States of America).

Through systematic coding and analysis of 143 RPT policy documents from 107 institutions for the prevalence of 17 criteria (including those related to qualitative or quantitative assessment of research, service to the institution or profession, and open and responsible research practices), we compare assessment practices across a range of international institutions to significantly broaden this evidence-base.

Although prevalence of indicators varies considerably between countries, overall we find that currently open and responsible research practices are minimally rewarded and problematic practices of quantification continue to dominate.

URL : Indicators of research quality, quantity, openness and responsibility in institutional review, promotion and tenure policies across seven countries

DOI : https://doi.org/10.1162/qss_a_00224

Global Diversity in Higher Education Workforces: Towards Openness

Authors : Katie Wilson, Cameron Neylon, Lucy Montgomery, Chun-Kai (Karl) Huang, Rebecca N. Handcock, Aniek Roelofs, Richard Hosking, Alkim Ozaygen

In this article we discuss the collection and nature of diversity data relating to origin (ethnicity, race, nationality, indigeneity), gender/sex and disability in higher education institutional workforces across 24 locations within Africa, Asia, Europe, Latin America, North America and Oceania.

The research emerges from the Curtin Open Knowledge Initiative project (n.d.), in which we analyse data relating to published research literature, its open access status, citations and collaborations for institutions, publishers and research funding bodies.

Our project explores demographic data relating to workforce diversity and research production; we examine who creates knowledge and how diversity is transmitted through research.

Collecting and analysing higher education workforce demographic diversity data reveals a global datascape with considerable variation in practices and data collected. The data reflect political and social histories, national and international policies and practices, priorities and funding.

The presence and absence of public data provide an opportunity to understand differing national situations and priorities beneath the statistics. We open a conversation about how the concepts of equity, diversity and inclusion differ between groups of countries, which makes global comparisons difficult.

By identifying higher education data and gaps, we also encourage institutions and countries to review their workforce demographics and their intersection with research production. Awareness of institutional diversity levels through data analysis can guide institutions towards knowledge openness.

URL : Global Diversity in Higher Education Workforces: Towards Openness

DOI : https://doi.org/10.16995/olh.4809

Toward openness and transparency to better facilitate knowledge creation

Author : Simon Mahony

Changes in modes of publication over recent decades and moves to publish material freely and openly have resulted in increased amounts of research and scholarly outputs being available online. These include teaching and other material but consist mostly of research publications.

There have been significant UK and European initiatives as part of the Open Agenda that facilitate and indeed mandate the move to open whether that is for educational materials, research output and data, or the mechanisms for ensuring the quality of these materials.

A significant issue is that although making research outputs freely available is praiseworthy, without the data on which that research is based, reproducibility and so verification, which are fundamental principles of scholarly methodology, are not possible.

When discrete datasets are linked openly and freely, are able to interact by using common standards, they become more powerful with extended possibilities for research questions that cross disciplinary divides and knowledge domains.

There are always objections and resistance to new innovations, and open publication is no exception; published research, nevertheless, indicates that publishing material openly is becoming considered to be “good research practice” and that the positives of “new collaborations and higher citation” outweigh any perceived negative effects.

URL : Toward openness and transparency to better facilitate knowledge creation

DOI : https://doi.org/10.1002/asi.24652

Promoting a culture of openness: Institutional open access policy development and evaluation at a Canadian university

Authors : Alison J. Moore, Jennifer Zerkee, Kate Shuttleworth, Rebecca Dowson, Gwen Bird

Institutional open access (OA) policies can act as a solid foundation on which to build university-wide support for open access. This is the first paper to reflect on the entire process of developing, implementing, and reviewing an institutional open access policy at a Canadian post-secondary institution.

Simon Fraser University (SFU) is one of a few Canadian universities with an institutional open access policy. As a leader in open access, SFU is well positioned to share observations of our experiences in the first three years of our OA policy.

Throughout this paper, we reflect on the role that the policy plays in the broader culture of openness at SFU and on the OA resources and supports provided to SFU researchers.

Other institutions may find our observations and adoption of the SOAR (strengths, opportunities, aspirations, results) appreciative inquiry framework useful as they explore future policy development or review and work to promote a culture of open access within their university community.

URL: Promoting a culture of openness: Institutional open access policy development and evaluation at a Canadian university

DOI : https://doi.org/10.21083/partnership.v16i1.6150

Openness in Big Data and Data Repositories. The Application of an Ethics Framework for Big Data in Healthand Research

Authors : Vicki Xafis, Markus K. Labude

There is a growing expectation, or even requirement, for researchers to deposit a variety of research data in data repositories as a condition of funding or publication. This expectation recognizes the enormous benefits of data collected and created for research purposes being made available for secondary uses, as open science gains increasing support.

This is particularly so in the context of big data, especially where health data is involved. There are, however, also challenges relating to the collection, storage, and re-use of research data.

This paper gives a brief overview of the landscape of data sharing via data repositories and discusses some of the key ethical issues raised by the sharing of health-related research data, including expectations of privacy and confidentiality, the transparency of repository governance structures, access restrictions, as well as data ownership and the fair attribution of credit.

To consider these issues and the values that are pertinent, the paper applies the deliberative balancing approach articulated in the Ethics Framework for Big Data in Health and Research (Xafis et al. 2019) to the domain of Openness in Big Data and Data Repositories.

Please refer to that article for more information on how this framework is to be used, including a full explanation of the key values involved and the balancing approach used in the case study at the end.

URL : Openness in Big Data and Data Repositories. The Application of an Ethics Framework for Big Data in Healthand Research

DOI : https://doi.org/10.1007/s41649-019-00097-z

Openness and Licensing

Author : Melanie Dulong de Rosnay

This chapter traces the evolution of legal conditions meant to support the production and flourishing of “commons-based peer production” in a diversity of fields covered by copyright, mostly in the digital realm.

From software to creative works, including scientific articles, cultural heritage, public sector information, and open data, a wealth of digital, knowledge, intellectual or information commons can be peer produced.

The rules which guarantee that they can remain in the commons, under open conditions, have been the subject of heated debates about the politics of technology and heavy legal fine-tuning along the years, opposing different definitions and nuances in openness reflecting underlying philosophies within the peer production political economy, such as liberal and commons-based approaches.

URL : https://halshs.archives-ouvertes.fr/halshs-02986892v1

Survey study of research integrity officers’ perceptions of research practices associated with instances of research misconduct

Author : Michael Kalichman

Background

Research on research integrity has tended to focus on frequency of research misconduct and factors that might induce someone to commit research misconduct.

A definitive answer to the first question has been elusive, but it remains clear that any research misconduct is too much. Answers to the second question are so diverse, it might be productive to ask a different question: What about how research is done allows research misconduct to occur?

Methods

With that question in mind, research integrity officers (RIOs) of the 62 members of the American Association of Universities were invited to complete a brief survey about their most recent instance of a finding of research misconduct.

Respondents were asked whether one or more good practices of research (e.g., openness and transparency, keeping good research records) were present in their case of research misconduct.

Results

Twenty-four (24) of the respondents (39% response rate) indicated they had dealt with at least one finding of research misconduct and answered the survey questions. Over half of these RIOs reported that their case of research misconduct had occurred in an environment in which at least nine of the ten listed good practices of research were deficient.

Conclusions

These results are not evidence for a causal effect of poor practices, but it is arguable that committing research misconduct would be more difficult if not impossible in research environments adhering to good practices of research.

URL : Survey study of research integrity officers’ perceptions of research practices associated with instances of research misconduct

DOI : https://doi.org/10.1186/s41073-020-00103-1