How are we Measuring Up? Evaluating Research Data Services in Academic Libraries

Authors : Heather L. Coates, Jake Carlson, Ryan Clement, Margaret Henderson, Lisa R Johnston, Yasmeen Shorish

INTRODUCTION

In the years since the emergence of federal funding agency data management and sharing requirements (http://datasharing.sparcopen.org/data), research data services (RDS) have expanded to dozens of academic libraries in the United States.

As these services have matured, service providers have begun to assess them. Given a lack of practical guidance in the literature, we seek to begin the discussion with several case studies and an exploration of four approaches suitable to assessing these emerging services.

DESCRIPTION OF PROGRAM

This article examines five case studies that vary by staffing, drivers, and institutional context in order to begin a practice-oriented conversation about how to evaluate and assess research data services in academic libraries.

The case studies highlight some commonly discussed challenges, including insufficient training and resources, competing demands for evaluation efforts, and the tension between evidence that can be easily gathered and that which addresses our most important questions.

We explore reflective practice, formative evaluation, developmental evaluation, and evidence-based library and information practice for ideas to advance practice.

NEXT STEPS

Data specialists engaged in providing research data services need strategies and tools with which to make decisions about their services. These range from identifying stakeholder needs to refining existing services to determining when to extend and discontinue declining services.

While the landscape of research data services is broad and diverse, there are common needs that we can address as a community. To that end, we have created a community-owned space to facilitate the exchange of knowledge and existing resources.

URL : How are we Measuring Up? Evaluating Research Data Services in Academic Libraries

DOI : http://doi.org/10.7710/2162-3309.2226

Science created by crowds: a case study of science crowdfunding in Japan

Authors : Yuko Ikkatai, Euan McKay, Hiromi M. Yokoyama

“Science crowdfunding” is a research funding system in which members of the public make small financial contributions towards a research project via the Internet. We compared the more common research process involving public research funding with science crowdfunding.

In the former, academic-peer communities review the research carried out whereas the Crowd Community, an aggregation of backers, carries out this function in the latter. In this paper, we propose that science crowdfunding can be successfully used to generate “crowd-supported science” by means of this Crowd Community.

URL : Science created by crowds: a case study of science crowdfunding in Japan

Alternative location : https://jcom.sissa.it/archive/17/03/JCOM_1703_2018_A06

Post-publication peer review in biomedical journals: overcoming obstacles and disincentives to knowledge sharing

Authors : Valerie Matarese, Karen Shashok

The importance of post-publication peer review (PPPR) as a type of knowledge exchange has been emphasized by several authorities in research publishing, yet biomedical journals do not always facilitate this type of publication.

Here we report our experience publishing a commentary intended to offer constructive feedback on a previously published article. We found that publishing our comment required more time and effort than foreseen, because of obstacles encountered at some journals.

Using our professional experience as authors’ editors and our knowledge of publication policies as a starting point, we reflect on the probable reasons behind these obstacles, and suggest ways in which journals could make PPPR easier. In addition, we argue that PPPR should be more explicitly valued and rewarded in biomedical disciplines, and suggest how these publications could be included in research evaluations.

Eliminating obstacles and disincentives to PPPR is essential in light of the key roles of post-publication analysis and commentary in drawing attention to shortcomings in published articles that were overlooked during pre-publication peer review.

URL : Post-publication peer review in biomedical journals: overcoming obstacles and disincentives to knowledge sharing

DOI : https://dx.doi.org/10.31229/osf.io/8kxyz

The Open Revolution : Rewriting the rules of the information age

Author : Rufus Pollock

Forget everything you think you know about the digital age. It’s not about privacy, surveillance, AI or blockchain—it’s about ownership. Because, in a digital age, who owns information controls the future.

In this urgent and provocative book, Rufus Pollock shows how today’s “Closed” digital economy is the source of problems ranging from growing inequality, to unaffordable medicines, to the power of a handful of tech monopolies to control how we think and vote.

He proposes a solution that charts a path to a more equitable, innovative and profitable future for all.

URL : The Open Revolution : Rewriting the rules of the information age

Alternative location : https://openrevolution.net/

The Impact of Open Educational Resources on Various Student Success Metrics

Authors : Nicholas Colvard, C. Edward Watson, Hyojin Park

There are multiple indicators which suggest that completion, quality, and affordability are the three greatest challenges for higher education today in terms of students, student learning, and student success.

Many colleges, universities, and state systems are seeking to adopt a portfolio of solutions that address these challenges. This article reports the results of a large-scale study (21,822 students) regarding the impact of course-level faculty adoption of Open Educational Resources (OER).

Results indicate that OER adoption does much more than simply save students money and address student debt concerns. OER improve end-of-course grades and decrease DFW (D, F, and Withdrawal letter grades) rates for all students.

They also improve course grades at greater rates and decrease DFW rates at greater rates for Pell recipient students, part-time students, and populations historically underserved by higher education.

OER address affordability, completion, attainment gap concerns, and learning. These findings contribute to a broadening perception of the value of OERs and their relevance to the great challenges facing higher education today.

URL : The Impact of Open Educational Resources on Various Student Success Metrics

Alternative location : http://www.isetl.org/ijtlhe/abstract.cfm?mid=3386

Reviewing the review process: Investigation of researchers’ opinions on different methods of peer review

Author : Carolin Anna Rebernig

Peer review is considered the gold standard of scientific publishing. Trust in the traditional system of editor – blind-reviewer – author is still high, but it’s authority is in decline and alternative methods are on the rise.

The current study investigates opinions of alternative peer review methods, the arguments for and against, and the reasons why academics are searching for new approaches. The opinions were analysed by applying qualitative content analysis to online discussions.

The findings were interpreted using two different sociological theories: the Mertonian sociology of science and social constructivism.

The results of the study show that the most discussed method was also the most traditional one: closed pre-publication peer review comprised of single blind, double-blind and open peer review (non blinded).

Discussions of open peer review (both open publishing of reports and open discussions) were also common. All other alternative methods were discussed much less. But the discussions were lively and each method was discussed in both positive and negative terms.

The reasons for preferring certain methods were also manifold, but dominant topics were bias and fairness, quality issues (regarding reviews and publications), issues concerning human resources and communication and exchange among people.

The results of this study demonstrate that while ethical norms seems to be a scientific ideal, human nature makes it impossible to accomplish this goal.

URN : http://urn.kb.se/resolve?urn=urn%3Anbn%3Ase%3Ahb%3Adiva-14607

Use of Twitter in Spanish Communication Journals

Authors : Victoria Tur-Viñes, Jesús Segarra-Saavedra, Tatiana Hidalgo-Marí

This is an exploratory study on the Twitter profiles managed by 30 Spanish Communication journals. The aim is to analyse the profile management, to identify the features of the most interactive content, and to propose effective practices motivating strategic management.

The management variables considered were the following: the launch date of the journal and launch of the Twitter profile; published content and frequency of publication; number of publications in 2016; number of Twitter followers.

The identification of the features of the most interactive tweets was performed in a 150-unit sample, taking into consideration the following factors: the number of retweets, likes, type of content (motivation), components forming the content, the date and time of publication, and origin of the publication (internal or unrelated).

The results reveal notable practices and certain deficiencies in the strategic management of social profiles. Twitter represents an innovative opportunity in scientific dissemination, and it establishes an inalienable strategy for creating and maintaining the brand-journal while retaining the need to strengthen followers’ reciprocity. Other potential uses are suggested.

URL : Use of Twitter in Spanish Communication Journals

Alternative location : http://www.mdpi.com/2304-6775/6/3/34