Étiquette : research impact

Publié le

Benefits of Open Access to Scholarly Research to…

Benefits of Open Access to Scholarly Research to the Public Sector :

“The objective of this project was to synthesise and generate evidence on the benefits that Open Access to scholarly research outputs has generated to the public sector, and to provide case studies of organisations that have realised such benefits. The project considered the benefits of Open Access for researchers in public sector organisations. It did not aim to be comprehensive in its coverage of the public sector, as there are many organisations for which research is only a very small part of their activity, and has only very limited impact on their policies and decisions. We have also focused on Open Access to research articles, as these still make up the largest proportion of research outputs used in analysis, policy and decision-making: research data is becoming more important but is still nascent in its influence in the organisations we surveyed. These organisations in any case often generate their own data through commissioned surveys and other tools as their needs tend to be very specific.”

URL : http://ie-repository.jisc.ac.uk/575/

Publié le

Altmetrics in the wild: Using social media to explore scholarly impact

In growing numbers, scholars are integrating social media tools like blogs, Twitter, and Mendeley into their professional communications. The online, public nature of these tools exposes and reifies scholarly processes once hidden and ephemeral. Metrics based on this activities could inform broader, faster measures of impact, complementing traditional citation metrics. This study explores the properties of these social media-based metrics or “altmetrics”, sampling 24,331 articles published by the Public Library of Science.

We find that that different indicators vary greatly in activity. Around 5% of sampled articles are cited in Wikipedia, while close to 80% have been included in at least one Mendeley library. There is, however, an encouraging diversity; a quarter of articles have nonzero data from five or more different sources. Correlation and factor analysis suggest citation and altmetrics indicators track related but distinct impacts, with neither able to describe the complete picture of scholarly use alone.

There are moderate correlations between Mendeley and Web of Science citation, but many altmetric indicators seem to measure impact mostly orthogonal to citation. Articles cluster in ways that suggest five different impact “flavors”, capturing impacts of different types on different audiences; for instance, some articles may be heavily read and saved by scholars but seldom cited. Together, these findings encourage more research into altmetrics as complements to traditional citation measures.

URL : http://arxiv.org/abs/1203.4745

Publié le

How the Scientific Community Reacts to Newly Submitted…

How the Scientific Community Reacts to Newly Submitted Preprints: Article Downloads, Twitter Mentions, and Citations :

“We analyze the online response of the scientific community to the preprint publication of scholarly articles. We employ a cohort of 4,606 scientific articles submitted to the preprint database arXiv.org between October 2010 and April 2011. We study three forms of reactions to these preprints: how they are downloaded on the arXiv.org site, how they are mentioned on the social media site Twitter, and how they are cited in the scholarly record. We perform two analyses. First, we analyze the delay and time span of article downloads and Twitter mentions following submission, to understand the temporal configuration of these reactions and whether significant differences exist between them. Second, we run correlation tests to investigate the relationship between Twitter mentions and both article downloads and article citations. We find that Twitter mentions follow rapidly after article submission and that they are correlated with later article downloads and later article citations, indicating that social media may be an important factor in determining the scientific impact of an article.”

URL : http://arxiv.org/abs/1202.2461

Publié le

Open Access Digital Repository Sharing Student Research with…

Open Access Digital Repository: Sharing Student Research with the World :

“University libraries use open access digital repositories to preserve and distribute the intellectual scholarly communications of their institution. How can global accessibility of quality student work be harnessed to benefit researchers, practitioners, and educators? To address this question, we study the impact of content factors and search engine optimization factors on download rates of capstone papers. We examined all 290 MPA capstone papers at Texas State University which have been made available through an online digital repository for public consumption. Results show strong support for the impact of search engine factors on download rates. The implications of high download rates of MPA capstone papers on public administration research, practice, and education are discussed in this paper.”

URL : http://www.naspaa.org/jpaemessenger/Article/VOL18-1/jpae18_01_final.pdf

Publié le

Users narcissism and control – tracking the impact…

Users, narcissism and control – tracking the impact of scholarly publications in the 21st century :

“What is the scientific and social impact of my research publications? This question has been of interest to scientists and scholars since the inception of modern science 400 years ago. But it was hard to answer. This may now be changing. Scholarship is transforming into a variety of digital networked forms. These developments have created new possibilities and challenges in the evaluation of the quality of research. This is of interest to research funders assessing the quality of research. It is also relevant to the individual researchers interested in assessing their career development.

This report explores the explosion of tracking tools that have accompanied the surge of web based information instruments. Is it possible to monitor ‘real-time’ how new research findings are being read, cited, used and transformed in practical results and applications? And what are the potential risks and disadvantages of the new tracking tools? This report aims to contribute to a better understanding of these developments by providing a detailed assessment of the currently available novel tools and methodologies. A total of 16 quite different tools are assessed.

The report concludes that web based academic publishing is producing a variety of novel information filters. These allow the researcher to make some sort of limited self-assessment with respect to the response to his/her work. However, this does not mean that these technologies and databases can also legitimately be used in research assessments. For this application, they need to adhere to a far stricter protocol of data quality and indicator reliability and validity. Most new tools do not (yet) comply with these more strict quality criteria.

The report therefore advises to start a concerted research programme in the dynamics, properties, and potential use of new web based metrics which relates these new measures to the already established indicators of publication impact. Its goal would be to contribute to the development of more useful tools for the scientific and scholarly community. This programme should monitor at least the following tools: F1000, Microsoft Academic Research, Total-Impact, PlosONE altmetrics, and Google Scholar. The programme should moreover develop the following key research themes: concepts of new web metrics and altmetrics; standardisation of tools and data; and the use and normalisation of the new metrics.”

URL : http://www.surffoundation.nl/nl/publicaties/Documents/Users%20narcissism%20and%20control.pdf

Publié le

The Future of Taxpayer-Funded Research: Who Will Control Access to the Results?

This report examines the costs and benefits of increased public access, and proposals to either extend or overturn the NIH policy. It looks at increased public access to research results through the lens of “openness,” with a particular interest in how greater openness affects the progress of science, the productivity of the research enterprise, the process of innovation, the commercialization of research, and economic growth.

URL : http://www.ced.org/images/content/issues/innovation-technology/DCCReport_Final_2_9-12.pdf

Publié le

The Effect of Free Access on the Diffusion…

The Effect of Free Access on the Diffusion of Scholarly Ideas :

“This study examines a relationship between free access to research articles and the diffusion of their ideas as measured by citation counts. While free access should, in theory, help the diffusion of ideas, many researchers have debated the existence of the benefit of free access: reported empirical findings range from zero or negative effect to an over 300% increase of citations of non-free articles. By using a dataset from the Social Science Research Network (SSRN), an open repository of research articles, and employing a natural experiment that allows the estimation of the value of free access separate from confounding factors such as early viewership and quality differential, this study identifies the causal effect of free access on the citation counts. The natural experiment in this study is that a select group of published articles is posted on SSRN at a time chosen by their authors’ affiliated organizations or SSRN, not by their authors. Using a difference-in-difference method and comparing the citation profiles of the articles before and after the posting time on SSRN against a group of control articles with similar characteristics, I stimated the effect of the SSRN posting on citation counts. The articles posted on SSRN receive more citations even prior to being posted on SSRN, suggesting that they are of higher quality. Their citation counts further increase after being posted, gaining an additional 10-20% of citations. This gain is likely to be caused by the free access that SSRN provides.”

URL : http://mis.eller.arizona.edu/events/speakers_series/2012/mis_speaker_series_Heekyung_Kim.asp