Étiquette : scientific communication

Catégories
EN

Altmetrics data providers: A meta-analysis review of the coverage of metrics and publication

Author : José-Luis Ortega

The aim of this paper is to review the current and most relevant literature on the use of altmetric providers since 2012. This review is supported by a meta-analysis of the coverage and metric counts obtained by more than 100 publications that have used these bibliographic platforms for altmetric studies.

The article is the most comprehensive analysis of altmetric data providers (Lagotto, Altmetric.com, ImpactStory, Mendeley, PlumX, Crossref Event Data) and explores the coverage of publications, social media and events from a longitudinal view. Disciplinary differences were also analysed.

The results show that most of the studies are based on Altmetric.com data. This provider is the service that captures most mentions from social media sites, blogs and news outlets. PlumX has better coverage, counting more Mendeley readers, but capturing fewer events.

CED has a special coverage of mentions from Wikipedia, while Lagotto and ImpactStory are becoming disused products because of their limited reach.

URL : Altmetrics data providers: A meta-analysis review of the coverage of metrics and publication

Original location : https://recyt.fecyt.es/index.php/EPI/article/view/epi.2020.ene.07

Catégories
Non classé

Altmetrics and societal impact measurements: Match or mismatch? A literature review

Authors : Iman Tahamtan, Lutz Bornmann

Can alternative metrics (altmetrics) data be used to measure societal impact? We wrote this literature overview of empirical studies in order to find an answer to this question. The overview includes two parts.

The first part, “societal impact measurements”, explains possible methods and problems in measuring the societal impact of research, case studies for societal impact measurement, societal impact considerations at funding organizations, and the societal problems that should be solved by science.

The second part of the review, “altmetrics”, addresses a major question in research evaluation, which is whether altmetrics are proper indicators for measuring the societal impact of research. In the second part we explain the data sources used for altmetrics studies and the importance of field-normalized indicators for impact measurements.

This review indicates that it should be relevant for impact measurements to be oriented towards pressing societal problems. Case studies in which societal impact of certain pieces of research is explained seem to provide a legitimate method for measuring societal impact.

In the use of altmetrics, field-specific differences should be considered by applying field normalization (in cross-field comparisons). Altmetrics data such as social media counts might mainly reflect the public interest and discussion of scholarly works rather than their societal impact.

Altmetrics (Twitter data) might be especially fruitfully employed for research evaluation purposes, if they are used in the context of network approaches. Conclusions based on altmetrics data in research evaluation should be drawn with caution.

URL : Altmetrics and societal impact measurements: Match or mismatch? A literature review

Original location : https://recyt.fecyt.es/index.php/EPI/article/view/epi.2020.ene.02

Catégories
Non classé

Results dissemination of registered clinical trials across Polish academic institutions: a cross-sectional analysis

Authors : Karolina Strzebonska, Mateusz T Wasylewski, Lucja Zaborowska, Nico Riede, Susanne Wieschowski, Daniel Strech, Marcin Waligora

Objectives

To establish the rates of publication and reporting of results for interventional clinical trials across Polish academic medical centres (AMCs) completed between 2009 and 2013. We aim also to compare the publication and reporting success between adult and paediatric trials.

Design

Cross-sectional study.

Setting

AMCs in Poland.

Participants

AMCs with interventional trials registered on ClinicalTrials.gov.

Main outcome measure

Results reporting on ClinicalTrials.gov and publishing via journal publication.

Results

We identified 305 interventional clinical trials registered on ClinicalTrials.gov, completed between 2009 and 2013 and affiliated with at least one AMC. Overall, 243 of the 305 trials (79.7%) had been published as articles or posted their summary results on ClinicalTrials.gov.

Results were posted within a year of study completion and/or published within 2 years of study completion for 131 trials (43.0%). Dissemination by both posting and publishing results in a timely manner was achieved by four trials (1.3%).

Conclusions

Our cross-sectional analysis revealed that Polish AMCs fail to meet the expectation for timely disseminating the findings of all interventional clinical trials. Delayed dissemination and non-dissemination of trial results negatively affects decisions in healthcare.

URL : Results dissemination of registered clinical trials across Polish academic institutions: a cross-sectional analysis

DOI : http://dx.doi.org/10.1136/bmjopen-2019-034666

Catégories
EN

The role of geographic bias in knowledge diffusion: a systematic review and narrative synthesis

Authors :  Mark Skopec, Hamdi Issa, Julie Reed, Matthew Harris

Background

Descriptive studies examining publication rates and citation counts demonstrate a geographic skew toward high-income countries (HIC), and research from low- or middle-income countries (LMICs) is generally underrepresented. This has been suggested to be due in part to reviewers’ and editors’ preference toward HIC sources; however, in the absence of controlled studies, it is impossible to assert whether there is bias or whether variations in the quality or relevance of the articles being reviewed explains the geographic divide. This study synthesizes the evidence from randomized and controlled studies that explore geographic bias in the peer review process.

Methods

A systematic review was conducted to identify research studies that explicitly explore the role of geographic bias in the assessment of the quality of research articles.

Only randomized and controlled studies were included in the review. Five databases were searched to locate relevant articles. A narrative synthesis of included articles was performed to identify common findings.

Results

The systematic literature search yielded 3501 titles from which 12 full texts were reviewed, and a further eight were identified through searching reference lists of the full texts. Of these articles, only three were randomized and controlled studies that examined variants of geographic bias.

One study found that abstracts attributed to HIC sources elicited a higher review score regarding relevance of the research and likelihood to recommend the research to a colleague, than did abstracts attributed to LIC sources.

Another study found that the predicted odds of acceptance for a submission to a computer science conference were statistically significantly higher for submissions from a “Top University.” Two of the studies showed the presence of geographic bias between articles from “high” or “low” prestige institutions.

Conclusions

Two of the three included studies identified that geographic bias in some form was impacting on peer review; however, further robust, experimental evidence is needed to adequately inform practice surrounding this topic.

Reviewers and researchers should nonetheless be aware of whether author and institutional characteristics are interfering in their judgement of research.

URL : The role of geographic bias in knowledge diffusion: a systematic review and narrative synthesis

DOI : https://doi.org/10.1186/s41073-019-0088-0

Catégories
EN

How society publishers can accelerate their transition to open access and align with Plan S

Authors : Alicia Wise, Lorraine Estelle

Wellcome, UK Research and Innovation, and the Association of Learned and Professional Society Publishers commissioned Information Power Ltd. to undertake a project to support society publishers to accelerate their transition to open access (OA) in alignment with Plan S and the wider move to accelerate immediate OA.

This project is part of a range of activities that cOAlition S partners are taking forward to support the implementation of Plan S principles. The objective of this project was to explore with learned societies a range of potential strategies and business models through which they could adapt and thrive under Plan S.

We consulted with society publishers through interviews, surveys, and workshops about the 27 business models and strategies identified during the project.

We also surveyed library consortia about their willingness to support society publishers to make the transition to OA. Our key finding is that transformative agreements emerge as the most promising model because they offer a predictable, steady funding stream.

We also facilitated pilot transformative agreement negotiations between several society publishers and library consortia. These pilots and a workshop of consortium representatives and society publishers informed the development of an OA transformative agreement toolkit.

Our conclusion is that society publishers should consider all the business models this project has developed and should not automatically equate OA with article publication charges.

URL : How society publishers can accelerate their transition to open access and align with Plan S

DOI : https://doi.org/10.1002/leap.1272

Catégories
EN

The role of learned societies in national scholarly publishing

Authors : Elina Late, Laura Korkeamäki, Janne Pölönen, Sami Syrjämäki

This study examines the role of learned societies as publishers in Finland based on bibliographic information from two Finnish databases. We studied the share of learned societies’ peer‐reviewed publication channels (serials with ISSNs and book publishers with distinct ISBN roots) and outputs (journal articles, conference articles, book articles, and monographs) in Finland.

We also studied the share of learned societies’ open access (OA) publications. In 2018, there were 402 peer‐reviewed publication channels in Finland. In 2011–2017, the number of peer‐reviewed publications from scholars working in Finnish universities and published in Finland was 17,724.

Learned societies publish around 70% of these channels and publications, mostly in the fields of humanities and social sciences. Learned societies in Finland focus on journal publishing, whereas university presses and commercial publishers focus on book publishing. In 2016–2017, 38.4% of the learned societies’ outputs were OA.

This study concludes that Finnish learned societies play an integral part in national scholarly publishing. They play an especially important role in journal publishing, as commercial publishers produce only 2.6% of Finnish journals and book series, and only 1.4% of the journal articles from scholars working in Finnish universities.

DOI : https://doi.org/10.1002/leap.1270

Catégories
EN

The journal publishing services agreement: A guide for societies

Author : Michael T. Clarke

Societies have two fundamental choices when it comes to publishing their journals: they can remain independent, managing all facets of the publication business, or they can work with a larger commercial or not‐for‐profit publisher. If a society chooses to work with a larger publisher, it will invariably do so via a publishing services agreement.

This article discusses the challenges and complexities facing independent society publishers and the reasons why some societies choose to enter into publisher services agreements, whereas others choose to remain independent.

URL : The journal publishing services agreement: A guide for societies

DOI : https://doi.org/10.1002/leap.1266