Creating research ethics and integrity country report cards: Case study from Europe

Authors : Andrijana Perković Paloš, Rea Roje, Vicko Tomić, Ana Marušić

Structures for and practices of research integrity (RI) and research ethics (RE) differ among countries. This study analyzed the processes and structures for RI and RE in Europe, following the framework developed at the World Conferences on Research Integrity.

We present RI and RE Country Report Cards for 16 European countries, which included the information on RI and RE structures, processes and outcomes. While some of the countries are front-runners when it comes to RI and RE, with well-established and continually developing policies and structures, others are just starting their journey in RI and RE.

Although RI and RE contextual divergences must be taken into account, a level of harmonization among the countries is necessary so that researchers working in the European area can similarly handle RI and RE issues and have similar expectations regardless of the organization in which they work. RI and RE Country Report Cards can be a tool to monitor, compare, and strengthen RE and integrity across countries through empowerment and inspiration by examples of good practices and developed systems.

URL : Creating research ethics and integrity country report cards Case study from Europe

DOI : https://doi.org/10.1080/08989621.2022.2163632

Analysing Elsevier Journal Metadata with a New Specialized Workbench inside ICSR Lab

Authors : Ramadurai Petchiappan, Kristy James, Andrew Plume, Efthymios Tsakonas, Ana Marušić, Mario Malicki, Francisco Grimaldo, Bahar Mehmani

In this white paper we introduce Elsevier’s Peer Review Workbench which will be available via the computational platform ICSR Lab. The workbench offers a unique dataset to interested researchers who want to run research on journal evaluation and peer review processes.

We describe its properties, advantages, and limitations as well as the process of proposal application. This is a living document and will be updated on a regular basis.

DOI : https://dx.doi.org/10.2139/ssrn.4211833

Development and implementation of research integrity guidance documents: Explorative interviews with research integrity experts

Authors : Rea Roje, Vicko Tomić, Ivan Buljan, Ana Marušić

Research integrity (RI) guidance documents often lack sufficient details on handling specific RI issues causing the lack of harmonized approaches to RI and opening the way to research misconduct and other detrimental research practices.

Standard operating procedures (SOPs) are developed and implemented by organizations for ensuring the uniformity and quality of performed actions. This study aimed to explore stakeholders’ opinions on SOPs for RI, factors influencing the implementation of RI guidance documents and practices, and ideas for improvements in the RI field.

We conducted semi-structured interviews with stakeholders from different groups. Data were analyzed using the reflexive thematic analysis approach, and three themes were developed. The first theme addressed participants’ knowledge and perceptions on SOPs for RI and their impact on RI promotion and implementation.

The second theme described different factors that have a positive or negative impact on the implementation of RI and RI guidance documents and practices, while the third theme addressed needed changes and ideas for improvements in the RI field.

Participants considered SOPs valuable for RI promotion. SOPs should be developed based on and consistent with more general and aspirational guidance and through the dialogue with researchers and other stakeholders, to ensure their relevancy.

URL : Development and implementation of research integrity guidance documents: Explorative interviews with research integrity experts

DOI : https://doi.org/10.1080/08989621.2021.1989676

Completeness of reporting in abstracts of randomized controlled trials in subscription and open access journals: cross-sectional study

Authors : Iva Jerčić Martinić-Cezar, Ana Marušić

Background

Open access (OA) journals are becoming a publication standard for health research, but it is not clear how they differ from traditional subscription journals in the quality of research reporting.

We assessed the completeness of results reporting in abstracts of randomized controlled trials (RCTs) published in these journals.

Methods

We used the Consolidated Standards of Reporting Trials Checklist for Abstracts (CONSORT-A) to assess the completeness of reporting in abstracts of parallel-design RCTs published in subscription journals (n = 149; New England Journal of Medicine, Journal of the American Medical Association, Annals of Internal Medicine, and Lancet) and OA journals (n = 119; BioMedCentral series, PLoS journals) in 2016 and 2017.

Results

Abstracts in subscription journals completely reported 79% (95% confidence interval [CI], 77–81%) of 16 CONSORT-A items, compared with 65% (95% CI, 63–67%) of these items in abstracts from OA journals (P < 0.001, chi-square test). The median number of completely reported CONSORT-A items was 13 (95% CI, 12–13) in subscription journal articles and 11 (95% CI, 10–11) in OA journal articles.

Subscription journal articles had significantly more complete reporting than OA journal articles for nine CONSORT-A items and did not differ in reporting for items trial design, outcome, randomization, blinding (masking), recruitment, and conclusions. OA journals were better than subscription journals in reporting randomized study design in the title.

Conclusion

Abstracts of randomized controlled trials published in subscription medical journals have greater completeness of reporting than abstracts published in OA journals.

OA journals should take appropriate measures to ensure that published articles contain adequate detail to facilitate understanding and quality appraisal of research reports about RCTs.

URL : Completeness of reporting in abstracts of randomized controlled trials in subscription and open access journals: cross-sectional study

DOI : https://doi.org/10.1186/s13063-019-3781-x

Editors’ and authors’ individual conflicts of interest disclosure and journal transparency. A cross-sectional study of high-impact medical specialty journals

Authors : Rafael Dal-Ré, Arthur L Caplan, Ana Marusic

Objective

To assess the fulfilment of authors’ and editors’ individual disclosure of potential conflicts of interest in a group of highly influential medicine journals across a variety of specialties.

Design

Cross-sectional analysis.

Setting and participants

Top-ranked five journals as per 2017 Journal Citation Report impact factor of 26 medical, surgery and imaging specialties.

Interventions

Observational analysis.

Primary and secondary outcome measures

Percentage of journals requiring disclosure of authors’ and editors’ individual potential conflicts of interest (CoI). Journals that were listed as followers of the International Committee of Medical Journal Editors (ICMJE) Recommendations, members of the Committee on Publication Ethics (COPE) and linked to a third party (ie, college, professional association/society, public institution).

Results

Although 99% (129/130) of journals required author’s CoI disclosure, only 12% (16/130) reported individual editors’ potential CoIs. Forty−five per cent (58/130) of journals were followers of the ICMJE Recommendations, and 73% (95/130) were COPE members. Most (69%; 90/130) were linked to a college, professional society/association or public institution. Only one journal did not have policies on individual authors’ and editors’ CoI disclosure.

Conclusion

Very few high-impact medical journals disclosed their editorial teams’ individual potential CoIs—conversely, almost all required disclosure of authors’ individual CoIs. Journal followers of the ICMJE Recommendations should regularly disclose the editors’ individual CoIs, as this is the only legitimate way to ask the same transparency of authors.

URL : Editors’ and authors’ individual conflicts of interest disclosure and journal transparency. A cross-sectional study of high-impact medical specialty journals

DOI : http://dx.doi.org/10.1136/bmjopen-2019-029796

Correcting duplicate publications: follow up study of MEDLINE tagged duplications

Authors : Mario Malički, Ana Utrobičić, Ana Marušić

Introduction

As MEDLINE indexers tag similar articles as duplicates even when journals have not addressed the duplication(s), we sought to determine the reasons behind the tagged duplications, and if the journals had undertaken or had planned to undertake any actions to address them.

Materials and methods

On 16 January 2013, we extracted all tagged duplicate publications (DPs), analysed published notices, and then contacted MEDLINE and editors regarding cases unaddressed by notices.

For non-respondents, we compared full text of the articles. We followed up the study for the next 5 years to see if any changes occurred.

Results

We found 1011 indexed DPs, which represented 555 possible DP cases (in MEDLINE, both the original and the duplicate are assigned a DP tag). Six cases were excluded as we could not obtain their full text.

Additional 190 (35%) cases were incorrectly tagged as DPs. Of 359 actual cases of DPs, 200 (54%) were due to publishers’ actions (e.g. identical publications in the same journal), and 159 (46%) due to authors’ actions (e.g. article submission to more than one journal). Of the 359 cases, 185 (52%) were addressed by notices, but only 25 (7%) retracted.

Following our notifications, MEDLINE corrected 138 (73%) incorrectly tagged cases, and editors retracted 8 articles.

Conclusions

Despite clear policies on how to handle DPs, just half (54%) of the DPs in MEDLINE were addressed by journals and only 9% retracted. Publishers, editors, and indexers need to develop and implement standards for better correction of duplicate published records.

URL : Correcting duplicate publications: follow up study of MEDLINE tagged duplications

DOI : https://doi.org/10.11613/BM.2019.010201