Academic writing in the age of AI: Comparing the reliability of ChatGPT and Bard with Scopus and Web of Science

Posté le par

Authors : Swati Garg, Asad Ahmad, Dag Øivind Madsen

ChatGPT and Bard (now known as Gemini) are becoming indispensable resources for researchers, academicians and diverse stakeholders within the academic landscape. At the same time, traditional digital tools such as scholarly databases continue to be widely used. Web of Science and Scopus are the most extensive academic databases and are generally regarded as consistently reliable scholarly research resources. With the increasing acceptance of artificial intelligence (AI) in academic writing, this study focuses on understanding the reliability of the new AI models compared to Scopus and Web of Science.

The study includes a bibliometric analysis of green, sustainable and ecological buying behaviour, covering the period from 1 January 2011 to 21 May 2023. These results are used to compare the results from the AI and the traditional scholarly databases on several parameters. Overall, the findings suggest that AI models like ChatGPT and Bard are not yet reliable for academic writing tasks. It appears to be too early to depend on AI for such tasks.

URL : Academic writing in the age of AI: Comparing the reliability of ChatGPT and Bard with Scopus and Web of Science

DOI : https://doi.org/10.1016/j.jik.2024.100563

Field-specific gold open access dynamics in the Chinese mainland: Overviews, disparities, and strategic insights

Posté le par

Authors : Xinyi Chen, Zhiqiang Liu

Gold Open Access (OA) journals are crucial for scholarly communication, highlighting the need for a thorough evaluation of their academic influence on different research fields. This study leverages the InCites platform to examine article-level characteristics relating to 22 Essential Science Indicators (ESI) research fields, with a focus on the dynamics of gold OA articles, including gold OA uptake in the Chinese mainland and gold OA adoption in the domestic English-language academic journal publishing of the Chinese mainland.

The findings reveal that disparities in gold OA adoption across 22 ESI fields are more pronounced in the Chinese mainland compared with the world scenario. In the Chinese mainland, there is a significant polarization in gold OA publishing volumes across different ESI fields, particularly in Chemistry, Clinical Medicine, and Engineering.

This study builds on the understanding of OA citation advantage (OACA) by incorporating gold OA publishing volume into a two-dimensional framework, resulting in the development of a “distance” metric. It further categorizes gold OA citation effects into four quadrants: positive citation effects (quadrants A and B) and negative citation effects (quadrants C and D), based on category normalized citation impact (CNCI) and journal normalized citation impact (JNCI) indicators from the InCites database.

The findings underscore the importance of developing tailored strategies to address field-specific challenges and promote gold OA dynamics in the Chinese mainland; while prioritizing high-quality gold OA journals is essential for fostering gold OA development in the rest of the world.

URL : Field-specific gold open access dynamics in the Chinese mainland: Overviews, disparities, and strategic insights

DOI : https://doi.org/10.1002/leap.1630

FAIR GPT: A virtual consultant for research data management in ChatGPT

Posté le par

Authors : Renat Shigapov, Irene Schumm

FAIR GPT is a first virtual consultant in ChatGPT designed to help researchers and organizations make their data and metadata compliant with the FAIR (Findable, Accessible, Interoperable, Reusable) principles. It provides guidance on metadata improvement, dataset organization, and repository selection.

To ensure accuracy, FAIR GPT uses external APIs to assess dataset FAIRness, retrieve controlled vocabularies, and recommend repositories, minimizing hallucination and improving precision. It also assists in creating documentation (data and software management plans, README files, and codebooks), and selecting proper licenses. This paper describes its features, applications, and limitations.

Arxiv : https://arxiv.org/abs/2410.07108

The impact of generative AI on the scholarly communications of early career researchers: An international, multi-disciplinary study

Posté le par

Authors : David Nicholas, Marzena Swigon, David Clark, Abdullah Abrizah, Jorge Revez, Eti Herman, Blanca Rodríguez Bravo, Jie Xu, Anthony Watkinson

The Harbingers study of early career researchers (ECRs), their work life and scholarly communications, began by studying generational—Millennial—change (c.2016), then moved to pandemic change (c.2020) and is now investigating another potential agent of change: artificial intelligence (2024–). We report here on a substantial scoping pilot study that looks at the impact of AI on the scholarly communications of international ECRs and, extends this to the arts and humanities.

It aims to fill the knowledge gap concerning ECRs whose millennial mindset may render them especially open to change and, as the research workhorses they are, very much in the frontline. The data was collected via in-depth interviews in China, Malaysia, Poland, Portugal, Spain and (selectively) the United Kingdom/United States. The data show ECRs to be thinking, probing and, in some cases, experimenting with AI.

There was a general acceptance that AI will be responsible for the growth of low-quality scientific papers, which could lead to a decline in the quality of research. Scholarly integrity and ethics were a big concern with issues of authenticity, plagiarism, copyright and poor citation practices raised. The most widespread belief was AI would prove to be a transformative force and would exacerbate existing scholarly disparities and inequalities.

URL : The impact of generative AI on the scholarly communications of early career researchers: An international, multi-disciplinary study

DOI : https://doi.org/10.1002/leap.1628

Model proposal of libraries functions to implement open science: Analysis from Latin American librarianship

Posté le par

Author : Juan Miguel Palma Peña

Libraries and open science are linked by common objectives, owing to libraries being actors that develop free access to information for many, and open science is an action that encourages free circulation of data and research outputs. Therefore both the actor and the action contribute to the satisfaction of information needs.

The aim of this research is to analyze the actions that governments, universities and libraries have carried out to implement open science in Latin America, based on the analysis of factors and library functions. The methodology of this research comprised a bibliographic review and quantitative methods.

For the exploratory analysis, the main sources for retrieval information were the official web portals of universities and library entities, the State of Open Data Policy Repository, the Registry of Research Data and the Dataverse Project. A general conclusion is that academic libraries are actors and laboratories with elements to support the implementation of open science.

DOI : https://doi.org/10.1177/03400352241276838

Economic valuation of open research data: A conceptual framework and methodological approach

Posté le par

Authors : Zhifang Tu, Jiashu Shen

The economic significance of open research data is widely acknowledged, yet its quantification remains challenging. This paper presents an effective valuation instrument to help stakeholders understand and evaluate the economic benefits of open research data. By conducting a scoping review and prioritizing user engagement, this study introduces a comprehensive conceptual framework for the economic valuation of open research data. The valuation is based on economic value and willingness to pay, employing the Contingent Valuation Method (CVM).

It incorporates per-use models (view, download, and request) and periodic subscription models (monthly and yearly). An empirical survey was conducted at the National Basic Science Data Center (NBSDC) in China to verify this framework. Both pricing models, comprising five distinct tactics, was supported by surveyed users. Measuring economic value by views and by year was preferred, while willingness to pay by downloads and by year was considered more reasonable.

Overall, the most applicable valuation approach is on a yearly basis. Through this case study at NBSDC, specific pricing tactics were identified, and the total economic value and users’ willingness to pay were assessed. This study is arguably the first to establish a conceptual framework with pricing tactics from a user perspective. This methodological approach for economic valuation of open research data provides evidence and tools for future research, policy formulation, and resource allocation in the context of open science and innovation.

URL : Economic valuation of open research data: A conceptual framework and methodological approach

DOI : https://doi.org/10.1093/reseval/rvae033

The ethics of knowledge sharing: a feminist examination of intellectual property rights and open-source materials in gender transformative methodologies

Posté le par

Authors : Leah Goldmann, Alice Welbourn, Diane Gillespie, Nastnet Ghebrebhran, Lufuno Barro, Sara Siebert, Hawa Kagoya, Lori Michau, Anjalee Kohli, Tina Musuya, Sonia Rebecca Kusiima

Debates on intellectual property rights and open source frequently stem from the business sector and higher education, where goals are typically oriented toward profit, academic status, credit, and/or reputation. What happens if we reconsider the ethics of intellectual property rights and open source when our driving motivation is advancing women’s health and rights? How does this prioritization complicate our assumptions of copyright and open access?

How can we embark on a journey that validates the complex realities of multiple stakeholders who have good intent, but do not always consider the unintended impacts and the broader power dynamics at play? This paper explores the tensions and nuances of sharing methodologies that aim to transform harmful gender norms in an ecosystem that does not always consider the complex challenges behind intellectual property and open-source material.

As a thought-collective dedicated to using a feminist approach to unpack and promote the principles of ethical, effective, and sustainable scale, we hope to underscore how the current research and debates on intellectual property rights and open-source material have good aims but may also fall short in encompassing the realities of gendered social norms change in and with communities around the world.

We conclude with key recommendations for donors, researchers, International Development Corporations, International Non-Governmental Organizations, and those interested in using or adapting dynamic, gender transformative materials created by others.

URL : The ethics of knowledge sharing: a feminist examination of intellectual property rights and open-source materials in gender transformative methodologies

DOI : https://doi.org/10.3389/frma.2024.1321302