Accepted for/Published in: JMIR Medical Education
Date Submitted: Mar 6, 2023
Open Peer Review Period: Mar 6, 2023 - May 1, 2023
Date Accepted: Jul 21, 2023
(closed for review but you can still tweet)
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
The potential and concerns of using Artificial Intelligence in scientific research: ChatGPT case
ABSTRACT
Background:
One aspect of AI that has gained significant attention is natural language processing (NLP) which refers to the ability of computers to understand and generate human language
Objective:
This study aimed to examine the potential and concerns of using Artificial Intelligence (AI) in scientific research by generating high-impact research articles by analyzing the quality of articles generated by ChatGPT and assessing its impact on research framework, data analysis, and literature review. The study also explored concerns around ownership and integrity of research when using AI-generated text.
Methods:
Four articles were generated using ChatGPT and evaluated by 23 reviewers. The researchers developed an evaluation form to assess the quality of the articles generated. Additionally, 500 abstracts were generated using ChatGPT and evaluated for their quality. The data were analyzed using ANOVA and thematic analysis to analyze the qualitative data provided by the reviewers.
Results:
Using detailed prompts with the context of the study would generate high-quality research that can be published in high-impact journals. However, ChatGPT had a slight impact on developing the research framework and data analysis, with the main improvement needed in developing the literature review. Moreover, concerns around ownership and integrity of research when using AI-generated text were highlighted. Nonetheless, ChatGPT has a high potential in increasing human productivity in research and can be used in academic writing.
Conclusions:
AI-generated text has the potential to improve the quality of high-impact research articles, and the study recommends changing the research template to focus only on research methodology and data analysis in-depth, which can be the trend for the next generation of research in the AI era.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.