Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Human Factors

Date Submitted: Sep 18, 2023
Date Accepted: Dec 15, 2023

The final, peer-reviewed published version of this preprint can be found here:

Leveraging Generative AI Tools to Support the Development of Digital Solutions in Health Care Research: Case Study

Rodriguez DV, Lawrence K, Gonzalez J, Brandfield-Harvey B, Xu L, Tasneem S, Levine D, Mann D

Leveraging Generative AI Tools to Support the Development of Digital Solutions in Health Care Research: Case Study

JMIR Hum Factors 2024;11:e52885

DOI: 10.2196/52885

PMID: 38446539

PMCID: 10955400

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Leveraging Generative AI tools to support the development of digital solutions in healthcare research: case study

  • Danissa V. Rodriguez; 
  • Katharine Lawrence; 
  • Javier Gonzalez; 
  • Beatrix Brandfield-Harvey; 
  • Lynn Xu; 
  • Sumaiya Tasneem; 
  • Defne Levine; 
  • Devin Mann

ABSTRACT

Background:

Generative artificial intelligence (GenAI) has the potential to revolutionize health technology product development by improving coding quality, efficiency, documentation, quality assessment and review, and troubleshooting.

Objective:

This paper explores the application of a commercially available GenAI tool (ChatGPT) to the development of a digital health behavior change intervention designed to support patient engagement in a commercial digital diabetes prevention program.

Methods:

We examine the capacity, advantages, and limitations of ChatGPT to support digital product idea conceptualization, intervention content development, and the software engineering process including software requirement generation, software design, and code production. Eleven participants with fields of study ranging from medicine, implementation science and computer science and years in field of work of average 15 years, participated in the output review process (ChatGPT vs Human generated outcome). All had familiarity or prior exposure to the original PAMS intervention.

Results:

Eleven experienced evaluators rated the ChatGPT-produced outputs in terms of understandability, usability, novelty, relevance, completeness and efficiency. Results were positive for most of the metrics. We identified that ChatGPT can 1) support developers in achieving high-quality products in a shorter development time, and 2) facilitate non-technical communication and system understanding between technical and non-technical team members, with the goal of driving the development of rapid and easy-to-build computational solutions for medical technologies.

Conclusions:

Overall, we have found that ChatGPT served as a usable facilitator for researchers engaging in the software development life cycle, from product conceptualization to feature identification, and user story development to code generation.


 Citation

Please cite as:

Rodriguez DV, Lawrence K, Gonzalez J, Brandfield-Harvey B, Xu L, Tasneem S, Levine D, Mann D

Leveraging Generative AI Tools to Support the Development of Digital Solutions in Health Care Research: Case Study

JMIR Hum Factors 2024;11:e52885

DOI: 10.2196/52885

PMID: 38446539

PMCID: 10955400

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.