Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Previously submitted to: Journal of Medical Internet Research (no longer under consideration since May 16, 2024)

Date Submitted: Jul 24, 2023

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Standardized Nomenclature Prompting (SNP): Enhancing Medical Queries in Generative Language Models

  • Saman Andalib; 
  • Aidin Spina; 
  • Faris Halaseh; 
  • Rishi Vermani; 
  • Jason Liang; 
  • Warren Wiechmann

ABSTRACT

Background:

OpenAI’s ChatGPT and other Generative Language Models (GLMs) have rapidly increased in popularity. Such language models have the potential to greatly benefit the medical field. Despite the rapid rise in the implementation of such technologies, no standardized framework currently exists to discuss the prompting techniques for these models.

Objective:

We aim to establish the nomenclature of “variable” and “clause” in prompting a generative language model while providing example interviews that outline the utility of said approaches in medical applications. This goal is key to implementing GLMs in the medical field, as they provide grounds for assessing prompting methodologies.

Methods:

The specific GLM assessed in this paper was OpenAI’s ChatGPT-4. Definitions of terms utilized in prompting procedures were outlined, including “Input Prompt,” “Variable,” “Demographic Variable and Clause,” “Independent Variable and Clause,” “Dependent Variable and Clause,” “Generative Clause,” and “Output.” This methodology was implemented with the three-example patient cases. Unedited ChatGPT outputs were included.

Results:

As demonstrated in our three cases, precise combinations of variables and clauses that consider patients’ age, gender, weight, height, and education level can yield unique outputs. The software can do so quickly and in a personalized, patient-specific manner. Our findings demonstrate that GLMs can be used to generate comprehensive sets of educational material to combat current limitations with the potential of improving healthcare outcomes as they are further explored.

Conclusions:

To our knowledge, this is the first attempt to standardize medical inputs into a GLM. Doing so opens the potential for outlining patient-specific information in medical queries that can better tailor responses to individual patients. Additionally, throughout this paper, we recommended several avenues that we believe would provide the greatest insight into future research of GLMs, such as ChatGPT. Most notably, future projects must look at the specialty and presentation-specific input changes that might produce the best outputs for desired goals.


 Citation

Please cite as:

Andalib S, Spina A, Halaseh F, Vermani R, Liang J, Wiechmann W

Standardized Nomenclature Prompting (SNP): Enhancing Medical Queries in Generative Language Models

JMIR Preprints. 24/07/2023:51209

DOI: 10.2196/preprints.51209

URL: https://preprints.jmir.org/preprint/51209

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.