Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Dermatology

Date Submitted: May 5, 2026
Date Accepted: Oct 13, 2026

The final, peer-reviewed published version of this preprint can be found here:

Using a Large Language Model Chatbot for Allergen Avoidance Counseling in Contact Dermatitis: Quantitative Evaluation Study

Phadungsaksawasdi P, Kamolphasukchuen T, Tresukosol P

Using a Large Language Model Chatbot for Allergen Avoidance Counseling in Contact Dermatitis: Quantitative Evaluation Study

JMIR Dermatol 2026;9:e100364

DOI: 10.2196/100364

PMID: 43044101

Using a large language model chatbot for allergen avoidance counseling in contact dermatitis: An evaluation of validity and limitations

  • Pawit Phadungsaksawasdi; 
  • Thanida Kamolphasukchuen; 
  • Poohglin Tresukosol

ABSTRACT

Background:

Artificial intelligence (AI), particularly large language models (LLMs) such as ChatGPT, is increasingly being explored for its potential role in supporting clinical decision-making. In dermatology, LLMs may assist with patient counseling, including allergen avoidance recommendations for individuals with contact dermatitis. However, their usefulness in recommending allergen-free products remains underexplored.

Objective:

This study aimed to evaluate the potential use of ChatGPT in recommending allergen-free products for the management of contact allergens.

Methods:

Thirty allergen groups from the international standard patch test series were assessed. For each allergen, ChatGPT was prompted to recommend five allergen-free products using three question formats of varying complexity. Responses were included if they specified a product. Dermatologists manually classified each response into one of five categories: valid, invalid, cross-reaction, unknown, or unresponsive.

Results:

ChatGPT generated valid product recommendations in 79.07% of responses. Invalid responses accounted for 1.78%, cross-reactive recommendations for 2.13%, unknown responses for 8.67%, and unresponsive outputs for 8.36%. The simplest question format produced the highest accuracy, with 85.33% valid responses. ChatGPT performed best for cosmetics and medications, with valid response rates of 90.48% and 82.5%, respectively. Accuracy was lower for sensitive allergens, including fragrance mixes and para-phenylenediamine (PPD). Frequent cross-reactive recommendations were observed, particularly involving Peru balsam.

Conclusions:

LLM-based chatbots such as ChatGPT may have potential as supportive tools for allergen-avoidance counseling in contact dermatitis. However, their performance varies by allergen type and prompt complexity, and further refinement is needed before they can be reliably used in clinical counseling.


 Citation

Please cite as:

Phadungsaksawasdi P, Kamolphasukchuen T, Tresukosol P

Using a Large Language Model Chatbot for Allergen Avoidance Counseling in Contact Dermatitis: Quantitative Evaluation Study

JMIR Dermatol 2026;9:e100364

DOI: 10.2196/100364

PMID: 43044101

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.