Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Human Factors

Date Submitted: Nov 22, 2024
Open Peer Review Period: Dec 29, 2024 - Feb 23, 2025
Date Accepted: Mar 6, 2025
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Building and Beta-Testing Be Well Buddy Chatbot, a Secure, Credible and Trustworthy AI Chatbot That Will Not Misinform, Hallucinate or Stigmatize Substance Use Disorder: Development and Usability Study

Salyers AJ, Bull S, Silvasstar J, Howell K, Wright T, Banaei-Kashani F

Building and Beta-Testing Be Well Buddy Chatbot, a Secure, Credible and Trustworthy AI Chatbot That Will Not Misinform, Hallucinate or Stigmatize Substance Use Disorder: Development and Usability Study

JMIR Hum Factors 2025;12:e69144

DOI: 10.2196/69144

PMID: 40334652

PMCID: 12077853

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Building a secure, credible and trustworthy artificially intelligent chatbot that will not misinform, hallucinate or stigmatize substance use disorder: the Be Well Buddy chatbot

  • Adam Jerome Salyers; 
  • Sheana Bull; 
  • Joshva Silvasstar; 
  • Kevin Howell; 
  • Tara Wright; 
  • Farnoush Banaei-Kashani

ABSTRACT

Background:

Artificially Intelligent (AI) Chatbots that deploy natural language processing (NLP) and machine learning (ML) are becoming more common in healthcare to facilitate patient education and outreach, but generative chatbots such as Chat GPT face challenges because they can misinform and hallucinate. Healthcare systems are increasingly interested in using these tools for patient education, access to care and self-management, but need reassurances that AI systems can be secure and credible.

Objective:

To build a secure system that people can use to send messages via SMS with questions about substance use, and where they can screen for substance use disorder. The system will rely on data transfer via third party vendors and will thus require reliable and trustworthy encryption of protected health information (PHI).

Methods:

We describe the process and specifications for building an AI chatbot that users can access to gain information about and screen for substance use disorder (SUD) from Be Well Texas, a clinical provider affiliated with the University of Texas Health Sciences at San Antonio.

Results:

The AI chatbot system utilizes NLP and ML to classify expert curated content related to SUD illustrates how we can comply with best practices in HIPAA compliance in data encryption for data transfer and data at rest while still offering a state-of-the-art system that utilizes dynamic user driven conversation to dialogue about SUD, screen for SUD and access SUD treatment services.

Conclusions:

Recent calls for attention to user friendly design that attend to user rights that honor digital rights and regulations for digital substance use offerings suggests this work is timely and appropriate while still advancing the field of AI. Clinical Trial: Not applicable, this is not a clinical trial.


 Citation

Please cite as:

Salyers AJ, Bull S, Silvasstar J, Howell K, Wright T, Banaei-Kashani F

Building and Beta-Testing Be Well Buddy Chatbot, a Secure, Credible and Trustworthy AI Chatbot That Will Not Misinform, Hallucinate or Stigmatize Substance Use Disorder: Development and Usability Study

JMIR Hum Factors 2025;12:e69144

DOI: 10.2196/69144

PMID: 40334652

PMCID: 12077853

The author of this paper has made a PDF available, but requires the user to login, or create an account.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.