Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Apr 7, 2021
Date Accepted: Sep 12, 2021

The final, peer-reviewed published version of this preprint can be found here:

Patient Interactions With an Automated Conversational Agent Delivering Pretest Genetics Education: Descriptive Study

Chavez-Yenter D, Kimball KE, Kohlmann W, Lorenz Chambers R, Bradshaw R, Espinel WF, Flynn M, Gammon A, Goldberg ER, Hagerty KJ, Hess R, Kessler C, Monahan R, Temares D, Tobik K, Mann DM, Kawamoto K, Del Fiol G, Buys S, Ginsburg O, Kaphingst KA

Patient Interactions With an Automated Conversational Agent Delivering Pretest Genetics Education: Descriptive Study

J Med Internet Res 2021;23(11):e29447

DOI: 10.2196/29447

PMID: 34792472

PMCID: 8663668

Patient Interactions with an Automated Conversational Agent Delivering Pre-test Genetics Education: A Descriptive Study

  • Daniel Chavez-Yenter; 
  • Kadyn E. Kimball; 
  • Wendy Kohlmann; 
  • Rachelle Lorenz Chambers; 
  • Richard Bradshaw; 
  • Whitney F. Espinel; 
  • Michael Flynn; 
  • Amanda Gammon; 
  • Eric R. Goldberg; 
  • Kelsi J. Hagerty; 
  • Rachel Hess; 
  • Cecilia Kessler; 
  • Rachel Monahan; 
  • Danielle Temares; 
  • Katie Tobik; 
  • Devin M. Mann; 
  • Kensaku Kawamoto; 
  • Guilherme Del Fiol; 
  • Saundra Buys; 
  • Ophira Ginsburg; 
  • Kimberly A. Kaphingst

ABSTRACT

Background:

Cancer genetic testing has grown exponentially in the past decade in its use for quantifying hereditary cancer risk, while also its use for targeting treatment and care. With this continued growth and shortage of healthcare workforces, there is a need for automated strategies that provide high quality genetics services to patients in order to reduce clinical demand on genetics providers. Conversational agents have shown promise in managing mental health, patient pain management, and chronic conditions and are increasingly being used in cancer genetic services. However, research on how these agents are utilized by patients is limited.

Objective:

Therefore, our current study aim was to assess users’ interactions with a conversational agent for pre-test genetics education prior to genetic testing.

Methods:

The conversational agent provided scripted content similar to what is delivered in a pre-test genetic counseling visit for cancer genetic testing. Outside of a core set of information delivered to all patients, users were able to navigate within the chat to request additional content in areas of interest. An AI preprogrammed library was also established to allow users to ask open-ended questions of the conversational agent. Descriptives statistics were used for quantitative measures and thematic analysis was used for qualitative responses.

Results:

Of 93 National Comprehensive Cancer Network guidelines eligible patients offered access to the conversational agent, 36 started the chat (38.7%), with 30 completed the chat (32.3%). Once a participant completed a chat, a transcript of the interaction was developed for the research team, from which we extracted the following data and compiled results. The majority of users who completed the chat indicated that they wanted to continue with genetic testing (70%, n=21); 30% were unsure (n=9) and no patients declined moving forward with testing. Those who decided to test spent an average of 10 minutes on the chat (SD=2.57), selected an average of 1.2 additional pieces of information, and generally did not ask open-ended questions. Those who were unsure spent 4.0 more minutes on average (mean=14.1, SD=7.41, P=.03) with the chat, selected an average of 2.9 additional pieces of information, and asked at least 1 open-ended question.

Conclusions:

Our results indicate that the chat met the information needs of the majority of patients considering cancer genetic testing. However, a subset of patients may need additional education or interpersonal support prior to making a testing decision. Such high-information seeking patients may need additional support from a clinical provider to make a testing decision. Genetic counseling team members should follow up with patients who have additional questions and concerns to alleviate any remaining concerns. Therefore, conversational agents have the potential to be a scalable alternative for pre-test genetics education, reducing clinical demand on genetics providers.


 Citation

Please cite as:

Chavez-Yenter D, Kimball KE, Kohlmann W, Lorenz Chambers R, Bradshaw R, Espinel WF, Flynn M, Gammon A, Goldberg ER, Hagerty KJ, Hess R, Kessler C, Monahan R, Temares D, Tobik K, Mann DM, Kawamoto K, Del Fiol G, Buys S, Ginsburg O, Kaphingst KA

Patient Interactions With an Automated Conversational Agent Delivering Pretest Genetics Education: Descriptive Study

J Med Internet Res 2021;23(11):e29447

DOI: 10.2196/29447

PMID: 34792472

PMCID: 8663668

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.