Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Research Protocols

Date Submitted: Nov 18, 2023
Open Peer Review Period: Nov 17, 2023 - Jan 12, 2024
Date Accepted: Dec 28, 2023
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Adapting and Evaluating an AI-Based Chatbot Through Patient and Stakeholder Engagement to Provide Information for Different Health Conditions: Master Protocol for an Adaptive Platform Trial (the MARVIN Chatbots Study)

MA Y, Achiche S, Pomey MP, Paquette J, Adjtoutah N, Vicente S, Engler K, Patient Expert Committee Mc, Laymouna M, Lessard D, Lemire B, Asselah J, Therrien R, Osmanlliu E, Zawati MH, Joly Y, Lebouché B

Adapting and Evaluating an AI-Based Chatbot Through Patient and Stakeholder Engagement to Provide Information for Different Health Conditions: Master Protocol for an Adaptive Platform Trial (the MARVIN Chatbots Study)

JMIR Res Protoc 2024;13:e54668

DOI: 10.2196/54668

PMID: 38349734

PMCID: 10900097

Adapting and Evaluating an Artificial Intelligence-Based Chatbot through Patient and Stakeholder Engagement to Provide Information for Different Health Conditions: Master Protocol for an Adaptive Platform Trial (the MARVIN Chatbots)

  • Yuanchao MA; 
  • Sofiane Achiche; 
  • Marie-Pascale Pomey; 
  • Jesseca Paquette; 
  • Nesrine Adjtoutah; 
  • Serge Vicente; 
  • Kim Engler; 
  • MARVIN chatbots Patient Expert Committee; 
  • Moustafa Laymouna; 
  • David Lessard; 
  • Benoît Lemire; 
  • Jamil Asselah; 
  • Rachel Therrien; 
  • Esli Osmanlliu; 
  • Ma’n H Zawati; 
  • Yann Joly; 
  • Bertrand Lebouché

ABSTRACT

Background:

Self-management interventions are emphasized as a way to optimize health outcomes and care, but they necessitate supporting patients to access timely and reliable health information, which remains a challenge. In the realm of digital health, artificial intelligence-based chatbots capable of conversing with users in natural language have emerged as promising tools. However, it is imperative to conduct further research on their implementation. Besides, inclusive digital health research and responsive AI integration into healthcare necessitates active and sustained patients and stakeholder engagement.

Objective:

This manuscript presents the master protocol of the MARVIN chatbots study which has four objectives: 1) co-construct tailored AI chatbots for different healthcare settings; 2) assess their usability in a small participant sample context; 3) measure their implementation outcomes (usability, acceptability, appropriateness, adoption, and fidelity) in a large sample context; and 4) evaluate the impact of patient and stakeholder partnerships on their development. This adaptive platform trial consists of multiple parallel individual chatbot sub-studies sharing common objectives, with Objective 1 through 3 to be completed sequentially, and Objective 4 to be assessed throughout.

Methods:

The study will recruit patients and healthcare professionals from the McGill University Health Centre and the Centre hospitalier de l’Université de Montréal (both in Montreal, Canada). Four needs assessment focus groups with 20 participants and six co-construction workshops with a co-construction design committee will first be conducted to develop and test chatbots adapted to the relevant healthcare context. Thirty participants will then interact with MARVIN for three weeks and assess its usability through a survey and three focus groups. Positive usability outcomes will lead to public access of the chatbot for a one-year real world implementation study. Questionnaires will be administered online to 150 participants to measure usability, acceptability, and appropriateness, while meta-use data will inform adoption and fidelity. Following completion of each objective, focus groups will be conducted with the co-construction design committee to better understand stakeholders’ perspectives on their engagement in research.

Results:

From July 2022 to October 2023, this master protocol led to four sub-studies: 1) MARVIN for HIV (large-scale implementation expected to begin in mid-2024); 2) MARVIN “Pharma” to support community pharmacist in providing HIV care (usability study planned for mid-2024); 3) MARVINA for breast cancer, and 4) MARVIN Champ for pediatric infectious conditions (both in preparation with development to begin in early-2024).

Conclusions:

The development and adaptation of the MARVIN chatbots is expected to improve patient self-management and healthcare efficiency. This master protocol comprehensively examines the implementation outcomes of chatbot interventions for patients and healthcare professionals. It will also contribute to best practice recommendations for patient and stakeholder engagement in digital health research. With appropriate design, this protocol can sustain long-term innovation translation, and deliver timely interventions to advance patient-centered personalized medicine. Clinical Trial: ClinicalTrials.gov identifier: NCT05789901 https://classic.clinicaltrials.gov/ct2/show/NCT05789901


 Citation

Please cite as:

MA Y, Achiche S, Pomey MP, Paquette J, Adjtoutah N, Vicente S, Engler K, Patient Expert Committee Mc, Laymouna M, Lessard D, Lemire B, Asselah J, Therrien R, Osmanlliu E, Zawati MH, Joly Y, Lebouché B

Adapting and Evaluating an AI-Based Chatbot Through Patient and Stakeholder Engagement to Provide Information for Different Health Conditions: Master Protocol for an Adaptive Platform Trial (the MARVIN Chatbots Study)

JMIR Res Protoc 2024;13:e54668

DOI: 10.2196/54668

PMID: 38349734

PMCID: 10900097

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.