Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Formative Research

Date Submitted: Feb 28, 2024
Date Accepted: Nov 13, 2024

The final, peer-reviewed published version of this preprint can be found here:

Usability and Usefulness of a Symptom Management Coaching System for Patients With Cancer Treated With Immune Checkpoint Inhibitors: Comparative Mixed Methods Study

Glaser SLC, Fraterman I, van Brummelen N, Tibollo V, Del Campo LM, Mallo H, Wilgenhof S, Wilk S, Gisko V, Khadakou V, Cornet R, Ottaviano M, Medlock SK

Usability and Usefulness of a Symptom Management Coaching System for Patients With Cancer Treated With Immune Checkpoint Inhibitors: Comparative Mixed Methods Study

JMIR Form Res 2025;9:e57659

DOI: 10.2196/57659

PMID: 39847771

PMCID: 11803325

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Usability and Usefulness Testing of a Symptom Management and Coaching System for Cancer Patients treated with Immune Checkpoint Inhibitors: a Comparative Qualitative Study

  • Savannah Lucia Caterina Glaser; 
  • Itske Fraterman; 
  • Noah van Brummelen; 
  • Valentina Tibollo; 
  • Laura Maria Del Campo; 
  • Henk Mallo; 
  • Sofie Wilgenhof; 
  • Szymon Wilk; 
  • Vitali Gisko; 
  • Vadim Khadakou; 
  • Ronald Cornet; 
  • Manuel Ottaviano; 
  • Stephanie K. Medlock

ABSTRACT

Background:

The prognosis for patients with several types of cancer has substantially improved since the introduction of immune checkpoint inhibitors. However, patients may experience symptoms both from the cancer itself and from the medication. EHealth applications can help support patients, their informal caregivers, and care providers during cancer treatment and follow-up. A prototype of the eHealth tool Cancer Patients Better Life Experience (CAPABLE) was developed to facilitate symptom reporting, patient education, and wellbeing interventions, aimed for melanoma and renal cell carcinoma patients treated with immunotherapy.

Objective:

To evaluate the CAPABLE prototype by conducting tests to assess usability, user experience and perceived acceptability amongst end-users, and secondarily to assess any agreements or differences in the results of our wide range of participants.

Methods:

This usability study was executed by interviewing patients with melanoma, renal cell carcinoma or other cancer types. Participants were asked to give their opinion on the concept of the tool, to perform think-aloud tasks and to complete the System Usability Scale and a Perceived Usefulness questionnaire. The interviews were analyzed by independent coding. The extracted usability problems were mapped to an eHealth Usability Problem Framework.

Results:

We included 21 participants in the study, aged 29 to 73 years; 13 melanoma or renal cell carcinoma patients who had received immunotherapy and 8 patients with other types of cancer who had not received immunotherapy. In total, 76 usability issues were identified. Most usability problems were in the task-technology fit category of the framework. Critical problems regarding the symptom monitoring functionality were mainly found by participants who had received immunotherapy.

Conclusions:

Despite identified usability issues, participants responded positively in the perceived acceptance and usefulness questionnaire regarding the evaluated tool. Further analysis of the usability problems indicates that it was essential to include participants who matched the target end-users. Participants treated with immunotherapy, specifically with previous experience in immune-related adverse events encountered critical problems with symptom reporting that would not have been identified if these participants were not included. For other tasks and functionalities, it seems likely that loosening the inclusion criteria would have resulted in sufficient feedback without critical missing usability issues. Clinical Trial: Not applicable.


 Citation

Please cite as:

Glaser SLC, Fraterman I, van Brummelen N, Tibollo V, Del Campo LM, Mallo H, Wilgenhof S, Wilk S, Gisko V, Khadakou V, Cornet R, Ottaviano M, Medlock SK

Usability and Usefulness of a Symptom Management Coaching System for Patients With Cancer Treated With Immune Checkpoint Inhibitors: Comparative Mixed Methods Study

JMIR Form Res 2025;9:e57659

DOI: 10.2196/57659

PMID: 39847771

PMCID: 11803325

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.