Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Formative Research

Date Submitted: Mar 8, 2023
Open Peer Review Period: Mar 8, 2023 - May 3, 2023
Date Accepted: Jun 19, 2023
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Outcomes of End-User Testing of a Care Coordination Mobile App With Families of Children With Special Health Care Needs: Simulation Study

Wong W, Ming D, Pataras S, Fee CH, Coleman C, Docktor M, Shah N, Antonelli R

Outcomes of End-User Testing of a Care Coordination Mobile App With Families of Children With Special Health Care Needs: Simulation Study

JMIR Form Res 2023;7:e43993

DOI: 10.2196/43993

PMID: 37639303

PMCID: 10495855

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Outcomes of End-User Testing with families of CYSHCN on a Care Coordination Mobile App: A Simulation Study

  • Willis Wong; 
  • David Ming; 
  • Sarah Pataras; 
  • Casey Holmes Fee; 
  • Cara Coleman; 
  • Michael Docktor; 
  • Nirmish Shah; 
  • Richard Antonelli

ABSTRACT

Background:

Care for children and youth with special healthcare needs (CYSHCN) relied on a network of providers who work to address the medical, behavioral, developmental, educational, family support, social, and economic needs of the child and family. Family-directed, manually created visual depictions of care team composition (i.e. care mapping) and detailed notetaking curated by caregivers (e.g. care binders) have been shown to enhance care coordination (CC) for families of CYSHCN, but are difficult to implement in clinical settings due to lack of integration with electronic health records (EHR) and limited visibility of family generated insights for care providers. Digital health tools are a promising solution to address this. Caremap is an EHR-integrated digital personal health record mobile application designed to integrate the benefits of care mapping and care binders. Currently, there is sparse literature describing end-user participation in the co-design of digital health tools that support care coordination for families of CYSHCN. In this paper, we describe a project that evaluated app usability and proof-of-concept through end-user simulation.

Objective:

The goal of this study was to conduct proof-of-concept of the Caremap app to coordinate care for CYSHCN. Specific aims include 1) to engage end-users in app co-design via app simulation; 2) to evaluate the useability of the app using validated measures; and 3) to explore user perspectives on how to make further improvements to the app using qualitative and quantitative data collection.

Methods:

In partnership with Family Voices, a national advocacy group for families of CYSHCN, caregivers of CYSHCN were recruited and underwent a virtual simulation exercise using Caremap to coordinate care for a simulated case of a child with complex medical and behavioral needs. Caregivers completed a post-simulation questionnaire adapted from two validated surveys: the Pediatric Integrated Care Survey (PICS) and the User Version of the Mobile Application Rating Scale (uMARS). In addition, a key informant interview was conducted with a liaison to Spanish-speaking families of CYSHCN regarding app accessibility for non-English speaking users.

Results:

A Caremap simulation was successfully developed in partnership with families of CYSHCN. 38 families recruited from 19 different states participated in the simulation exercise and completed the survey. Average rating for the adapted PICS survey was 4.1/5 (range: 1-5), and average rating for the adapted uMARS survey was 4/5(range: 1-5). The highest rated app feature was the ability to track progress toward short-term, patient/ family defined care goals.

Conclusions:

Virtual simulation successfully facilitated end-user engagement and feedback on the usability and functionality of a digital health care coordination app for families of CYSHCN. Families who completed simulation with Caremap rated the app highly across several domains for CC. Simulation study results also elucidated key areas for improvement that translated to actionable next steps in application development.


 Citation

Please cite as:

Wong W, Ming D, Pataras S, Fee CH, Coleman C, Docktor M, Shah N, Antonelli R

Outcomes of End-User Testing of a Care Coordination Mobile App With Families of Children With Special Health Care Needs: Simulation Study

JMIR Form Res 2023;7:e43993

DOI: 10.2196/43993

PMID: 37639303

PMCID: 10495855

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.