Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR mHealth and uHealth

Date Submitted: Mar 13, 2025
Date Accepted: Oct 17, 2025

The final, peer-reviewed published version of this preprint can be found here:

Interpretable Machine Learning Models for Analyzing Determinants Affecting the Use of mHealth Apps Among Family Caregivers of Patients With Stroke in Chinese Communities: Cross-Sectional Survey Study

Du Y, Fan JY, Liu GZ, Yang ZY, Lei Y, Guo YF

Interpretable Machine Learning Models for Analyzing Determinants Affecting the Use of mHealth Apps Among Family Caregivers of Patients With Stroke in Chinese Communities: Cross-Sectional Survey Study

JMIR Mhealth Uhealth 2025;13:e73903

DOI: 10.2196/73903

PMID: 41284965

PMCID: 12643396

An analysis of determinants affecting the utilization of mHealth App by family caregivers of stroke patients in Chinese communities: Based on interpretable machine learning models

  • Yun Du; 
  • Jun-Ying Fan; 
  • Guang-Zhi Liu; 
  • Zi-Yue Yang; 
  • Yang Lei; 
  • Yu-Fang Guo

ABSTRACT

Background:

mHealth App was believed as an effective method to support family caregivers to better care of stroke patients. This study aimed to explore the status and the influencing factors of mHealth App utilization among family caregivers of stroke patients via machine-learning (ML) models.

Objective:

The purpose of this study was to understand the status quo of mHealth App use among community family caregivers of stroke patients and the factors influencing their use behavior. Six machine learning models were used to construct the classifier, and SHAP algorithm is introduced to interpret the best machine learning model.

Methods:

In this cross-sectional study, we included family carers of stroke patients into the study, whose basic profile and mHealth App usage were obtained through face-to-face questionnaires, and for the users, additional measurements of hedonic motivation, usage habits and other information were taken. Six ML algorithms were adopted and a total of 12 models were constructed, of which the top performing Random Forest (RF) and Logistic Regression (LR) models were further analysed for SHAP interpretability to gain a deeper understanding of the key factors affecting the model output.

Results:

A total of 360 family caregivers of stroke patients were included in this study from March to November 2023, of which 206 reported having used the mHealth Apps, with a usage rate of 57.22%. Of the six ML models, the RF model performed the best in terms of whether or not caregivers used the mHealth App, with an area under the curve (AUC) of 0.735 (0.635, 0.822), accuracy of 0.722 (0.630, 0.806), sensitivity of 0.742 (0.635, 0.843), and specificity of 0.696 (0.558, 0.825). SHAP analysis showed that the top five most influencing factors were age, literacy, relationship with the cared-for person, the patient's ability to care for him/herself, and average monthly income. The LR model performed best in terms of use behaviour with an AUC of 0.800 (0.681, 0.904), accuracy of 0.742 (0.629, 0.839), sensitivity of 0.662 (0.503, 0.811) and specificity of 0.828 (0.764, 0.893). SHAP analysis revealed that usage habits, performance expectations, hedonism, effort expectations, and price value were the five most significant influencing factors .

Conclusions:

The results suggest that mHealth Apps software developers and policy makers should take the above influencing factors into consideration when developing and promoting software, focusing on older adults with lower literacy levels, and lowering the threshold and cost of software use. Capture the hedonism and habitual use of users and provide them with more concise and accurate health information, which will increase the popularity and effectiveness of mHealth App.


 Citation

Please cite as:

Du Y, Fan JY, Liu GZ, Yang ZY, Lei Y, Guo YF

Interpretable Machine Learning Models for Analyzing Determinants Affecting the Use of mHealth Apps Among Family Caregivers of Patients With Stroke in Chinese Communities: Cross-Sectional Survey Study

JMIR Mhealth Uhealth 2025;13:e73903

DOI: 10.2196/73903

PMID: 41284965

PMCID: 12643396

Per the author's request the PDF is not available.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.