Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Medical Informatics

Date Submitted: Dec 16, 2020
Date Accepted: Dec 4, 2021

The final, peer-reviewed published version of this preprint can be found here:

Prediction of Chronic Obstructive Pulmonary Disease Exacerbation Events by Using Patient Self-reported Data in a Digital Health App: Statistical Evaluation and Machine Learning Approach

Chmiel FP, Burns DK, Pickering JB, Blythin A, Wilkinson TMA, Boniface MJ

Prediction of Chronic Obstructive Pulmonary Disease Exacerbation Events by Using Patient Self-reported Data in a Digital Health App: Statistical Evaluation and Machine Learning Approach

JMIR Med Inform 2022;10(3):e26499

DOI: 10.2196/26499

PMID: 35311685

PMCID: 8981014

Predicting Chronic Obstructive Pulmonary Disease exacerbation events using data self-reported to a digital health application by patients

  • Francis Peter Chmiel; 
  • Dan K Burns; 
  • John Brian Pickering; 
  • Alison Blythin; 
  • Thomas M. A. Wilkinson; 
  • Michael J. Boniface

ABSTRACT

Background:

Self-reporting digital applications provide a way of remotely monitoring and managing patients with chronic conditions in the community. Leveraging the data collected by these applications in prognostic models could provide increased personalisation of care and reduce the burden of care for people who live with chronic conditions. This study evaluated the predictive ability of prognostic models for prediction of acute exacerbation events in people with Chronic Obstructive Pulmonary Disease using data self-reported to a digital health application.

Objective:

To evaluate if data-self reported to a digital health application can be used to predict acute exacerbation events in the near-future.

Methods:

Retrospective study evaluating the use of symptom and Chronic Obstructive Pulmonary Disease assessment test data self-reported to a digital health application (myCOPD) in predicting acute exacerbation events. We include data from 2,374 patients who made a total of 68,139 self-reports. We evaluated the degree to which the different variables self-reported to the application are predictive of exacerbation events and developed both heuristic and machine-learnt models to predict whether the patient will report an exacerbation event within three days of self-reporting to the application. The model’s predictive ability was evaluated on self-reports from an independent set of patients.

Results:

Users self-reported symptoms and standard Chronic Obstructive Pulmonary Disease assessment tests display correlation with future exacerbation events. Both a baseline model (AUROC 0.655 (95 % CI: 0.689-0.676)) and a machine-learnt model (AUROC 0.727 (95 % CI: 0.720-0.735)) showed moderate ability in predicting exacerbation events occurring within three days of a given self-report. While the baseline model obtained a fixed sensitivity and specificity of 0.551 (95 % CI: 0.508-0.596) and 0.759 (95 % CI: 0.752-0.767) respectively, the sensitivity and specificity of the machine-learnt model can be tuned by dichotomizing the continuous predictions it provides with different thresholds.

Conclusions:

Data self-reported to healthcare applications designed to remotely monitor patients with Chronic Obstructive Pulmonary Disease can be used to predict acute exacerbation events with moderate performance. This could increase personalisation of care by allowing pre-emptive action to be taken to mitigate the risk of future exacerbation events. It is plausible future studies could improve the accuracy of these models by either the inclusion of symptom information recorded with greater granularity or including variables not considered in our study, for example vital signs, information on activity, local environmental data, and lifestyle information.


 Citation

Please cite as:

Chmiel FP, Burns DK, Pickering JB, Blythin A, Wilkinson TMA, Boniface MJ

Prediction of Chronic Obstructive Pulmonary Disease Exacerbation Events by Using Patient Self-reported Data in a Digital Health App: Statistical Evaluation and Machine Learning Approach

JMIR Med Inform 2022;10(3):e26499

DOI: 10.2196/26499

PMID: 35311685

PMCID: 8981014

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.