Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Formative Research

Date Submitted: Jul 9, 2023
Open Peer Review Period: Jul 9, 2023 - Sep 3, 2023
Date Accepted: Feb 26, 2024
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Classifying Self-Reported Rheumatoid Arthritis Flares Using Daily Patient-Generated Data From a Smartphone App: Exploratory Analysis Applying Machine Learning Approaches

Gandrup J, Selby DA, Dixon WG

Classifying Self-Reported Rheumatoid Arthritis Flares Using Daily Patient-Generated Data From a Smartphone App: Exploratory Analysis Applying Machine Learning Approaches

JMIR Form Res 2024;8:e50679

DOI: 10.2196/50679

PMID: 38743480

PMCID: 11134244

Classifying Self-reported Rheumatoid Arthritis Flares Using Daily Patient-generated Data from a Smartphone App: An Exploratory Analysis Applying Machine Learning Approaches

  • Julie Gandrup; 
  • David A Selby; 
  • William G Dixon

ABSTRACT

Background:

The ability to predict rheumatoid arthritis (RA) flares between clinic visits based on real-time, longitudinal patient-generated data could potentially allow for timely interventions to avoid disease worsening.

Objective:

In this exploratory study, we aimed to investigate the feasibility of using machine learning methods to classify self-reported RA flares based on a small dataset of daily symptom data collected on a smartphone app.

Methods:

We used daily symptoms and weekly flares reported on the REMORA smartphone app from 20 RA patients over three months. Predictors were several summary features of the daily symptom scores collected in the week leading up to the flare question. We fitted three binary classifiers: logistic regression +/- elastic net regularization, a random forest and naïve Bayes. Performance was evaluated according to the area under the curve (AUC) of the receiver operating characteristic curve.

Results:

The data comprised an average of 60.6 daily reports and 10.5 weekly reports per participant. AUCs were broadly similar between models, but logistic regression with elastic net had the highest AUC of 0.82. At a cut-off requiring specificity to be 0.80, the corresponding sensitivity to detect flares was 0.60 for this model. The positive predictive value in this population was 53%, and negative predictive value 85%.

Conclusions:

Predicting self-reported flares based on daily symptom scorings in the preceding week using machine learning methods was feasible. The observed predictive accuracy might improve as we obtain more data, and these exploratory results should be validated in an external cohort. In the future, analysis of frequently collected patient-generated data may allow us to predict flares before they unfold, opening opportunities for just-in-time interventions.


 Citation

Please cite as:

Gandrup J, Selby DA, Dixon WG

Classifying Self-Reported Rheumatoid Arthritis Flares Using Daily Patient-Generated Data From a Smartphone App: Exploratory Analysis Applying Machine Learning Approaches

JMIR Form Res 2024;8:e50679

DOI: 10.2196/50679

PMID: 38743480

PMCID: 11134244

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.