Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Feb 4, 2021
Date Accepted: May 24, 2021

The final, peer-reviewed published version of this preprint can be found here:

A Machine Learning Approach to Passively Informed Prediction of Mental Health Risk in People with Diabetes: Retrospective Case-Control Analysis

Yu J, Chiu C, Wang Y, Dzubur E, Lu W, Hoffman J

A Machine Learning Approach to Passively Informed Prediction of Mental Health Risk in People with Diabetes: Retrospective Case-Control Analysis

J Med Internet Res 2021;23(8):e27709

DOI: 10.2196/27709

PMID: 34448707

PMCID: 8433872

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

A Novel Approach to Passively Informed Mental Health Risk Detection in People with Diabetes: Rationale, Methods, and Early Results

  • Jessica Yu; 
  • Carter Chiu; 
  • Yajuan Wang; 
  • Eldin Dzubur; 
  • Wei Lu; 
  • Julia Hoffman

ABSTRACT

Background:

Proactive detection of mental health (MH) needs among people with diabetes mellitus (DM) could facilitate early intervention, improve overall health and quality of life, and reduce individual and societal health and economic burdens. Passive sensing and ecological momentary assessment are newer methods that may be leveraged for proactive detection.

Objective:

The primary aim of this study was to conceptualize, develop, and evaluate a novel machine learning approach for predicting MH risk in people with DM.

Methods:

A retrospective study was designed to develop and evaluate a machine learning model, utilizing data collected on 142,432 individuals with DM enrolled in the Livongo for Diabetes program. First, participants’ MH statuses were verified using prescription and medical and pharmacy claims data. Next, passive sensing signals were extracted from participant behavior in the program. Data sets were then assembled to create participant-period instances and descriptive analyses were conducted to understand the correlation between MH status and passive sensing signals. Passive sensing signals were then entered into the model to train and test its performance. The model was evaluated on seven measures: sensitivity, specificity, precision, area under the curve, F1 score, accuracy, and confusion matrix.

Results:

In training and 3 subsequent test sets, the model achieved a confidence score of greater than 0.5 in all but three measures.

Results:

In training and 3 subsequent test sets, the model achieved a confidence score of greater than 0.5 in all but three measures.

Conclusions:

Results demonstrate the utility of a passively informed MH risk algorithm and invite further exploration.


 Citation

Please cite as:

Yu J, Chiu C, Wang Y, Dzubur E, Lu W, Hoffman J

A Machine Learning Approach to Passively Informed Prediction of Mental Health Risk in People with Diabetes: Retrospective Case-Control Analysis

J Med Internet Res 2021;23(8):e27709

DOI: 10.2196/27709

PMID: 34448707

PMCID: 8433872

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.