Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR mHealth and uHealth

Date Submitted: Aug 16, 2019
Date Accepted: Feb 29, 2020
Date Submitted to PubMed: May 22, 2020

The final, peer-reviewed published version of this preprint can be found here:

Testing Suicide Risk Prediction Algorithms Using Phone Measurements With Patients in Acute Mental Health Settings: Feasibility Study

Haines A, Chahal G, Bruen AJ, Wall A, Khan CT, Sadashiv R, Fearnley D

Testing Suicide Risk Prediction Algorithms Using Phone Measurements With Patients in Acute Mental Health Settings: Feasibility Study

JMIR Mhealth Uhealth 2020;8(6):e15901

DOI: 10.2196/15901

PMID: 32442152

PMCID: 7380988

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Predicting Suicidal Risk through Machine Learning with Phone Measurements as Proxies to Clinical Counterparts

  • Alina Haines; 
  • Gurdit Chahal; 
  • Ashley Jane Bruen; 
  • Abbie Wall; 
  • Christina Tara Khan; 
  • Ramesh Sadashiv; 
  • David Fearnley

ABSTRACT

Background:

Machine learning is nowadays being applied to augment or even replace traditional analytic procedures in many domains, including health care.

Objective:

To apply machine learning in an acute mental health setting for suicide risk prediction. This study is novel, adding to existing knowledge by using data collected through a smartphone in place of clinical data which has typically been collected from health care records.

Methods:

We created a smartphone application called Strength Within Me (SWiM) that was linked to Fitbit, Apple Health kit, and Facebook, to collect salient clinical information such as sleep behavior and mood, step frequency and count, and engagement patterns with the phone from a cohort of 66 acute mental health inpatients. In addition, clinical research interviews were used to assess mood, sleep, and suicide risk. Multiple machine learning algorithms were tested to determine best fit.

Results:

Nearest Neighbors (k=2) emerged as the most promising algorithm, with 68% average accuracy (averaged over 25,000 simulations of splitting the training and testing data of 80-20 splits) and average AUC of 0.65. We have therefore taken the first steps in prototyping a system that could continuously and accurately assess risk of suicide via mobile devices.

Conclusions:

This is the first study to suggest it is feasible to utilize smartphone generated user input and passive sensor data to generate a risk algorithm among inpatients at suicide risk. The model reveals fair concordance between phone-derived and research generated clinical data and with iterative development has potential for accurate discriminant risk prediction.


 Citation

Please cite as:

Haines A, Chahal G, Bruen AJ, Wall A, Khan CT, Sadashiv R, Fearnley D

Testing Suicide Risk Prediction Algorithms Using Phone Measurements With Patients in Acute Mental Health Settings: Feasibility Study

JMIR Mhealth Uhealth 2020;8(6):e15901

DOI: 10.2196/15901

PMID: 32442152

PMCID: 7380988

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.