Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Public Health and Surveillance

Date Submitted: Oct 20, 2020
Open Peer Review Period: Oct 20, 2020 - Nov 3, 2020
Date Accepted: Jun 15, 2021
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Designing a Clinical Decision Support Tool That Leverages Machine Learning for Suicide Risk Prediction: Development Study in Partnership With Native American Care Providers

Haroz E, Grubin F, Goklish N, Pioche S, Cwik M, Allison B, Waugh E, Usher J, Lenert M, Walsh C

Designing a Clinical Decision Support Tool That Leverages Machine Learning for Suicide Risk Prediction: Development Study in Partnership With Native American Care Providers

JMIR Public Health Surveill 2021;7(9):e24377

DOI: 10.2196/24377

PMID: 34473065

PMCID: 8446841

Designing a clinical decision support tool that leverages machine learning for suicide in partnership with Native American care providers

  • Emily Haroz; 
  • Fiona Grubin; 
  • Novalene Goklish; 
  • Shardai Pioche; 
  • Mary Cwik; 
  • Barlow Allison; 
  • Emma Waugh; 
  • Jason Usher; 
  • Matthew Lenert; 
  • Colin Walsh

ABSTRACT

Background:

Machine learning algorithms for suicide risk prediction have been developed with notable improvements in accuracy. Implementing these algorithms to enhance clinical care and reduce suicide has not been well studied.

Objective:

Our study aimed to design a Clinical Decision Support tool (CDS) and appropriate care pathways for a community-based suicide surveillance and case management systems operating on Native American reservations.

Methods:

Participants included Native American case managers and supervisors (N = 9) who work on suicide surveillance and case management programs on two Native American reservations. We used in-depth interviews to understand how case managers think about and respond to suicide risk. Results from interviews informed a draft CDS tool, which was then reviewed with supervisors and combined with appropriate care pathways.

Results:

Case managers reported acceptance of risk flags based on a predictive algorithm in their surveillance system tools, particularly if the information was available in a timely way and used in conjunction with their clinical judgement. Implementation of risk flags needed to be programmed on a dichotomous basis so the algorithm could produce output indicating high vs. low risk. To dichotomize the continuous predicted probabilities, we developed a cutoff point that favored specificity, with the understanding that case managers’ clinical judgment would help increase sensitivity.

Conclusions:

Suicide risk prediction algorithms show promise, but implementation to guide clinical care has remained relatively elusive. Our study demonstrates the utility of working with partners to develop and guide operationalization of risk prediction algorithms to enhance clinical care in a community setting.


 Citation

Please cite as:

Haroz E, Grubin F, Goklish N, Pioche S, Cwik M, Allison B, Waugh E, Usher J, Lenert M, Walsh C

Designing a Clinical Decision Support Tool That Leverages Machine Learning for Suicide Risk Prediction: Development Study in Partnership With Native American Care Providers

JMIR Public Health Surveill 2021;7(9):e24377

DOI: 10.2196/24377

PMID: 34473065

PMCID: 8446841

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.