Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Feb 28, 2020
Date Accepted: May 13, 2020

The final, peer-reviewed published version of this preprint can be found here:

Reinforcement Learning for Clinical Decision Support in Critical Care: Comprehensive Review

Liu S, See KC, Ngiam KY, Celi LA, Sun X, Feng M

Reinforcement Learning for Clinical Decision Support in Critical Care: Comprehensive Review

J Med Internet Res 2020;22(7):e18477

DOI: 10.2196/18477

PMID: 32706670

PMCID: 7400046

Reinforcement Learning for Clinical Decision Support in Critical Care: A Comprehensive Review

  • Siqi Liu; 
  • Kay Choong See; 
  • Kee Yuan Ngiam; 
  • Leo Anthony Celi; 
  • Xingzhi Sun; 
  • Mengling Feng

ABSTRACT

Background:

Reinforcement Learning (RL)-based decision support systems have been implemented to facilitate the delivery of personalised care. This paper details a systematic review of RL applications in the critical care setting.

Objective:

This review aimed to survey the literature with regards to RL applications for clinical decision support in critical care, and to provide insight into the challenges of applying various RL models.

Methods:

We performed a systematic search of the following databases: PubMed, Google Scholar, IEEE, ScienceDirect, Web of Science, MEDLINE and Embase. Studies published over the past 10 years (2010-2019) that have applied RL for critical care were included.

Results:

We included 21 papers. We found that RL has been used to optimise choice of medications, drug dosing and timing of interventions, and to target personalised laboratory values. We further compared and contrasted the design of the RL models and the evaluation metrics in each application.

Conclusions:

RL has great potential for enhancing decision-making in critical care. Challenges regarding RL system design, evaluation metrics and model choice exist. More importantly, further work is required to validate RL in authentic clinical environments.


 Citation

Please cite as:

Liu S, See KC, Ngiam KY, Celi LA, Sun X, Feng M

Reinforcement Learning for Clinical Decision Support in Critical Care: Comprehensive Review

J Med Internet Res 2020;22(7):e18477

DOI: 10.2196/18477

PMID: 32706670

PMCID: 7400046

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.