Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Nov 21, 2022
Date Accepted: Aug 18, 2024
Date Submitted to PubMed: Sep 2, 2024

The final, peer-reviewed published version of this preprint can be found here:

Reinforcement Learning to Optimize Ventilator Settings for Patients on Invasive Mechanical Ventilation: Retrospective Study

Liu S, Xu Q, Xu Z, Liu Z, Sun X, Xie G, Feng M, See KC

Reinforcement Learning to Optimize Ventilator Settings for Patients on Invasive Mechanical Ventilation: Retrospective Study

J Med Internet Res 2024;26:e44494

DOI: 10.2196/44494

PMID: 39219230

PMCID: 11525081

Reinforcement Learning to Optimize Ventilator Settings for Patients on Invasive Mechanical Ventilation: A Retrospective Study

  • Siqi Liu; 
  • Qianyi Xu; 
  • Zhuoyang Xu; 
  • Zhuo Liu; 
  • Xingzhi Sun; 
  • Guotong Xie; 
  • Mengling Feng; 
  • Kay Choong See

ABSTRACT

Background:

Mechanical ventilation is the cornerstone of critical care medicine. However, choosing the optimal ventilator strategy for a patient remains imprecise. Existing guidelines provide one-size-fits-all recommendations, but do not personalize treatments for different intensive care unit (ICU) patients.

Objective:

In this study, we aimed to design and evaluate an artificial intelligence (AI) solution that could tailor an optimal ventilator strategy for each critically ill patient who requires mechanical ventilation.

Methods:

We proposed a reinforcement learning-based AI solution using observational data from multiple ICUs in the US. The primary outcome was hospital mortality. Secondary outcomes were the proportion of optimal oxygen saturation and the proportion of optimal mean arterial blood pressure. We trained our AI agent to learn each patients’ treatment trajectory and thus to recommend low/medium/high levels of three ventilator settings, namely the positive end-expiratory pressure, fraction of inspired oxygen and ideal body weight-adjusted tidal volume. Off-policy evaluation metrics were applied to evaluate the AI policy.

Results:

We studied 5105 and 21595 patients’ ICU stays from the Multiparameter Intelligent Monitoring in Intensive Care (MIMIC-IV) and eICU Collaborative Research (eICU) databases respectively. Observed hospital mortality rates were 18.2% (eICU) and 31.1% (MIMIC-IV). For the learnt AI policy, we estimated the hospital mortality rate (eICU 14.7±0.7%; MIMIC-IV 29.1±0.9%), proportion of optimal oxygen saturation (eICU 57.8±1.0%; MIMIC-IV 49.0±1.0%), and proportion of optimal mean arterial blood pressure (eICU 34.7 ± 1.0%; MIMIC-IV 41.2±1.0%). Based on multiple quantitative and qualitative evaluation metrics, our proposed AI solution has potential to outperform observed clinical practice.

Conclusions:

Our proposed approach has potential to be applied as a clinical decision support tool that helps intensivists make better treatment decisions and to improve the survival and prognosis of critically ill patients who require invasive respiratory support.


 Citation

Please cite as:

Liu S, Xu Q, Xu Z, Liu Z, Sun X, Xie G, Feng M, See KC

Reinforcement Learning to Optimize Ventilator Settings for Patients on Invasive Mechanical Ventilation: Retrospective Study

J Med Internet Res 2024;26:e44494

DOI: 10.2196/44494

PMID: 39219230

PMCID: 11525081

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.