Accepted for/Published in: Journal of Medical Internet Research
Date Submitted: Nov 21, 2022
Date Accepted: Aug 18, 2024
Date Submitted to PubMed: Sep 2, 2024
Reinforcement Learning to Optimize Ventilator Settings for Patients on Invasive Mechanical Ventilation: A Retrospective Study
ABSTRACT
Background:
Mechanical ventilation is the cornerstone of critical care medicine. However, choosing the optimal ventilator strategy for a patient remains imprecise. Existing guidelines provide one-size-fits-all recommendations, but do not personalize treatments for different intensive care unit (ICU) patients.
Objective:
In this study, we aimed to design and evaluate an artificial intelligence (AI) solution that could tailor an optimal ventilator strategy for each critically ill patient who requires mechanical ventilation.
Methods:
We proposed a reinforcement learning-based AI solution using observational data from multiple ICUs in the US. The primary outcome was hospital mortality. Secondary outcomes were the proportion of optimal oxygen saturation and the proportion of optimal mean arterial blood pressure. We trained our AI agent to learn each patients’ treatment trajectory and thus to recommend low/medium/high levels of three ventilator settings, namely the positive end-expiratory pressure, fraction of inspired oxygen and ideal body weight-adjusted tidal volume. Off-policy evaluation metrics were applied to evaluate the AI policy.
Results:
We studied 5105 and 21595 patients’ ICU stays from the Multiparameter Intelligent Monitoring in Intensive Care (MIMIC-IV) and eICU Collaborative Research (eICU) databases respectively. Observed hospital mortality rates were 18.2% (eICU) and 31.1% (MIMIC-IV). For the learnt AI policy, we estimated the hospital mortality rate (eICU 14.7±0.7%; MIMIC-IV 29.1±0.9%), proportion of optimal oxygen saturation (eICU 57.8±1.0%; MIMIC-IV 49.0±1.0%), and proportion of optimal mean arterial blood pressure (eICU 34.7 ± 1.0%; MIMIC-IV 41.2±1.0%). Based on multiple quantitative and qualitative evaluation metrics, our proposed AI solution has potential to outperform observed clinical practice.
Conclusions:
Our proposed approach has potential to be applied as a clinical decision support tool that helps intensivists make better treatment decisions and to improve the survival and prognosis of critically ill patients who require invasive respiratory support.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.