Previously submitted to: Journal of Medical Internet Research (no longer under consideration since Oct 19, 2021)
Date Submitted: Aug 14, 2021
Open Peer Review Period: Aug 13, 2021 - Aug 20, 2021
(closed for review but you can still tweet)
NOTE: This is an unreviewed Preprint
Warning: This is a unreviewed preprint (What is a preprint?). Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn (a note "no longer under consideration" will appear above).
Peer review me: Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period (in this case, a "Peer Review Me" button to sign up as reviewer is displayed above). All preprints currently open for review are listed here. Outside of the formal open peer-review period we encourage you to tweet about the preprint.
Citation: Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author).
Final version: If our system detects a final peer-reviewed "version of record" (VoR) published in any journal, a link to that VoR will appear below. Readers are then encourage to cite the VoR instead of this preprint.
Settings: If you are the author, you can login and change the preprint display settings, but the preprint URL/DOI is supposed to be stable and citable, so it should not be removed once posted.
Submit: To post your own preprint, simply submit to any JMIR journal, and choose the appropriate settings to expose your submitted version as preprint.
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
Prediction of Poststroke Urinary Tract Infection Risk in Immobile Patients Using Machine Learning: Observational Cohort Study
ABSTRACT
Background:
Poststroke immobility gets patients more vulnerable to stroke-relevant complications. Urinary tract infection (UTI) is one of major nosocomial infections significantly affecting the outcomes of immobile stroke patients. Previous studies have identified several risk factors, but it is still challenging to accurately estimate personal UTI risk due to unclear interaction of various factors and variability of individual characteristics. This calls for more precise and trust-worthy predictive models to assist with potential UTI identification.
Objective:
The aim of this study was to develop predictive models for UTI risk identification for immobile stroke patients. A prospective analysis was conducted to evaluate the effectiveness and clinical interpretability of the models.
Methods:
The data used in this study were collected from the Common Complications of Bedridden Patients and the Construction of Standardized Nursing Intervention Model (CCBPC). Derivation cohort included data of 3982 immobile stroke patients collected during CCBPC-I, from November 1, 2015 to June 30, 2016; external validation cohort included data of 3837 immobile stroke patients collected during CCBPC-II, from November 1, 2016 to July 30, 2017. 6 machine learning models and an ensemble learning model were derived based on 80% of derivation cohort and its effectiveness was evaluated with the remaining 20% of derivation cohort data. We further compared the effectiveness of predictive models in external validation cohort. The performance of logistic regression without regularization was used as a reference. We used Shapley additive explanation values to determine feature importance and examine the clinical significance of prediction models. Shapely values of the factors were calculated to represent the magnitude, prevalence, and direction of their effects, and were further visualized in a summary plot.
Results:
A total of 103(2.59%) patients were diagnosed with UTI in derivation cohort(N=3982); the internal validation cohort (N=797) shared the same incidence. The external validation cohort had a UTI incidence of 1.38% (N=53). Evaluation results showed that the ensemble learning model performed the best in area under the receiver operating characteristic (ROC) curve in internal validation, up to 82.2%; second best in external validation, 80.8%. In addition, the ensemble learning model performed the best sensitivity in both internal and external validation sets (80.9% and 81.1%, respectively). We also identified seven UTI risk factors (pneumonia, glucocorticoid use, female sex, mixed cerebrovascular disease, increased age, prolonged length of stay, and duration of catheterization) contributing most to the predictive model, thus demonstrating the clinical interpretability of model.
Conclusions:
Our ensemble learning model demonstrated promising performance. Identifying UTI risk and detecting high risk factors among immobile stroke patients would allow more selective and effective use of preventive interventions, thus improving clinical outcomes. Future work should focus on developing a more concise scoring tool and prospectively examining the model in practical use.
Citation
The author of this paper has made a PDF available, but requires the user to login, or create an account.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.