Previously submitted to: JMIR Medical Informatics (no longer under consideration since May 25, 2024)
Date Submitted: Nov 30, 2023
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
Quantifying Healthcare Provider Perceptions of a Novel Deep Learning Algorithm to Predict Sepsis: Electronic Survey
ABSTRACT
Background:
Sepsis is a major cause of morbidity and mortality for which early intervention improves patient outcomes. However, many patients experience delays in appropriate diagnosis and treatment. Predictive modeling and machine learning may aid in early recognition of sepsis but there remains a considerable disconnect between the development of predictive algorithms and their use in clinical care. Despite the importance of user experience for the adoption and efficacy of clinical predictive models, there are relatively few studies focused on provider acceptance and feedback on the deployment of such models.
Objective:
Evaluate healthcare worker perception and acceptance of a deep learning model for the prediction of sepsis in the ED
Methods:
COMPOSER, a previously described deep learning algorithm in use at two EDs of a large academic medical center, utilizes routinely collected vital-signs, laboratory results, demographics, medications, and comorbidities to predict sepsis prior to clear clinical presentation. When the COMPOSER risk score crosses a predefined detection threshold, a Best Practice Advisory (BPA) is triggered for nursing staff. For physicians and advanced practice providers (APP), COMPOSER alerts are displayed on the ED trackboard. An internally developed and validated survey in accordance with the CHERRIES checklist was distributed to a convenience sample of team members taking care of a patient for whom a COMPOSER alert crossed the pre-defined threshold. Recruitment occurred between May and September 2023 and was administered using a vendor survey tool.
Results:
A total of 114 responses were received with 76 from MD/DOs, 34 from RNs, and 4 from NP/PAs. 53% of respondents were from providers with less than 5 years of experience. 77% of respondents had a positive or neutral perception of the alert’s usefulness. Providers with 0-5 years of experience were more likely to have increased expectation that a patient had sepsis after the alert (p=.021), and were more likely to say that the alert was useful in care of a patient (p=.016), than those with 6+ years of experience. Finally, physicians with 0-5 years of experience were more likely to say that the alert changed their management of the patient (p=.048) than physicians with 6+ years of experience.
Conclusions:
Less experienced providers and nurses were more likely to perceive benefit from the alert, and the alerts were overall received favorably.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.