Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Previously submitted to: JMIR Medical Informatics (no longer under consideration since May 25, 2024)

Date Submitted: Nov 30, 2023

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Quantifying Healthcare Provider Perceptions of a Novel Deep Learning Algorithm to Predict Sepsis: Electronic Survey

  • Karthik Ramesh; 
  • Aaron Boussina; 
  • Supreeth P. Shashikumar; 
  • Atul Malhotra; 
  • Christopher Longhurst; 
  • Christopher S. Josef; 
  • Kimberly Quintero; 
  • Jake Del Rosso; 
  • Shamim Nemati; 
  • Gabriel Wardi

ABSTRACT

Background:

Sepsis is a major cause of morbidity and mortality for which early intervention improves patient outcomes. However, many patients experience delays in appropriate diagnosis and treatment. Predictive modeling and machine learning may aid in early recognition of sepsis but there remains a considerable disconnect between the development of predictive algorithms and their use in clinical care. Despite the importance of user experience for the adoption and efficacy of clinical predictive models, there are relatively few studies focused on provider acceptance and feedback on the deployment of such models.

Objective:

Evaluate healthcare worker perception and acceptance of a deep learning model for the prediction of sepsis in the ED

Methods:

COMPOSER, a previously described deep learning algorithm in use at two EDs of a large academic medical center, utilizes routinely collected vital-signs, laboratory results, demographics, medications, and comorbidities to predict sepsis prior to clear clinical presentation. When the COMPOSER risk score crosses a predefined detection threshold, a Best Practice Advisory (BPA) is triggered for nursing staff. For physicians and advanced practice providers (APP), COMPOSER alerts are displayed on the ED trackboard. An internally developed and validated survey in accordance with the CHERRIES checklist was distributed to a convenience sample of team members taking care of a patient for whom a COMPOSER alert crossed the pre-defined threshold. Recruitment occurred between May and September 2023 and was administered using a vendor survey tool.

Results:

A total of 114 responses were received with 76 from MD/DOs, 34 from RNs, and 4 from NP/PAs. 53% of respondents were from providers with less than 5 years of experience. 77% of respondents had a positive or neutral perception of the alert’s usefulness. Providers with 0-5 years of experience were more likely to have increased expectation that a patient had sepsis after the alert (p=.021), and were more likely to say that the alert was useful in care of a patient (p=.016), than those with 6+ years of experience. Finally, physicians with 0-5 years of experience were more likely to say that the alert changed their management of the patient (p=.048) than physicians with 6+ years of experience.

Conclusions:

Less experienced providers and nurses were more likely to perceive benefit from the alert, and the alerts were overall received favorably.


 Citation

Please cite as:

Ramesh K, Boussina A, Shashikumar SP, Malhotra A, Longhurst C, Josef CS, Quintero K, Rosso JD, Nemati S, Wardi G

Quantifying Healthcare Provider Perceptions of a Novel Deep Learning Algorithm to Predict Sepsis: Electronic Survey

JMIR Preprints. 30/11/2023:54998

DOI: 10.2196/preprints.54998

URL: https://preprints.jmir.org/preprint/54998

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.