Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Medical Informatics

Date Submitted: Mar 25, 2024
Open Peer Review Period: Mar 25, 2024 - May 20, 2024
Date Accepted: Sep 7, 2024
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Performance of an Electronic Health Record–Based Automated Pulmonary Embolism Severity Index Score Calculator: Cohort Study in the Emergency Department

Joyce E, McMullen J, Kong X, O'Hare C, Gavrila V, Cuttitta A, Barnes GD, Greineder CF

Performance of an Electronic Health Record–Based Automated Pulmonary Embolism Severity Index Score Calculator: Cohort Study in the Emergency Department

JMIR Med Inform 2025;13:e58800

DOI: 10.2196/58800

PMID: 39864956

PMCID: 11769779

Performance of an Electronic Health Record-based automated Pulmonary Embolism Severity Index score calculator: a cohort study in the Emergency Department

  • Elizabeth Joyce; 
  • James McMullen; 
  • Xiaowen Kong; 
  • Connor O'Hare; 
  • Valerie Gavrila; 
  • Anthony Cuttitta; 
  • Geoffrey D Barnes; 
  • Colin F Greineder

ABSTRACT

Background:

Studies suggest that less than 4% of patients with pulmonary embolisms (PE) are managed in the outpatient setting. Strong evidence and multiple guidelines support use of the Pulmonary Embolism Severity Index (PESI) for identification of acute PE patients appropriate for outpatient management. However, calculating the PESI score can be inconvenient in a busy emergency department (ED). To facilitate integration into ED workflow, we created a 2023 EpicTM-compatible clinical decision support (CDS) tool that automatically calculates the PESI score in real-time with patients’ electronic health data (ePESI).

Objective:

The primary objectives of this study were to determine the overall accuracy of ePESI and its ability to correctly distinguish high- and low-risk PESI scores within the EpicTM 2023 software. The secondary objective was to identify variables that impact ePESI accuracy.

Methods:

We collected ePESI scores on 500 consecutive patients at least 18 years old who underwent a computerized tomography-PE (CT-PE) scan in the ED of our tertiary, academic health center between January 3 and February 15, 2023. We compared ePESI results to a PESI score calculated by two independent, medically-trained abstractors blinded to the ePESI and each other’s results. ePESI accuracy was calculated with binomial test. Odds ratio (OR) was calculated with logistic regression.

Results:

203 (40.6%) and 297 (59.4%) patients had low- and high-risk PESI scores, respectively. The ePESI exactly matched the calculated PESI in 394/500 cases, for an accuracy of 78.8% (95% CI 74.9-82.3%), and correctly identified low- vs. high-risk in 477/500 (95.4%) cases. The accuracy of the ePESI was higher for low-risk scores (OR=2.96, 0<0.0001) and lower when patients were without prior encounters in the health system (OR 0.42, p=0.0075).

Conclusions:

In this single center study, the ePESI was highly accurate in discriminating between low- and high-risk scores. The CDS should facilitate real-time identification of patients who may be candidates for outpatient PE management.


 Citation

Please cite as:

Joyce E, McMullen J, Kong X, O'Hare C, Gavrila V, Cuttitta A, Barnes GD, Greineder CF

Performance of an Electronic Health Record–Based Automated Pulmonary Embolism Severity Index Score Calculator: Cohort Study in the Emergency Department

JMIR Med Inform 2025;13:e58800

DOI: 10.2196/58800

PMID: 39864956

PMCID: 11769779

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.