Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Perioperative Medicine

Date Submitted: May 16, 2022
Date Accepted: Dec 25, 2022

The final, peer-reviewed published version of this preprint can be found here:

An Ensemble Learning Approach to Improving Prediction of Case Duration for Spine Surgery: Algorithm Development and Validation

Gabriel RA, Harjai B, Simpson S, Du AL, Tully JL, George O, Waterman RS

An Ensemble Learning Approach to Improving Prediction of Case Duration for Spine Surgery: Algorithm Development and Validation

JMIR Perioper Med 2023;6:e39650

DOI: 10.2196/39650

PMID: 36701181

PMCID: 9912154

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

An Ensemble Learning Approach to Improving Prediction of Case Duration for Spine Surgery Using Patient and Surgical Features

  • Rodney Allanigue Gabriel; 
  • Bhavya Harjai; 
  • Sierra Simpson; 
  • Austin Liu Du; 
  • Jeffrey Logan Tully; 
  • Olivier George; 
  • Ruth Susanna Waterman

ABSTRACT

Background:

Estimating surgical case duration accurately is an important operating room efficiency metric.

Objective:

The primary objective of this 4-year, single academic center retrospective study was to utilize an ensemble learning approach to improve the accuracy of scheduled case duration for spine surgery. The primary outcome measure was case duration.

Methods:

We compared machine learning models using surgical and patient features to our institutional method, which used historic averages and surgeon adjustment as needed. We implemented multivariable linear regression, random forest, bagging, and XGBoost and calculated average R2, root mean squared error (RMSE), and mean absolute error (MAE) using stratified k-folds cross-validation. We then used the Shapley Additive exPlanations (SHAP) explainer model to determine feature importance.

Results:

3,315 patients who underwent spine surgery were included. The institution’s current method of predicting case times had poor coefficient of determination with actual times (R2 = 0.19). On k-folds cross-validation, the linear regression model had an R2 of 0.34, RMSE of 165.3, and MAE of 128.4. Among all models, the XGBoost regressor performed the best with an R2 of 0.70, RMSE of 110.9, and MAE of 75.8. Based on SHAP analysis of the XGBoost regression, body mass index, spinal fusions, surgical procedure, and number of spine levels involved were the features with the most impact on the model.

Conclusions:

Utilizing ensemble learning-based predictive models, specifically XGBoost regression, can improve accuracy of the estimation of spine surgery times. Clinical Trial: N/A


 Citation

Please cite as:

Gabriel RA, Harjai B, Simpson S, Du AL, Tully JL, George O, Waterman RS

An Ensemble Learning Approach to Improving Prediction of Case Duration for Spine Surgery: Algorithm Development and Validation

JMIR Perioper Med 2023;6:e39650

DOI: 10.2196/39650

PMID: 36701181

PMCID: 9912154

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.