Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Public Health and Surveillance

Date Submitted: Oct 3, 2023
Date Accepted: May 16, 2024

The final, peer-reviewed published version of this preprint can be found here:

Predicting Long COVID in the National COVID Cohort Collaborative Using Super Learner: Cohort Study

Butzin-Dozier Z, Ji Y, Li H, Coyle J, Shi J(, Phillips RV, Mertens A, Pirracchio R, van der Laan MJ, Patel RC, Colford JM, Hubbard AE

Predicting Long COVID in the National COVID Cohort Collaborative Using Super Learner: Cohort Study

JMIR Public Health Surveill 2024;10:e53322

DOI: 10.2196/53322

PMID: 39146534

PMCID: 11364083

Predicting Long COVID in the National COVID Cohort Collaborative Using Super Learner: Cohort Study

  • Zachary Butzin-Dozier; 
  • Yunwen Ji; 
  • Haodong Li; 
  • Jeremy Coyle; 
  • Junming (Seraphina) Shi; 
  • Rachael V Phillips; 
  • Andrew Mertens; 
  • Romain Pirracchio; 
  • Mark J van der Laan; 
  • Rena C Patel; 
  • John M Colford; 
  • Alan E Hubbard

ABSTRACT

Background:

Post-acute Sequelae of COVID-19 (PASC), also known as Long COVID, is a broad grouping of a range of long-term symptoms following acute COVID-19 infection. An understanding of characteristics that are predictive of future PASC is valuable, as this can inform the identification of high-risk individuals and future preventative efforts. However, current knowledge regarding PASC risk factors is limited.

Objective:

We sought to predict individual risk of PASC diagnosis from a curated set of clinically informed covariates available in electronic health records.

Methods:

We predicted individual PASC status, given covariate information, using Super Learner (an ensemble machine learning algorithm also known as stacking) to learn the optimal, AUC-maximizing combination of gradient boosting and random forest algorithms. We evaluated variable importance via Shapley values. We included data from the National COVID Cohort Collaborative, and these efforts were part of the NIH Long COVID Computational Challenge.

Results:

Using a sample of 55,257 participants, we were able to accurately predict individual PASC diagnoses (AUC 0.947). Temporally, we found that baseline characteristics were most predictive of future PASC diagnosis, compared with characteristics immediately before, during, or after COVID-19 infection. In terms of clinical domains of predictors, we found that medical utilization, demographics, anthropometry, and respiratory factors were most predictive of PASC diagnosis.

Conclusions:

These findings support the hypothesis that clinicians may be able to accurately assess the risk of PASC in patients prior to acute COVID diagnosis, which could improve early interventions and preventive care. In addition, these results highlight the importance of respiratory characteristics in PASC risk assessment. The methods outlined here provide an open-source, applied example of using Super Learner to predict PASC status using electronic health record data, which can be replicated across a variety of settings.


 Citation

Please cite as:

Butzin-Dozier Z, Ji Y, Li H, Coyle J, Shi J(, Phillips RV, Mertens A, Pirracchio R, van der Laan MJ, Patel RC, Colford JM, Hubbard AE

Predicting Long COVID in the National COVID Cohort Collaborative Using Super Learner: Cohort Study

JMIR Public Health Surveill 2024;10:e53322

DOI: 10.2196/53322

PMID: 39146534

PMCID: 11364083

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.