Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Public Health and Surveillance

Date Submitted: Jul 29, 2022
Date Accepted: Nov 29, 2022
Date Submitted to PubMed: Nov 29, 2022

The final, peer-reviewed published version of this preprint can be found here:

Natural Language Processing for Improved Characterization of COVID-19 Symptoms: Observational Study of 350,000 Patients in a Large Integrated Health Care System

Malden DE, Tartof SY, Ackerson BK, Hong V, Skarbinski J, Yau V, Qian L, Fischer H, Shaw S, Caparosa S, Xie F

Natural Language Processing for Improved Characterization of COVID-19 Symptoms: Observational Study of 350,000 Patients in a Large Integrated Health Care System

JMIR Public Health Surveill 2022;8(12):e41529

DOI: 10.2196/41529

PMID: 36446133

PMCID: 9822566

Natural Language Processing for Improved Characterization of COVID-19 Symptoms: An Observational Study of 350,000 Patients in a Large Integrated Healthcare System

  • Deborah Ellen Malden; 
  • Sara Y Tartof; 
  • Bradley Kent Ackerson; 
  • Vennis Hong; 
  • Jacek Skarbinski; 
  • Vincent Yau; 
  • Lei Qian; 
  • Heidi Fischer; 
  • Sally Shaw; 
  • Susan Caparosa; 
  • Fagen Xie

ABSTRACT

Background:

Natural language processing (NLP) of unstructured text from EMR can improve characterization of COVID-19 symptoms, but large-scale studies assessing the real world application of NLP for this purpose are limited.

Objective:

To assess the contribution of NLP when identifying COVID-19 symptoms from EMR.

Methods:

This was a retrospective cohort study conducted in Kaiser Permanente Southern California (KPSC), a large integrated health care system using data from patients with positive SARS-CoV-2 laboratory tests from March 2020 to May 2021. An NLP algorithm was developed to extract free text from EMR on 12 established COVID-19 symptoms. Proportions of patients reporting each symptom were described before and after supplementing structured EMR data with NLP-extracted symptoms.

Results:

Among 359,938 patients with confirmed SARS-CoV-2 infection, NLP-supplemented analysis identified an additional 55,568 (15%) symptomatic cases that were previously defined as asymptomatic using structured data alone. The most common symptoms identified through NLP-supplemented analyses were cough (61%), fever (52%), myalgia (43%), and headache (40%). The proportion of additional cases with each selected symptom identified in NLP-supplemented analysis varied across symptoms, from 29% of all complaints for cough, to 61% of all records with nausea or vomiting. Of 295,305 symptomatic patients, the median time from symptom onset to testing was 3 days using structured data alone, whereas NLP-supplemented analyses resulted in the identification of COVID-19 symptoms approximately one day earlier.

Conclusions:

These findings demonstrate the value of NLP to facilitate enhanced characterization of COVID-19 by identifying additional signs and symptoms from EMR compared to traditional surveillance systems.


 Citation

Please cite as:

Malden DE, Tartof SY, Ackerson BK, Hong V, Skarbinski J, Yau V, Qian L, Fischer H, Shaw S, Caparosa S, Xie F

Natural Language Processing for Improved Characterization of COVID-19 Symptoms: Observational Study of 350,000 Patients in a Large Integrated Health Care System

JMIR Public Health Surveill 2022;8(12):e41529

DOI: 10.2196/41529

PMID: 36446133

PMCID: 9822566

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.