Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Medical Informatics

Date Submitted: May 15, 2023
Date Accepted: Nov 24, 2023

The final, peer-reviewed published version of this preprint can be found here:

Additional Value From Free-Text Diagnoses in Electronic Health Records: Hybrid Dictionary and Machine Learning Classification Study

Mehra T, Wekhof T, Keller DI

Additional Value From Free-Text Diagnoses in Electronic Health Records: Hybrid Dictionary and Machine Learning Classification Study

JMIR Med Inform 2024;12:e49007

DOI: 10.2196/49007

PMID: 38231569

PMCID: 10831590

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

The value added of free text in electronic health records

  • Tarun Mehra; 
  • Tobias Wekhof; 
  • Dagmar Iris Keller

ABSTRACT

Background:

Physicians are hesitant to forgo the opportunity of entering unstructured clinical notes for structured data entry in electronic health records. Does the flexibility of free text also increase informational value?

Objective:

To compare information from unstructured clinical notes harvested and processed by a natural language processing algorithm, to clinician-entered structured data as to their potential utility for automated improvement of patient workflows.

Methods:

EHR of 293’298 patient visists at a Swiss university hospital from 01/2014 to 10/2021 were analyzed. Using emergency department overcrowding as a case in point, we compared supervised natural language processing (NLP)-based symptom clusters from unstructured clinical notes and clinician-entered chief complaints from a structured drop-down menu with the two outcomes hospitalization and high ESI score.

Results:

In 11 of the 12 symptom clusters, the NLP cluster was significant in predicting hospitalization. Eight clusters remained significant even when controlling for the cluster of clinician-determined chief complaints in the model. All 12 NLP symptom clusters were significant in predicting a low ESI score, of which 9 remained significant when controlling for clinician-determined chief complaints. The correlation of NLP clusters with chief complaints was low (-0.04-0.6), indicating a complementarity of information.

Conclusions:

The NLP-derived features and clinicians’ knowledge were complementary in explaining patient outcome heterogeneity. They can provide an efficient approach to patient flow management, for example, in an emergency medicine setting. We further demonstrate the feasibility of creating extensive and precise keyword dictionaries with NLP by medical experts without requiring programming knowledge. Using the dictionary, we could classify short and unstructured clinical texts into diagnostic categories defined by the clinician. Clinical Trial: None


 Citation

Please cite as:

Mehra T, Wekhof T, Keller DI

Additional Value From Free-Text Diagnoses in Electronic Health Records: Hybrid Dictionary and Machine Learning Classification Study

JMIR Med Inform 2024;12:e49007

DOI: 10.2196/49007

PMID: 38231569

PMCID: 10831590

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.