Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Medical Informatics

Date Submitted: Apr 21, 2021
Date Accepted: Dec 4, 2021

The final, peer-reviewed published version of this preprint can be found here:

Identification of Prediabetes Discussions in Unstructured Clinical Documentation: Validation of a Natural Language Processing Algorithm

Schwartz J, Tseng E, Maruthur NM, Rouhizadeh M

Identification of Prediabetes Discussions in Unstructured Clinical Documentation: Validation of a Natural Language Processing Algorithm

JMIR Med Inform 2022;10(2):e29803

DOI: 10.2196/29803

PMID: 35200154

PMCID: 8914791

Identification of prediabetes discussions in unstructured clinical documentation using natural language processing methods

  • Jessica Schwartz; 
  • Eva Tseng; 
  • Nisa M Maruthur; 
  • Masoud Rouhizadeh

ABSTRACT

Background:

Prediabetes affects 1 in 3 US adults. Most are not receiving evidence-based interventions so understanding how providers discuss prediabetes with patients will inform how to improve their care.

Objective:

Develop an NLP algorithm using machine learning techniques to identify discussions of prediabetes in narrative documentation.

Methods:

We developed and applied a keyword search strategy to identify discussions of prediabetes in clinical documentation for patients with prediabetes. We manually reviewed matching notes to determine which represented actual prediabetes discussions. We applied seven machine learning models against our manual annotation.

Results:

Machine learning classifiers were able to achieve classification results that were close to human performance with up to 98% precision and recall to identify prediabetes discussions in clinical documentation.

Conclusions:

We demonstrated that prediabetes discussions can be accurately identified using an NLP algorithm. This approach can be used to understand and identify prediabetes management practices in primary care, thereby informing interventions to improve guideline-concordant care.


 Citation

Please cite as:

Schwartz J, Tseng E, Maruthur NM, Rouhizadeh M

Identification of Prediabetes Discussions in Unstructured Clinical Documentation: Validation of a Natural Language Processing Algorithm

JMIR Med Inform 2022;10(2):e29803

DOI: 10.2196/29803

PMID: 35200154

PMCID: 8914791

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.