Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Sep 19, 2025
Open Peer Review Period: Sep 19, 2025 - Nov 14, 2025
Date Accepted: Jul 7, 2026
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Machine Learning to Identify Point-of-Care Ultrasound and Evaluate Standardized Documentation: Retrospective Operational Cohort Study

Nguyen K, Wu Z, Tsai CA, Vandervest J, Lammers D, Cassidy R, Murphy Z, Pandian B, Hammoud MM, Collin J, Smith R, Maben-Feaster R, Kaufman Eddy A, Burns ML

Machine Learning to Identify Point-of-Care Ultrasound and Evaluate Standardized Documentation: Retrospective Operational Cohort Study

J Med Internet Res 2026;28:e84454

DOI: 10.2196/84454

PMID: 42566781

Machine Learning to Identify Point-of-Care Ultrasound and Evaluate Standardized Documentation: A Retrospective Operational Cohort Study

  • Kevin Nguyen; 
  • Zewen Wu; 
  • Chu-An Tsai; 
  • John Vandervest; 
  • D’Anna Lammers; 
  • Ruth Cassidy; 
  • Zachary Murphy; 
  • Balaji Pandian; 
  • Maya M. Hammoud; 
  • Jennifer Collin; 
  • Roger Smith; 
  • Rosalyn Maben-Feaster; 
  • Amy Kaufman Eddy; 
  • Michael L. Burns

ABSTRACT

Background:

Point-of-care ultrasound (POCUS) in obstetrics and gynecology (OBGYN) is essential for diagnosis and treatment. However, documentation and billing of these procedures frequently encounter challenges due to inconsistent practices and inefficiencies in EHR systems.

Objective:

This study employs machine learning (ML) to identify POCUS procedures from clinical notes and evaluates the impact of standardized documentation (ProcDoc) on billing capture.

Methods:

A multi-part retrospective cohort study to (1) develop a machine learning model for identifying POCUS procedures from clinical notes and (2) use the model to evaluate the effectiveness of implementing standardized documentation for these procedures. Machine learning models were developed using clinical encounter data from January 1, 2018, to December 31, 2020. Standardized documentation was introduced in February 2023 and assessed over a period from February 1, 2022, to August 31, 2024. Outcomes included model performance metrics and billing recapture assessments.

Results:

Analysis was conducted on 558,997 clinical encounters. The BioBERT model achieved 0.97 accuracy and 0.88 F1 score. Standardized documentation adoption reached 77.9% within six months. Post-intervention data indicated a reduction in charges identified through recapture from 10.0% to 2.4%, with an overall POCUS usage increase of +0.7%. The odds of recapture were significantly lower post-intervention (OR = 0.22, 95% CI: 0.17 to 0.30, p<.001).

Conclusions:

The study illustrates the effectiveness of using ML to enhance the identification and billing of POCUS procedures in OBGYN settings. The adoption of standardized documentation significantly improved accurate billing capture, highlighting ML's potential in optimizing clinical processes without direct EHR integration.


 Citation

Please cite as:

Nguyen K, Wu Z, Tsai CA, Vandervest J, Lammers D, Cassidy R, Murphy Z, Pandian B, Hammoud MM, Collin J, Smith R, Maben-Feaster R, Kaufman Eddy A, Burns ML

Machine Learning to Identify Point-of-Care Ultrasound and Evaluate Standardized Documentation: Retrospective Operational Cohort Study

J Med Internet Res 2026;28:e84454

DOI: 10.2196/84454

PMID: 42566781

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.