Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.
Who will be affected?
Readers: No access to all 28 journals. We recommend accessing our articles via PubMed Central
Authors: No access to the submission form or your user account.
Reviewers: No access to your user account. Please download manuscripts you are reviewing for offline reading before Wednesday, July 01, 2020 at 7:00 PM.
Editors: No access to your user account to assign reviewers or make decisions.
Copyeditors: No access to user account. Please download manuscripts you are copyediting before Wednesday, July 01, 2020 at 7:00 PM.
Woo M, Mishra P, Lin J, Kar S, Deas N, Linduff C, Niu S, Yang Y, McClendon J, Smith DH, Shelton SL, Gainey CE, Gerard WC, Smith MC, Griffin SF, Gimbel RW, Wang KC
Complete and Resilient Documentation for Operational Medical Environments Leveraging Mobile Hands-free Technology in a Systems Approach: Experimental Study
Complete and Resilient Documentation (CARD) for Operational Medical Environments Leveraging Mobile Hands-free Technology in a Systems Approach
MinJae Woo;
Prabodh Mishra;
Ju Lin;
Snigdhaswin Kar;
Nicholas Deas;
Caleb Linduff;
Sufeng Niu;
Yuzhe Yang;
Jerome McClendon;
D. Hudson Smith;
Stephen L. Shelton;
Christopher E. Gainey;
William C. Gerard;
Melissa C. Smith;
Sarah F. Griffin;
Ronald W. Gimbel;
Kuang-Ching Wang
ABSTRACT
Background:
Prehospitalization documentation is a challenging task and prone to loss of information, as paramedics operate under disruptive environments requiring their constant attention to the patients.
Objective:
The aim of this study is to develop a mobile platform for hands-free prehospitalization documentation to assist first-responders in operational medical environments.
Methods:
The platform was built to extract meaningful medical information from the real-time audio streaming at the point of injury and transmit complete documentation to a field hospital prior to patient arrival. To this end, the state-of-the-art Automatic Speech Recognition (ASR) solutions with relevant modular improvements were thoroughly explored. Development of the platform was strictly guided by qualitative research and simulation-based evaluation to address the relevant challenges through progressive improvements at every process step of the end-to-end solution. The primary performance metrics included medical Word Error Rate (WER) in machine-transcribed text output and F1 score calculated by comparing the autogenerated documentation to manual documentation by physicians.
Results:
The total number of 15,139 individual words necessary for completing the documentation were identified from all conversations occurred during the physician-supervised simulation drills. While the noise-resilient ASR, multi-style training, and customized lexicon improved the overall performance, not all modular improvements were effective when evaluated in real-world noisy environments. The finalized platform achieved medical WER of 33.3% and F1 score of 0.81 when compared to manual documentation.
Conclusions:
This study presented a fully functional mobile platform for hands-free prehospitalization documentation in operational medical environments and lesson learned from its implementation. Clinical Trial: N/A
Citation
Please cite as:
Woo M, Mishra P, Lin J, Kar S, Deas N, Linduff C, Niu S, Yang Y, McClendon J, Smith DH, Shelton SL, Gainey CE, Gerard WC, Smith MC, Griffin SF, Gimbel RW, Wang KC
Complete and Resilient Documentation for Operational Medical Environments Leveraging Mobile Hands-free Technology in a Systems Approach: Experimental Study