Accepted for/Published in: JMIR Human Factors
Date Submitted: Apr 30, 2024
Open Peer Review Period: Jun 5, 2024 - Jul 31, 2024
Date Accepted: Dec 1, 2024
(closed for review but you can still tweet)
Validating the Application of Clinical Department-specific Artificial Intelligence-assisted Coding using TwDRGs
ABSTRACT
Background:
The accuracy of ICD-10-CM/PCS (International Classification of Diseases, 10th Revision Clinical Modification/Procedure Coding System) coding is crucial for generating correct Taiwan Diagnosis-Related Groups (TwDRGs), as coding errors can lead to financial losses for hospitals.
Objective:
The study aimed to determine the consistency between the artificial intelligence (AI)-assisted coding module and manual coding, as well as identifying clinical specialties suitable for implementing the developed AI-assisted coding module.
Methods:
This study validates the AI-assisted coding module from the perspective of healthcare professionals. The research period commenced in February 2023. The study subjects excluded cases outside of TwDRGs, those with incomplete medical records, and cases with TwDRGs disposals ICD-10-PCS. Data collection was conducted through retrospective medical record review. The AI-assisted module was constructed using a hierarchical attention network (HAN). The verification of the TwDRGs results from the AI-assisted coding model focused on the major diagnostic category (MDC). Statistical computations were conducted using statistical package for the social sciences (SPSS) software, while research variables consisted of categorical variables represented by MDC, and continuous variables represented by the RW of TwDRGs.
Results:
A total of 2,632 discharge records meeting the research criteria were collected from 0February to April 2023. In terms of inferential statistics, Kappa statistics were employed for MDC analysis. The infectious diseases, parasitic diseases and respiratory system had Kappa values exceeding 0.8. Clinical inpatient specialties were statistically analyzed using the Wilcoxon Signed Rank Test. There was no difference in coding results between 23 clinical departments such as Division of Cardiology, Division of Nephrology, and Department of Urology classification personnel.
Conclusions:
For human coders, with the assistance of the ICD-10-CM/PCS AI-assisted coding system, work time is reduced; additionally, strengthening knowledge in clinical documentation improvement (CDI) enables human coders to maximize their role. This positions them to become CDI experts1, preparing them for further career development. Future research will apply the same methodology to validate the ICD10PCS AI-assisted coding module.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.