Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Aug 9, 2023
Date Accepted: May 29, 2024

The final, peer-reviewed published version of this preprint can be found here:

A 3D and Explainable Artificial Intelligence Model for Evaluation of Chronic Otitis Media Based on Temporal Bone Computed Tomography: Model Development, Validation, and Clinical Application

Chen B, Li Y, Sun Y, Sun H, Wang Y, Lyu J, Guo J, Cheng Y, Niu X, Yang L, Xu J, Yang J, Huang Y, Chi F, Liang B, Ren D

A 3D and Explainable Artificial Intelligence Model for Evaluation of Chronic Otitis Media Based on Temporal Bone Computed Tomography: Model Development, Validation, and Clinical Application

J Med Internet Res 2024;26:e51706

DOI: 10.2196/51706

PMID: 39116439

PMCID: 11342006

A Three-Dimensional and Explainable Artificial Intelligence Model for Evaluation of Chronic Otitis Media Based on Temporal Bone Computed Tomography: Model Development, Validation, and Clinical Application

  • Binjun Chen; 
  • Yike Li; 
  • Yu Sun; 
  • Haojie Sun; 
  • Yanmei Wang; 
  • Jihan Lyu; 
  • Jiajie Guo; 
  • Yushu Cheng; 
  • Xun Niu; 
  • Lian Yang; 
  • Jianghong Xu; 
  • Juanmei Yang; 
  • Yibo Huang; 
  • Fanglu Chi; 
  • Bo Liang; 
  • Dongdong Ren

ABSTRACT

Background:

Computed tomography (CT) of the temporal bone has become a critical diagnostic approach to chronic otitis media (COM), but it requires training and experience for interpretation. Artificial intelligence may assist clinicians in evaluating COM using CT with efficiency and reliability, but the logic for decision-making can be incomprehensible and there is currently no model that makes full use of the multidimensional diagnostic information.

Objective:

This study was to develop an explainable and three-dimensional (3D) deep learning framework for detection and differential diagnosis of COM based on CT.

Methods:

Temporal bone CT scans were retrospectively obtained from patients receiving surgeries for COM between December 2015 and July 2021 at two independent institutes. The region of interest containing the middle ear was automatically segmented, followed by 3D convolutional neural networks trained to identify pathological ears and cholesteatoma. Gradient-weighted class activation mapping was used to generate heatmaps highlighting the critical regions for decision-making. Model performance was evaluated over five rounds of cross-validation and external validation and benchmarked against clinical experts.

Results:

The internal and the external datasets contained 1,661 patients (number of eligible ears[n]= 3,153) and 108 patients (n=211), respectively. The deep learning model achieved decent and comparable area under the receiver operating characteristic curve (AUROC) scores ([mean ± SD]: 0.96±0.01 and 0.93±0.01) and accuracies (87.8±1.7% and 84.3±1.5%) in detection of pathological ears on two datasets. Similar outcomes were also observed in identifying cholesteatoma, with AUROC of 0.85±0.03 and 0.83±0.05, and accuracies of 78.3±4.0% and 81.3±3.3%, respectively. The model exhibited equivalent or superior performance and a much higher consistency compared to experts’ averages in both tasks. The heatmaps properly highlighted the middle ear and mastoid regions, consistent with human knowledge in interpreting temporal bone CT.

Conclusions:

This study suggests the feasibility of a 3D deep learning framework in automatic evaluation of COM using CT. This model demonstrates decent performance, generalizability, and transparency, making it a useful tool to assist clinicians in assessment of COM.


 Citation

Please cite as:

Chen B, Li Y, Sun Y, Sun H, Wang Y, Lyu J, Guo J, Cheng Y, Niu X, Yang L, Xu J, Yang J, Huang Y, Chi F, Liang B, Ren D

A 3D and Explainable Artificial Intelligence Model for Evaluation of Chronic Otitis Media Based on Temporal Bone Computed Tomography: Model Development, Validation, and Clinical Application

J Med Internet Res 2024;26:e51706

DOI: 10.2196/51706

PMID: 39116439

PMCID: 11342006

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.