Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Sep 6, 2023
Date Accepted: Jun 10, 2024

The final, peer-reviewed published version of this preprint can be found here:

Using AI to Differentiate Mpox From Common Skin Lesions in a Sexual Health Clinic: Algorithm Development and Validation Study

Soe NN, Yu Z, Latt PM, Lee D, Samra RS, Ge Z, Rahman R, Sun J, Ong JJ, Fairley CK, Zhang L

Using AI to Differentiate Mpox From Common Skin Lesions in a Sexual Health Clinic: Algorithm Development and Validation Study

J Med Internet Res 2024;26:e52490

DOI: 10.2196/52490

PMID: 39269753

PMCID: 11437223

Using Artificial Intelligence to Differentiate Mpox from Common Skin Lesions in a Sexual Health Clinic: Development and Evaluation of an Image Recognition Algorithm

  • Nyi Nyi Soe; 
  • Zhen Yu; 
  • Phyu Mon Latt; 
  • David Lee; 
  • Ranjit Singh Samra; 
  • Zongyuan Ge; 
  • Rashidur Rahman; 
  • Jiajun Sun; 
  • Jason J Ong; 
  • Christopher K. Fairley; 
  • Lei Zhang

ABSTRACT

Background:

The 2022 global outbreak of mpox has significantly impacted health facilities, and necessitated additional infection prevention and control measures and alterations to clinic processes. Early identification of suspected mpox cases will assist in mitigating these impacts.

Objective:

We aimed to develop an AI-based tool to differentiate mpox lesion images from other skin lesions seen in a sexual health clinic.

Methods:

We used a dataset with 2,200 images, that included mpox and non-mpox lesions images, collected from Melbourne Sexual Health Centre and web resources. We adopted deep learning approaches which involved six different deep learning architectures to train our AI models. We subsequently evaluated the performance of each model to determine the best model for differentiating between mpox and non-mpox lesions.

Results:

The denseNet-121 model outperformed other models with an overall Area Under the Receiver Operating Characteristic Curve (AUC) of 0·928, an accuracy of 0·848, a precision of 0·942, a recall of 0·742, and an F1-score of 0·834. Implementation of a region-of-interest approach significantly improved the performance of all models, with the AUC for the DenseNet-121 model increasing to 0·982. This approach resulted in an increase in the correct classification of mpox images from 79% to 94%. The effectiveness of this approach was further validated by a visual analysis with Grad-CAM, demonstrating a reduction in the false detection within the background of lesion images.

Conclusions:

Our study demonstrated it was possible to use an AI-based image recognition algorithm to accurately differentiate between mpox and common skin lesions. Our findings provide a foundation for future investigations aimed at refining the algorithm and establishing the place of such technology in a sexual health clinic.


 Citation

Please cite as:

Soe NN, Yu Z, Latt PM, Lee D, Samra RS, Ge Z, Rahman R, Sun J, Ong JJ, Fairley CK, Zhang L

Using AI to Differentiate Mpox From Common Skin Lesions in a Sexual Health Clinic: Algorithm Development and Validation Study

J Med Internet Res 2024;26:e52490

DOI: 10.2196/52490

PMID: 39269753

PMCID: 11437223

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.