Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Medical Informatics

Date Submitted: Nov 19, 2020
Date Accepted: Apr 3, 2021
Date Submitted to PubMed: Apr 16, 2021

The final, peer-reviewed published version of this preprint can be found here:

Federated Learning for Thyroid Ultrasound Image Analysis to Protect Personal Information: Validation Study in a Real Health Care Environment

Lee H, Chai YJ, Joo H, Lee K, Hwang JY, Kim SM, Kim K, Nam IC, Choi JY, Yu HW, Lee MC, Masuoka H, Miyauchi A, Lee KE, Kim S, Kong HJ

Federated Learning for Thyroid Ultrasound Image Analysis to Protect Personal Information: Validation Study in a Real Health Care Environment

JMIR Med Inform 2021;9(5):e25869

DOI: 10.2196/25869

PMID: 33858817

PMCID: 8170555

Application of Federated Learning for Thyroid Ultrasound Image Analysis to Protect Personal Information: Validation Study in Real Healthcare Environment

  • Haeyun Lee; 
  • Young Jun Chai; 
  • Hyunjin Joo; 
  • Kyungsu Lee; 
  • Jae Youn Hwang; 
  • Seok-Mo Kim; 
  • Kwangsoon Kim; 
  • Inn-Chul Nam; 
  • June Young Choi; 
  • Hyeong Won Yu; 
  • Myung-Chul Lee; 
  • Hiroo Masuoka; 
  • Akira Miyauchi; 
  • Kyu Eun Lee; 
  • Sungwan Kim; 
  • Hyoun-Joong Kong

ABSTRACT

Background:

Federated learning (FL) is a decentralized approach to machine learning which is attracting attention as a training strategy that overcomes medical data privacy regulations and generalization of deep learning algorithms. In this study, we performed ultrasound (US) image analysis using FL to predict the benignity or malignancy of thyroid nodules.

Objective:

The goal of this study is to collect clinical data from several medical institutions and to validate the performance of FL by comparing FL and conventional deep learning using the collected data.

Methods:

We pooled 8,457 thyroid US images (5,375 malignant, 3,082 benign) from six institutions, and conducted FL using five deep learning networks (VGG19, ResNet50, ResNext50, SE-ResNet50, and SE-ResNext50). We also performed conventional deep learning on the pooled data and compared the results with those of FL. We used 20% of the dataset for internal validation and 100 US images from another institute for external validation.

Results:

For internal validation, the area under the receiver operating characteristic (AUROC) curve of the FL was between 78.88 and 87.56, and the AUC of the conventional deep learning was between 82.61 and 91.57. For external validation, the AUROC of the FL was between 75.20 and 86.72, and the AUROC curve of the conventional deep learning was between 73.04 and 91.04.

Conclusions:

We demonstrated that US image analysis using FL is feasible and that the performance of FL using decentralized data is comparable to that of conventional deep learning using pooled data. FL is a potentially useful method for analyzing medical images using deep learning while protecting patients’ personal information.


 Citation

Please cite as:

Lee H, Chai YJ, Joo H, Lee K, Hwang JY, Kim SM, Kim K, Nam IC, Choi JY, Yu HW, Lee MC, Masuoka H, Miyauchi A, Lee KE, Kim S, Kong HJ

Federated Learning for Thyroid Ultrasound Image Analysis to Protect Personal Information: Validation Study in a Real Health Care Environment

JMIR Med Inform 2021;9(5):e25869

DOI: 10.2196/25869

PMID: 33858817

PMCID: 8170555

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.