Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Jul 21, 2023
Open Peer Review Period: Jul 21, 2023 - Sep 15, 2023
Date Accepted: Sep 19, 2023
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Automated Machine Learning Analysis of Patients With Chronic Skin Disease Using a Medical Smartphone App: Retrospective Study

Bibi I, Schaffert D, Blauth M, Lull C, von Ahnen JA, Gross G, Weigandt WA, Knitza J, Kuhn S, Benecke J, Leipe J, Schmieder A, Olsavszky V

Automated Machine Learning Analysis of Patients With Chronic Skin Disease Using a Medical Smartphone App: Retrospective Study

J Med Internet Res 2023;25:e50886

DOI: 10.2196/50886

PMID: 38015608

PMCID: 10716771

Automated Machine Learning Study of Chronic Skin Disease Patients Using a Medical Smartphone App

  • Igor Bibi; 
  • Daniel Schaffert; 
  • Mara Blauth; 
  • Christian Lull; 
  • Jan Alwin von Ahnen; 
  • Georg Gross; 
  • Wanja Alexander Weigandt; 
  • Johannes Knitza; 
  • Sebastian Kuhn; 
  • Johannes Benecke; 
  • Jan Leipe; 
  • Astrid Schmieder; 
  • Victor Olsavszky

ABSTRACT

Background:

The rapid digitalization in healthcare has led to the adoption of digital technologies, but limited trust in internet-based health decisions and the need for technical personnel hinder the utilization of smartphones and machine learning (ML) applications. To address this, automated machine learning (AutoML) is a promising tool that can empower healthcare professionals to enhance the effectiveness of mobile health (mHealth) applications.

Objective:

We employed AutoML to analyze data from clinical studies involving patients with chronic hand and/or foot eczema or psoriasis vulgaris who used a smartphone monitoring application. The analysis focused on itching, pain and Dermatology Life Quality Index (DLQI) development as well as app usage.

Methods:

After extensive data set preparation, which consisted of combining three primary data sets by extracting common but also by computing new features, a new pseudomised secondary data set with a total of 368 patients was created. Next, multiple ML classification models were built during AutoML processing, with the most accurate models ultimately selected for further data set analysis.

Results:

Itching development over 6 months was accurately modelled using the Light Gradient Boosted Trees Classifier model (LogLoss: 0.9302 for validation, 1.0193 for cross-validation, and 0.9167 for holdout). Pain development over 6 months was assessed using the Random Forest Classifier model (LogLoss: 1.1799 for validation, 1.1561 for cross-validation, and 1.0976 for holdout). Next, the Random Forest Classifier model (LogLoss: 1.3670 for validation, 1.4354 for cross-validation and 1.3974 for holdout) was used again to estimate DLQI development over 6 months. Finally, app usage was analyzed using the eXtreme Gradient Boosted Trees Classifier model (LogLoss: 0.6817 for validation, 0.7121 for cross-validation, and 0.6604 for holdout). Influential feature correlations were identified, such as therapy changes during the trial, disease activity at enrolment, and DLQI scores at follow-up. Increased app usage was associated with higher disease activity, physical job types, and higher BMI. Conversely, lower pain intensity at follow-up and nicotine use were linked to lower likelihood of app usage.

Conclusions:

This study provides valuable insights into the relationship between data characteristics and targeted outcomes in patients with chronic eczema or psoriasis, highlighting the potential of smartphone and AutoML techniques to improve chronic disease management and patient care.


 Citation

Please cite as:

Bibi I, Schaffert D, Blauth M, Lull C, von Ahnen JA, Gross G, Weigandt WA, Knitza J, Kuhn S, Benecke J, Leipe J, Schmieder A, Olsavszky V

Automated Machine Learning Analysis of Patients With Chronic Skin Disease Using a Medical Smartphone App: Retrospective Study

J Med Internet Res 2023;25:e50886

DOI: 10.2196/50886

PMID: 38015608

PMCID: 10716771

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.