Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Research Protocols

Date Submitted: Aug 26, 2024
Open Peer Review Period: Aug 29, 2024 - Oct 24, 2024
Date Accepted: Feb 19, 2025
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Predicting Therapy Outcomes in Patients With Stress-Related Disorders: Protocol for a Predictive Modeling Study

Franke Föyen L, Sennerstam V, Kontio E, Flygare O, Boman M, Lindsäter E

Predicting Therapy Outcomes in Patients With Stress-Related Disorders: Protocol for a Predictive Modeling Study

JMIR Res Protoc 2025;14:e65790

DOI: 10.2196/65790

PMID: 40132191

PMCID: 11979537

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Predicting Therapy Outcomes for Stress-Related Disorders using Machine Learning: A Study Protocol

  • Ludwig Franke Föyen; 
  • Victoria Sennerstam; 
  • Evelina Kontio; 
  • Oskar Flygare; 
  • Magnus Boman; 
  • Elin Lindsäter

ABSTRACT

Background:

Stress-related disorders, such as adjustment disorder and exhaustion disorder, are prevalent and associated with significant personal suffering and societal costs. While cognitive behavioral therapy has shown efficacy in treating these conditions, knowledge about factors contributing to treatment response is limited. Improved identification of such factors could enhance assessment procedures and treatment strategies.

Objective:

This study aims to (1) evaluate putative predictors of treatment outcome in patients with stress-related disorders using traditional prediction methods and (2) model treatment outcomes utilizing a machine learning approach. The primary outcome of interest is responder status on the Perceived Stress Scale-10, evaluated based on the reliable change index post-treatment.

Methods:

Data from a randomized controlled trial comparing two internet-delivered treatments for patients diagnosed with adjustment disorder or exhaustion disorder (N = 300) will be analyzed. Putative predictors include sociodemographic and clinical information, clinician-assessed data, self-rated symptoms, and cognitive test scores. For the traditional approach, univariate logistic regressions will be conducted for each predictor, followed by an ablation study for significant predictors. For the machine learning approach, four classifiers (logistic regression with Elastic Net, random forest, support vector machine, and AdaBoost) will be trained and evaluated. The dataset will be split into training (70%) and testing (30%) sets. Hyperparameter tuning will be conducted using 5-fold cross-validation with randomized search. Model performance will be assessed using balanced accuracy, precision, recall, and area under the curve.

Results:

All data to be used in the present study was collected between April 2021 and July 2022. We hypothesize that key predictors will include younger age, education level, baseline symptom severity, treatment credibility, and history of sickness absence. We anticipate that the machine learning models will outperform a dummy model predicting the majority class and achieve a balanced accuracy of 67% or higher, thus being considered clinically useful.

Conclusions:

This study will contribute to the limited research on predictors of treatment outcome in stress-related disorders. By comparing traditional and machine learning approaches, it aims to enhance our understanding of factors influencing treatment response. The findings could support the development of more personalized and effective treatments for individuals diagnosed with adjustment disorder or exhaustion disorder, potentially improving clinical practice and patient outcomes. If successful, this approach may encourage future studies with larger datasets and the implementation of machine learning models in clinical settings, ultimately enhancing precision in mental health care. Clinical Trial: ClinicalTrials ID: NCT04797273. Trial registration date 15 March 2021.


 Citation

Please cite as:

Franke Föyen L, Sennerstam V, Kontio E, Flygare O, Boman M, Lindsäter E

Predicting Therapy Outcomes in Patients With Stress-Related Disorders: Protocol for a Predictive Modeling Study

JMIR Res Protoc 2025;14:e65790

DOI: 10.2196/65790

PMID: 40132191

PMCID: 11979537

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.