Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Mental Health

Date Submitted: Jun 5, 2020
Date Accepted: Sep 28, 2021

The final, peer-reviewed published version of this preprint can be found here:

Improving Web-Based Treatment Intake for Multiple Mental and Substance Use Disorders by Text Mining and Machine Learning: Algorithm Development and Validation

Wiegersma S, Hidajat M, Schrieken B, Veldkamp BP, Olff M

Improving Web-Based Treatment Intake for Multiple Mental and Substance Use Disorders by Text Mining and Machine Learning: Algorithm Development and Validation

JMIR Ment Health 2022;9(4):e21111

DOI: 10.2196/21111

PMID: 35404261

PMCID: 9039807

Improving Online Treatment Intake for Multiple Mental and Substance Use Disorders by Text Mining and Machine Learning: Algorithm Development and Validation

  • Sytske Wiegersma; 
  • Maurice Hidajat; 
  • Bart Schrieken; 
  • Bernard P. Veldkamp; 
  • Miranda Olff

ABSTRACT

Background:

Text mining and machine learning are increasingly used in mental health care practice and research, potentially saving time and effort in the diagnosis and monitoring of patients. Previous studies showed that mental disorders can be detected based on text, but those focused on screening for one predefined disorder instead of multiple disorders simultaneously.

Objective:

This study developed a Dutch multiclass text classification model to screen for a range of mental disorders, in order to refer new patients to the most suitable treatment.

Methods:

Based on patients’ (N = 5,863) textual responses to a questionnaire currently used for intake and referral, a seven-class classifier was developed to distinguish between anxiety, panic, posttraumatic stress, mood, eating, substance use, and somatic symptom disorders. A linear Support Vector Machine (SVM) was fitted using nested cross-validation grid search.

Results:

The highest classification rate was found for eating disorders (82%). Scores for panic (55%), posttraumatic stress (52%), mood (50%), somatic symptom (50%), anxiety (35%), and substance use disorders (33%) were lower, likely due to overlapping symptoms. The overall classification accuracy (49%) was reasonable for a seven-class classifier.

Conclusions:

Though this study enabled simultaneous screening for multiple disorders, performance for disorders other than eating needs to be improved before implementation in mental health practice.


 Citation

Please cite as:

Wiegersma S, Hidajat M, Schrieken B, Veldkamp BP, Olff M

Improving Web-Based Treatment Intake for Multiple Mental and Substance Use Disorders by Text Mining and Machine Learning: Algorithm Development and Validation

JMIR Ment Health 2022;9(4):e21111

DOI: 10.2196/21111

PMID: 35404261

PMCID: 9039807

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.