Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Currently submitted to: Journal of Medical Internet Research

Date Submitted: Jun 17, 2026

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Clinical Validation and Establishing Optimal Cut-off Scores for the Depression Scale for Online Assessment (DSO): A Comparative Study of Patients with Depressive Disorders and Healthy Controls

  • Minjeong Jeon; 
  • Hae-In Park; 
  • Jin Young Park

ABSTRACT

Background:

Widely used depression screeners (PHQ-9, CES-D, BDI-II) share two limitations: they employ clinical terminology developed before digital communication became normative, and their cut-offs were validated predominantly against major depressive disorder (MDD) without testing across persistent depressive disorder (PDD) or other specified depressive disorder (OSDD). The Depression Scale for Online Assessment (DSO) is a 17-item, five-factor instrument grounded in social media language, with community validation confirming strong structural fit and internal consistency (N=1,151; CFI=0.959; α=.949). Clinical validation—including subtype-specific diagnostic cut-offs—is essential before deployment in outpatient psychiatric care.

Objective:

This study aimed to (1) confirm the DSO's five-factor structure via CFA in a clinical sample; (2) evaluate known-group validity across diagnostic groups and healthy controls; (3) assess concurrent validity, internal consistency, and test-retest reliability; (4) derive overall and subtype-specific diagnostic cut-offs via ROC analysis; and (5) test transdiagnostic equivalence of the DSO–severity relationship across diagnostic subgroups.

Methods:

A cross-sectional study with a prospective test-retest component was conducted at Yongin Severance Hospital and in the surrounding community. Participants included 197 individuals with MINI-confirmed diagnoses of MDD (n=70), PDD (n=45), or OSDD (n=82), recruited from the outpatient clinic and community, alongside 69 community-recruited healthy controls (N=266). CFA with maximum-likelihood estimation tested the five-factor model. Known-group and concurrent validity were evaluated using one-way ANOVA, Cohen's d, and Pearson correlations with the CES-D and BDI-II. Internal consistency was assessed via Cronbach's alpha. Test-retest reliability was evaluated at baseline (T1), Day 4 (T2), and 4 weeks (T3) using ICC(2,1) and ICC(3,1) with bootstrap confidence intervals. Optimal cut-offs were identified via ROC analysis using Youden's J. Transdiagnostic equivalence was examined via moderation regression.

Results:

CFA confirmed the five-factor structure in the clinical sample (CFI=0.906, RMSEA=0.087) and full sample (CFI=0.938, RMSEA=0.095); fit improved after freeing two theoretically justified residual covariances (CFI=0.940, RMSEA=0.070). DSO scores discriminated all clinical groups from controls with large effect sizes (Cohen's d=2.62–3.69). ROC analysis demonstrated excellent diagnostic accuracy (AUC≥0.993), with an overall cut-off of ≥14 (sensitivity=95.4%, specificity=96.8%) and disorder-specific thresholds of ≥14 for MDD, ≥20 for PDD, and ≥13 for OSDD. Total-scale Cronbach's alpha was 0.964 (subscale range: 0.859–0.931). Concurrent validity was supported by strong correlations with the CES-D (r=0.815, P<.001) and BDI-II (r=0.955, P<.001). Test-retest reliability was excellent at four days (ICC=0.960, 95% CI: 0.941–0.974) and four weeks (ICC=0.930, 95% CI: 0.873–0.967). The DSO–severity relationship was statistically equivalent across MDD and PDD (interaction P=.432).

Conclusions:

The DSO demonstrates robust psychometric properties across outpatients and community-recruited individuals with depressive disorders and healthy controls. Disorder-specific cut-offs (≥13–≥20) and an overall threshold of ≥14 support its use as a brief, digitally deliverable screening and monitoring tool in outpatient psychiatric settings.


 Citation

Please cite as:

Jeon M, Park HI, Park JY

Clinical Validation and Establishing Optimal Cut-off Scores for the Depression Scale for Online Assessment (DSO): A Comparative Study of Patients with Depressive Disorders and Healthy Controls

JMIR Preprints. 17/06/2026:104923

DOI: 10.2196/preprints.104923

URL: https://preprints.jmir.org/preprint/104923

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.