Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Research Protocols

Date Submitted: Jan 13, 2022
Open Peer Review Period: Jan 13, 2022 - Mar 10, 2022
Date Accepted: May 31, 2022
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Multimodal Assessment of Schizophrenia and Depression Utilizing Video, Acoustic, Locomotor, Electroencephalographic, and Heart Rate Technology: Protocol for an Observational Study

Cotes RO, Boazak M, Griner E, Jiang Z, Kim B, Bremer W, Seyedi S, Bahrami Rad A, Clifford GD

Multimodal Assessment of Schizophrenia and Depression Utilizing Video, Acoustic, Locomotor, Electroencephalographic, and Heart Rate Technology: Protocol for an Observational Study

JMIR Res Protoc 2022;11(7):e36417

DOI: 10.2196/36417

PMID: 35830230

PMCID: 9330209

Multimodal Assessment of Schizophrenia and Depression Utilizing Video, Acoustic, Locomotor, Electroencephalographic, and Heart Rate Technology: Protocol for an Observational Study

  • Robert O Cotes; 
  • Mina Boazak; 
  • Emily Griner; 
  • Zifan Jiang; 
  • Bona Kim; 
  • Whitney Bremer; 
  • Salman Seyedi; 
  • Ali Bahrami Rad; 
  • Gari D Clifford

ABSTRACT

Background:

Current standards of psychiatric assessment and diagnostic evaluation rely primarily on the clinical subjective interpretation of a patient’s outward manifestations of their internal state. While psychometric tools can help to evaluate these behaviors more systematically, the tools still rely on the clinicians’ interpretation of what are frequently nuanced speech and behavior patterns. With advances in computing power, increased availability of clinical data, and improving resolution of recording and sensor hardware (including acoustic, video, accelerometer, infrared and other modalities), researchers have begun to demonstrate the feasibility of cutting-edge technologies in aiding the assessment of psychiatric disorders.

Objective:

We present a research protocol that utilizes facial expression, eye gaze, voice and speech, locomotor, heart rate, and electroencephalography monitoring to assess schizophrenia symptoms and to distinguish schizophrenia from other psychiatric disorders and control populations.

Methods:

We plan to recruit three outpatient groups: 1) 50 patients with schizophrenia, 2) 50 patients with unipolar major depressive disorder, and 3) 50 individuals with no prior psychiatric history. Using an internally developed semi-structured interview, psychometrically validated clinical outcome measures, and a multi-modal sensing system utilizing video, acoustic, actigraphic, heart rate, and electroencephalographic sensors, we aim to evaluate the system’s capacity in classifying subject grouping (schizophrenia, depression, or control); to evaluate the systems sensitivity to within group symptom severity; and to determine if such a system can further classify variations in disorder subtypes.

Results:

Data collection began in July 2020 and is expected to continue through December 2022.

Conclusions:

If successful, this study will help advance current progress in the merger between state-of-the-art technology in aiding clinical psychiatric assessments and treatment. If our findings suggest these technologies to be capable of resolving diagnosis and symptoms to the level of current psychometric testing/clinician judgment, then we would be among the first to develop a system that can eventually be used by clinicians to more objectively diagnose and assess schizophrenia and depression, with the possibility of less risk of bias. Such a tool has the potential to improve accessibility to care, to aid clinicians in objectively evaluating diagnosis, severity of symptoms, and treatment efficacy through time, and to reduce treatment related morbidity.


 Citation

Please cite as:

Cotes RO, Boazak M, Griner E, Jiang Z, Kim B, Bremer W, Seyedi S, Bahrami Rad A, Clifford GD

Multimodal Assessment of Schizophrenia and Depression Utilizing Video, Acoustic, Locomotor, Electroencephalographic, and Heart Rate Technology: Protocol for an Observational Study

JMIR Res Protoc 2022;11(7):e36417

DOI: 10.2196/36417

PMID: 35830230

PMCID: 9330209

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.