Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Mental Health

Date Submitted: Jun 7, 2024
Date Accepted: Oct 8, 2024

The final, peer-reviewed published version of this preprint can be found here:

Developing a Sleep Algorithm to Support a Digital Medicine System: Noninterventional, Observational Sleep Study

Cochran J

Developing a Sleep Algorithm to Support a Digital Medicine System: Noninterventional, Observational Sleep Study

JMIR Ment Health 2024;11:e62959

DOI: 10.2196/62959

PMID: 39727095

PMCID: 11683743

A Noninterventional, Observational Sleep Study to Develop a Sleep Algorithm to Support a Digital Medicine System

  • Jeffrey Cochran

ABSTRACT

Background:

Sleep-wake patterns are important behavioral biomarkers for patients with serious mental illness (SMI), providing insight into their well-being. The gold standard for monitoring sleep is polysomnography (PSG), which requires a sleep lab facility; however, advances in wearable sensor technology allow for real-world sleep-wake monitoring.

Objective:

The goal of this study was to develop a PSG-validated sleep algorithm using accelerometer (ACC) and electrocardiogram (ECG) data from a wearable patch to accurately quantify sleep in a real-world setting.

Methods:

In this noninterventional, nonsignificant-risk, abbreviated investigational device exemption, single-site study, participants wore the reusable wearable sensor version 2 (RW2) patch. The RW2 patch is part of a digital medicine system (aripiprazole with sensor) designed to provide objective records of medication ingestion for patients with schizophrenia, bipolar I disorder, and major depressive disorder. This study developed a sleep algorithm from patch data and did not contain any study-related or digitized medication. Patch-acquired ACC and ECG data were compared against PSG data to build machine learning classification models to distinguish periods of wake from sleep. The PSG data provided sleep stage classifications at 30-second intervals, which were combined into 5-minute windows, and labeled as sleep or wake based on the majority of sleep stages within the window. ACC and ECG features were derived for each 5-minute window. The algorithm that most accurately predicted sleep parameters against PSG data was compared to commercially available wearable devices to further benchmark model performance.

Results:

Of 80 participants enrolled, 73 had at least 1 night of analyzable ACC and ECG data (31 healthy volunteers and 42 participants with diagnosed SMI). Overall, 10,170 5-minute valid windows were identified (5610 from participants with SMI) and 83% were classified as greater than half sleep. Of 3 models tested, the conditional random field (CRF) algorithm provided the most robust sleep-wake classification. Performance was comparable to the middle 50% of commercial devices evaluated in a recent publication, providing sleep detection performance of 0.93 (sensitivity) and wake detection performance of 0.60 (specificity) at a prediction probability threshold of 0.75. The CRF algorithm retained this performance for individual sleep parameters, including total sleep time, sleep efficiency, and wake after sleep onset (within the middle 50% to top 25% of the assessed devices). The only parameter where the model performance was lower was sleep onset latency (within the bottom 25% of all comparator devices).

Conclusions:

Using industry-best practices, we developed a sleep algorithm for use with the RW2 patch that can accurately detect sleep and wake windows compared to PSG-labeled sleep data. This algorithm may be used for a more complete understanding of well-being for patients with SMI in a real-world setting, without the need for PSG and a sleep lab. Clinical Trial: NA


 Citation

Please cite as:

Cochran J

Developing a Sleep Algorithm to Support a Digital Medicine System: Noninterventional, Observational Sleep Study

JMIR Ment Health 2024;11:e62959

DOI: 10.2196/62959

PMID: 39727095

PMCID: 11683743

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.