JMIR Publications

ABSTRACT

Background:

Digital remote monitoring technologies, including smartphones and wearables, offer promising avenues for early detection of psychosis relapse. However, selecting devices that are acceptable to participants and produce high-quality data remains challenging.

Objective:

The aim of this nested pilot study was to assess acceptability and data quality of three commercially available wearable devices in people with psychosis recruited to the CONNECT cohort study.

Methods:

Participants recruited to the CONNECT study before July 31st, 2024 were included in the pilot study and selected one of three wearable devices: a Fitbit Charge 5, Samsung Galaxy Watch 5, or Apple Watch SE. Baseline demographics were compared between device groups. Acceptability of devices to participants was assessed through a Wearable Device Satisfaction Questionnaire after 3 months of use, with the proportion of positive responses to each question calculated and compared. Data completeness was also assessed by calculating the number (and %) of valid days of step count, heart rate and sleep data and comparing between groups. Data quality was assessed through summarising the amount of troubleshooting required, additional metrics available from the wearables, and continuity of data completeness by calculating the proportion of participants with at least 3 days of heart rate data per week for the first 20 weeks of follow-up. Pre-defined criteria were used to determine the next steps for the wider CONNECT study: if one device was superior this would be selected, if none were found to be superior and the Fitbit found to be non-inferior then Fitbit would be retained.

Results:

Of the first 107 participants recruited to CONNECT, 105 were included in the pilot study evaluation. The Samsung Galaxy watch was selected most frequently by participants (43.8%), followed by the Apple Watch (25.7%) and Fitbit Charge (21.9%). Differences in participant demographics were observed across device groups. Self-reported acceptability after use did not differ substantially between devices. However, in terms of data completeness, the median proportion of valid heart rate data days was significantly lower for Samsung Galaxy (median 31.2% IQR 8.5, 46.0) compared to Fitbit (median 80.1%, IQR 26.7, 95.0, p = 0.003) and Apple Watch (median 49.3%, IQR 21.5, 86.0, p = 0.020). There was no significant difference between Fitbit and Apple Watch. Similar patterns were observed for step count and sleep data. The Samsung Galaxy watch required more frequent troubleshooting for data flow issues and lacked additional physiological metrics, available from the other devices.

Conclusions:

Due to comparatively lower data quality and technical performance, the Samsung Galaxy Watch was discontinued for use in the subsequent phase of the CONNECT study. The study highlights the importance of incorporating nested evaluations of devices in long-term research.