Currently accepted at: JMIR Formative Research
Date Submitted: Mar 5, 2026
Date Accepted: Oct 19, 2026
This paper has been accepted and is currently in production.
It will appear shortly on 10.2196/94739
The final accepted version (not copyedited yet) is in this tab.
Building a Better Computerized Adaptive Test for Suicide Risk Screening and Measurement Through Iterative User Input: A Usability Study
ABSTRACT
Background:
Background:
Suicide remains a leading cause of death in the United States, with healthcare settings like emergency departments (EDs) representing key opportunities for early identification of risk. Existing screening tools are limited by inefficiency, narrow scope, and workflow integration challenges, necessitating the development of solutions that combine accurate risk detection with clinical feasibility.
Objective:
Objectives: This study aimed to develop and assess the Computerized Adaptive Test for Suicide Scale Expanded (CAT-SSE), an integrated tool that merges computerized adaptive testing with electronic health record (EHR)-based machine learning to improve suicide risk screening and measurement in a large ED.
Methods:
Methods:
The development process followed a user-centered, four-phase design involving ED clinicians and patients: 1) initial design, 2) early feedback, 3) build and integration, and 4) final testing and feedback. The CAT-SSE was built to incorporate adaptive tests across multiple psychopathology domains combined with an EHR-based machine learning algorithm. Iterative feedback guided enhancements in usability and ED workflow integration. Usability, acceptability, appropriateness, and feasibility were evaluated using validated instruments, including the System Usability Scale (SUS), Acceptability of Intervention Measure (AIM), Intervention Appropriateness Measure (IAM), and Feasibility of Intervention Measure (FIM).
Results:
Results:
Ten patients and sixteen clinicians participated in the early prototype testing phase, and usability improvements were made accordingly to the CAT-SSE. In the final user testing phase, fourteen patients and five clinicians who managed nine of the patient encounters assessed the production version. Across study phases 2 and 4, patients consistently reported high usability ratings (mean SUS (SD): 87.0 (9.9) to 87.8 (12.8)), while clinicians’ usability ratings increased from a mean of 73.5 (16.2) to 79.3 (24.1) after iterative refinements. Both user groups rated the CAT-SSE as highly acceptable and appropriate for use in the ED. Clinicians also endorsed its feasibility for integration into busy ED workflows.
Conclusions:
Conclusions:
The CAT-SSE is one of the first ED-based suicide risk screening tools designed to combine adaptive tests and EHR-based machine learning algorithms. Iterative development with end-user input yielded a solution rated as usable, acceptable, and feasible by both patients and clinicians. The CAT-SSE shows promise as a scalable strategy to efficiently screen and measure suicide risk and broad psychopathology within ED clinical practice.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.