Currently accepted at: JMIR Formative Research
Date Submitted: Mar 5, 2026
Date Accepted: Oct 19, 2026
This paper has been accepted and is currently in production.
It will appear shortly on 10.2196/94739
The final accepted version (not copyedited yet) is in this tab.
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
Building a Better Computerized Adaptive Test for Suicide Risk Screening and Measurement Through Iterative User Input: An Implementation Study
ABSTRACT
Background:
Suicide remains a leading cause of death in the United States, with healthcare settings like emergency departments (EDs) representing key settings for early identification of risk. Existing screening tools are limited by inefficiency, narrow scope, and workflow integration challenges, necessitating the development of solutions that combine accurate risk detection with clinical feasibility.
Objective:
This study aimed to develop the Computerized Adaptive Test for Suicide and Expanded (CAT-SSE), an integrated tool that merges computerized adaptive testing with electronic health record (EHR)-based machine learning to improve suicide risk screening and measurement in a large ED.
Methods:
The development process followed a user-centered, four-phase design involving ED clinicians and patients: 1) initial design, 2) early feedback, 3) build and integration, and 4) final testing and feedback. The CAT-SSE incorporated adaptive tests across multiple psychopathology domains combined with an EHR-based machine learning algorithm. Iterative feedback guided enhancements in usability and workflow integration. Usability, acceptability, appropriateness, and feasibility were evaluated using validated instruments, including the System Usability Scale (SUS), Acceptability of Intervention Measure (AIM), Intervention Appropriateness Measure (IAM), and Feasibility of Intervention Measure (FIM).
Results:
Ten patients and sixteen clinicians participated in early wireframe and prototype testing, and usability improvements were made accordingly. In the final user testing phase, twelve patients and five clinicians who managed nine of the patient encounters assessed the production version. Across earlier and later study phases, patients consistently reported high usability ratings (mean SUS (SD): 87.0 (9.9); 87.7 (12.8)), while clinicians’ usability ratings increased from a mean of 73.4 (16.2) to 79.7 (24.1) after iterative refinements. Both user groups rated the CAT-SSE as highly acceptable and appropriate. Clinicians also endorsed its feasibility for integration into busy ED workflows.
Conclusions:
The CAT-SSE is one of the first ED-based suicide risk screening tools to effectively combine adaptive tests and EHR-based machine learning algorithms. Iterative development with end-user input yielded a solution rated as usable, acceptable, and feasible by both patients and clinicians. The CAT-SSE shows promise as a scalable strategy to efficiently screen and measure suicide risk and broad psychopathology within ED clinical practice.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.