Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Currently accepted at: JMIR Formative Research

Date Submitted: Mar 5, 2026
Date Accepted: Oct 19, 2026

This paper has been accepted and is currently in production.

It will appear shortly on 10.2196/94739

The final accepted version (not copyedited yet) is in this tab.

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Building a Better Computerized Adaptive Test for Suicide Risk Screening and Measurement Through Iterative User Input: An Implementation Study

  • Edwin D Boudreaux; 
  • Hyein S Lee; 
  • Rachel E Davis-Martin; 
  • Celine Larkin; 
  • Cody Schroeder; 
  • Robert D Gibbons

ABSTRACT

Background:

Suicide remains a leading cause of death in the United States, with healthcare settings like emergency departments (EDs) representing key settings for early identification of risk. Existing screening tools are limited by inefficiency, narrow scope, and workflow integration challenges, necessitating the development of solutions that combine accurate risk detection with clinical feasibility.

Objective:

This study aimed to develop the Computerized Adaptive Test for Suicide and Expanded (CAT-SSE), an integrated tool that merges computerized adaptive testing with electronic health record (EHR)-based machine learning to improve suicide risk screening and measurement in a large ED.

Methods:

The development process followed a user-centered, four-phase design involving ED clinicians and patients: 1) initial design, 2) early feedback, 3) build and integration, and 4) final testing and feedback. The CAT-SSE incorporated adaptive tests across multiple psychopathology domains combined with an EHR-based machine learning algorithm. Iterative feedback guided enhancements in usability and workflow integration. Usability, acceptability, appropriateness, and feasibility were evaluated using validated instruments, including the System Usability Scale (SUS), Acceptability of Intervention Measure (AIM), Intervention Appropriateness Measure (IAM), and Feasibility of Intervention Measure (FIM).

Results:

Ten patients and sixteen clinicians participated in early wireframe and prototype testing, and usability improvements were made accordingly. In the final user testing phase, twelve patients and five clinicians who managed nine of the patient encounters assessed the production version. Across earlier and later study phases, patients consistently reported high usability ratings (mean SUS (SD): 87.0 (9.9); 87.7 (12.8)), while clinicians’ usability ratings increased from a mean of 73.4 (16.2) to 79.7 (24.1) after iterative refinements. Both user groups rated the CAT-SSE as highly acceptable and appropriate. Clinicians also endorsed its feasibility for integration into busy ED workflows.

Conclusions:

The CAT-SSE is one of the first ED-based suicide risk screening tools to effectively combine adaptive tests and EHR-based machine learning algorithms. Iterative development with end-user input yielded a solution rated as usable, acceptable, and feasible by both patients and clinicians. The CAT-SSE shows promise as a scalable strategy to efficiently screen and measure suicide risk and broad psychopathology within ED clinical practice.


 Citation

Please cite as:

Boudreaux ED, Lee HS, Davis-Martin RE, Larkin C, Schroeder C, Gibbons RD

Building a Better Computerized Adaptive Test for Suicide Risk Screening and Measurement Through Iterative User Input: An Implementation Study

JMIR Preprints. 05/03/2026:94739

DOI: 10.2196/preprints.94739

URL: https://preprints.jmir.org/preprint/94739

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.