Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Formative Research

Date Submitted: Apr 10, 2025
Open Peer Review Period: Apr 10, 2025 - Jun 5, 2025
Date Accepted: Oct 31, 2025
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

User-Centered Formative Evaluation of Cognitive Rehabilitation Software: Cognitive Walkthrough and System Usability Scale Study

Hong S, Choi H, Kweon H

User-Centered Formative Evaluation of Cognitive Rehabilitation Software: Cognitive Walkthrough and System Usability Scale Study

JMIR Form Res 2025;9:e75805

DOI: 10.2196/75805

PMID: 41252193

PMCID: 12673306

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

User-Centered Usability Evaluation of Cognitive Rehabilitation Software: A Cognitive Walkthrough and System Usability Scale(SUS) Study

  • Seojin Hong; 
  • Hyun Choi; 
  • Hyosun Kweon

ABSTRACT

Background:

The usability of medical device software (SW) significantly influences the clinical utility and effectiveness of treatment. Importantly, user experience (UX) with cognitive rehabilitation SW can directly affect treatment adherence and outcomes.

Objective:

To evaluate the usability of tablet-based cognitive rehabilitation SW and identify areas for improvement of the user-centered UX/user interface (UI).

Methods:

A formative evaluation utilizing cognitive walkthrough and the system usability scale (SUS) was conducted with occupational therapists, the primary users of the SW. User errors that may potentially occur during system navigation and interface issues were analyzed, whereas the usability level was quantitatively evaluated based on the SUS.

Results:

We identified the following key areas for improvement: adjustment of keypad size and position, addition of information before cognitive development evaluation, enhancement of the evaluation completion method, improvement of user manual accessibility, and refinement of the hint button and difficulty level adjustment interface. The mean SUS score was 73.5 points (B- grade), indicating an overall “Acceptable” usability level. Furthermore, the need for improvement was also identified in some UX/UI elements (e.g., utility, complexity, integration, unity, and satisfaction). To address these issues, this study proposed measures for enhancing UX/UI, including improving UI intuitiveness, optimizing the evaluation process, and improving user manual accessibility.

Conclusions:

The measures proposed for identifying the usability tasks of digital rehabilitation SW and improving the UX may contribute to optimizing the UX of medical device SW and increase the prospect of clinical adoption.


 Citation

Please cite as:

Hong S, Choi H, Kweon H

User-Centered Formative Evaluation of Cognitive Rehabilitation Software: Cognitive Walkthrough and System Usability Scale Study

JMIR Form Res 2025;9:e75805

DOI: 10.2196/75805

PMID: 41252193

PMCID: 12673306

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.