Accepted for/Published in: JMIR Formative Research
Date Submitted: Dec 11, 2023
Open Peer Review Period: Dec 15, 2023 - Feb 9, 2024
Date Accepted: Oct 30, 2024
(closed for review but you can still tweet)
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
Snowball Group Usability Testing: a novel method for pragmatic multi-site testing
ABSTRACT
Background:
Usability testing is valuable for assessing a new tool or system’s usefulness and ease-of-use. However, during clinical decision support (CDS) tool development, usability testing is often not done due to its time- and labor-intensiveness, cost, and the skills required to conduct the testing.
Objective:
Our objective was to develop a new method of usability testing that would enable efficient acquisition and dissemination of results among multiple institutions.
Methods:
We combined individual think aloud testing and focus groups into one session, and performed sessions serially across four institutions (Snowball Group Usability Testing) to assess the usability of two clinical decision support tools for use by nurses in the primary and urgent care settings.
Results:
The group testing and snowballing components of our new usability testing method proved to be highly beneficial. Study teams were more easily able to notice similarities in feedback among participants, and thus, to discuss and act upon suggestions efficiently, as feedback from multiple participants was obtained in a single session. Snowballing allowed study teams to incorporate feedback based on previous institutions’ sessions prior to conducting their own testing.
Conclusions:
Snowball Group Usability Testing provides an efficient method of obtaining feedback on newly developed tools and systems, while addressing barriers typically associated with traditional usability testing methods. This method can be applied to test a wide variety of tools, including CDS tools, prior to launch so that they can be efficiently optimized, ultimately leading to higher adoption. Clinical Trial: NCT04255303
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.