Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
Current Practices for Assessing the Usability of Novel Diagnostics in Infectious Diseases: A Multi-stakeholder Qualitative Study
ABSTRACT
Background:
Decentralized diagnostic tests are expanding access to infectious disease testing in low-resource settings. Usability evaluations help ensure these tools are used safely, accurately, and efficiently, but approaches vary widely. Our previous scoping review found substantial variation in evaluation designs, endpoint selection, and result reporting, yet little is known about the factors driving this variation or how it influences the quality, comparability, and regulatory utility of usability evidence.
Objective:
This study aimed to explore how developers, regulators, and researchers conceptualize and conduct usability and human factors evaluations of decentralized diagnostic tests for infectious diseases intended for low-resource settings, and to identify gaps in existing usability guidance and standards.
Methods:
We conducted semi-structured interviews with 23 stakeholders across three groups: 14 developers, 5 regulators, and 4 researchers, purposively sampled across regions and experience levels. Topic guides were tailored to each stakeholder group and informed by established usability and human factors frameworks. Interviews were conducted in English, audio-recorded, and transcribed verbatim; recruitment continued until thematic saturation was reached. Data were analyzed thematically using an inductive and deductive approach.
Results:
Participants were based in 11 countries across high- and low-resource settings; nearly half (11/23, 48%) were based in the United States or China. Across stakeholder groups, usability was framed primarily around safety and error prevention, closely tied to regulatory expectations. User-centered attributes such as learnability, efficiency, satisfaction, and memorability were acknowledged but rarely defined or systematically assessed. Differences in study design, sample size, and endpoint selection were attributed to a lack of shared definitions, inconsistent regulatory guidance, and limited practical instructions for conducting usability evaluations, particularly in low-resource settings. Environmental conditions, infrastructure, and user diversity further shaped evaluations and often required adaptations to standard approaches. Overall, participants highlighted a need to balance consistency in usability evaluation with flexibility to accommodate different contexts and regulatory requirements.
Conclusions:
The heterogeneity observed in usability evaluations reflects differences in how usability is defined, operationalized, and assessed across regulatory and contextual settings. Our findings support the development of consensus-based guidance that defines core usability constructs and reporting standards, while allowing flexibility in study design, sample size, and endpoint selection according to the purpose of the evaluation and context. Such guidance could strengthen the rigor, comparability, and practical relevance of usability evidence for regulatory decision-making and implementation, particularly in low-resource settings.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.