Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Feb 28, 2022
Open Peer Review Period: Feb 26, 2022 - Apr 23, 2022
Date Accepted: Apr 21, 2022
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

Usability Issues in Evidence-Based Psychosocial Interventions and Implementation Strategies: Cross-project Analysis

Munson S, Friedman EC, Osterhage K, Allred R, Pullmann MD, Areán PA, Lyon AR, UW ALACRITY Center Researchers

Usability Issues in Evidence-Based Psychosocial Interventions and Implementation Strategies: Cross-project Analysis

J Med Internet Res 2022;24(6):e37585

DOI: 10.2196/37585

PMID: 35700016

PMCID: 9240934

Usability Issues in Evidence-Based Psychosocial Interventions and Implementation Strategies: A Cross-Project Analysis

  • Sean Munson; 
  • Emily C Friedman; 
  • Katie Osterhage; 
  • Ryan Allred; 
  • Michael D Pullmann; 
  • Patricia A Areán; 
  • Aaron R Lyon; 
  • UW ALACRITY Center Researchers

ABSTRACT

Background:

People often prefer evidence-based psychosocial interventions (EBPIs) for mental health care, but these interventions often remain unavailable to people in non specialty or integrated settings, such as primary care and schools. Previous research has suggested that usability–a concept from human centered design–could support an understanding of the barriers and facilitators to successful adoption of EBPIs and support the redesign of EBPIs and implementation strategies.

Objective:

We sought to identify and categorize usability issues in EBPIs and implementation strategies.

Methods:

We adapted as usability issue analysis and reporting format from human centered design. Thirteen projects supported by the NIMH-funded ALACRITY Center at the University of Washington used this format to describe usability issues the EBPIs and implementation strategies with which they were working. Center researchers used an iterative affinity diagramming and coding process to identify usability issue categories. Based on these categories and underlying issues, we propose heuristics for the design or redesign of EBPIs and implementation strategies.

Results:

The thirteen projects reported a total of 90 usability issues, which we categorized into twelve categories, including: complex and/or cognitively overwhelming; time required exceeds time available; incompatibility with interventionist preference or practice; incompatibility with existing workflow; insufficient customization to clients/recipients; intervention buy-in (value); interventionist buy-in (trust); overreliance on technology; requires unavailable infrastructure inadequate scaffolding for client/recipient; inadequate training and scaffolding for interventionist; and lack of support for necessary communication. These issues range from minor inconveniences that affect a few interventionists or recipients to severe issues that prevent all interventionists or recipients in a setting from completing part or all of the intervention. We propose twelve corresponding heuristics to guide EBPI and implementation strategy designers in preventing and addressing these usability issues.

Conclusions:

Usability issues are prevalent in the studied EBPIs and implementation strategies. We recommend using the lens of usability evaluation to understand and address barriers to effective use and reach of EBPIs and implementation strategies.


 Citation

Please cite as:

Munson S, Friedman EC, Osterhage K, Allred R, Pullmann MD, Areán PA, Lyon AR, UW ALACRITY Center Researchers

Usability Issues in Evidence-Based Psychosocial Interventions and Implementation Strategies: Cross-project Analysis

J Med Internet Res 2022;24(6):e37585

DOI: 10.2196/37585

PMID: 35700016

PMCID: 9240934

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.