Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Human Factors

Date Submitted: Nov 3, 2023
Date Accepted: Mar 6, 2024

The final, peer-reviewed published version of this preprint can be found here:

Capturing Usability Problems for People Living With Dementia by Applying the DEMIGNED Principles in Usability Evaluation Methods: Mixed Methods Study

Engelsma T, Heijmink S, Hendriksen HMA, Visser LNC, Lemstra AW, Jaspers MWM, Peute LWP

Capturing Usability Problems for People Living With Dementia by Applying the DEMIGNED Principles in Usability Evaluation Methods: Mixed Methods Study

JMIR Hum Factors 2024;11:e54032

DOI: 10.2196/54032

PMID: 39083790

PMCID: 11325128

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Capturing usability problems for people living with dementia applying the DEMIGNED principles in usability testing methods

  • Thomas Engelsma; 
  • Simone Heijmink; 
  • Heleen M. A. Hendriksen; 
  • Leonie N. C. Visser; 
  • Afina W. Lemstra; 
  • Monique W. M. Jaspers; 
  • Linda W. P. Peute

ABSTRACT

Background:

: Dementia-related impairments can cause complex barriers to access, use, and adopt digital health technologies. These barriers can contribute to digital health inequities. Therefore, literature-based design principles called DEMIGNED have been developed to support the design and evaluation of digital health technologies for this rapidly increasing population.

Objective:

This study aims to (1) apply these principles in usability testing to capture usability problems on a mobile website providing information resources for people visiting a memory clinic, including those living with dementia and (2) further validate the relevance of DEMIGNED principles and the applicability specifically for mobile websites as a means of providing digital health technology.

Methods:

A heuristic evaluation approach was conducted with the DEMIGNED principles serving as domain-specific guidelines with two usability experts, one domain expert and two double experts (experienced both in usability and dementia). Second, think-aloud sessions were conducted with memory clinic patients living with subjective cognitive decline, mild cognitive impairment, or dementia.

Results:

The heuristic evaluation resulted in 36 unique usability problems. Seven people visiting a memory clinic participated in a think aloud session: four with subjective cognitive decline, one with mild cognitive impairment and two with dementia. The analysis of the think-aloud sessions revealed 181 usability problem encounters. One hundred forty-four of these could be mapped on 18 usability problems identified in the heuristic evaluation. The remaining 37 encounters from the user-testing revealed another ten unique usability problems. Usability problems frequently encountered in the think aloud sessions encompassed difficulties with utilizing the search function, discrepancies between the user’s expectations and the content organization, the need for scrolling, information overload and unclear system feedback.

Conclusions:

By applying the DEMIGNED principles in expert-testing, evaluators were able to capture ~80% of usability problems encountered in user testing of a mobile website for people visiting a memory clinic, including people living with dementia. Future research should look into the applicability of the DEMIGNED principles for other digital health functionalities, to increase accessibility of digital health and decrease digital health inequity for this complex and rapidly increasing population.


 Citation

Please cite as:

Engelsma T, Heijmink S, Hendriksen HMA, Visser LNC, Lemstra AW, Jaspers MWM, Peute LWP

Capturing Usability Problems for People Living With Dementia by Applying the DEMIGNED Principles in Usability Evaluation Methods: Mixed Methods Study

JMIR Hum Factors 2024;11:e54032

DOI: 10.2196/54032

PMID: 39083790

PMCID: 11325128

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.