Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR mHealth and uHealth

Date Submitted: Aug 25, 2023
Date Accepted: Feb 1, 2024

The final, peer-reviewed published version of this preprint can be found here:

Attributes, Methods, and Frameworks Used to Evaluate Wearables and Their Companion mHealth Apps: Scoping Review

Moorthy P, Weinert L, Schüttler C, Svensson L, Sedlmayr B, Müller J, Nagel T

Attributes, Methods, and Frameworks Used to Evaluate Wearables and Their Companion mHealth Apps: Scoping Review

JMIR Mhealth Uhealth 2024;12:e52179

DOI: 10.2196/52179

PMID: 38578671

PMCID: 11031706

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Usability Evaluation of Wearables and Companion mHealth Applications – Attributes, Methods, and Frameworks: A Scoping Review

  • Preetha Moorthy; 
  • Lina Weinert; 
  • Christina Schüttler; 
  • Laura Svensson; 
  • Brita Sedlmayr; 
  • Julia Müller; 
  • Till Nagel

ABSTRACT

Background:

Wearable technologies have crossed boundaries and have been accepted into clinical use to better assess the physical fitness and quality of life of patients and in the use of preventive healthcare. Usability is pivotal in overcoming constraints and gaining users' acceptance of technology such as wearables and companion mobile health applications. However, due to poor design and evaluation, interactive wearables and healthcare applications have often been restricted from delivering their full potential.

Objective:

The goal of this scoping review is to identify the type of wearables and their frequency of use in studies, along with mobile health applications, and their combinations and the attributes and evaluation methods of usability within the healthcare domain.

Methods:

An extensive search was conducted across four electronic databases, spanning the last 30 years up to December 2021. Studies including the keywords wearables, mobile health applications, medical use cases, physiological data and usability frameworks, attributes, and evaluation methods were considered for inclusion. 5 reviewers screened the collected publications and charted the features based on the research questions. These characteristics were further mapped into categories grounded on existing usability and wearable taxonomies. This scoping review followed the Arksey and O’Malley framework and the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Extension for Scoping Reviews checklist.

Results:

382 reports resulted from the search strategy, and 68 articles were included. The majority of the studies (57/68, 84%) involved the simultaneous use of wearables and mobile applications. Wrist-worn commercially available devices like wristbands and smartwatches were the most prevalent, accounting for 66% (45/68) of the wearables identified in our review. Nearly half of the data from the medical domain (32/68, 47%) focused on studies involving participants with chronic illnesses or disorders. 29 usability attributes were identified, and five attributes were frequently employed for evaluation: satisfaction (34/68, 50%), ease of use (27/68, 40%), user experience (16/68, 24%), perceived usefulness (18/68, 26%), and effectiveness (15/68, 22%). Only seven (10%) studies employed a user- or human-centered design paradigm for usability evaluation.

Conclusions:

Our scoping review identified the type of wearables and their frequency of use in studies, along with the use cases for which the wearables were used in the medical context. Additionally, we examined the evaluation of these wearables in the form of usability methods, attributes, and frameworks. Within the array of available wearables and mobile health applications, healthcare providers and manufacturers encounter the challenge of selecting devices and companion apps that are effective, user-friendly, and compatible with user interactions. The current gap in usability and user experience research limits our understanding of the strengths and limitations of wearable technologies. Furthermore, additional research is necessary to overcome these limitations and improve researchers' understanding of this field.


 Citation

Please cite as:

Moorthy P, Weinert L, Schüttler C, Svensson L, Sedlmayr B, Müller J, Nagel T

Attributes, Methods, and Frameworks Used to Evaluate Wearables and Their Companion mHealth Apps: Scoping Review

JMIR Mhealth Uhealth 2024;12:e52179

DOI: 10.2196/52179

PMID: 38578671

PMCID: 11031706

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.