Accepted for/Published in: JMIR mHealth and uHealth
Date Submitted: May 29, 2023
Date Accepted: Jul 30, 2024
An umbrella review of usability assessment methods for mobile apps for physical rehabilitation
ABSTRACT
Background:
Usability has been touted as one determiner of success of mobile Health (mHealth) interventions. While multiple systematic reviews of usability assessment approaches for different mHealth solutions for physical rehabilitation are available, there is a lack of synthesis of this portion of the literature.
Objective:
To summarise systematic reviews examining usability assessment tools in mHealth interventions including physical rehabilitation.
Methods:
An umbrella review was conducted according to a published registered protocol (CRD42022338785). A topic-based search was conducted of Pubmed, Cochrane, IEEEXplore, Epistemonikos and Web of Science from January 2015 to April 2023 for systematic reviews investigating usability assessment tools in mHealth interventions including physical exercise rehabilitation. Eligibility screening, data extraction and assessment of the methodological quality (AMSTAR2) was completed and data tabulated for synthesis.
Results:
A total of 12 systematic reviews were included of which three (25%) did not refer to any theoretical usability framework. The sample referenced a total of 32 usability assessment tools and 66 custom-made, as well as hybrid, measures. Information on psychometric properties was included for nine instruments (28%) with satisfactory internal consistency and structural validity. A lack of reliability, responsiveness and cross-cultural validity data was found. The methodological quality of the systematic reviews was limited with eight studies (67%) displaying two or more critical weaknesses.
Conclusions:
There is significant diversity in the usability assessment of mHealth for rehabilitation and a link to theoretical models is often lacking. There is widespread use of custom-made measures and pre-existing measures often do not display sufficient psychometric strength. As a result, existing mHealth usability evaluations are difficult to compare. It is proposed that multi-method usability assessment is employed and that, in the selection of usability measures, there is a focus on explicit reference to their theoretical underpinning and acceptable psychometric properties. Clinical Trial: PROSPERO CRD42022338785; https://www.crd.york.ac.uk/prospero/#recordDetails
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.