Accepted for/Published in: JMIR mHealth and uHealth
Date Submitted: Oct 10, 2019
Date Accepted: Mar 11, 2020
Evaluating Online Consumer Medication Information Systems: A Comparative Online Usability Study
ABSTRACT
Background:
Medication is the most common intervention in Health Care and the number of Online Consumer Information Systems (OCMIS) within the pharmaceutical sector are increasing. OCMIS can also prove as a barrier for their users imposing information asymmetry between stakeholders.
Objective:
Quantify and compare the usability of OCMIS against a reference implementation based on an interoperable information model for patients, physicians and pharmacists.
Methods:
Quantitative and qualitative data were acquired from patients, physicians and pharmacists in this online usability study. We administered three use cases to resolve and a post hoc questionnaire per user. Quantitative usability data like effectiveness (task success), efficiency (task time) and user satisfaction (System Usability Scale) was complemented by qualitative- and demographic data. Users evaluated six existing and one reference implementation of web-based OCMIS.
Results:
A total of 137 patients, 81 physicians and 68 pharmacists participated. Task success varied from 84-92% in patients, 66-100% in physicians and 50-91% in pharmacists. Task completion time decreased during the process of the study for all but two OCMIS within the patient group. Due to assumed non-normal distributed SUS-scores, within group comparison was done using the Kruskal-Wallis Test. Patients showed differences in SUS-score (p= .016) and task time (p= .025), and not significant differences for physicians in SUS-score (p= .831) and task time (p= .723). A significant difference in SUS score (p< .001) and task time (p= .007) for pharmacists was detected.
Conclusions:
The vendor neutral reference implementation based on an interoperable information model has proven as a promising approach, not inferior to existing solutions for patients and physicians. For pharmacists it even excels in user satisfaction compared to other OCMIS. This data driven approach based on an interoperable information model, enables the development of more, user tailored views, in order to increase usability. This fosters data democratization and empowers stakeholders within the pharmaceutical sector.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.