Accepted for/Published in: JMIR Medical Education
Date Submitted: Nov 16, 2022
Open Peer Review Period: Nov 16, 2022 - Jan 11, 2023
Date Accepted: Apr 30, 2023
(closed for review but you can still tweet)
Student and Faculty Perspectives about Usefulness and Usability of a Digital Health Educational Tool to Teach Standardized Assessment of Persons Post-Stroke: Mixed Methods
ABSTRACT
Background &
Objective:
The VSTEP Examination Suite, a collection of evidence-based standardized assessments for persons post-stroke, was evaluated as an educational tool by physical therapy students and faculty.
Methods:
Six students from a Doctor of Physical Therapy program in the US and six faculty who teach standardized assessments in different physical therapy programs from the US and Israel interacted with the system using a talk-aloud procedure. Transcripts were coded deductively with a priori categories of usability, usefulness and labeled with negative or positive valences. A second round of inductive coding yielded emergent themes based on theories of technology adoption, clinical reasoning and education.
Results:
Frequencies and valences of the deductive themes of usefulness and usability were tested for differences between faculty and students using a Wilcoxon Sign Rank test. Faculty comments with positive valence for usefulness were lowest for the 6MWT (83%) and for the students on the 4SQT (92%). Usefulness scores were not significantly different between faculty and students. For usability, faculty and students had the lowest positive valence scores for the 10MWT (50%). Students had a statistically significant higher number of negative usability comments compared to faculty (W=0, p =0.017) specifically for the 5XSTS (W=0.5, p = 0.022). Themes emerged related to variable knowledge about the standardized tests, value as a teaching and learning tool, technology being consistent with clinical reasoning in addition to ensuring reliability, expert-to-novice clinical reasoning (students) and usability.
Conclusions:
The VSTEP was found to be useful by both faculty and students, and usability testing revealed opportunities for technology refinement.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.