Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Formative Research

Date Submitted: Aug 10, 2022
Date Accepted: Feb 13, 2023

The final, peer-reviewed published version of this preprint can be found here:

Usability Testing of a Web-Based Empathy Training Portal: Mixed Methods Study

Lobchuk M, Hoplock L, Harder N, Friesen M, Sakamoto Y, Rempel J, Reddy PB, Adeyemo A, Livingston A

Usability Testing of a Web-Based Empathy Training Portal: Mixed Methods Study

JMIR Form Res 2023;7:e41222

DOI: 10.2196/41222

PMID: 37014693

PMCID: 10131903

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Usability testing of a Web-Based Empathy Training Portal: A Mixed Methods Study

  • Michelle Lobchuk; 
  • Lisa Hoplock; 
  • Nicole Harder; 
  • Marcia Friesen; 
  • Yumiko Sakamoto; 
  • Julie Rempel; 
  • Prachotan Bathi Reddy; 
  • Adedotun Adeyemo; 
  • Aislinn Livingston

ABSTRACT

Background:

Pre-pandemic saw the rise of online teaching. Yet, online tools for teaching the essential nursing skill of empathy remain limited. Not only are more of these tools needed, but they need to be tested for ease of use and understanding by students.

Objective:

To evaluate student usability of the In Your Shoes web-based empathy training portal application with quantitative and qualitative methods.

Methods:

A mixed methods design was employed in this 3-phase formative usability study. We conducted remote observation of student participants interacting with the training portal application and captured their qualitative reflections followed by data analysis and iterative design refinements to the application. Eight third- and fourth-year nursing students were from an undergraduate baccalaureate program at one mid-Canada university. Student participants in Phases 1 and 2 were remotely observed by research personnel while engaged in pre-defined tasks. In Phase 3, student participants were asked to use the application as they liked in their own environments; this was followed by a video-recorded exit interview with a think aloud process as student participants responded to the System Usability Scale.

Results:

We found ‘above average’ perceived usability with the application. Student participants had a range of technology skills and tended to give one-off comments on application appearance, content, navigation, and functionality. Main challenges included navigation during video-analysis and the length of educational materials. Application refinements were made (e.g., pop-up messages, narrated video) based on feedback.

Conclusions:

With the rising engagement in online teaching, technology is an essential medium for learning in health care education. We developed a novel tool as a supplemental classroom tool to foster students’ self-directed learning about empathy. This study provided direction for ongoing refinements to enhance the usability and user satisfaction with the application. Our next step is to obtain feedback from users who will experience more authentic experiences doing ‘live’ video-capture, -annotation, and -analysis as these could not be fully evaluated due to COVID protocol. Clinical Trial: not applicable.


 Citation

Please cite as:

Lobchuk M, Hoplock L, Harder N, Friesen M, Sakamoto Y, Rempel J, Reddy PB, Adeyemo A, Livingston A

Usability Testing of a Web-Based Empathy Training Portal: Mixed Methods Study

JMIR Form Res 2023;7:e41222

DOI: 10.2196/41222

PMID: 37014693

PMCID: 10131903

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.