Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Human Factors

Date Submitted: Feb 11, 2021
Date Accepted: Oct 8, 2021

The final, peer-reviewed published version of this preprint can be found here:

Enriching the Value of Patient Experience Feedback: Web-Based Dashboard Development Using Co-design and Heuristic Evaluation

Khanbhai M, Symons J, Flott K, Harrison-White S, Spofforth J, Klaber R, Manton D, Darzi A, Mayer E

Enriching the Value of Patient Experience Feedback: Web-Based Dashboard Development Using Co-design and Heuristic Evaluation

JMIR Hum Factors 2022;9(1):e27887

DOI: 10.2196/27887

PMID: 35113022

PMCID: 8855286

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Enriching the value of patient experience feedback: interactive dashboard development using co-design and heuristic evaluation

  • Mustafa Khanbhai; 
  • Joshua Symons; 
  • Kelsey Flott; 
  • Stephanie Harrison-White; 
  • Jamie Spofforth; 
  • Robert Klaber; 
  • Dave Manton; 
  • Ara Darzi; 
  • Erik Mayer

ABSTRACT

Background:

There is an abundance of patient experience data held within healthcare organisations but stakeholders and staff are often unable to use the output in a meaningful and timely way to improve care delivery. Dashboards, which use visualised data to summarise key patient experience feedback, have the potential to address these issues.

Objective:

The aim of this study was to develop a patient experience dashboard with an emphasis on FFT reporting as per the national policy drive. An iterative process involving co-design involving key stakeholders was used to develop the dashboard, followed by heuristic usability testing.

Methods:

A two staged approach was employed; participatory co-design involving 20 co-designers to develop a dashboard prototype followed by iterative dashboard testing. Language analysis was performed on free-text patient experience data from the Friends and Family Test (FFT) and the themes and sentiment generated was used to populate the dashboard with associated FFT metrics. Heuristic evaluation and usability testing were conducted to refine the dashboard and assess user satisfaction using the system usability score (SUS).

Results:

Qualitative analysis from the co-design process informed development of the dashboard prototype with key dashboard requirements and a significant preference for bubble chart display. Heuristic evaluation revelated the majority of cumulative scores had no usability problem (n=18), cosmetic problem only (n=7), or minor usability problem (n= 5). Mean SUS was 89.7 (SD 7.9) suggesting an excellent rating.

Conclusions:

The growing capacity to collect and process patient experience data suggests that data visualisation will be increasingly important in turning the feedback into improvements to care. Through heuristic usability we demonstrated that very large FFT data can be presented into a thematically driven, simple visual display without loss of the nuances and still allow for exploration of the original free-text comments. This study establishes guidance for optimising the design of patient experience dashboards that healthcare providers find meaningful which in-turn drives patient-centred care.


 Citation

Please cite as:

Khanbhai M, Symons J, Flott K, Harrison-White S, Spofforth J, Klaber R, Manton D, Darzi A, Mayer E

Enriching the Value of Patient Experience Feedback: Web-Based Dashboard Development Using Co-design and Heuristic Evaluation

JMIR Hum Factors 2022;9(1):e27887

DOI: 10.2196/27887

PMID: 35113022

PMCID: 8855286

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.