Accepted for/Published in: Journal of Medical Internet Research
Date Submitted: Aug 4, 2019
Date Accepted: May 14, 2020
Evaluating the Impact of GRASP Framework on Clinicians and Healthcare Professionals’ Decisions in Selecting Clinical Predictive Tools: A Randomized Controlled Trial
ABSTRACT
Background:
Introduction: When selecting predictive tools, for implementation in clinical practice or for recommendation in clinical guidelines, clinicians and healthcare professionals are challenged with an overwhelming number of tools. Many of these tools have never been implemented or evaluated for comparative effectiveness.
Objective:
To overcome this challenge, the authors developed and validated an evidence-based framework for grading and assessment of predictive tools (The GRASP Framework), based on the critical appraisal of the published evidence on such tools.
Methods:
Methods:
To examine the impact of using GRASP on clinicians and healthcare professionals’ decisions in selecting clinical predictive tools, a controlled experiment was conducted through an online survey. Through randomising two different groups of predictive tools and two scenarios; participants were asked to select the best tools; the most validated or implemented, with and without using the GRASP framework. A wide group of international clinicians and healthcare professionals were invited to take the survey. Task completion time, rate of correct decisions, rate of objective versus subjective decisions, and level of decisional conflict were measured.
Results:
Results:
Valid responses received were 194. Compared to not using GRASP, using the framework significantly increased correct decisions by 64%, from 53.7% to 88.1% (88.1/53.7=1.64) (T=8.53, P<.001, CI 0.231, 0.449), increased objective decision making by 32%, from 3.11/5 to 4.10/5 (T=9.24, P<.001, CI 0.709, 1.302), and decreased subjective decision making; based on guessing and based on prior knowledge or experience, by 20%, from 2.48/5 to 1.98/5 (T=-5.47, P<.001, CI -0.777, -0.260) and 8%, from 3.55/5 to 3.27/5 (T=-2.99, P=.003, CI -0.613, -0.028) respectively. Using GRASP significantly decreased decisional conflict; increasing confidence and satisfaction of participants with their decisions by 11%, from 3.55/5 to 3.96/5 (T=4.27, P<.001, CI 0.141, 0.642) and 13%, from 3.54/5 to 3.99/5 (T=4.89, P<.001, CI 0.194, 0.684) respectively. Using GRASP decreased task completion time, on the 90th percentile, by 52%, from 12.4 to 6.4 minutes (T=-0.87, P=0.384, CI -1847, 952). The average system usability scale of GRASP framework was very good; 72.5%, and 108 out of 122 of participants (88%) found GRASP useful.
Conclusions:
Conclusions:
Using GRASP has positively supported and significantly improved evidence-based decision making and increased accuracy and efficiency of selecting predictive tools. GRASP is not meant to be prescriptive; it represents a high-level approach and an effective, evidence-based, and comprehensive, yet simple and feasible, method to evaluate, compare, and select clinical predictive tools. Clinical Trial: Not Applicable.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.