Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Formative Research

Date Submitted: Jul 3, 2020
Date Accepted: May 31, 2021

The final, peer-reviewed published version of this preprint can be found here:

Evaluating Simplified Web Interfaces of Risk Models for Clinical Use: Pilot Survey Study

Evaluating Simplified Web Interfaces of Risk Models for Clinical Use: Pilot Survey Study

JMIR Form Res 2021;5(7):e22110

DOI: 10.2196/22110

PMID: 34269692

PMCID: 8325085

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Evaluating simplified web interfaces of risk models for clinical use

ABSTRACT

Background:

Information overload negatively affects clinicians’ decision effectiveness and ultimately impacts patient safety. Clinicians who are tasked with assessing patient outcomes are often required to use complex outcome and risk models in a spreadsheet format. In response to this challenge, we developed a mobile web model which simplifies the information presented to clinicians and expedites the decision process. However, new electronic technologies often face barriers to adoption which inhibits their use in clinical settings.

Objective:

This pilot study investigated sociotechnical factors that affect intention to use a simplified WebModel to support clinical decision making. We investigated factors from the UTAUT2 model, which are known to affect technology adoption.

Methods:

A WebModel is developed based on the results from a previously published work, to allow users to work with regression equations and their predictions to evaluate the impact of various characteristics or treatments on key outcomes (e.g. survival time) for chronic obstructive pulmonary disease (COPD). To test the WebModel a questionnaire was designed to probe the efficacy of the WebModel and to assess the usability and usefulness of the system. The questionnaire was administered online, and data from 550 clinical users who had access to the WebModel was captured. SPSS and R were used for statistical analysis.

Results:

The regression model developed from UTAUT2 constructs was found to be a fit, with five variables found to significantly predicts behavioural intention to sue the WebModel: Performance Expectancy, Effort Expectancy, Facilitating Conditions, Hedonic Motivation and Habit. Social Influence was not a significant factor, while Value had a significant negative influence on intention to use the WebModel. Multiple influences were found to impact the positive response to the system, many of which related to the efficiency of the interface to provide clear information. Given that this was a pilot test, and that the system was not used in a clinical setting factors related to actual workflow, or patient safety could not be examined.

Conclusions:

This study proves that the concept of a simplified WebModel could be effective and efficient in reducing information overload in complex clinical decision making. Further study to test this in a clinical setting, and gather qualitative data from users regarding the value of the tool in practice is recommended.


 Citation

Please cite as:

Evaluating Simplified Web Interfaces of Risk Models for Clinical Use: Pilot Survey Study

JMIR Form Res 2021;5(7):e22110

DOI: 10.2196/22110

PMID: 34269692

PMCID: 8325085

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.