Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Currently submitted to: JMIR Medical Informatics

Date Submitted: Jul 30, 2024
Open Peer Review Period: Aug 6, 2024 - Oct 1, 2024
(closed for review but you can still tweet)

NOTE: This is an unreviewed Preprint

Warning: This is a unreviewed preprint (What is a preprint?). Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn (a note "no longer under consideration" will appear above).

Peer-review me: Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period (in this case, a "Peer-Review Me" button to sign up as reviewer is displayed above). All preprints currently open for review are listed here. Outside of the formal open peer-review period we encourage you to tweet about the preprint.

Citation: Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author).

Final version: If our system detects a final peer-reviewed "version of record" (VoR) published in any journal, a link to that VoR will appear below. Readers are then encourage to cite the VoR instead of this preprint.

Settings: If you are the author, you can login and change the preprint display settings, but the preprint URL/DOI is supposed to be stable and citable, so it should not be removed once posted.

Submit: To post your own preprint, simply submit to any JMIR journal, and choose the appropriate settings to expose your submitted version as preprint.

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Effect of uncertainty-aware artificial intelligence models on human reaction time and decision-making: A randomized controlled trial

  • Corey Lester; 
  • Brigid Rowell; 
  • Yifan Zheng; 
  • Zoe Co; 
  • Vincent Marshall; 
  • Jin Yong Kim; 
  • Qiyuan Chen; 
  • Raed Kontar; 
  • X. Jessie Yang

ABSTRACT

Background:

Artificial intelligence (AI)-based clinical decision support systems are increasingly used in healthcare. Uncertainty-aware AI presents the model’s confidence in its decision alongside its prediction whereas black-box AI only provides a prediction. Little is known about how this type of AI affects healthcare providers’ work performance and reaction time.

Objective:

To determine the effects of black-box and uncertainty-aware AI advice on pharmacist decision-making and reaction time.

Methods:

Thirty licensed pharmacists participated in a crossover, randomized controlled trial. Eligible participants were randomized to either the black-box AI or uncertainty-aware AI condition in a 1:1 manner. Participants completed 100 mock verification tasks with AI help and 100 without AI help. The order of no help and AI help was randomized. Participants were exposed to correct and incorrect prescription fills, where the correct decision was to ‘accept’ or ‘reject’, respectively. AI help provided correct (79%) or incorrect (21%) advice. Reaction times, participant decision, AI advice, and AI help type were recorded for each verification. Likelihood ratio tests (LRT) compared means across the three categories of AI type for each level of AI correctness.

Results:

Participants’ decision-making performance and reaction times differed across the three conditions. Accurate AI recommendations resulted in the rejection of the incorrect drug 96.1% and 91.8% of the time for uncertainty-aware AI and black-box AI respectively, compared to 81.2% without AI help. Correctly dispensed medications were accepted at rates of 99.2% with black-box help, 94.1% with uncertainty-aware AI help, and 94.6% without AI help. Uncertainty-aware AI protected against bad AI advice to approve an incorrectly filled medication compared to black-box AI (83.3% vs 76.7%). When the AI recommended rejecting a correctly filled medication, pharmacists without AI help had a higher rate of correctly accepting the medication (94.6%) compared to uncertainty-aware AI help (86.2%) and black-box AI help (81.2%). Uncertainty-aware AI resulted in shorter reaction times than black-box AI and no AI help except in the scenario where "AI rejects the correct drug". Black-box AI did not lead to reduced reaction times compared to pharmacists acting alone.

Conclusions:

Pharmacists’ performance and reaction times varied by AI type and AI accuracy. Overall, uncertainty-aware AI resulted in faster decision-making and acted as a safeguard against bad AI advice to approve a misfilled medication. Conversely, black-box AI had the longest reaction times, and user performance degraded in the presence of bad AI advice. However, uncertainty-aware AI could result in unnecessary double-checks, but it is preferred over false negative advice, where patients receive the wrong medication. These results highlight the importance of well-designed AI that addresses users’ needs, enhances performance, and avoids overreliance on AI.


 Citation

Please cite as:

Lester C, Rowell B, Zheng Y, Co Z, Marshall V, Kim JY, Chen Q, Kontar R, Yang XJ

Effect of uncertainty-aware artificial intelligence models on human reaction time and decision-making: A randomized controlled trial

JMIR Preprints. 30/07/2024:64902

DOI: 10.2196/preprints.64902

URL: https://preprints.jmir.org/preprint/64902

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.