Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Currently submitted to: Journal of Medical Internet Research

Date Submitted: Nov 16, 2026
Open Peer Review Period: Nov 16, 2026 - Jan 11, 2027
(currently open for review)

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Understanding How Hospital-based Healthcare Professionals come to Trust, Accept and Rely upon Artificial Intelligence Risk Recommenders: A Rapid Realist Review

  • George Frederick Glass Jr; 
  • Chin-Siang Ang; 
  • Marianne E. Weiss; 
  • Xiuyi Fan; 
  • Jennifer Anne Cleland; 
  • Jo-Anne Manski-Nankervis

ABSTRACT

Background:

Artificial intelligence (AI) risk recommenders can help hospital-based healthcare professionals (HCPs) in decision-making, but only if the systems are accepted and their recommendations appropriately relied upon. While trust, acceptance and reliance of AI risk recommenders are widely studied to understand human interaction and usage of AI systems, less is known about how, why and under what conditions these unfold in the hospital setting.

Objective:

Our rapid realist review aimed to understand how, why and in what contexts hospital-based HCPs come to use AI risk recommenders.

Methods:

We developed a programme theory of Context-Mechanism-Outcome (CMO) configurations to explain how AI features (resources) interact with the individual, organisational and system-level conditions that shape how the HCP encounters and responds to the system (contexts), triggering reasoning processes (reasoning) that produce acceptance of the system and reliance on its outputs (outcome). We searched ten databases for articles published between 2015 and 2025. Findings were extracted and synthesised to identify and refine explanatory relationships, refining our programme theory to a final state.

Results:

96 articles were included. These informed 12 CMO configurations operating across two stages. Nine contexts at the micro (individual), meso (clinical and organisation) and macro (system) level shaped how HCPs judged the systems they encountered. Stage one explained acceptance - the intention to use an AI risk recommender. This depended on seven contexts such as pre-existing expectations and the accountability structure surrounding HCPs. Four resources trigger trust and subsequently acceptance – consistently accurate predictions, explainable transparent models, verifiable predictions and calibrated alerts. Two resources – actionable outputs and user-centred presentation - trigger a perception of clinical fit that influenced acceptance independently of trust. Stage two explained reliance on an individual recommendation, once the system is accepted. Its central mechanism is the HCPs’ appraisal of the AI recommendation against their own clinical judgement and experience. This appraisal depends on two micro contexts – whether the HCP is open to revise their initial assessment in light of new AI output, and their cognitive capacity when engaging with the system. When the HCP is open to revising their assessment and has the cognitive capacity to engage, their appraisal is critical, producing appropriate reliance. Without openness, the HCP only seeks affirmation from the system and discounts conflicting output, producing under-reliance. Without cognitive capacity, the HCP defers uncritically to the system, leading to over-reliance.

Conclusions:

Our two-stage framework suggests that the features driving initial acceptance of AI risk recommender systems do not guarantee appropriate reliance upon their outputs. Trust is a key mechanism towards acceptance but not the only route - systems must also be actionable and fit clinical processes. Our synthesis offers guidance for developers and clinical leaders to design AI tools and implementation strategies that foster trust, acceptance and appropriate reliance. Clinical Trial: PROSPERO CRD420251155251


 Citation

Please cite as:

Glass GF Jr, Ang CS, Weiss ME, Fan X, Cleland JA, Manski-Nankervis JA

Understanding How Hospital-based Healthcare Professionals come to Trust, Accept and Rely upon Artificial Intelligence Risk Recommenders: A Rapid Realist Review

JMIR Preprints. 16/11/2026:116745

DOI: 10.2196/preprints.116745

URL: https://preprints.jmir.org/preprint/116745

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.