Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR AI

Date Submitted: Dec 13, 2022
Open Peer Review Period: Dec 13, 2022 - Feb 7, 2023
Date Accepted: Apr 22, 2023
(closed for review but you can still tweet)

The final, peer-reviewed published version of this preprint can be found here:

An Assessment of How Clinicians and Staff Members Use a Diabetes Artificial Intelligence Prediction Tool: Mixed Methods Study

Liaw WR, Ramos Silva Y, Soltero EG, Krist A, Stotts AL

An Assessment of How Clinicians and Staff Members Use a Diabetes Artificial Intelligence Prediction Tool: Mixed Methods Study

JMIR AI 2023;2:e45032

DOI: 10.2196/45032

PMID: 38875578

PMCID: 11041401

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

Assessing how clinicians and staff would use a diabetes artificial intelligence prediction tool

  • Winston R. Liaw; 
  • Yessenia Ramos Silva; 
  • Erica G Soltero; 
  • Alex Krist; 
  • Angela L. Stotts

ABSTRACT

Background:

Nearly one third of those with diabetes are poorly controlled (hemoglobin A1c of ≥9.0%). Identifying at-risk individuals and providing them with effective treatment is an important strategy for preventing poor control.

Objective:

The objective is to assess how clinicians and staff would use a clinical decision support tool based on artificial intelligence (AI) and identify factors that affect adoption.

Methods:

This is a mixed-methods study that combines semi-structured interviews and surveys to assess the perceived usefulness and ease of use, intent to use, and factors affecting tool adoption. We recruited clinicians and staff from practices that manage diabetes. During interviews, participants reviewed a sample electronic health record alert and were informed that the tool uses AI to identify those at high risk for poor control. Participants discussed how they would use the tool, whether it would contribute to care, and the factors affecting its implementation. In a survey, participants reported their demographics, rank ordered factors influencing adoption of the tool, and their perception of the tool’s usefulness as well as their intent to use, ease of use, and organizational support for use. Qualitative data were analyzed using a thematic content analysis approach. We used descriptive statistics to report demographics and analyze the findings of the survey.

Results:

Twenty-two individuals participated in the study. Two-thirds of respondents were physicians. Thirty-six percent worked in academic health centers while 27% worked in Federally Qualified Health Centers. The interviews identified several themes: (1) This tool has the potential to be useful because it provides information that is not currently available and can make care more efficient and effective; (2) Clinicians and staff were concerned about how the tool affects patient-oriented outcomes and clinic workflows; (3) Adoption of the tool is dependent on its validation, transparency, actionability, and design and could be increased with changes to the interface and usability; and (4) Implementation would require buy in and need to be tailored to the demands and resources of clinics and communities. Survey findings supported these themes as seventeen (77.3%) participants somewhat, moderately, or strongly agreed that they would use the tool while these figures were 18 (81.8%) for usefulness, 18 (81.8%) for ease-of-use, and 15 (68.2%) for clinic support, respectively. The two highest-ranked factors affecting adoption were whether the tool improves health and the accuracy of the tool. Conclusion: A majority found the tool to be easy to use and useful though they had concerns about alert fatigue, bias, and transparency. These data will be used to enhance the design of an AI tool.


 Citation

Please cite as:

Liaw WR, Ramos Silva Y, Soltero EG, Krist A, Stotts AL

An Assessment of How Clinicians and Staff Members Use a Diabetes Artificial Intelligence Prediction Tool: Mixed Methods Study

JMIR AI 2023;2:e45032

DOI: 10.2196/45032

PMID: 38875578

PMCID: 11041401

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.