JMIR Publications

ABSTRACT

Background:

Artificial Intelligence (AI) is increasingly being integrated into healthcare to streamline documentation and improve clinician efficiency. AI powered documentation tools, such as CarePilot, may reduce administrative burdens and help mitigate burnout. However, their usability and perceived value among medical trainees remains underexplored.

Objective:

To evaluate medical students’ perceptions of usability, efficiency, and satisfaction when using an AI powered documentation system in a simulated clinical setting.

Methods:

This cross sectional study was conducted at the Burnett School of Medicine at Texas Christian University. Forty four third and fourth year medical students participated in a standardized patient encounter for headache. Using CarePilot, participants documented patient history, physical examination findings, clinical reasoning, and management decisions. Afterward, they completed a 27 item Likert scale survey assessing ease of use, documentation efficiency, organization, and overall satisfaction.

Results:

Over 75 percent of respondents rated ease of use, learnability, interface likability, and documentation organization positively. However, approximately 30 percent reported neutral or dissatisfied opinions regarding overall satisfaction, citing workflow interruptions and limited functionality that could affect patient interaction.

Conclusions:

CarePilot was generally perceived as user friendly and effective for organizing documentation. Nonetheless, areas for refinement, particularly workflow integration and expanded functionalities, may enhance satisfaction and clinical applicability. These findings inform future design and implementation strategies for AI powered documentation tools in healthcare education and beyond.