Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: Journal of Medical Internet Research

Date Submitted: Jan 2, 2025
Date Accepted: Mar 21, 2025
Date Submitted to PubMed: Mar 21, 2025

The final, peer-reviewed published version of this preprint can be found here:

Adoption of Large Language Model AI Tools in Everyday Tasks: Multisite Cross-Sectional Qualitative Study of Chinese Hospital Administrators

Chen J, Liu Y, Liu P, Zhao Y, Zuo Y, Duan H

Adoption of Large Language Model AI Tools in Everyday Tasks: Multisite Cross-Sectional Qualitative Study of Chinese Hospital Administrators

J Med Internet Res 2025;27:e70789

DOI: 10.2196/70789

PMID: 40116330

PMCID: 12000786

Adoption of LLM AI tools in everyday tasks: A multi-site cross-sectional qualitative study of Chinese hospital administrators

  • Jun Chen; 
  • Yu Liu; 
  • Peng Liu; 
  • Yiming Zhao; 
  • Yan Zuo; 
  • Hui Duan

ABSTRACT

Background:

Large Language Model (LLM) artificial intelligence (AI) tools have the potential to streamline healthcare administration by enhancing efficiency in document drafting, resource allocation, and communication tasks. Despite this potential, the adoption of such tools among hospital administrators remains understudied, particularly at the individual level.

Objective:

To explore factors influencing the adoption and utilization of LLM AI tools among hospital administrators in China, focusing on enablers, barriers, and practical applications in daily administrative tasks.

Methods:

A multi-center, cross-sectional, descriptive qualitative design was employed. Three tertiary hospitals located in Beijing (Site 1), Shenzhen (Site 2), and Chengdu (Site 3) were selected to represent diverse geographic regions and institutional profiles. Middle-level administrators were recruited using purposive sampling. Data were collected from June 11 to August 16, 2024 through face-to-face semi-structured interviews guided by a collaboratively developed and piloted interview guide. Each interview was audio-recorded and transcribed verbatim. Colaizzi’s method was employed for thematic analysis. Data saturation was determined on a per-site basis by continuously reviewing transcripts during biweekly meetings until no new themes emerged from additional interviews.

Results:

A total of 31 participants (Site 1: 9; Site 2: 10; Site 3: 12) completed interviews lasting an average of 27.3 min (range: 21–39 min). Only 22.6% of participants reported high familiarity with LLM AI tools, and 25.8% were frequent users while 45.2% were rare users. Adoption varied by site. Site 3 had the highest proportion of high-familiarity participants who consistently used the tools more frequently. Qualitative analysis revealed that positive early experiences and prior technological expertise facilitated adoption, whereas mistrust in tool accuracy, limited prompting skills, and insufficient training were significant barriers. Participants predominantly used the tools for document drafting and strongly advocated for structured tutorials and institutional support to enhance broader utilization.

Conclusions:

Familiarity with technology, positive early experiences, and openness to innovation may facilitate adoption, while barriers such as limited knowledge, mistrust in tool accuracy, and insufficient prompting skills can hinder broader use. LLM AI tools are now primarily used for basic tasks such as document drafting, with limited application to more advanced functionalities due to a lack of training and confidence. Structured tutorials and institutional support are needed to enhance usability and integration. Targeted training programs, combined with organizational strategies to build trust and improve accessibility, could enhance adoption rates and broaden tool usage. Future quantitative investigations should validate the adoption rate and influencing factors.


 Citation

Please cite as:

Chen J, Liu Y, Liu P, Zhao Y, Zuo Y, Duan H

Adoption of Large Language Model AI Tools in Everyday Tasks: Multisite Cross-Sectional Qualitative Study of Chinese Hospital Administrators

J Med Internet Res 2025;27:e70789

DOI: 10.2196/70789

PMID: 40116330

PMCID: 12000786

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.