Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Currently submitted to: JMIR AI

Date Submitted: Jan 11, 2026
Open Peer Review Period: Jan 27, 2026 - Mar 24, 2026
(closed for review but you can still tweet)

NOTE: This is an unreviewed Preprint

Warning: This is a unreviewed preprint (What is a preprint?). Readers are warned that the document has not been peer-reviewed by expert/patient reviewers or an academic editor, may contain misleading claims, and is likely to undergo changes before final publication, if accepted, or may have been rejected/withdrawn (a note "no longer under consideration" will appear above).

Peer review me: Readers with interest and expertise are encouraged to sign up as peer-reviewer, if the paper is within an open peer-review period (in this case, a "Peer Review Me" button to sign up as reviewer is displayed above). All preprints currently open for review are listed here. Outside of the formal open peer-review period we encourage you to tweet about the preprint.

Citation: Please cite this preprint only for review purposes or for grant applications and CVs (if you are the author).

Final version: If our system detects a final peer-reviewed "version of record" (VoR) published in any journal, a link to that VoR will appear below. Readers are then encourage to cite the VoR instead of this preprint.

Settings: If you are the author, you can login and change the preprint display settings, but the preprint URL/DOI is supposed to be stable and citable, so it should not be removed once posted.

Submit: To post your own preprint, simply submit to any JMIR journal, and choose the appropriate settings to expose your submitted version as preprint.

Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.

AI-Driven Digital Mentor for Tacit Medical Knowledge Transmission: A Randomized Controlled Trial

  • LinJing Peng; 
  • Wen Xie; 
  • Deng Gao; 
  • Hengyi TIan; 
  • Zhiya Yang; 
  • Nanxing Xian; 
  • Kunning Li; 
  • Linling Liu; 
  • Yuping Zhao; 
  • Yiqing Liu

ABSTRACT

The accelerating loss of senior Traditional Chinese Medicine (TCM) practitioners is causing irreversible erosion of tacit clinical expertise—knowledge grounded in sensory intuition and dynamic, embodied mentorship. Conventional preservation methods fail to capture this interactive, context-sensitive practice. To address this gap, we developed an AI-driven digital mentor system that authentically simulates face-to-face master–apprentice teaching for structured capture and transmission of irreplaceable TCM tacit knowledge. We constructed a fine-grained knowledge base of 50,000 structured entries from the medical corpus of Master Xichun Zhang using automated semantic chunking and multimodal extraction. To evaluate retrieval performance, we created TCM-RAGBench, a domain-specific benchmark comprising 600 question–answer pairs. Our multimodal system integrates a domain-adapted Retrieval-Augmented Generation (RAG) framework—featuring task-specific strategies for diagnostic reasoning, herbal formula recommendation, and procedural guidance—with digital twin technologies (voice cloning and lip synchronization). Seven large language models (LLMs) were benchmarked on the Chinese Medical Benchmark for optimal selection. Technically, fine-grained knowledge structuring improved retrieval recall (Recall@1) from 59.30% to 72.00% on TCM-RAGBench. The system also demonstrated expert-level proficiency, achieving 93.95% and 96.65% accuracy on the national TCM practitioner and pharmacist licensing examinations in China, respectively. To assess educational efficacy, we recruited 24 TCM students for a single-blind, randomized controlled trial. Through a six-month learning period with periodic assessments, the 12 participants who utilized the "AI-driven digital mentor system" developed in this study demonstrated significant learning gains in both objective test scores and clinical reasoning abilities evaluated by three blinded experts. Statistical data (p < 0.05) revealed that the group using the digital mentor system not only significantly outperformed the traditional learning group in overall scores (by 18.75%,p <0.001)), but more importantly, exhibited particularly pronounced advantages in complex clinical reasoning tasks(+20% accuracy) and in the acquisition of tacit clinical expertise across multiple dimensions.This study presents a reproducible framework for digitizing medical expertise through cognitive alignment and embodied interaction. Our findings demonstrate that high-fidelity digital mentorship can effectively enhance clinical reasoning and offer a scalable paradigm for modernizing medical education while safeguarding intangible medical heritage.


 Citation

Please cite as:

Peng L, Xie W, Gao D, TIan H, Yang Z, Xian N, Li K, Liu L, Zhao Y, Liu Y

AI-Driven Digital Mentor for Tacit Medical Knowledge Transmission: A Randomized Controlled Trial

JMIR Preprints. 11/01/2026:91173

DOI: 10.2196/preprints.91173

URL: https://preprints.jmir.org/preprint/91173

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.