Maintenance Notice

Due to necessary scheduled maintenance, the JMIR Publications website will be unavailable from Wednesday, July 01, 2020 at 8:00 PM to 10:00 PM EST. We apologize in advance for any inconvenience this may cause you.

Who will be affected?

Accepted for/Published in: JMIR Cancer

Date Submitted: Jun 4, 2026
Date Accepted: Aug 20, 2026

The final, peer-reviewed published version of this preprint can be found here:

AI Agents for Multimodal Oncology Diagnosis: Toward Transparent and Traceable Clinical Decision Support

Yang L, Shan L, Yao X, Zhao R, Li Z, Feng S, Wang Y

AI Agents for Multimodal Oncology Diagnosis: Toward Transparent and Traceable Clinical Decision Support

JMIR Cancer 2026;12:e103545

DOI: 10.2196/103545

PMID: 42743545

AI Agents for Multimodal Oncology Diagnostics: Viewpoint on Auditable Clinical Orchestration

  • Liuyang Yang; 
  • Liyu Shan; 
  • Xiangmei Yao; 
  • Renbin Zhao; 
  • Zengzheng Li; 
  • Shuai Feng; 
  • Yajie Wang

ABSTRACT

Cancer diagnosis increasingly depends on heterogeneous data streams, including radiology, digital pathology, molecular profiling, laboratory testing, and longitudinal clinical records. Artificial intelligence (AI) has made substantial progress in isolated tasks such as lesion detection, histopathological classification, and risk prediction. Yet many systems remain narrow, static, and detached from the diagnostic workflow. This limits their value in oncology, where diagnostic reasoning is multimodal, iterative, and context dependent. Large language models, multimodal foundation models, and tool-using autonomous systems now provide the technical basis for AI agents that coordinate diagnostic processes rather than execute isolated predictions. Their clinical value should be framed as supervised orchestration. An agent must select tools, preserve evidence provenance, expose uncertainty, and remain auditable by clinicians. Early oncology-specific evidence supports this direction. An autonomous precision-oncology agent evaluated on 20 realistic multimodal cases achieved 87.5% correct tool use, 91.0% correct clinical conclusions, and 75.5% accurate guideline citation, highlighting both promise and a remaining reliability gap. This perspective is organized around four operational stages: multimodal data collection, multimodal data preprocessing, multimodal fusion and representation learning, and diagnostic decision support. Across these stages, agentic orchestration differs from conventional multimodal AI through task planning, dynamic tool invocation, longitudinal context, uncertainty-aware fusion, traceable reasoning, and physician-in-the-loop governance. Evidence from PubMed-indexed studies of oncology-agent validation, multimodal data-supply-chain deployment, oncology chatbot benchmarks, tumor multidisciplinary team workflows, source-attributed uro-oncology decision support, explainable real-world oncology AI, hallucination safety, and trustworthy-AI governance anchors the discussion.


 Citation

Please cite as:

Yang L, Shan L, Yao X, Zhao R, Li Z, Feng S, Wang Y

AI Agents for Multimodal Oncology Diagnosis: Toward Transparent and Traceable Clinical Decision Support

JMIR Cancer 2026;12:e103545

DOI: 10.2196/103545

PMID: 42743545

Download PDF


Request queued. Please wait while the file is being generated. It may take some time.

© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.