AI Agents for Multimodal Oncology Diagnostics: Viewpoint on Auditable Clinical Orchestration
ABSTRACT
Cancer diagnosis increasingly depends on heterogeneous data streams, including radiology, digital pathology, molecular profiling, laboratory testing, and longitudinal clinical records. Artificial intelligence (AI) has made substantial progress in isolated tasks such as lesion detection, histopathological classification, and risk prediction. Yet many systems remain narrow, static, and detached from the diagnostic workflow. This limits their value in oncology, where diagnostic reasoning is multimodal, iterative, and context dependent. Large language models, multimodal foundation models, and tool-using autonomous systems now provide the technical basis for AI agents that coordinate diagnostic processes rather than execute isolated predictions. Their clinical value should be framed as supervised orchestration. An agent must select tools, preserve evidence provenance, expose uncertainty, and remain auditable by clinicians. Early oncology-specific evidence supports this direction. An autonomous precision-oncology agent evaluated on 20 realistic multimodal cases achieved 87.5% correct tool use, 91.0% correct clinical conclusions, and 75.5% accurate guideline citation, highlighting both promise and a remaining reliability gap. This perspective is organized around four operational stages: multimodal data collection, multimodal data preprocessing, multimodal fusion and representation learning, and diagnostic decision support. Across these stages, agentic orchestration differs from conventional multimodal AI through task planning, dynamic tool invocation, longitudinal context, uncertainty-aware fusion, traceable reasoning, and physician-in-the-loop governance. Evidence from PubMed-indexed studies of oncology-agent validation, multimodal data-supply-chain deployment, oncology chatbot benchmarks, tumor multidisciplinary team workflows, source-attributed uro-oncology decision support, explainable real-world oncology AI, hallucination safety, and trustworthy-AI governance anchors the discussion.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.