Accepted for/Published in: JMIR AI
Date Submitted: Jul 7, 2025
Open Peer Review Period: Aug 5, 2025 - Sep 30, 2025
Date Accepted: Oct 12, 2025
(closed for review but you can still tweet)
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
PRISMA-trAIce: A Proposed Checklist for Transparent Reporting of Artificial Intelligence in Comprehensive Evidence-Synthesis
ABSTRACT
Background:
Systematic Literature Reviews (SLR) build the foundation for evidence synthesis, but they are exceptionally demanding in terms of time and resources. While recent advances in Artificial Intelligence (AI), particularly Large Language Models (LLMs), offer the potential to accelerate this process, their use introduces challenges to transparency and reproducibility. Developing reporting guidelines like PRISMA-AI primarily focus on AI as a subject of research, not as a tool in the review process itself.
Objective:
To address the gap in reporting standards, this paper aims to develop and propose a discipline-agnostic checklist extension to the PRISMA 2020 statement. The goal is to ensure transparent reporting when AI is used as a methodological tool in evidence synthesis, fostering trust in the next generation of SLRs.
Methods:
The proposed checklist, named PRISMA-trAIce (Transparent Reporting of Artificial Intelligence in Comprehensive Evidence-synthesis), was developed through a systematic process. We conducted a literature search to identify established, consensus-based AI reporting guidelines (e.g., CONSORT-AI, TRIPOD-AI). Relevant items from these frameworks were extracted, analyzed, and thematically synthesized to form a modular checklist that integrates with the PRISMA 2020 structure.
Results:
The primary result of this work is the PRISMA-trAIce checklist, a comprehensive set of reporting items designed to document the use of AI in SLRs. The checklist covers all phases of the review process, from title and abstract to methods and discussion, and includes specific items for identifying AI tools, describing human-AI interaction, reporting performance evaluation, and discussing limitations.
Conclusions:
PRISMA-trAIce establishes an important framework to improve the transparency and methodological integrity of AI-assisted systematic reviews, enhancing the trust required for their responsible application in evidence synthesis. We present this work as a foundational proposal, explicitly inviting the scientific community to join an open science process of consensus-building. Through this collaborative refinement, we aim to evolve PRISMA-trAIce into a formally endorsed guideline, thereby ensuring the collective validation and scientific rigor of future AI-driven research. Clinical Trial: Not applicable.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.