Accepted for/Published in: JMIR Research Protocols
Date Submitted: Jul 4, 2024
Date Accepted: Oct 9, 2024
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
In silico evaluation of algorithm-based clinical decision support systems: Protocol for a scoping review
ABSTRACT
Background:
Integrating algorithm-based clinical decision support (CDS) systems poses significant challenges in evaluating their actual clinical value. Such CDS systems are traditionally assessed via controlled but resource-intensive clinical trials.
Objective:
This paper presents a review protocol for pre-implementation in silico evaluation methods to enable broadened impact analysis under simulated environments before clinical trials.
Methods:
We propose a scoping review protocol that follows an enhanced Arksey and O’Malley framework and PRISMA-ScR guidelines to investigate the scope and research gaps in the in silico evaluation of algorithm-based CDS models—specifically CDS decision-making endpoints and objectives, evaluation metrics used, and simulation paradigms employed to assess potential impacts.
Results:
The databases searched are PubMed, Embase, CINAHL, PsycInfo, Cochrane, IEEEXplore, Web of Science, and arXiv. A two-stage screening process identified pertinent articles. The information extracted from articles is iteratively refined. The review will employ thematic, trend, and descriptive analyses to meet scoping aims.
Conclusions:
The study’s findings will be published and presented in forums combining artificial intelligence and machine learning, clinical decision-making, and health technology impact analysis; ultimately, we aim to bridge the development-deployment gap through in silico evaluation-based potential impact assessments.
Citation
The author of this paper has made a PDF available, but requires the user to login, or create an account.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.