This paper has been accepted and is currently in production.
It will appear shortly on 10.2196/96900
The final accepted version (not copyedited yet) is in this tab.
The Feature Ceiling: Recognizing Data-Driven Performance Limits as a Diagnostic Category in Clinical Machine Learning
ABSTRACT
Machine learning (ML) pipelines in health care are increasingly sophisticated, yet a recurring and underappreciated phenomenon limits their practical impact: the convergence of diverse model families to the same predictive performance ceiling, regardless of algorithmic complexity. This viewpoint introduces the feature ceiling as a formal diagnostic category in clinical ML—a condition in which the informational content of the available feature set constitutes the binding constraint on predictive performance, independently of the learning algorithm employed. When the feature ceiling is reached, even a logistic regression and a carefully tuned gradient-boosted ensemble yield statistically equivalent metrics, with overlapping confidence intervals. This convergence is not a modeling failure; it is an epistemological signal that the data cannot encode what the algorithm is being asked to predict. Recognizing this condition early redirects development effort toward meaningful interventions—feature expansion, integration of complementary data sources, and strategic redesign of data collection systems—rather than continued algorithmic iteration. Beyond its technical implications, the feature ceiling carries strategic significance for health organizations: data architecture decisions made today silently define the predictive ceiling of models to be developed years from now. Embedding feature ceiling reasoning into clinical ML project design can prevent substantial misallocation of resources and redirect investment toward the structural improvements that generate real performance gains.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.