Previously submitted to: JMIR Aging (no longer under consideration since Jan 17, 2024)
Date Submitted: Dec 6, 2023
Warning: This is an author submission that is not peer-reviewed or edited. Preprints - unless they show as "accepted" - should not be relied on to guide clinical practice or health-related behavior and should not be reported in news media as established information.
Advancing Alzheimer's Disease Risk Prediction: Development and Validation of a Machine Learning-Based Preclinical Screening Model
ABSTRACT
Background:
Alzheimer's disease (AD) poses a significant challenge for individuals aged 65 and older, being the most prevalent form of dementia. Most existing Alzheimer's disease risk prediction tools have high accuracy, but the complexity and limited accessibility of current AD risk prediction tools hinder their practical use.
Objective:
Our goal was to leverage machine learning techniques to develop a prediction model that is not only highly efficient but also cost-effective.
Methods:
Utilizing data from 2,968 individuals sourced from the National Alzheimer's Coordinating Center, and we constructed models, including gradient-enhanced machines and random forests, as well as commonly used logistic regression models. For modeling purposes, we employed two popular machine learning algorithms, Random Forest and XGBoost, along with traditional logistic regression methods. The models' performance was evaluated based on five key criteria: the Brier score, accuracy (ACC), specificity (SPE), sensitivity (SEN), and area under the receiver operating characteristic curve (AUC).
Results:
The average age of the 2968 participants was 71.1 years, with a standard deviation of 6.8 years, and 60.3% were female. The prevalence of AD was 23.15% (n= 687). The machine learning-based Boruta algorithm identified 16 significant predictors from 33 potential risk factors, with a minimum Root mean squared error (RMSE) of 0.27 when the top 5 variables were selected (education level, depression, rapid eye movement sleep disorder, age, anxiety).We used the SHAP feature in the Gradient Boosting Decision Tree Model importance to rank the top 20 significant predictors and selected the top 4 variables: education level, age, marital status, and depression to construct our model based on cross-validation results. Compared to the logistic regression model, the integrated algorithm XGBoost and the random forest model performed better. Notably, XGBoost outperformed other models, achieving an AUC score of 0.78, ACC score of 0.691, SPE score of 0.677, SEN score of 0.739, PRE score of 0.403, and Brier score of 0.140.
Conclusions:
Individual characteristics and psychological status are more critical than past history. Machine-learning-based AD risk assessment tools for older adults can be easily accessed and show some accurate discrimination, which may be useful in guiding preclinical screening for AD in the elderly population.
Citation
Request queued. Please wait while the file is being generated. It may take some time.
Copyright
© The authors. All rights reserved. This is a privileged document currently under peer-review/community review (or an accepted/rejected manuscript). Authors have provided JMIR Publications with an exclusive license to publish this preprint on it's website for review and ahead-of-print citation purposes only. While the final peer-reviewed paper may be licensed under a cc-by license on publication, at this stage authors and publisher expressively prohibit redistribution of this draft paper other than for review purposes.