An Interpretable and Externally Validated Model for Cardiovascular Disease Risk Assessment in Older Adults
Source abstract
Abstract
Cardiovascular disease (CVD) risk assessment in older adults requires models that are accurate, clinically interpretable, and able to retain performance in independent populations. This study developed an interpretable machine-learning framework for CVD risk stratification in individuals aged 65 years and older using routinely available clinical factors and a selected biochemical extension and then evaluated its performance in a substantially larger independent external cohort. Model development used a development cohort of 100 patients (Almaty, age ≥ 65) with leakage-free nested cross-validation and out-of-fold (OOF) probabilities. Three internally evaluated configurations were compared: a clinical logistic regression baseline (LR clinical), a biomarker-augmented logistic regression (LR selected), and a nonlinear random forest on the selected feature set (RF selected). Discrimination was assessed using ROC-AUC and PR-AUC; probabilistic accuracy using Brier score and log loss. Calibration was examined using OOF calibration curves with sigmoid calibration for selected models. Decision-analytic utility and exploratory operational thresholds were assessed using Decision Curve Analysis (DCA), yielding a three-tier scale with thresholds t_low = 0.23 and t_high = 0.40. In nested cross-validation, LR clinical achieved ROC-AUC 0.9425 ± 0.0188 and PR-AUC 0.9574 ± 0.0092 with Brier 0.1004 ± 0.0215 and log loss 0.3634 ± 0.0652; LR selected performed worse, while RF selected showed competitive discrimination. External validation on an independent cohort (n = 695) showed retained discrimination (ROC-AUC 0.8355; PR-AUC 0.9376) with acceptable probabilistic accuracy (Brier 0.1131; log loss 0.3760), and recalibration (intercept + slope) slightly improved probability metrics. Explainability analyses (odds ratios, permutation importance, SHAP) consistently identified heredity, BMI, physical activity, and diabetes as influential model-associated factors, with clinically plausible directionality. The results suggest that an interpretable model trained on a small geriatric cohort can retain meaningful predictive performance on a substantially larger external cohort, supporting the potential value of transparent risk stratification in older adults, while broader prospective and multi-center validation remains necessary before routine clinical implementation.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: GDF15 and Related Biomarkers · Artificial Intelligence in Healthcare · Heart Failure Treatment and Management
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Big Data and Artificial Intelligence, Faculty of Information Technology, Al-Farabi Kazakh National University, Almaty 050040, Kazakhstan
Department of Information Systems, International Information Technology University, Almaty 050040, Kazakhstan
Non-State Educational Institution, Kazakh-Russian Medical University, Almaty 050040, Kazakhstan
References (17)
Show source-provided references
1. World Health Organization (2025, June 23). Cardiovascular Diseases (CVDs), Available online: https://www.who.int/news-room/fact-sheets/detail/cardiovascular-diseases-(cvds).
2. Weng, S.F., Reps, J., Kai, J., Garibaldi, J.M., and Qureshi, N. (2017). Can machine-learning improve cardiovascular risk prediction using routine clinical data?. PLoS ONE, 12.10.1371/journal.pone.0174944 ↗
3. Kasartzian, D.-I., and Tsiampalis, T. (2025). Transforming Cardiovascular Risk Prediction: A Review of Machine Learning and Artificial Intelligence Innovations. Life, 15.10.3390/life15010094 ↗
4. A systematic review of machine learning in heart disease prediction10.55730/1300-0152.2766 ↗
5. Decision curve analysis: A novel method for evaluating prediction models10.1177/0272989X06295361 ↗
6. Abzaliyev, K., Suleimenova, M., Chen, S., Mansurova, M., Abzaliyeva, S., Manapova, A., Kurmanova, A., Bugibayeva, A., Sundetova, D., and Bitemirova, R. (2025). Predicting Cardiovascular Aging Risk Based on Clinical Data Through the Integration of Mathematical Modeling and Machine Learning. Appl. Sci., 15.10.3390/app15095077 ↗
7. Abzaliyev, K., Suleimenova, M., Abzaliyeva, S., Mansurova, M., Shomanov, A., Bugibayeva, A., Tolemisova, A., Kurmanova, A., and Nassyrova, N. (2025). Multidimensional Visualization and AI-Driven Prediction Using Clinical and Biochemical Biomarkers in Premature Cardiovascular Aging. Biomedicines, 13.10.3390/biomedicines13102482 ↗
8. Lundberg, S., and Lee, S.-I. (2017). A Unified Approach to Interpreting Model Predictions. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA, 4–9 December 2017, Curran Associates Inc.
9. A hybrid deep neural net learning model for predicting Coronary Heart Disease using Randomized Search Cross-Validation Optimization10.1016/j.dajour.2023.100331 ↗
10. Machine learning and atherosclerotic cardiovascular disease risk prediction in a multi-ethnic population10.1038/s41746-020-00331-1 ↗
11. Cherradi, B., Terrada, O., Ouhmida, A., Hamida, S., Raihani, A., and Bouattane, O. (2021). Computer-Aided Diagnosis System for Early Prediction of Atherosclerosis using Machine Learning and K-fold cross-validation. Proceedings of the 2021 International Congress of Advanced Technology and Engineering (ICOTEN), Taiz, Yemen, 4–5 July 2021, IEEE.10.1109/ICOTEN52080.2021.9493524 ↗
12. Cai, Y., Cai, Y.-Q., Tang, L.-Y., Wang, Y.-H., Gong, M., Jing, T.-C., Li, H.-J., Li-Ling, J., Hu, W., and Yin, Z. (2024). Artificial intelligence in the risk prediction models of cardiovascular disease and development of an independent validation screening tool: A systematic review. BMC Med., 22.10.1186/s12916-024-03273-7 ↗
13. Cardiovascular Risk Prediction in Older Adults10.1007/s11883-025-01339-2 ↗
14. External validation and recalibration of cardiovascular risk scores for prediction of 10-year risk of fatal cardiovascular disease: A prospective, observational, population-based cohort analysis of adults in Mexico City
15. External validation of the PREVENT risk score: Performance and clinical utility in an Iranian population10.1038/s41598-026-38614-4 ↗
16. Evaluation of performance measures in predictive artificial intelligence models to support medical decisions: Overview and guidance10.1016/j.landig.2025.100916 ↗
17. Mănescu, A.M., Tudor, A.C., Dinciu, C.C., Hangu, S.Ș., Mărgărit, I.R., Tudor, V., Mănescu, C.O., Ciomag, R.V., Rădulescu, M.L., and Hangu, C. (2025). Interpretable Machine Learning on Simulation-Derived Biomechanical Features for Hamstrings–Quadriceps Imbalance Detection in Running. Sports, 13.10.20944/preprints202509.1439.v2 ↗