journal article·2026-04-17Open access

An Interpretable and Externally Validated Model for Cardiovascular Disease Risk Assessment in Older Adults

Madina Suleimenova, Kuat Abzaliyev, Symbat Abzaliyeva, Nargiza Nassyrova

Applied Sciences· Volume 16· Issue 8

Abstract

Cardiovascular disease (CVD) risk assessment in older adults requires models that are accurate, clinically interpretable, and able to retain performance in independent populations. This study developed an interpretable machine-learning framework for CVD risk stratification in individuals aged 65 years and older using routinely available clinical factors and a selected biochemical extension and then evaluated its performance in a substantially larger independent external cohort. Model development used a development cohort of 100 patients (Almaty, age ≥ 65) with leakage-free nested cross-validation and out-of-fold (OOF) probabilities. Three internally evaluated configurations were compared: a clinical logistic regression baseline (LR clinical), a biomarker-augmented logistic regression (LR selected), and a nonlinear random forest on the selected feature set (RF selected). Discrimination was assessed using ROC-AUC and PR-AUC; probabilistic accuracy using Brier score and log loss. Calibration was examined using OOF calibration curves with sigmoid calibration for selected models. Decision-analytic utility and exploratory operational thresholds were assessed using Decision Curve Analysis (DCA), yielding a three-tier scale with thresholds t_low = 0.23 and t_high = 0.40. In nested cross-validation, LR clinical achieved ROC-AUC 0.9425 ± 0.0188 and PR-AUC 0.9574 ± 0.0092 with Brier 0.1004 ± 0.0215 and log loss 0.3634 ± 0.0652; LR selected performed worse, while RF selected showed competitive discrimination. External validation on an independent cohort (n = 695) showed retained discrimination (ROC-AUC 0.8355; PR-AUC 0.9376) with acceptable probabilistic accuracy (Brier 0.1131; log loss 0.3760), and recalibration (intercept + slope) slightly improved probability metrics. Explainability analyses (odds ratios, permutation importance, SHAP) consistently identified heredity, BMI, physical activity, and diabetes as influential model-associated factors, with clinically plausible directionality. The results suggest that an interpretable model trained on a small geriatric cohort can retain meaningful predictive performance on a substantially larger external cohort, supporting the potential value of transparent risk stratification in older adults, while broader prospective and multi-center validation remains necessary before routine clinical implementation.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: GDF15 and Related Biomarkers · Artificial Intelligence in Healthcare · Heart Failure Treatment and Management

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Big Data and Artificial Intelligence, Faculty of Information Technology, Al-Farabi Kazakh National University, Almaty 050040, Kazakhstan

Department of Information Systems, International Information Technology University, Almaty 050040, Kazakhstan

Non-State Educational Institution, Kazakh-Russian Medical University, Almaty 050040, Kazakhstan

References (17)

Show source-provided references
1. World Health Organization (2025, June 23). Cardiovascular Diseases (CVDs), Available online: https://www.who.int/news-room/fact-sheets/detail/cardiovascular-diseases-(cvds).
2. Weng, S.F., Reps, J., Kai, J., Garibaldi, J.M., and Qureshi, N. (2017). Can machine-learning improve cardiovascular risk prediction using routine clinical data?. PLoS ONE, 12.10.1371/journal.pone.0174944 ↗
3. Kasartzian, D.-I., and Tsiampalis, T. (2025). Transforming Cardiovascular Risk Prediction: A Review of Machine Learning and Artificial Intelligence Innovations. Life, 15.10.3390/life15010094 ↗
4. A systematic review of machine learning in heart disease prediction10.55730/1300-0152.2766 ↗
5. Decision curve analysis: A novel method for evaluating prediction models10.1177/0272989X06295361 ↗
6. Abzaliyev, K., Suleimenova, M., Chen, S., Mansurova, M., Abzaliyeva, S., Manapova, A., Kurmanova, A., Bugibayeva, A., Sundetova, D., and Bitemirova, R. (2025). Predicting Cardiovascular Aging Risk Based on Clinical Data Through the Integration of Mathematical Modeling and Machine Learning. Appl. Sci., 15.10.3390/app15095077 ↗
7. Abzaliyev, K., Suleimenova, M., Abzaliyeva, S., Mansurova, M., Shomanov, A., Bugibayeva, A., Tolemisova, A., Kurmanova, A., and Nassyrova, N. (2025). Multidimensional Visualization and AI-Driven Prediction Using Clinical and Biochemical Biomarkers in Premature Cardiovascular Aging. Biomedicines, 13.10.3390/biomedicines13102482 ↗
8. Lundberg, S., and Lee, S.-I. (2017). A Unified Approach to Interpreting Model Predictions. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA, 4–9 December 2017, Curran Associates Inc.
9. A hybrid deep neural net learning model for predicting Coronary Heart Disease using Randomized Search Cross-Validation Optimization10.1016/j.dajour.2023.100331 ↗
10. Machine learning and atherosclerotic cardiovascular disease risk prediction in a multi-ethnic population10.1038/s41746-020-00331-1 ↗
11. Cherradi, B., Terrada, O., Ouhmida, A., Hamida, S., Raihani, A., and Bouattane, O. (2021). Computer-Aided Diagnosis System for Early Prediction of Atherosclerosis using Machine Learning and K-fold cross-validation. Proceedings of the 2021 International Congress of Advanced Technology and Engineering (ICOTEN), Taiz, Yemen, 4–5 July 2021, IEEE.10.1109/ICOTEN52080.2021.9493524 ↗
12. Cai, Y., Cai, Y.-Q., Tang, L.-Y., Wang, Y.-H., Gong, M., Jing, T.-C., Li, H.-J., Li-Ling, J., Hu, W., and Yin, Z. (2024). Artificial intelligence in the risk prediction models of cardiovascular disease and development of an independent validation screening tool: A systematic review. BMC Med., 22.10.1186/s12916-024-03273-7 ↗
13. Cardiovascular Risk Prediction in Older Adults10.1007/s11883-025-01339-2 ↗
14. External validation and recalibration of cardiovascular risk scores for prediction of 10-year risk of fatal cardiovascular disease: A prospective, observational, population-based cohort analysis of adults in Mexico City
15. External validation of the PREVENT risk score: Performance and clinical utility in an Iranian population10.1038/s41598-026-38614-4 ↗
16. Evaluation of performance measures in predictive artificial intelligence models to support medical decisions: Overview and guidance10.1016/j.landig.2025.100916 ↗
17. Mănescu, A.M., Tudor, A.C., Dinciu, C.C., Hangu, S.Ș., Mărgărit, I.R., Tudor, V., Mănescu, C.O., Ciomag, R.V., Rădulescu, M.L., and Hangu, C. (2025). Interpretable Machine Learning on Simulation-Derived Biomechanical Features for Hamstrings–Quadriceps Imbalance Detection in Running. Sports, 13.10.20944/preprints202509.1439.v2 ↗