Hyperparameter Tuning with High Performance Computing Machine Learning for Imbalanced Alzheimer’s Disease Data
Source abstract
Abstract
Accurate detection is still a challenge in machine learning (ML) for Alzheimer’s disease (AD). Class imbalance in imbalanced AD data is another big challenge for machine-learning algorithms working under the assumption that the data are evenly distributed within classes. Here, we present a hyperparameter tuning workflow with high-performance computing (HPC) for imbalanced data related to prevalent mild cognitive impairment (MCI) and AD in the Health and Aging Brain Study-Health Disparities (HABS-HD) project. We applied a single-node multicore parallel mode to hyperparameter tuning of gamma, cost, and class weight using a support vector machine (SVM) model with 10 times repeated fivefold cross-validation. We executed the hyperparameter tuning workflow with R’s bigmemory, foreach, and doParallel packages on Texas Advanced Computing Center (TACC)’s Lonestar6 system. The computational time was dramatically reduced by up to 98.2% for the high-performance SVM hyperparameter tuning model, and the performance of cross-validation was also improved (the positive predictive value and the negative predictive value at base rate 12% were, respectively, 16.42% and 92.72%). Our results show that a single-node multicore parallel structure and high-performance SVM hyperparameter tuning model can deliver efficient and fast computation and achieve outstanding agility, simplicity, and productivity for imbalanced data in AD applications.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Artificial Intelligence in Healthcare · Machine Learning in Healthcare · Dementia and Cognitive Impairment Research
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Institute for Translational Research, University of North Texas Health Science Center, Fort Worth, TX 76107, USA
Department of Family Medicine, University of North Texas Health Science Center, Fort Worth, TX 76107, USA
Department of Pharmacology and Neuroscience, University of North Texas Health Science Center, Fort Worth, TX 76107, USA
Funding
the National Institute on Aging of the National Institutes of Health
References (25)
Show source-provided references
1. Accelerating Hyperparameter Tuning in Machine Learning for Alzheimer’s Disease With High Performance Computing10.3389/frai.2021.798962 ↗
2. Alzheimer’s Association (2022, March 21). Alzheimer’s Disease Facts and Figures. Available online: https://www.alz.org/alzheimers-dementia/facts-figures.
3. Dementia Prevalence in the United States in 2000 and 2012: Estimates Based on a Nationally Representative Study10.1093/geronb/gbx169 ↗
4. Al-Jumeily, D., Hussain, A., Mallucci, C., and Oliver, C. (2016). Chapter 1—Early Diagnosis of Neurodegenerative Diseases from Gait Discrimination to Neural Synchronization. Applied Computing in Medicine and Health, Morgan Kaufmann.10.1016/B978-0-12-803468-2.00001-1 ↗
5. Using Fractional Anisotropy Imaging to Detect Mild Cognitive Impairment and Alzheimer’s Disease among Mexican Americans and Non-Hispanic Whites: A HABLE Study10.1159/000518102 ↗
6. Levels of alpha-2 Macroglobulin in cognitively normal Mexican- Americans with Subjective Cognitive Decline: A HABLE Study
7. Depression, inflammation, and memory loss among Mexican Americans: Analysis of the HABLE cohort10.1017/S1041610217001016 ↗
8. Vascular risk profile and white matter hyperintensity volume among Mexican Americans and non-Hispanic Whites: The HABLE study
9. Proteomic Profiles of Neurodegeneration Among Mexican Americans and Non-Hispanic Whites in the HABS-HD Study10.3233/JAD-210543 ↗
10. The Health & Aging Brain among Latino Elders (HABLE) study methods and participant characteristics
11. Neurodegeneration from the AT(N) framework is different among Mexican Americans compared to non-Hispanic Whites: A Health & Aging Brain among Latino Elders (HABLE) Study
12. The relationship of CRP and cognition in cognitively normal older Mexican Americans: A cross-sectional study of the HABLE cohort10.1097/MD.0000000000015605 ↗
13. Cardiovascular risk factors in Mexico and the United States: A comparative cross-sectional study between the HABLE and MHAS participants
14. Metabolic Factors Are Related to Brain Amyloid Among Mexican Americans: A HABS-HD Study10.3233/JAD-215620 ↗
15. Kong, J., Kowalczyk, W., Nguyen, D.A., Bäck, T., and Menzel, S. (2019, January 6–9). Hyperparameter Optimisation for Improving Classification under Class Imbalance. Proceedings of the 2019 IEEE Symposium Series on Computational Intelligence (SSCI), Xiamen, China.10.1109/SSCI44817.2019.9002679 ↗
16. Guido, R., Groccia, M.C., and Conforti, D. (2022). A hyper-parameter tuning approach for cost-sensitive support vector machine classifiers. Soft Comput.10.1007/s00500-022-06768-8 ↗
17. Hancock, J., and Khoshgoftaar, T.M. (2021, January 10–12). Impact of Hyperparameter Tuning in Classifying Highly Imbalanced Big Data. Proceedings of the 2021 IEEE 22nd International Conference on Information Reuse and Integration for Data Science (IRI), Las Vegas, NV, USA.10.1109/IRI51335.2021.00054 ↗
18. High-Performance Machine Learning for Large-Scale Data Classification considering Class Imbalance
19. Guo, J., Nomura, A., Barton, R., Zhang, H., and Matsuoka, S. (2018). Machine Learning Predictions for Underestimation of Job Runtime on HPC System, Springer.10.1007/978-3-319-69953-0_11 ↗
20. Recursive Support Vector Machine Biomarker Selection for Alzheimer’s Disease10.3233/JAD-201254 ↗
21. Characterizing plasma NfL in a community-dwelling multi-ethnic cohort: Results from the HABLE study10.1002/alz.12404 ↗
22. Hsu, C.-W., Chang, C.-C., and Lin, C.-J. (2003). A Practical Guide to Support Vector Classification, National Taiwan University.
23. mlr: Machine learning in R
24. Alzheimer’s Association (2022, June 16). Mild Cognitive Impairment (MCI). Available online: https://www.alz.org/alzheimers-dementia/what-is-dementia/related_conditions/mild-cognitive-impairment.
25. Scalable Strategies for Computing with Massive Data10.18637/jss.v055.i14 ↗