Special Issue on Using Machine Learning Algorithms in the Prediction of Kyphosis Disease: A Comparative Study
Source abstract
Abstract
Machine learning (ML) is the technology that allows a computer system to learn from the environment, through re-iterative processes, and improve itself from experience. Recently, machine learning has gained massive attention across numerous fields, and is making it easy to model data extremely well, without the importance of using strong assumptions about the modeled system. The rise of machine learning has proven to better describe data as a result of providing both engineering solutions and an important benchmark. Therefore, in this current research work, we applied three different machine learning algorithms, which were, the Random Forest (RF), Support Vector Machines (SVM), and Artificial Neural Network (ANN) to predict kyphosis disease based on a biomedical data. At the initial stage of the experiments, we performed 5- and 10-Fold Cross-Validation using Logistic Regression as a baseline model to compare with our ML models without performing grid search. We then evaluated the models and compared their performances based on 5- and 10-Fold Cross-Validation after running grid search algorithms on the ML models. Among the Support Vector Machines, we experimented with the three kernels (Linear, Radial Basis Function (RBF), Polynomial). We observed overall accuracies of the models between 79%–85%, and 77%–86% based on the 5- and 10-Fold Cross-Validation, after running grid search respectively. Based on the 5- and 10-Fold Cross-Validation as evaluation metrics, the RF, SVM-RBF, and ANN models achieved accuracies more than 80%. The RF, SVM-RBF and ANN models outperformed the baseline model based on the 10-Fold Cross-Validation with grid search. Overall, in terms of accuracies, the ANN model outperformed all the other ML models, achieving 85.19% and 86.42% based on the 5- and 10-Fold Cross-Validation. We proposed that RF, SVM-RBF and ANN models should be used to detect and predict kyphosis disease after a patient had undergone surgery or operation. We suggest that machine learning should be adopted and used as an essential and critical tool across the maximum spectrum of answering biomedical questions.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Artificial Intelligence in Healthcare · AI in cancer detection · Traditional Chinese Medicine Studies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Automation Engineering, University of Electronic Science and Technology of China, Chengdu 611371, China
References (33)
Show source-provided references
1. Vinitha, S., Sweetlin, S., Vinusha, H., and Sajini, S. (2018). Disease Prediction Using Machine Learning Over Big Data. Comput. Sci. Eng. Int. J., 8.
2. Early Detection of Breast Cancer Using Machine Learning Techniques
3. Machine Learning Algorithms: A Review
4. Richert, W., and Coelho, L.P. (2013). Building Machine Learning Systems with Python, Packt Publishing Ltd.
5. Breast Cancer classification using Support Vector Machine and Neural Network
6. Comparative analysis of logistic regression, support vector machine and artificial neural network for the differential diagnosis of benign and malignant solid breast tumors by the use of three-dimensional power Doppler imaging10.3348/kjr.2009.10.5.464 ↗
7. Simons, A. (2019, June 26). Using Artificial Intelligence to Improve Early Breast Cancer Detection. Available online: https://www.csail.mit.edu/news/using-artificial-intelligence-improve-early-breast-cancer-detection.
8. Abdullah, A., Yaakob, A., and Ibrahim, Z. (2018, January 15–17). Prediction of Spinal Abnormalities Using Machine Learning Techniques. Proceedings of the 2018 International Conference on Computational Approach in Smart Systems Design and Applications, Kuching, Serawak, Malaysia.10.1109/ICASSDA.2018.8477622 ↗
9. Diabetes Diagnosis Using Machine Learning
10. Hybrid intelligent modelling, schemes for heart disease classification10.1016/j.asoc.2013.09.020 ↗
11. Heart Disease Prediction Using Machine learning and Data Mining Technique
12. Heart Disease Diagnosis and Prediction Using Machine Learning and Data Mining Techniques: A Review
13. Modelling and Design of Evolutionary Neural Network for Heart Disease Detection
14. Heart Diseases Diagnoses Using Artificial Neural Network
15. Mrudula, G., Kapil, W., and Snehlata, D. (July, January 29). Decision Support System for Heart Disease Based on Support Vector Machine and Artificial Neural Network. Proceedings of the 2010 International Conference on Computer and Communication Technology, Bradford, UK.
16. Ayeldeen, H., Elfattah, M.A., Shaker, O., Hassanien, A.E., and Kim, T.H. (2015, January 28–29). Case-Based Retrieval Approach of Clinical Breast Cancer Patients. Proceedings of the 2015 3rd International Conference on Computer, Information and Application, Qingdao, China.10.1109/CIA.2015.17 ↗
17. Comparative Analysis of Artificial Neural Network and Support Vector Machine Classification for Breast Cancer Detection
18. Comparison of Models for the Prediction of Medical Costs of Spinal Fusion in Taiwan Diagnosis-Related Groups by Machine Learning Algorithms10.4258/hir.2018.24.1.29 ↗
19. John, M.C., and Trevor, J.H. (1992). Statistical Models in S, Wadsworth and Brooks/Cole.
20. Understanding logistic regression analysis10.11613/BM.2014.003 ↗
21. (2019, August 06). Understanding Logistic Regression. Available online: https://towardsdatascience.com/understanding-logistic-regression-9b02c2aec102.
22. Random Forests10.1023/A:1010933404324 ↗
23. (2019, June 07). Neural Designer. Available online: https://www.neuraldesigner.com/blog/what_is_advanced_analytics.
24. Vapnik, V.N. (1998). Statistical Learning Theory, Wiley.
25. Benchmarking Least Squares Support Vector Machine Classifiers10.1023/B:MACH.0000008082.80494.e0 ↗
26. Support Vector Machine and Random Forest Modeling for Intrusion Detection System (IDS)
27. Prajapati, G.L., and Patle, A. (2010, January 19–21). On Performing Classification Using SVM with Radial Basis and Polynomial Kernel Functions. Proceedings of the 3rd International Conference on Emerging Trends in Engineering and Technology, Goa, India.10.1109/ICETET.2010.134 ↗
28. (2019, July 26). Mathematics of Neural Networks. Available online: https://juxt.pro/blog/posts/neural-maths.html.
29. Kingma, D., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv.
30. (2019, July 26). k-Fold Cross-Validating Neural Networks. Available online: https://chrisalbon.com/deep_learning/keras/k-fold_cross-validating_neural_networks/.
31. (2019, July 26). Cross-Validation: Evaluating Estimator Performance. Available online: https://scikit-learn.org/stable/modules/cross_validation.html.
32. Min, C., Yixue, H., Kai, H., Lu, W., and Lin, W. (2017). Disease Prediction by Machine Learning Over Big Data from Healthcare Communities. Special Section on Healthcare Big Data. IEEE Acess.
33. A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models10.1016/j.jclinepi.2019.02.004 ↗