journal article·2023Open access

Deep Learning Model Ensemble for the Accuracy of Classification Degenerative Arthritis

Sang-min Lee, Namgi Kim

Computers, Materials & Continua· Volume 75· Issue 1

Abstract

Artificial intelligence technologies are being studied to provide scientific evidence in the medical field and developed for use as diagnostic tools. This study focused on deep learning models to classify degenerative arthritis into Kellgren–Lawrence grades. Specifically, degenerative arthritis was assessed by X-ray radiographic images and classified into five classes. Subsequently, the use of various deep learning models was investigated for automating the degenerative arthritis classification process. Although research on the classification of osteoarthritis using deep learning has been conducted in previous studies, only local models have been used, and an ensemble of deep learning models has never been applied to obtain more accurate results. To address this issue, this study compared the classification performance of deep learning models, including VGGNet, DenseNet, ResNet, TinyNet, EfficientNet, MobileNet, Xception, and ViT, on a dataset commonly used for osteoarthritis classification tasks. Our experimental results verified that even without applying a separate methodology, the performance of the ensemble was comparable to that of existing studies that only used the latest deep learning model and changed the learning method. From the trained models, two ensembles were created and evaluated: weight and specialist. The weight ensemble showed an improvement in accuracy of 1%, and the proposed specialist ensemble improved accuracy, precision, recall, and F1 score by 5%, 6%, 6%, and 6%, respectively, compared with the results of prior studies.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Rheumatoid Arthritis Research and Therapies · Osteoarthritis Treatment and Mechanisms · Traditional Chinese Medicine Studies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (24)

Show source-provided references
1. J. R. H. Foran, “American Academy of Orthopaedic Surgeons,” Total knee replacement, 2020. [Online]. Available: https://orthoinfo.aaos.org/en/treatment/total-knee-replacement/
2. An exploratory study on the reliability of degenerative knee arthritis dialectics and the correlation between knee ROM, VAS, and WOMAC10.18325/jkmr.2019.29.3.113 ↗
3. Diagnosis and treatment of arthritis10.17340/jkna.2017.4.28 ↗
4. Current state of total knee arthroplasty10.5124/jkma.2020.63.8.452 ↗
5. A ResNet based multiscale feature extraction for classifying multi-variate medical time series
6. A tuberculosis detection method using attention and sparse R-CNN
7. A lightweight CNN and joint shape-joint space (JS2) descriptor for radiological osteoarthritis detection10.1007/978-3-030-52791-4_26 ↗
8. V. Pai and H. Knipe, “Kellgren and Lawrence system for classification of osteoarthritis,” Reference article, Radiopaedia.org, 2014. [Online]. Available: https://doi.org/10.53347/rID-27111.10.53347/rID-27111 ↗
9. K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” arXiv preprint arXiv: 1409.1556, 2015. [Online]. Available: https://arxiv.org/abs/1409.1556.
10. K. He, X. Zhang, S. Ren and J. Sun, “Deep residual learning for image recognition,” arXiv preprint arXiv: 1512.03385, 2015. [Online]. Available: https://arxiv.org/abs/1512.03385.
11. G. Huang, Z. Liu, L. V. D. Maaten and K. Q. Weinberger, “Densely connected convolutional networks,” arXiv preprint arXiv: 1608.06993, 2018. [Online]. Available: https://arxiv.org/abs/1608.06993.
12. Lee · Korea Institute of Science and Technology Information · 2020 · 1
13. A parallel deep convolutional neural network for Alzheimer’s disease classification on PET/CT brain images
14. Fully automatic knee osteoarthritis severity grading using deep neural networks with a novel ordinal loss10.1016/j.compmedimag.2019.06.002 ↗
15. Knee osteoarthritis severity grading dataset
16. Knee osteoarthritis severity classification with ordinal regression module
17. Automatic detection of knee joints and quantification of knee osteoarthritis severity using convolutional neural networks
18. Automated classification of radiographic knee osteoarthritis severity using deep neural networks
19. R. K. Jain, P. K. Sharma, S. Gaj, A. Sur and P. Ghosh, “Knee osteoarthritis severity prediction using an attentive multi-scale deep convolutional neural network,” arXiv preprint arXiv: 2106.14292, 2021. [Online]. Available: https://arxiv.org/abs/2106.14292.
20. Xception: Deep learning with depthwise separable convolutions
21. A. G. Howard, M. Zhu, B. Chen, D. Kalenichenko, W. Wang et al., “MobileNets: Efficient convolutional neural networks for mobile vision applications,” arXiv preprint arXiv:1704.04861, 2017. [Online]. Available: https://arxiv.org/abs/1704.04861.
22. A new lightweight network based on MobileNetV3
23. K. Han, Y. Wang, Q. Zhang, W. Zhang, C. Xu et al., “Model Rubik’s cube: Twisting resolution, depth and width for TinyNets,” arXiv preprint arXiv.2010.14819v2, 2020. [Online]. Available: https://arxiv.org/pdf/2010.14819.pdf.
24. S. Meyen, F. Goppert, H. Alber, U. V. Luxburg and V. H. Franz, “Specialists outperform generalists in ensemble classification,” arXiv preprint arXiv: 2107.04381v1, 2021. [Online]. Available: https://arxiv.org/abs/2107.04381v1.