journal article·2023-08-25Open access

Use of Ensemble Learning to Improve Performance of Known Convolutional Neural Networks for Mammography Classification

Mayra C. Berrones-Reyes, M. Angélica Salazar-Aguilar, Cristian Castillo-Olea

Applied Sciences· Volume 13· Issue 17

Abstract

Convolutional neural networks and deep learning models represent the gold standard in medical image classification. Their innovative architectures have led to notable breakthroughs in image classification and feature extraction performance. However, these advancements often remain underutilized in the medical imaging field due to the scarcity of sufficient labeled data which are needed to leverage these new features fully. While many methodologies exhibit stellar performance on benchmark data sets like DDSM or Minimias, their efficacy drastically decreases when applied to real-world data sets. This study aims to develop a tool to streamline mammogram classification that maintains high reliability across different data sources. We use images from the DDSM data set and a proprietary data set, YERAL, which comprises 943 mammograms from Mexican patients. We evaluate the performance of ensemble learning algorithms combined with prevalent deep learning models such as Alexnet, VGG-16, and Inception. The computational results demonstrate the effectiveness of the proposed methodology, with models achieving 82% accuracy without overtaxing our hardware capabilities, and they also highlight the efficiency of ensemble algorithms in enhancing accuracy across all test cases.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: AI in cancer detection · COVID-19 diagnosis using AI · Radiomics and Machine Learning in Medical Imaging

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Facultad de Ingeniería Mecánica y Eléctrica, Universidad Autónoma de Nuevo León, Av. Universidad s/n, Cd. Universitaria, San Nicolás de los Garza 66455, Mexico

Facultad de Ingeniería, CETYS Universidad Campus Mexicali, Calzada CETYS s/n, Colonia Rivera, Mexicali 21259, Mexico

References (46)

Show source-provided references
1. Deep learning-based image recognition for autonomous driving10.1016/j.iatssr.2019.11.008 ↗
2. Li, Y. (2022, January 5–9). Research and Application of Deep Learning in Image Recognition. Proceedings of the 2022 IEEE 2nd International Conference on Power, Electronics and Computer Applications (ICPECA), Beijing, China.10.1109/ICPECA53709.2022.9718847 ↗
3. Hybrid deep convolutional neural models for iris image recognition10.1007/s11042-021-11482-y ↗
4. KoopaML, a Machine Learning platform for medical data analysis10.5753/jis.2022.2574 ↗
5. A machine-learning-based method for automatizing lattice-Boltzmann simulations of respiratory flows10.1007/s10489-021-02808-2 ↗
6. Optimization problems for machine learning: A survey10.1016/j.ejor.2020.08.045 ↗
7. Alzubaidi, L., Al-Amidie, M., Al-Asadi, A., Humaidi, A.J., Al-Shamma, O., Fadhel, M.A., Zhang, J., Santamaría, J., and Duan, Y. (2021). Novel transfer learning approach for medical imaging with limited labeled data. Cancers, 13.10.3390/cancers13071590 ↗
8. A comparison of deep learning performance against health-care professionals in detecting diseases from medical imaging: A systematic review and meta-analysis10.1016/S2589-7500(19)30123-2 ↗
9. Big data and health10.1016/S2589-7500(19)30109-8 ↗
10. Walking the tightrope of artificial intelligence guidelines in clinical practice10.1016/S2589-7500(19)30063-9 ↗
11. How Good Is My Test Data? Introducing Safety Analysis for Computer Vision10.1007/s11263-017-1020-z ↗
12. Varoquaux, G., and Cheplygina, V. (2021). How I failed machine learning in medical imaging–shortcomings and recommendations. arXiv.
13. Big data and medical research in China10.1136/bmj.j5910 ↗
14. A survey on deep learning in medical image analysis10.1016/j.media.2017.07.005 ↗
15. Imagenet classification with deep convolutional neural networks
16. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
17. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 14–17). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Brussels, Belgium.10.1109/CVPR.2016.90 ↗
18. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
19. Multi-label classification of multi-modality skin lesion via hyper-connected convolutional neural network10.1016/j.patcog.2020.107502 ↗
20. Lin, C.H., Lin, C.J., Li, Y.C., and Wang, S.H. (2021). Using generative adversarial networks and parameter optimization of convolutional neural networks for lung tumor classification. Appl. Sci., 11.10.3390/app11020480 ↗
21. A scoping review of transfer learning research on medical image analysis using ImageNet10.1016/j.compbiomed.2020.104115 ↗
22. Transfer learning techniques for medical image analysis: A review
23. Rahman, T., Chowdhury, M.E., Khandakar, A., Islam, K.R., Islam, K.F., Mahbub, Z.B., Kadir, M.A., and Kashem, S. (2020). Transfer learning with deep convolutional neural network (CNN) for pneumonia detection using chest X-ray. Appl. Sci., 10.10.3390/app10093233 ↗
24. Alzubaidi, L., Fadhel, M.A., Al-Shamma, O., Zhang, J., Santamaría, J., Duan, Y., and Oleiwi, S.R. (2020). Towards a Better Understanding of Transfer Learning for Medical Imaging: A Case Study. Appl. Sci., 10.10.3390/app10134523 ↗
25. Research on feature extraction of tumor image based on convolutional neural network10.1109/ACCESS.2019.2897131 ↗
26. Kim, H.E., Cosa-Linan, A., Santhanam, N., Jannesari, M., Maros, M.E., and Ganslandt, T. (2022). Transfer learning for medical image classification: A literature review. BMC Med. Imaging, 22.10.1186/s12880-022-00793-7 ↗
27. An ensemble machine learning approach through effective feature extraction to classify fake news10.1016/j.future.2020.11.022 ↗
28. Integration of deep feature extraction and ensemble learning for outlier detection10.1016/j.patcog.2019.01.002 ↗
29. Classification by a stacking model using CNN features for COVID-19 infection diagnosis
30. Müller, D., Soto-Rey, I., and Kramer, F. (2022). An Analysis on Ensemble Learning optimized Medical Image Classification with Deep Convolutional Neural Networks. arXiv.10.1109/ACCESS.2022.3182399 ↗
31. Comparing stacking ensemble techniques to improve musculoskeletal fracture image classification10.3390/jimaging7060100 ↗
32. Feature fusion and Ensemble learning-based CNN model for mammographic image classification
33. Breast cancer detection using an ensemble deep learning method10.1016/j.bspc.2021.103009 ↗
34. Prediction of Heart Disease Using a Collection of Machine and Deep Learning Algorithms
35. Reinke, A., Eisenmann, M., Tizabi, M.D., Sudre, C.H., Rädsch, T., Antonelli, M., Arbel, T., Bakas, S., Cardoso, M.J., and Cheplygina, V. (2021). Common limitations of image processing metrics: A picture story. arXiv.
36. Kunapuli, G. (2022). Ensemble Methods for Machine Learning, Simon and Schuster.
37. Ensemble learning: A survey10.1002/widm.1249 ↗
38. Scikit-learn: Machine Learning in Python
39. Raschka, S., and Mirjalili, V. (2019). Python Machine Learning: Machine Learning and Deep Learning with Python, Scikit-Learn, and TensorFlow 2, Packt Publishing Ltd.
40. Ng, A. (2022, August 15). Machine Learning Yearning: Technical Strategy for AI Engineers in the Era of Deep Learning. Available online: https://www.mlyearning.org.
41. A curated mammography data set for use in computer-aided detection and diagnosis research10.1038/sdata.2017.177 ↗
42. Lekamlage, C.D., Afzal, F., Westerberg, E., and Chaddad, A. (2020, January 12–16). Mini-DDSM: Mammography-based Automatic Age Estimation. Proceedings of the ACM 2020 3rd International Conference on Digital Medicine and Image Processing, Berlin, Germany.10.1145/3441369.3441370 ↗
43. Chollet, F. (2021). Deep Learning with Python, Simon and Schuster.
44. Brownlee, J. (2016). Deep Learning with Python: Develop Deep Learning Models on Theano and TensorFlow Using Keras, Machine Learning Mastery.
45. Ng, A. (2023, August 01). Machine Learning Yearning Volume 139. Available online: https://github.com/ajaymache/machine-learning-yearning.
46. Hepsağ, P.U., Özel, S.A., and Yazıcı, A. (2017, January 5–8). Using deep learning for mammography classification. Proceedings of the IEEE 2017 International Conference on Computer Science and Engineering (UBMK), Antalya, Turkey.10.1109/UBMK.2017.8093429 ↗