Enhancing Skin Lesion Classification Performance with the ABC Ensemble Model
Source abstract
Abstract
Skin cancer is one of the most easily developed cancers and is continuously seeing an increased incidence rate. In this study, we propose a novel ABC ensemble model for skin lesion classification by leveraging the ABCD rule, which is commonly used in dermatology to evaluate lesion features such as asymmetry, border, color, and diameter. Our model consists of five distinct blocks, two of which focus on learning general image characteristics, while the remaining three focus on specialized features related to the ABCD rule. The final classification results are achieved through a weighted soft voting approach, where the generalization blocks are assigned higher weights to optimize performance. Through 15 experiments using various model configurations, we show that the weighted ABC ensemble model outperforms the baseline models, achieving the best performance with an accuracy of 0.9326 and an F1-score of 0.9302. Additionally, Grad-CAM analysis is employed to assess how each block in the ensemble focuses on distinct lesion features, further enhancing the interpretability and reliability of the model. Our findings demonstrate that integrating general image features with specific lesion characteristics improves classification performance, and that adjusting the soft voting weights yields optimal results. This novel model offers a reliable tool for early skin lesion diagnosis.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Cutaneous Melanoma Detection and Management · AI in cancer detection · Digital Imaging for Blood Diseases
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Mathematics, The Catholic University of Korea, Bucheon 14662, Republic of Korea
Department of Data Science, The Catholic University of Korea, Bucheon 14662, Republic of Korea
Funding
Research Fund of The Catholic University of Korea · Korea government (MSIT)
References (51)
Show source-provided references
1. Image based computer aided diagnosis system for cancer detection10.1016/j.eswa.2015.02.005 ↗
2. Basal cell carcinoma, squamous cell carcinoma and melanoma of the head and face10.1186/s13005-016-0106-0 ↗
3. MFSNet: A multi focus segmentation network for skin lesion segmentation10.1016/j.patcog.2022.108673 ↗
4. Skin cancer classification via convolutional neural networks: Systematic review of studies involving human experts10.1016/j.ejca.2021.06.049 ↗
5. M2CE: Multi-convolutional neural network ensemble approach for improved multiclass classification of skin lesion10.1111/exsy.13435 ↗
6. Skin cancer classification based on convolutional neural networks and vision transformers10.1088/1742-6596/2405/1/012037 ↗
7. The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions10.1038/sdata.2018.161 ↗
8. Computer applications in the diagnosis and prognosis of malignant melanoma10.1016/S0733-8635(18)30374-7 ↗
9. Digital image analysis for diagnosis of cutaneous melanoma. Development of a highly effective computer algorithm based on analysis of 837 melanocytic lesions10.1111/j.1365-2133.2004.06210.x ↗
10. Ballerini, L., Fisher, R.B., Aldridge, B., and Rees, J. (2013). A color and texture based hierarchical K-NN approach to the classification of non-melanoma skin lesions. Color Medical Image Analysis, Springer.10.1007/978-94-007-5389-1_4 ↗
11. A methodological approach to the classification of dermoscopy images10.1016/j.compmedimag.2007.01.003 ↗
12. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
13. Alwakid, G., Gouda, W., Humayun, M., and Sama, N.U. (2022). Melanoma detection using deep learning-based classifications. Healthcare, 10.10.3390/healthcare10122481 ↗
14. Huang, G., Liu, Z., Van Der Maaten, L., and Weinberger, K.Q. (2017, January 21–26). Densely connected convolutional networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.243 ↗
15. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). Mobilenets: Efficient convolutional neural networks for mobile vision applications. arXiv.
16. Tan, M., and Le, Q. (2019, January 9–15). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning, PMLR, Long Beach, CA, USA.
17. Multiclass skin cancer classification using EfficientNets–a first step towards preventing skin cancer10.1016/j.neuri.2021.100034 ↗
18. Yin, W., Huang, J., Chen, J., and Ji, Y. (2022). A study on skin tumor classification based on dense convolutional networks with fused metadata. Front. Oncol., 12.10.3389/fonc.2022.989894 ↗
19. Classification of skin lesions with generative adversarial networks and improved MobileNetV210.1002/ima.22880 ↗
20. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017, January 4–9). Attention is all you need. Proceedings of the 31st Conference on Neural Information Processing Systems (NIPS 2017), Long Beach, CA, USA.
21. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16x16 words: Transformers for image recognition at scale. arXiv.
22. Song, B., Kc, D.R., Yang, R.Y., Li, S., Zhang, C., and Liang, R. (2024). Classification of Mobile-Based Oral Cancer Images Using the Vision Transformer and the Swin Transformer. Cancers, 16.10.3390/cancers16050987 ↗
23. Neural architecture search for skin lesion classification10.1109/ACCESS.2020.2964424 ↗
24. Rahi, M.M.I., Khan, F.T., Mahtab, M.T., Ullah, A.A., Alam, M.G.R., and Alam, M.A. (2019, January 9–11). Detection of skin cancer using deep neural networks. Proceedings of the 2019 IEEE Asia-Pacific Conference on Computer Science and Data Engineering (CSDE), Melbourne, Australia.10.1109/CSDE48274.2019.9162400 ↗
25. Kawahara, J., BenTaieb, A., and Hamarneh, G. (2016, January 13–16). Deep features to classify skin lesions. Proceedings of the 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI), Prague, Czech Republic.10.1109/ISBI.2016.7493528 ↗
26. Rahman, A., Smith, D.V., and Timms, G. (2013, January 2–5). Multiple classifier system for automated quality assessment of marine sensor data. Proceedings of the 2013 IEEE Eighth International Conference on Intelligent Sensors, Sensor Networks and Information Processing, Melbourne, Australia.10.1109/ISSNIP.2013.6529817 ↗
27. Haralabopoulos, G., Anagnostopoulos, I., and McAuley, D. (2020). Ensemble deep learning for multilabel binary classification of user-generated content. Algorithms, 13.10.3390/a13040083 ↗
28. Ensemble learning-based CNN for textile fabric defects classification10.1108/IJCST-12-2019-0188 ↗
29. Vennelakanti, A., Shreya, S., Rajendran, R., Sarkar, D., Muddegowda, D., and Hanagal, P. (2019, January 11–13). Traffic sign detection and recognition using a CNN ensemble. Proceedings of the 2019 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA.10.1109/ICCE.2019.8662019 ↗
30. An analysis on ensemble learning optimized medical image classification with deep convolutional neural networks10.1109/ACCESS.2022.3182399 ↗
31. A novel ensemble CNN model for COVID-19 classification in computerized tomography scans10.1016/j.rico.2023.100215 ↗
32. Charan, D.S., Nadipineni, H., Sahayam, S., and Jayaraman, U. (2020). Method to classify skin lesions using dermoscopic images. arXiv.
33. Mahbod, A., Schaefer, G., Wang, C., Dorffner, G., Ecker, R., and Ellinger, I. (2020). Transfer learning using a multi-scale and multi-network ensemble for skin lesion classification. Comput. Methods Programs Biomed., 193.10.1016/j.cmpb.2020.105475 ↗
34. Lin, T.C., and Lee, H.C. (2020, January 17–19). Skin cancer dermoscopy images classification with meta data via deep learning ensemble. Proceedings of the 2020 International Computer Symposium (ICS), Tainan, Taiwan.10.1109/ICS51289.2020.00055 ↗
35. Dermatoscopy of flat pigmented facial lesions: Diagnostic challenge between pigmented actinic keratosis and lentigo maligna10.1111/j.1365-2133.2010.10025.x ↗
36. The dermatoscopic universe of basal cell carcinoma10.5826/dpc.0403a02 ↗
37. Lichenoid keratosis-like melanomas10.1016/j.jaad.2011.02.039 ↗
38. Dermoscopy of dermatofibromas: A prospective morphological study of 412 cases10.1001/archdermatol.2007.8 ↗
39. Improvement of early recognition of lentigo maligna using dermatoscopy10.1016/S0190-9622(00)90005-7 ↗
40. Dermatoscopy in routine practice: ‘Chaos and clues’
41. Dermoscopy of pyogenic granuloma: A morphological study10.1111/j.1365-2133.2010.10040.x ↗
42. Early detection of malignant melanoma: The role of physician examination and self-examination of the skin10.3322/canjclin.35.3.130 ↗
43. Healthline (2024, November 06). What Is the ABCDE Rule for Detecting Skin Cancer?. Available online: https://www.healthline.com/health/skin-cancer/abcd-rule-for-skin-cancer.
44. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany. Proceedings, Part III 18.
45. Izadpanahkakhk, M., Razavi, S.M., Taghipour-Gorjikolaie, M., Zahiri, S.H., and Uncini, A. (2018). Deep region of interest and feature extraction models for palmprint verification using convolutional neural networks transfer learning. Appl. Sci., 8.10.3390/app8071210 ↗
46. Hu, J., Shen, L., and Sun, G. (2018, January 18–22). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
47. Morphological operations for image processing: Understanding and its applications
48. Kang, H.C., Han, H.N., Bae, H.C., Kim, M.G., Son, J.Y., and Kim, Y.K. (2021). HSV color-space-based automated object localization for robot grasping without prior knowledge. Appl. Sci., 11.10.3390/app11167593 ↗
49. Szegedy, C., Liu, W., Jia, Y., Sermanet, P., Reed, S., Anguelov, D., Erhan, D., Vanhoucke, V., and Rabinovich, A. (2015, January 7–12). Going deeper with convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298594 ↗
50. Imagenet classification with deep convolutional neural networks
51. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22–29). Grad-cam: Visual explanations from deep networks via gradient-based localization. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.74 ↗