journal article·2025-06-13Open access

Multi-Feature Facial Complexion Classification Algorithms Based on CNN

Xiyuan Cao, Delong Zhang, Chunyang Jin, Zhidong Zhang, Chenyang Xue

Biomimetics· Volume 10· Issue 6

Abstract

Variations in facial complexion serve as a telltale sign of underlying health conditions. Precisely categorizing facial complexions poses a significant challenge due to the subtle distinctions in facial features. Three multi-feature facial complexion classification algorithms leveraging convolutional neural networks (CNNs) are proposed. They fuse, splice, or independently train the features extracted from distinct facial regions of interest (ROI), respectively. Innovative frameworks of the three algorithms can more effectively exploit facial features, improving the utilization rate of feature information and classification performance. We trained and validated the three algorithms on the dataset consisting of 721 facial images that we had collected and preprocessed. The comprehensive evaluation reveals that multi-feature fusion and splicing classification algorithms achieve accuracies of 95.98% and 93.76%, respectively. The optimal approach combining multi-feature CNN with machine learning algorithms attains a remarkable accuracy of 97.78%. Additionally, these experiments proved that the multidomain combination was crucial, and the arrangement of ROI features, including the nose, forehead, philtrum, and right and left cheek, was the optimal choice for classification. Furthermore, we employed the EfficientNet model for training on the face image as a whole, which achieves a classification accuracy of 89.37%. The difference in accuracy underscores the superiority and efficacy of multi-feature classification algorithms. The employment of multi-feature fusion algorithms in facial complexion classification holds substantial advantages, ushering in fresh research directions in the field of facial complexion classification and deep learning.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Remote-Sensing Image Classification

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

State Key Laboratory of Extreme Environment Optoelectronic Dynamic Testing Technology and Instrument, North University of China, Taiyuan 030051, China

Funding

Key Research and Development Program of Shanxi Province · National Natural Science Foundation of China · Key Research and Development Program of Hainan Province

References (30)

Show source-provided references
1. Deep facial diagnosis: Deep transfer learning from face recognition to facial diagnosis10.1109/ACCESS.2020.3005687 ↗
2. Chen, W., Xu, D., Xu, L., Xu, G., Guo, Y., Tian, D., and Yao, Y. (2024). A review of traditional Chinese medicine diagnosis using machine learning: Inspection, auscultation-olfaction, inquiry, and palpation. Comput. Biol. Med., 170.10.1016/j.compbiomed.2024.108074 ↗
3. Computerized facial diagnosis using both color and texture features10.1016/j.ins.2012.09.011 ↗
4. Jose, J.P., Kumar, K.M., and Poornima, P.A. (2012, January 22–24). A Novel Method for Color Face Recognition Using KNN Classifier. Proceedings of the 2012 International Conference on Computing, Communication and Applications, Dindigul, India.10.1109/ICCCA.2012.6179151 ↗
5. Face region segmention applying in face diagnosis of traditional Chinese medicine
6. Human facial complexion recognition of traditional Chinese medicine based on uniform color space10.1142/S0218001414500086 ↗
7. Zhao, C., Li, F., Liu, C., Wang, Z., and Liu, G. (2014). Qualitative and quantitative analysis for facial complexion in traditional Chinese medicine. BioMed. Res. Int., 2014.10.1155/2014/207589 ↗
8. JMAL, M., Mseddi, W.S., Attia, R., and Youssef, A. (2014, January 23–27). Classification of Human Skin Color and Its Application to Face Recognition. Proceedings of the MMEDIA 2014: The Sixth International Conference on Advances in Multimedia, IARIA, Nice, France.
9. Fufeng, L., Dan, D., Xiaoqiang, L., Yiqin, W., Peng, Q., and Xiaoyan, Z. (2009, January 3–5). Facial Complexion Acquisition and Recognition System for Clinical Diagnosis in Traditional Chinese Medicine. Proceedings of the 2009 International Joint Conference on Bioinformatics, Systems Biology and Intelligent Computing, Shanghai, China.10.1109/IJCBS.2009.111 ↗
10. Lin, Y., and Wang, B. (2020, January 19–21). Facial Complexion Recognition of Traditional Chinese Medicine Based on Computer Vision. Proceedings of the 2020 5th International Conference on Computational Intelligence and Applications (ICCIA), Beijing, China.10.1109/ICCIA49625.2020.00029 ↗
11. Eyupoglu, C. (2016, January 2–3). Implementation of Color Face Recognition Using PCA and k-NN Classifier. Proceedings of the 2016 IEEE NW Russia Young Researchers in Electrical and Electronic Engineering Conference (EIConRusNW), St. Petersburg, Russia.10.1109/EIConRusNW.2016.7448153 ↗
12. Zhang, J., Wang, C., Zhuo, L., and Yuncong, Y. (2014, January 10–12). Uniform Color Space Based Facial Complexion Recognition for Traditional Chinese Medicine. Proceedings of the 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV), Singapore.10.1109/ICARCV.2014.7064377 ↗
13. Lili, Z., Xiaoqiang, L., Xiping, Y., Fufeng, L., Xiaoyan, Z., and Wei, L. (2010, January 16–18). Lip Color Classification Based on Support Vector Machine and Histogram. Proceedings of the 2010 3rd International Congress on Image and Signal Processing, Yantai, China.
14. Classification of zygomatic color based on support vector machine in traditional Chinese medicine inspection
15. Xu, M., Guo, C., Hu, Y., Lu, H., Xue, L., Li, F., and Zhang, W. (2017, January 28–29). Automatic Facial Complexion Classification Based on Mixture Model. Proceedings of the Advances in Multimedia Information Processing–PCM 2017: 18th Pacific-Rim Conference on Multimedia, Harbin, China. Revised Selected Papers, Part II 18.
16. Research on TCM color extraction and recognition based on the convolutional neural network
17. Li, W.S., Wang, S., Wu, T., and Wu, Y. (2011, January 15–17). Facial Complexion Recognition Based on Supervised Latent Dirichlet Allocation in TCM. Proceedings of the 2011 4th International Conference on Biomedical Engineering and Informatics (BMEI), Shanghai, China.10.1109/BMEI.2011.6098306 ↗
18. Convolutional neural network: Deep learning-based classification of building quality problems10.1016/j.aei.2019.02.009 ↗
19. Deep feature extraction and classification of hyperspectral images based on convolutional neural networks10.1109/TGRS.2016.2584107 ↗
20. Challenges and emerging trends for machine reading of the mind from facial expressions10.1007/s42979-023-02447-z ↗
21. Hou, J., Su, H.Y., Yan, B., Zheng, H., Sun, Z.L., and Cai, X.C. (2017, January 10–12). Classification of Tongue Color Based on CNN. Proceedings of the 2017 IEEE 2nd International Conference on Big Data Analysis (ICBDA), Beijing, China.10.1109/ICBDA.2017.8078731 ↗
22. El Alami, A., Lakhili, Z., Mesbah, A., Berrahou, A., and Qjidaa, H. (2019, January 3–4). Color Face Recognition by Using Quaternion and Deep Neural Networks. Proceedings of the 2019 International Conference on Wireless Technologies, Embedded and Intelligent Systems (WITS), Fez, Morocco.10.1109/WITS.2019.8723788 ↗
23. Complexion classification based on convolutional neural network
24. Zhao, K., Ma, X., Kuang, H., and Xinhua, L. (2024, January 20–22). Facial Complexion Classification of Traditional Chinese Medicine Based on Statistical Features and MobileViT. Proceedings of the 2024 IEEE 7th Information Technology, Networking, Electronic and Automation Control Conference (ITNEC), Chongqing, China.10.1109/ITNEC60942.2024.10733073 ↗
25. The Unique Aspects of Diagnosing and Treating the Face in Chinese Medicine
26. Bioinspired multisensory neural network with crossmodal integration and recognition10.1038/s41467-021-21404-z ↗
27. Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8–14). Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_49 ↗
28. Advanced Zero-Shot Learning (AZSL) Framework for Secure Model Generalization in Federated Learning10.1109/ACCESS.2024.3510756 ↗
29. Tan, M., and Le, Q. (2019, January 9–15). Efficientnet: Rethinking Model Scaling for Convolutional Neural Networks. Proceedings of the International Conference on Machine Learning, Long Beach, Singapore.
30. Chen, T., and Guestrin, C. (2016). Xgboost: A Scalable Tree Boosting System. 22nd Acm Sigkdd International Conference on Knowledge Discovery and Data Mining, Association for Computing Machinery.10.1145/2939672.2939785 ↗