journal article·2022-12-29Open access

Robust Facial Expression Recognition Using an Evolutionary Algorithm with a Deep Learning Model

Mayuri Arul Vinayakam Rajasimman, Ranjith Kumar Manoharan, Neelakandan Subramani, Manimaran Aridoss, Mohammad Gouse Galety

Applied Sciences· Volume 13· Issue 1

Abstract

The most important component that can express a person’s mental condition is facial expressions. A human can communicate around 55% of information non-verbally and the remaining 45% audibly. Automatic facial expression recognition (FER) has now become a challenging task in the surveying of computers. Applications of FER include understanding the behavior of humans and monitoring moods and psychological states. It even penetrates other domains—namely, robotics, criminology, smart healthcare systems, entertainment, security systems, holographic images, stress detection, and education. This study introduces a novel Robust Facial Expression Recognition using an Evolutionary Algorithm with Deep Learning (RFER-EADL) model. RFER-EADL aims to determine various kinds of emotions using computer vision and DL models. Primarily, RFER-EADL performs histogram equalization to normalize the intensity and contrast levels of the images of identical persons and expressions. Next, the deep convolutional neural network-based densely connected network (DenseNet-169) model is exploited with the chimp optimization algorithm (COA) as a hyperparameter-tuning approach. Finally, teaching and learning-based optimization (TLBO) with a long short-term memory (LSTM) model is employed for expression recognition and classification. The designs of COA and TLBO algorithms aided in the optimal parameter selection of the DenseNet and LSTM models, respectively. A brief simulation analysis of the benchmark dataset portrays the greater performance of the RFER-EADL model compared to other approaches.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Emotion and Mood Recognition · Face and Expression Recognition · Face recognition and analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computing Science and Engineering, VIT Bhopal University, Bhopal 466114, India

Department of Mathematics, Amrita School of Engineering, Amrita Vishwa Vidyapeetham, Chennai 601103, India

Department of Computer Science and Engineering, R.M.K Engineering College, Kavaraipettai 601206, India

School of Advanced Sciences, VIT-AP University, Amaravati 522237, India

Department of Information Technology and Computer Science, Catholic University in Erbil, Erbil 44001, Kurdistan Region, Iraq

References (57)

Show source-provided references
1. Fathima, A., and Vaidehi, K. (2020). Review on facial expression recognition system using machine learning techniques. Advances in Decision Sciences, Image Processing, Security and Computer Vision, Springer.10.1007/978-3-030-24318-0_70 ↗
2. An Efficient Resource Selection and Binding Model for Job Scheduling in Grid
3. A survey on human face expression recognition techniques
4. Resource Selection in Grid Environment based on Trust Evaluation using Feedback and Performance10.3844/ajassp.2013.924.930 ↗
5. Jaswanth, K.S., and David, D.S. (2020, January 3–4). A novel based 3D facial expression detection using recurrent neural network. Proceedings of the 2020 International Conference on System, Computation, Automation and Networking (ICSCAN), Pondicherry, India.
6. Multi angle optimal pattern-based deep learning for automatic facial expression recognition10.1016/j.patrec.2017.06.025 ↗
7. Pyramid With Super Resolution for In-the-Wild Facial Expression Recognition10.1109/ACCESS.2020.3010018 ↗
8. Discriminative deep multi-task learning for facial expression recognition10.1016/j.ins.2020.04.041 ↗
9. Optimization of Peak to Average Power Reduction in OFDM10.1134/S1064226917140017 ↗
10. Analysis of OFDM system using DCT-PTS-SLM based approach for multimedia applications10.1007/s10586-018-2140-0 ↗
11. Novel deep learning model for facial expression recognition based on maximum boosted CNN and LSTM10.1049/iet-ipr.2019.1188 ↗
12. Deep learning based facial expression recognition using improved Cat Swarm Optimization10.1007/s12652-020-02463-4 ↗
13. Wang, K., Peng, X., Yang, J., Lu, S., and Qiao, Y. (2020, January 14–19). Suppressing uncertainties for large-scale facial expression recognition. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition 2020, Seattle, WA, USA.10.1109/CVPR42600.2020.00693 ↗
14. Attention mechanism-based CNN for facial expression recognition10.1016/j.neucom.2020.06.014 ↗
15. Facial Expression Recognition Method Based on Improved VGG Convolutional Neural Network10.1142/S0218001420560030 ↗
16. E2-capsule neural networks for facial expression recognition using AU-aware attention10.1049/iet-ipr.2020.0063 ↗
17. Efficient Facial Expression Recognition Algorithm Based on Hierarchical Deep Neural Network Structure10.1109/ACCESS.2019.2907327 ↗
18. Convolutional relation network for facial expression recognition in the wild with few-shot learning10.1016/j.eswa.2021.116046 ↗
19. Multi-modal fusion network with complementarity and importance for emotion recognition10.1016/j.ins.2022.11.076 ↗
20. Liu, S., Huang, S., Fu, W., and Lin, J.C.-W. (2022). A descriptive human visual cognitive strategy using graph neural network for facial expression recognition. Int. J. Mach. Learn. Cybern., 1–17.10.1007/s13042-022-01681-w ↗
21. Classification techniques’ performance evaluation for facial expression recognition
22. An Analytical Appraisal for Supervised Classifiers’ Performance on Facial Expression Recognition Based on Relief-F Feature Selection10.1088/1742-6596/1804/1/012055 ↗
23. Intelligent deep learning based bidirectional long short term memory model for automated reply of e-mail client prototype10.1016/j.patrec.2021.10.021 ↗
24. Two-Stage Fuzzy Fusion Based-Convolution Neural Network for Dynamic Emotion Recognition10.1109/TAFFC.2020.2966440 ↗
25. Neelakandan, S., Paulraj, D., Ezhumalai, P., and Prakash, M. (2022). A Deep Learning Modified Neural Network(DLMNN) based proficient sentiment analysis technique on Twitter data. J. Exp. Theor. Artif. Intell., 1–20.10.1080/0952813X.2022.2093405 ↗
26. Intelligent deep learning based ethnicity recognition and classification using facial images10.1016/j.imavis.2022.104404 ↗
27. An Automated Word Embedding with Parameter Tuned Model for Web Crawling10.32604/iasc.2022.022209 ↗
28. Convolutional Neural Networks Based Video Reconstruction and Computation in Digital Twins10.32604/iasc.2022.026385 ↗
29. Deep Learning Approaches for Cyberbullying Detection and Classification on Social Media
30. Low dynamic range histogram equalization (LDR-HE) via quantized Haar wavelet transform10.1007/s00371-021-02281-5 ↗
31. Rahman, M.T., and Dola, A. (2021, January 17–19). Automated Grading of Diabetic Retinopathy using DenseNet-169 Architecture. Proceedings of the 2021 5th International Conference on Electrical Information and Communication Technology (EICT), Khulna, Bangladesh.10.1109/EICT54103.2021.9733431 ↗
32. An enhanced chimp optimization algorithm for continuous optimization domains10.1007/s40747-021-00346-5 ↗
33. Fault diagnosis of wind turbine based on Long Short-term memory networks10.1016/j.renene.2018.10.031 ↗
34. Techno-economic analysis of a grid-connected PV/battery system using the teaching-learning-based optimization algorithm10.1016/j.solener.2020.04.007 ↗
35. (2022, October 14). Available online: https://www.kaggle.com/datasets/shawon10/ckplus.
36. Automated Facial Expression Recognition Framework Using Deep Learning10.1155/2022/5707930 ↗
37. Deployment of Multicloud Environment with Avoidance of DDOS Attack and Secured Data Privacy
38. Awari, H., Subramani, N., Janagaraj, A., Thanammal, G.B., Thangarasu, J., and Kohar, R. (2022). Three-dimensional dental image segmentation and classification using deep learning with tunicate swarm algorithm. Expert Syst., e13198.10.1111/exsy.13198 ↗
39. Honest Auction Based Spectrum Assignment and Exploiting Spectrum Sensing Data Falsification Attack Using Stochastic Game Theory in Wireless Cognitive Radio Network10.1007/s11277-017-5105-3 ↗
40. Mitigating eavesdropping by using fuzzy based MDPOP-Q learning approach and multilevel Stackelberg game theoretic approach in wireless CRN10.1016/j.cogsys.2018.09.021 ↗
41. An efficient technique for cloud storage using secured de-duplication algorithm10.3233/JIFS-210038 ↗
42. Modeling of human action recognition using hyperparameter tuned deep learning model
43. Prakash, P.R., Anuradha, D., Iqbal, J., Galety, M.G., Singh, R., and Neelakandan, S. (2022). A novel convolutional neural network with gated recurrent unit for automated speech emotion recognition and classification. J. Control Decis., 1–10.10.1080/23307706.2022.2085198 ↗
44. Neelakandan, S., Prakash, M., Bhargava, S., Mohan, K., Robert, N.R., and Upadhye, S. (2022). Optimal Stacked Sparse Autoencoder Based Traffic Flow Prediction in Intelligent Transportation Systems. Virtual and Augmented Reality for Automobile Industry: Innovation Vision and Applications, Springer.10.1007/978-3-030-94102-4_6 ↗
45. Artificial Intelligence Based Customer Churn Prediction Model for Business Markets
46. Metaheuristics with Deep Transfer Learning Enabled Detection and classification model for industrial waste management10.1016/j.chemosphere.2022.136046 ↗
47. Capsule Network-Based Deep Transfer Learning Model for Face Recognition10.1155/2022/2086613 ↗
48. Design of fuzzy logic based energy management and traffic predictive model for cyber physical systems10.1016/j.compeleceng.2022.108135 ↗
49. Multilayer Stacked Probabilistic Belief Network-Based Brain Tumor Segmentation and Classification10.1142/S0129054122420047 ↗
50. Chaotic Salp Swarm Optimization-Based Energy-Aware VMP Technique for Cloud Data Centers10.1155/2022/4343476 ↗
51. Metaheuristic Optimization-Based Resource Allocation Technique for Cybertwin-Driven 6G on IoE Environment10.1109/TII.2021.3138915 ↗
52. An efficient low complexity compression based optimal homomorphic encryption for secure fiber optic communication10.1016/j.ijleo.2021.168545 ↗
53. Lakshmanna, K., Subramani, N., Alotaibi, Y., Alghamdi, S., Khalafand, O.I., and Nanda, A.K. (2022). Improved Metaheuristic-Driven Energy-Aware Cluster-Based Routing Scheme for IoT-Assisted Wireless Sensor Networks. Sustainability, 14.10.3390/su14137712 ↗
54. LSGDM with Biogeography-Based Optimization (BBO) Model for Healthcare Applications10.1155/2022/2170839 ↗
55. Le, T.T.Q., Tran, T.K., and Rege, M. (2020, January 11–13). Dynamic image for micro-expression recognition on region-based framework. Proceedings of the 2020 IEEE 21st International Conference on Information Reuse and Integration for Data Science (IRI), Las Vegas, NV, USA.
56. An Efficient On-Demand Virtual Machine Migration in Cloud Using Common Deployment Model10.32604/csse.2022.022122 ↗
57. Pigeon Inspired Optimization with Encryption Based Secure Medical Image Management System10.1155/2022/2243827 ↗