Faster Region Convolutional Neural Network (FRCNN) Based Facial Emotion Recognition
Source abstract
Abstract
Facial emotion recognition (FER) has become a focal point of research due to its widespread applications, ranging from human-computer interaction to affective computing. While traditional FER techniques have relied on handcrafted features and classification models trained on image or video datasets, recent strides in artificial intelligence and deep learning (DL) have ushered in more sophisticated approaches. The research aims to develop a FER system using a Faster Region Convolutional Neural Network (FRCNN) and design a specialized FRCNN architecture tailored for facial emotion recognition, leveraging its ability to capture spatial hierarchies within localized regions of facial features. The proposed work enhances the accuracy and efficiency of facial emotion recognition. The proposed work comprises two major key components: Inception V3-based feature extraction and FRCNN-based emotion categorization. Extensive experimentation on Kaggle datasets validates the effectiveness of the proposed strategy, showcasing the FRCNN approach’s resilience and accuracy in identifying and categorizing facial expressions. The model’s overall performance metrics are compelling, with an accuracy of 98.4%, precision of 97.2%, and recall of 96.31%. This work introduces a perceptive deep learning-based FER method, contributing to the evolving landscape of emotion recognition technologies. The high accuracy and resilience demonstrated by the FRCNN approach underscore its potential for real-world applications. This research advances the field of FER and presents a compelling case for the practicality and efficacy of deep learning models in automating the understanding of facial emotions.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Emotion and Mood Recognition · Face and Expression Recognition · Brain Tumor Detection and Classification
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (42)
Show source-provided references
1. Facial emotion recognition using conventional machine learning and deep learning methods: Current achievements, analysis and remaining challenges10.3390/info13060268 ↗
2. Emotion recognition from facial expression using deep learning10.35940/ijeat.F1019.0886S19 ↗
3. Emotion recognition support system: Where physicians and psychiatrists meet linguists and data engineers10.5498/wjp.v13.i1.1 ↗
4. Emotion recognition for human-robot interaction: Recent advances and future perspectives
5. Optimal facial feature based emotional recognition using deep learning algorithm10.1155/2022/9755422 ↗
6. Going deeper in facial expression recognition using deep neural networks
7. Facial expression recognition with convolutional neural networks: Coping with few data and the training sample order10.1016/j.patcog.2016.07.026 ↗
8. Facial expression recognition via deep learning
9. Implicit and explicit feature purification for age-invariant facial representation learning10.1109/TIFS.2022.3142998 ↗
10. A real-time face emotion classification and recognition using deep learning model
11. Facial expression recognition for monitoring neurological disorders based on convolutional neural network10.1007/s11042-019-07959-6 ↗
12. A deep learning model for classifying human facial expressions from infrared thermal images10.1038/s41598-021-99998-z ↗
13. Multi-objective based spatio-temporal feature representation learning robust to expression intensity variations for facial expression recognition10.1109/TAFFC.2017.2695999 ↗
14. Spatio-temporal convolutional features with nested LSTM for facial expression recognition10.1016/j.neucom.2018.07.028 ↗
15. Framework for the classification of emotions in people with visual disabilities through brain signals10.3389/fninf.2021.642766 ↗
16. Development of an adaptive trait-aging invariant face recognition system using convolutional neural networks
17. Face detection based on receptive field enhanced multi-task cascaded convolutional neural networks10.1109/ACCESS.2020.3023782 ↗
18. Hierarchical scale convolutional neural network for facial expression recognition10.1007/s11571-021-09761-3 ↗
19. Facial expression recognition with convolutional neural networks
20. Deep learning-based facial emotion recognition for human–computer interaction applications10.1007/s00521-021-06012-8 ↗
21. A brief review of facial emotion recognition based on visual information10.3390/s18020401 ↗
22. Automatic analysis of facial expressions: The state of the art10.1109/34.895976 ↗
23. Evolution of image segmentation using deep convolutional neural network: A survey10.1016/j.knosys.2020.106062 ↗
24. Single image super-resolution using deep CNN with dense skip connections and Inception-ResNet
25. Content-based image retrieval using GroupNormalized-Inception-Darknet-5310.1007/s13735-021-00215-4 ↗
26. Research on inception module incorporated siamese convolutional neural networks to realize face recognition10.1109/ACCESS.2019.2963211 ↗
27. Face recognition under mask-wearing based on residual inception networks
28. Face detection with different scales based on Faster R-CNN10.1109/TCYB.2018.2859482 ↗
29. Face detection with the faster R-CNN
30. Faster region-based convolutional neural network for mask face detection
31. Zhu · Deep Learning for Biometrics. Advances in Computer Vision and Pattern Recognition · 2017
32. Face detection using deep learning: An improved faster RCNN approach10.1016/j.neucom.2018.03.030 ↗
33. H. Wang, Z. Li, X. Ji, and Y. Wang, “Face R-CNN,” arXiv preprint arXiv:1706.01061, 2017.
34. Probabilistic Faster R-CNN with stochastic region proposing: Towards object detection and recognition in remote sensing imagery10.1016/j.neucom.2021.06.072 ↗
35. Design and implementation of an object detection system using Faster R-CNN
36. Facial expression recognition method based on deep convolutional neural network combined with improved LBP features10.1007/s00779-019-01238-9 ↗
37. Stacked deep convolutional auto-encoders for emotion recognition from facial expressions
38. Occlusion aware facial expression recognition using CNN with an attention mechanism”10.1109/TIP.2018.2886767 ↗
39. Hybrid deep neural networks for face emotion recognition10.1016/j.patrec.2018.04.010 ↗
40. Facial expression recognition method based on sparse batch normalization CNN
41. A facial expression recognition system using robust face features from depth videos and deep learning10.1016/j.compeleceng.2017.04.019 ↗
42. Multi angle optimal pattern-based deep learning for automatic facial expression recognition10.1016/j.patrec.2017.06.025 ↗