Emotion Recognition from Occluded Facial Images Using Deep Ensemble燤odel
Source abstract
Abstract
Facial expression recognition has been a hot topic for decades, but high intraclass variation makes it challenging. To overcome intraclass variation for visual recognition, we introduce a novel fusion methodology, in which the proposed model first extract features followed by feature fusion. Specifically, RestNet-50, VGG-19, and Inception-V3 is used to ensure feature learning followed by feature fusion. Finally, the three feature extraction models are utilized using Ensemble Learning techniques for final expression classification. The representation learnt by the proposed methodology is robust to occlusions and pose variations and offers promising accuracy. To evaluate the efficiency of the proposed model, we use two wild benchmark datasets Real-world Affective Faces Database (RAF-DB) and AffectNet for facial expression recognition. The proposed model classifies the emotions into seven different categories namely: happiness, anger, fear, disgust, sadness, surprise, and neutral. Furthermore, the performance of the proposed model is also compared with other algorithms focusing on the analysis of computational cost, convergence and accuracy based on a standard problem specific to classification applications.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Emotion and Mood Recognition · Face and Expression Recognition · Face recognition and analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (52)
Show source-provided references
1. Facial emotion recognition in schizophrenia10.3389/fpsyt.2021.633717 ↗
2. On the effectiveness of facial expression recognition for evaluation of urban sound perception10.1016/j.scitotenv.2019.135484 ↗
3. Emotion recognition in human computer interaction10.1109/79.911197 ↗
4. Improved transfer-learning-based facial recognition framework to detect autistic children at an early stage10.3390/brainsci11060734 ↗
5. Fear-type emotion recognition for future audio-based surveillance systems10.1016/j.specom.2008.03.012 ↗
6. Computational assessment of facial expression production in ASD children10.3390/s18113993 ↗
7. A new method of 3D facial expression animation
8. Emotion recognition from speech using MFCC and DWT for security system
9. Emotion recognition from EEG using higher order crossings10.1109/TITB.2009.2034649 ↗
10. Going deeper in facial expression recognition using deep neural networks
11. Facial expression recognition via a boosted deep belief network
12. Emotion recognition from text using semantic labels and separable mixture models10.1145/1165255.1165259 ↗
13. Speech emotion recognition using deep neural network and extreme learning machine
14. Courville · FER-2013 face database · 2013
15. The Japanese Female Facial Expression (JAFFE) database
16. Unsupervised pre-trained filter learning approach for efficient convolution neural network10.1016/j.neucom.2019.06.084 ↗
17. Do deep neural networks learn facial action units when doing expression recognition?
18. End-to-end multimodal emotion recognition using deep neural networks10.1109/JSTSP.2017.2764438 ↗
19. A computerized analysis of facial expression: Feasibility of automated discrimination
20. Visualizing and understanding convolutional networks
21. Constants across cultures in the face and emotion10.1037/h0030377 ↗
22. Ekman · Facial action coding system: A technique for the measurement of facial movement · 1978
23. Recognizing facial expression: Machine learning and application to spontaneous behavior
24. Haar features for FACS AU recognition
25. Facial expression recognition based on local binary patterns: A comprehensive study10.1016/j.imavis.2008.08.005 ↗
26. Method and means for recognizing complex patterns
27. Facial expression recognition based on facial components detection and hog features
28. Training deep networks for facial expression recognition with crowd-sourced label distribution
29. Incremental boosting convolutional neural network for facial action unit recognition
30. Identity-aware convolutional neural network for facial expression recognition
31. FERAtt: Facial expression recognition with attention net
32. Suppressing uncertainties for large-scale facial expression recognition
33. Region attention networks for pose and occlusion robust facial expression recognition10.1109/TIP.2019.2956143 ↗
34. A lightweight CNN based on transfer learning for COVID-19 diagnosis10.32604/cmc.2022.024589 ↗
35. Reliable crowdsourcing and deep locality-preserving learning for expression recognition in the wild
36. Affectnet: A database for facial expression, valence, and arousal computing in the wild10.1109/TAFFC.2017.2740923 ↗
37. Very deep convolutional networks for large-scale image recognition
38. Deep residual learning for image recognition
39. Rethinking the inception architecture for computer vision
40. ModPSO-CNN: An evolutionary convolution neural network with application to visual recognition10.1007/s00500-020-05288-7 ↗
41. Deep learning models for intelligent healthcare: implementation and challenges
42. CSFL: A novel unsupervised convolution neural network approach for visual pattern classification10.3233/AIC-170739 ↗
43. Face recognition: A novel un-supervised convolutional neural network method
44. Optimization of CNN through novel training strategy for visual classification problems10.3390/e20040290 ↗
45. Expression empowered residen network for facial action unit detection
46. Occluded facial expression recognition enhanced through privileged information
47. Patch-gated CNN for occlusion-aware facial expression recognition
48. A discriminative feature learning approach for deep face recognition
49. Annealed label transfer for face expression recognition
50. Occlusion aware facial expression recognition using CNN with attention mechanism10.1109/TIP.2018.2886767 ↗
51. Occlusion-adaptive deep network for robust facial expression recognition
52. Generative image inpainting with contextual attention