Facial Expression Recognition with High Response-Based Local Directional Pattern (HR-LDP) Network
Source abstract
Abstract
Although lots of research has been done in recognizing facial expressions, there is still a need to increase the accuracy of facial expression recognition, particularly under uncontrolled situations. The use of Local Directional Patterns (LDP), which has good characteristics for emotion detection has yielded encouraging results. An innovative end-to-end learnable High Response-based Local Directional Pattern (HR-LDP) network for facial emotion recognition is implemented by employing fixed convolutional filters in the proposed work. By combining learnable convolutional layers with fixed-parameter HR-LDP layers made up of eight Kirsch filters and derivable simulated gate functions, this network considerably minimizes the number of network parameters. The cost of the parameters in our fully linked layers is up to 64 times lesser than those in currently used deep learning-based detection algorithms. On seven well-known databases, including JAFFE, CK+, MMI, SFEW, OULU-CASIA and MUG, the recognition rates for seven-class facial expression recognition are 99.36%, 99.2%, 97.8%, 60.4%, 91.1% and 90.1%, respectively. The results demonstrate the advantage of the proposed work over cutting-edge techniques.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Face and Expression Recognition
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (47)
Show source-provided references
1. A comprehensive review of facial expression recognition techniques10.1007/s00530-022-00984-w ↗
2. A comprehensive survey on deep facial expression recognition: Challenges, applications, and future guidelines10.1016/j.aej.2023.01.017 ↗
3. Deep learning-based facial emotion recognition for human-computer interaction applications
4. Facial emotion recognition using convolutional neural networks (FERC)10.1007/s42452-020-2234-1 ↗
5. Facial emotion recognition using deep convolutional neural network
6. Facial emotion recognition using transfer learning in the deep CNN10.3390/electronics10091036 ↗
7. Facial emotion recognition using convolution neural network
8. Deep-emotion: Facial expression recognition using attentional convolutional network10.3390/s21093046 ↗
9. Y. Khaireddin and Z. Chen, “Facial emotion recognition: State of the art performance on FER2013,” arXiv preprint arXiv:2105.03588, 2021.
10. A discriminatively deep fusion approach with improved conditional GAN (im-cGAN) for facial expression recognition10.1016/j.patcog.2022.109157 ↗
11. WOA-TLBO: Whale optimization algorithm with teaching-learning-based optimization for global optimization and facial emotion recognition10.1016/j.asoc.2021.107623 ↗
12. Facial expression recognition with convolutional neural networks via a new face cropping and rotation strategy10.1007/s00371-019-01627-4 ↗
13. Fine-grained image analysis for facial expression recognition using deep convolutional neural networks with bilinear pooling10.1016/j.asoc.2023.109997 ↗
14. A novel monogenic Sobel directional pattern (MSDP) and enhanced bat algorithm-based optimization (BAO) with Pearson mutation (PM) for facial emotion recognition10.3390/electronics12040836 ↗
15. Hybrid deep neural networks for face emotion recognition10.1016/j.patrec.2018.04.010 ↗
16. A generic deep architecture for single image reflection removal and image smoothing
17. Mind the class weight bias: Weighted maximum mean discrepancy for unsupervised domain adaptation
18. Deep convolutional neural networks for facial expression recognition
19. Deep learning based facial expression recognition using improved cat swarm optimization10.1007/s12652-020-02463-4 ↗
20. Incremental face alignment in the wild
21. HistNet: Histogram-based convolutional neural network with Chi-squared deep metric learning for facial expression recognition10.1016/j.ins.2022.06.092 ↗
22. Local binary convolutional neural networks
23. Face spoofing detection with local binary pattern network10.1016/j.jvcir.2018.05.009 ↗
24. Local directional pattern (LDP) for face recognition
25. Local directional texture pattern image descriptor10.1016/j.patrec.2014.08.012 ↗
26. Coding facial expressions with gabor wavelets
27. The extended cohn-kanade dataset (CK): A complete dataset for action unit and emotion-specified expression
28. Facial expression recognition from near-infrared videos10.1016/j.imavis.2011.07.002 ↗
29. Web-based database for facial expression analysis
30. Induced disgust, happiness and surprise: An addition to the mmi facial expression database
31. The MUG facial expression database
32. Emotion recognition in the wild challenge 2014: Baseline, data and protocol
33. Collecting large, richly annotated facial expression databases from movies10.1109/MMUL.2012.26 ↗
34. Face expression recognition with a 2-channel convolutional neural network
35. Facial expression recognition via a boosted deep belief network
36. C. Turan, K. M. Lam, and X. He, “Soft locality preserving map (SLPM) for facial expression recognition,” arXiv preprint arXiv:1801.03754, 2018.
37. W. Wang et al., “A fine-grained facial expression database for end-to-end multi-pose facial expression recognition,” arXiv preprint arXiv:1907.10838, 2019.
38. A ROI-guided deep architecture for robust facial expressions recognition10.1016/j.ins.2020.02.047 ↗
39. Facial expression recognition by de-expression residue learning
40. From facial expression recognition to interpersonal relation prediction10.1007/s11263-017-1055-1 ↗
41. Deep multi-task learning for facial expression recognition and synthesis based on selective feature sharing
42. Discriminative deep multi-task learning for facial expression recognition10.1016/j.ins.2020.04.041 ↗
43. A. Dosovitski et al., “An image is worth 16x16 words: Transformers for image recognition at scale,” arXiv preprint arXiv:2010.11929, 2020.
44. Multi-EmoNet: A novel multi-task neural network for driver emotion recognition10.1016/j.ifacol.2021.04.155 ↗
45. Landmark guidance independent spatio-channel attention and complementary context information based facial expression recognition10.1016/j.patrec.2021.01.029 ↗
46. Z. Qawaqneh, A. A. Mallouh and B. D. Barkana, “Deep convolutional neural network for age estimation based on VGG-face model,” arXiv preprint arXiv:1709.01664, 2017.
47. FaceNet: A unified embedding for face recognition and clustering