journal article·2024Open access

CapsNet-FR: Capsule Networks for Improved Recognition of Facial Features

Mahmood Ul Haq, Muhammad Athar Javed Sethi, Najib Ben Aoun, Ala Saleh Alluhaidan, Sadique Ahmad, Zahid farid

Computers, Materials & Continua· Volume 79· Issue 2

Abstract

Face recognition (FR) technology has numerous applications in artificial intelligence including biometrics, security, authentication, law enforcement, and surveillance. Deep learning (DL) models, notably convolutional neural networks (CNNs), have shown promising results in the field of FR. However CNNs are easily fooled since they do not encode position and orientation correlations between features. Hinton et al. envisioned Capsule Networks as a more robust design capable of retaining pose information and spatial correlations to recognize objects more like the brain does. Lower-level capsules hold 8-dimensional vectors of attributes like position, hue, texture, and so on, which are routed to higher-level capsules via a new routing by agreement algorithm. This provides capsule networks with viewpoint invariance, which has previously evaded CNNs. This research presents a FR model based on capsule networks that was tested using the LFW dataset, COMSATS face dataset, and own acquired photos using cameras measuring 128 × 128 pixels, 40 × 40 pixels, and 30 × 30 pixels. The trained model outperforms state-of-the-art algorithms, achieving 95.82% test accuracy and performing well on unseen faces that have been blurred or rotated. Additionally, the suggested model outperformed the recently released approaches on the COMSATS face dataset, achieving a high accuracy of 92.47%. Based on the results of this research as well as previous results, capsule networks perform better than deeper CNNs on unobserved altered data because of their special equivariance properties.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Face recognition and analysis · Biometric Identification and Security · Face and Expression Recognition

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (57)

Show source-provided references
1. A robust face recognition method for occluded and low-resolution images
2. An empirical study of image resolution and pose on automatic face recognition
3. Depth map denoising network and lightweight fusion network for enhanced 3D face recognition10.1016/j.patcog.2023.109936 ↗
4. COMSATS face: A dataset of face images with pose variations, its design, and aspects
5. A novel comparative case study of entropy generation for natural convection flow of proportional-Caputo hybrid and Atangana baleanu fractional derivative
6. Attention-based spatial-temporal multi-scale network for face anti-spoofing10.1109/TBIOM.2021.3066983 ↗
7. A review of convolutional neural network architectures and their optimizations10.1007/s10462-022-10213-5 ↗
8. FACILE: A capsule network with fewer capsules and richer hierarchical information for malware image classification10.1016/j.cose.2023.103606 ↗
9. Face recognition for occluded face with mask region convolutional neural network and fully convolutional network: A literature review
10. Robust physical-world attacks on face recognition10.1016/j.patcog.2022.109009 ↗
11. On the effect of selfie beautification filters on face detection and recognition10.1016/j.patrec.2022.09.018 ↗
12. Capsule network with its limitation, modification, and applications—A survey10.3390/make5030047 ↗
13. Multi-layer capsule network with joint dynamic routing for fire recognition10.1016/j.imavis.2023.104825 ↗
14. Synthetic data for face recognition: Current state and future prospects10.1016/j.imavis.2023.104688 ↗
15. Multi-level feature fusion capsule network with self-attention for facial expression recognition10.1117/1.JEI.32.2.023038 ↗
16. A facial recognition using a combination of a novel one dimension deep CNN and LDA
17. A lightweight CNN-based algorithm and implementation on embedded system for real-time face recognition10.1007/s00530-022-00973-z ↗
18. Deep roto-translation scattering for object classification
19. Harmonic networks: Deep translation and rotation equivariance
20. Transforming auto-encoders10.1007/978-3-642-21735-7_6 ↗
21. Stacked capsule autoencoders
22. Dynamic routing between capsules
23. Matrix capsules with EM routing
24. 3D point capsule networks
25. Group equivariant capsule networks
26. DeepCaps: Going deeper with capsule networks
27. FlowCaps: Optical flow estimation with capsule networks for action recognition
28. A novel capsule network based on wide convolution and multi-scale convolution for fault diagnosis10.3390/app10103659 ↗
29. Intelligent system for leaf disease detection using capsule networks for horticulture10.3233/JIFS-210593 ↗
30. IR-capsule: Two-stream network for face forgery detection10.1007/s12559-022-10008-4 ↗
31. Attention-based deformable convolutional network for Chinese various dynasties character recognition10.1016/j.eswa.2023.121881 ↗
32. Blockchain-federated and deep-learning-based ensembling of capsule network with incremental extreme learning machines for classification of COVID-19 using CT scans
33. Attention-based spatial-temporal multi-scale network for face anti-spoofing10.1109/TBIOM.2021.3066983 ↗
34. SeVuc: A study on the security vulnerabilities of capsule networks against adversarial attacks10.1016/j.micpro.2022.104738 ↗
35. W. Jaiswal, Y. AbdAlmageed, Y. Wu, and P. Natarajan, “CapsuleGAN: Generative adversarial capsule network,” Cornell Univ., Feb. 2018. doi: 10.48550/arxiv.1802.06167.10.1007/978-3-030-11015-4_38 ↗
36. Fast CapsNet for lung cancer screening10.1007/978-3-030-00934-2_82 ↗
37. Remote sensing image scene classification using CNN-CapsNet10.3390/rs11050494 ↗
38. FaceNet: A unified embedding for face recognition and clustering
39. Frontal to profile face verification in the wild
40. Wang · IEEE Transactions on Affective Computing · 2023
41. Pose aware RGBD-based face recognition system with hierarchical bilinear pooling
42. Realistic feature perception for face frontalization with dual-mode face transformation10.1016/j.eswa.2023.121344 ↗
43. Total capture: A 3D deformation model for tracking faces, hands, and bodies,
44. Towards pose invariant face recognition in the wild
45. Deformable face net for pose invariant face recognition10.1016/j.patcog.2019.107113 ↗
46. Boosting the face recognition performance of ensemble based LDA for pose, non-uniform illuminations, and low-resolution images
47. MagFace: A universal representation for face recognition and quality assessment
48. Face recognition using Laplacianfaces10.1109/TPAMI.2005.55 ↗
49. Fisher vector faces in the wild
50. DeepFace: Closing the gap to human-level performance in face verification
51. Real-time goat face recognition using convolutional neural network10.1016/j.compag.2022.106730 ↗
52. Face localization and facial feature extraction based on shape and color information
53. Face localization and authentication using color and depth images10.1109/TIP.2004.840714 ↗
54. DLib-ML: A machine learning toolkit
55. Eigenfaces for recognition10.1162/jocn.1991.3.1.71 ↗
56. Ensemble-based discriminant learning with boosting for face recognition10.1109/TNN.2005.860853 ↗
57. Robust face recognition via multimodal deep face representation10.1109/TMM.2015.2477042 ↗