Deep Convolutional Neural Network-Based Approaches for Face Recognition
Source abstract
Abstract
Face recognition (FR) is defined as the process through which people are identified using facial images. This technology is applied broadly in biometrics, security information, accessing controlled areas, keeping of the law by different enforcement bodies, smart cards, and surveillance technology. The facial recognition system is built using two steps. The first step is a process through which the facial features are picked up or extracted, and the second step is pattern classification. Deep learning, specifically the convolutional neural network (CNN), has recently made commendable progress in FR technology. This paper investigates the performance of the pre-trained CNN with multi-class support vector machine (SVM) classifier and the performance of transfer learning using the AlexNet model to perform classification. The study considers CNN architecture, which has so far recorded the best outcome in the ImageNet Large-Scale Visual Recognition Challenge (ILSVRC) in the past years, more specifically, AlexNet and ResNet-50. In order to determine performance optimization of the CNN algorithm, recognition accuracy was used as a determinant. Improved classification rates were seen in the comprehensive experiments that were completed on the various datasets of ORL, GTAV face, Georgia Tech face, labelled faces in the wild (LFW), frontalized labeled faces in the wild (F_LFW), YouTube face, and FEI faces. The result showed that our model achieved a higher accuracy compared to most of the state-of-the-art models. An accuracy range of 94% to 100% for models with all databases was obtained. Also, this was obtained with an improvement in recognition accuracy up to 39%.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Face recognition and analysis · Face and Expression Recognition · Biometric Identification and Security
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Computer Science Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
Electrical Engineering Department, Faculty of Engineering at Shoubra, Benha University, Cairo 11629, Egypt
References (60)
Show source-provided references
1. Deep Learning for Audio Signal Processing10.1109/JSTSP.2019.2908700 ↗
2. Computer vision and deep learning–based data anomaly detection method for structural health monitoring10.1177/1475921718757405 ↗
3. Xue, J., Han, J., Zheng, T., Gao, X., and Guo, J. (2019). A Multi-Task Learning Framework for Overcoming the Catastrophic Forgetting in Automatic Speech Recognition. arXiv.
4. Imran, J., and Raman, B. (2019). Deep motion templates and extreme learning machine for sign language recognition. Vis. Comput.10.1007/s00371-019-01725-3 ↗
5. Multi Modal Spatio Temporal Co-Trained CNNs with Single Modal Testing on RGB–D based Sign Language Gesture Recognition10.1016/j.cola.2019.04.002 ↗
6. Al-Emadi, S., Al-Ali, A., Mohammad, A., and Al-Ali, A. (2019, January 24–28). Audio Based Drone Detection and Identification using Deep Learning. Proceedings of the 2019 15th International Wireless Communications & Mobile Computing Conference (IWCMC), Tangier, Morocc.10.1109/IWCMC.2019.8766732 ↗
7. Prasad, P.S., Pathak, R., Gunjan, V.K., and Rao, H.V.R. (2019). Deep Learning Based Representation for Face Recognition, Springer.10.1007/978-981-13-8715-9_50 ↗
8. Hu, G., Yang, Y., Yi, D., Kittler, J., Christmas, W., Li, S.Z., and Hospedales, T. (2015, January 11–12). When face recognition meets with deep learning: An evaluation of convolutional neural networks for face recognition. Proceedings of the IEEE International Conference on Computer Vision Workshops, Santiago, Chile.10.1109/ICCVW.2015.58 ↗
9. Kshirsagar, V.P., Baviskar, M.R., and Gaikwad, M.E. (2011, January 11–13). Face recognition using Eigenfaces. Proceedings of the 2011 3rd International Conference on Computer Research and Development, Shanghai, China.10.1109/ICCRD.2011.5764137 ↗
10. Face recognition by independent component analysis10.1109/TNN.2002.804287 ↗
11. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns10.1109/TPAMI.2002.1017623 ↗
12. A physiognomy based method for facial feature extraction and recognition10.1016/j.jvlc.2017.09.006 ↗
13. Taigman, Y., Yang, M., Ranzato, M., and Wolf, L. (2014, January 23–28). Deepface: Closing the gap to human-level performance in face verification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.220 ↗
14. Investigation on deep learning for off-line handwritten Arabic character recognition10.1016/j.cogsys.2017.11.002 ↗
15. Boser, B.E., Guyon, I.M., and Vapnik, V.N. (1992, January 27–29). A training algorithm for optimal margin classifiers. Proceedings of the Fifth Annual Workshop on Computational Learning Theory, Pittsburgh, PA, USA.10.1145/130385.130401 ↗
16. (2019, April 06). ORL Face Database. Available online: http://www.uk.research.att.com/facedatabase.html.
17. Tarres, F., and Rama, A. (2019, April 06). GTAV Face Database. Available online: https://gtav.upc.edu/en/research-areas/face-database.
18. Nefian, A.V. (2019, April 06). Georgia Tech Face Database. Available online: http://www.anefian.com/research/face_reco.htm.
19. Thomaz, C.E. (2019, April 06). FEI Face Database. Available online: https://fei.edu.br/~cet/facedatabase.html.
20. Huang, G.B., Ramesh, M., Berg, T., and Learned-Miller, E. (2019, September 01). Available online: https://hal.inria.fr/inria-00321923.
21. (2019, April 06). Frontalized Faces in the Wild. Available online: https://www.micc.unifi.it/resources/datasets/frontalized-faces-in-the-wild/.
22. Wolf, L., Hassner, T., and Maoz, I. (2011, January 20–25). Face recognition in unconstrained videos with matched background similarity. Proceedings of the Computer Vision and Pattern Recognition (CVPR), Colorado Springs, CO, USA.10.1109/CVPR.2011.5995566 ↗
23. LeCun, Y., Kavukcuoglu, K., and Farabet, C. (June, January 30). Convolutional networks and applications in vision. Proceedings of the 2010 IEEE International Symposium on Circuits and Systems, Paris, France.10.1109/ISCAS.2010.5537907 ↗
24. LeCun, Y., Boser, B.E., Denker, J.S., Henderson, D., Howard, R.E., Hubbard, W.E., and Jackel, L.D. (1990, January 26–29). Handwritten digit recognition with a back-propagation network. Proceedings of the Advances in Neural Information Processing Systems, Denver, CO, USA.
25. Postorino, M.N., and Sarne, G.M.L. (2011, January 27–29). A neural network hybrid recommender system. Proceedings of the 2011 Conference on Neural Nets WIRN10, Salerno, Italy.
26. Ciresan, D.C., Meier, U., Masci, J., Gambardella, L.M., and Schmidhuber, J. (2011, January 16–22). Flexible, high performance convolutional neural networks for image classification. Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence, Catalonia, Spain.
27. Xie, Y., Le, L., Zhou, Y., and Raghavan, V.V. (2018). Deep Learning for Natural Language Processing. Handbook of Statistics, Elsevier.10.1016/bs.host.2018.05.001 ↗
28. Kumar, R. (2017). Natural language processing. Machine Learning and Cognition in Enterprises, Springer.10.1007/978-1-4842-3069-5 ↗
29. Rojas, R. (2013). Neural Networks: A Systematic Introduction, Springer.
30. (2019, May 08). Karpathy CS231n Convolutional Neural Networks for Visual Recognition. Available online: http://cs231n.github.io/convolutional-networks/.
31. Boureau, Y.-L., Ponce, J., and LeCun, Y. (2010, January 21–24). A theoretical analysis of feature pooling in visual recognition. Proceedings of the 27th International Conference on Machine Learning, Haifa, Israel.
32. Scherer, D., Müller, A., and Behnke, S. (2010, January 15–18). Evaluation of pooling operations in convolutional architectures for object recognition. Proceedings of the International Conference on Artificial Neural Networks, Thessaloniki, Greece.10.1007/978-3-642-15825-4_10 ↗
33. Wu, H., and Gu, X. (2015, January 9–12). Max-pooling dropout for regularization of convolutional neural networks. Proceedings of the International Conference on Neural Information Processing, Istanbul, Turkey.10.1007/978-3-319-26532-2_6 ↗
34. Spatial pyramid pooling in deep convolutional networks for visual recognition10.1109/TPAMI.2015.2389824 ↗
35. Ouyang, W., Wang, X., Zeng, X., Qiu, S., Luo, P., Tian, Y., and Tang, X. (2015, January 7–12). Deepid-net: Deformable deep convolutional neural networks for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298854 ↗
36. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012, January 3–6). Imagenet classification with deep convolutional neural networks. Proceedings of the Advances in Neural Information Processing Systems, Lake Tahoe, CA, USA.
37. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
38. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
39. Face biometric quality assessment via light CNN10.1016/j.patrec.2017.07.015 ↗
40. Hybrid deep learning for computing face similarities
41. Newborn face recognition using deep convolutional neural network10.1007/s11042-016-4342-x ↗
42. Face recognition using both visible light image and near-infrared image and a deep network10.1016/j.trit.2017.03.001 ↗
43. Hu, H., Afaq, S., Shah, A., Bennamoun, M., and Molton, M. (2017, January 5–8). 2D and 3D Face Recognition Using Convolutional Neural Network. Proceedings of the TENCON 2017 IEEE Region 10 Conference, Penang, Malaysia.10.1109/TENCON.2017.8227850 ↗
44. Nam, G.P., Choi, H., and Cho, J. (2018). PSI-CNN: A Pyramid-Based Scale-Invariant CNN Architecture for Face Recognition Robust to Various Image Resolutions. Appl. Sci., 8.10.3390/app8091561 ↗
45. Khan, S., Javed, M.H., Ahmed, E., Shah, S.A.A., and Ali, S.U. (2019, January 9–10). Networks and Implementation on Smart Glasses. Proceedings of the 2019 International Conference on Information Science and Communication Technology (ICISCT), Karachi, Pakistan.
46. Identity Recognition Based on Face Image10.1088/1742-6596/1302/3/032049 ↗
47. Deep Representations for Iris, Face, and Fingerprint Spoofing Detection10.1109/TIFS.2015.2398817 ↗
48. Improved RGB-D-T based face recognition10.1049/iet-bmt.2015.0057 ↗
49. Deep Face Recognition
50. Zhu, Z., Luo, P., Wang, X., and Tang, X. (2014). Recover canonical-view faces in the wild with deep neural networks. arXiv.
51. Guo, S., Chen, S., and Li, Y. (2016, January 1–3). Face recognition based on convolutional neural network & support vector machine. Proceedings of the 2016 IEEE International Conference on Information and Automation (ICIA), Ningbo, China.10.1109/ICInfA.2016.7832107 ↗
52. Face recognition: A convolutional neural-network approach10.1109/72.554195 ↗
53. Sun, Y., Wang, X., and Tang, X. (2014, January 23–28). Deep Learning Face Representation from Predicting 10,000 Classes. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.244 ↗
54. Sun, Y., Chen, Y., Wang, X., and Tang, X. (2014, January 8–13). Deep Learning Face Representation by Joint Identification-Verification. Proceedings of the Advances in Neural Information Processing Systems 27, Montreal, QC, Canada.
55. Sun, Y., Wang, X., and Tang, X. (2015, January 7–12). Deeply Learned Face Representations Are Sparse, Selective, and Robust. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298907 ↗
56. Deep Coupled ResNet for Low-Resolution Face Recognition10.1109/LSP.2018.2810121 ↗
57. Ferrari, C., Lisanti, G., Berretti, S., and del Bimbo, A. (2016, January 4–8). Effective 3D based frontalization for unconstrained face recognition. Proceedings of the 2016 23rd International Conference on Pattern Recognition (ICPR), Cancun, Mexico.10.1109/ICPR.2016.7899774 ↗
58. Adaptive Convolutional Neural Network and Its Application in Face Recognition10.1007/s11063-015-9420-y ↗
59. Single-sample face recognition based on intra-class differences in a variation model10.3390/s150101071 ↗
60. Chui, K., and Lytras, M.D. (2019). A Novel MOGA-SVM Multinomial Classification for Organ Inflammation Detection. Appl. Sci., 9.10.3390/app9112284 ↗