journal article·2021Open access

Race Classification Using Deep Learning

Khalil Khan, Rehan Ullah Khan, Jehad Ali, Irfan Uddin, Sahib Khan, Byeong-hee Roh

Computers, Materials & Continua· Volume 68· Issue 3

Abstract

Race classification is a long-standing challenge in the field of face image analysis. The investigation of salient facial features is an important task to avoid processing all face parts. Face segmentation strongly benefits several face analysis tasks, including ethnicity and race classification. We propose a race-classification algorithm using a prior face segmentation framework. A deep convolutional neural network (DCNN) was used to construct a face segmentation model. For training the DCNN, we label face images according to seven different classes, that is, nose, skin, hair, eyes, brows, back, and mouth. The DCNN model developed in the first phase was used to create segmentation results. The probabilistic classification method is used, and probability maps (PMs) are created for each semantic class. We investigated five salient facial features from among seven that help in race classification. Features are extracted from the PMs of five classes, and a new model is trained based on the DCNN. We assessed the performance of the proposed race classification method on four standard face datasets, reporting superior results compared with previous studies.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Speech and Audio Processing · Speech Recognition and Synthesis · Handwritten Text Recognition Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (48)

Show source-provided references
1. Race classification from face using deep convolutional neural networks
2. On combining face local appearance and geometrical features for race classification
3. Considering race a problem of transfer learning
4. Analysis of morphous characteristics of facial reconstruction and the five organs in Chinese north five national minorities crowd
5. Facial feature discovery for ethnicity recognition
6. Xiii. on the apparent direction of ryes in a portrait10.1098/rstl.1824.0016 ↗
7. Towards unconstrained face recognition
8. Multi-class semantic segmentation of faces
9. Multiclass semantic segmentation of faces using CRFs10.3906/elk-1607-332 ↗
10. On partial least squares in head pose estimation: How to simultaneously deal with misalignment
11. Head pose estimation in computer vision: A survey10.1109/TPAMI.2008.106 ↗
12. Facial feature discovery for ethnicity recognition
13. Davies · Perceiving and remembering faces · 1981
14. Face recognition by humans: Nineteen results all computer vision researchers should know about10.1109/JPROC.2006.884093 ↗
15. Hierarchical face parsing via deep learning
16. Top-down sampling convolution network for face segmentation
17. 3D head pose estimation with convolutional neural network trained on synthetic images
18. Label faces: Parsing facial features by multiclass labeling with an epitome prior
19. Tracking the visual focus of attention for a varying number of wandering people10.1109/TPAMI.2007.70773 ↗
20. A CNN cascade for landmark guided semantic part segmentation
21. HCP: A flexible CNN framework for multi-label image classification
22. Mixture of experts for classification of gender, ethnic origin, and pose of human faces10.1109/72.857774 ↗
23. Gender and ethnic classification of facial images
24. The FERET database and evaluation procedure for face-recognition algorithms10.1016/S0262-8856(97)00070-X ↗
25. Ethnicity identification from face images10.1117/12.542847 ↗
26. Real-time race classification system
27. The CAS-PEAL large-scale Chinese face database and baseline evaluations10.1109/TSMCA.2007.909557 ↗
28. Race classification based on facial features
29. Facial part displacement effect on template-based gender and ethnicity classification
30. Lifespan database of adult facial stimuli10.3758/BF03206543 ↗
31. Fusing local binary patterns with wavelet features for ethnicity identification
32. A robust approach to facial ethnicity classification on large scale face databases
33. Demographic estimation from face images: Human vs. machine performance
34. Real-time facial segmentation and performance capture from rgb input
35. Pose aligned networks for deep attribute modeling
36. A unified framework for head pose, age and gender classification through end-to-end face segmentation10.3390/e21070647 ↗
37. Learned features are better for ethnicity classification10.1515/cait-2017-0036 ↗
38. Ssd: Single shot multibox detector
39. Deep learning
40. Scikit-learn: Machine learning in Python
41. Race recognition using deep convolutional neural networks10.3390/sym10110564 ↗
42. Benchmarking deep network architectures for ethnicity recognition using a new large face dataset
43. Vggface2: A dataset for recognising faces across pose and age
44. Race classification from face images using local descriptors10.1142/S0218213012500194 ↗
45. Sarfaraz · Data Engineering and Intelligent Computing · 2018 · 217
46. Face modeling with first name attributes10.1109/TPAMI.2014.2302443 ↗
47. Automatic age estimation based on facial aging patterns10.1109/TPAMI.2007.70733 ↗
48. Large-scale video classification with convolutional neural networks