A Sequential GAN–CNN–FUZZY Framework for Robust Face Recognition and Attentiveness Analysis in E-Learning
Source abstract
Abstract
In modern e-learning environments, ensuring both student identity verification and concentration monitoring during online examinations has become increasingly important. This paper introduces a robust sequential framework that integrates Generative Adversarial Networks (GANs), Convolutional Neural Networks (CNNs) and fuzzy logic to achieve reliable face recognition and interpretable attentiveness assessment. Images from the Extended Yale B (cropped) dataset are preprocessed through grayscale normalization and resizing, while GANs generate synthetic variations in pose, illumination, and occlusion to enrich the training set and improve generalization. The CNN extracts discriminative facial features for identity recognition, and a fuzzy inference system transforms the CNN’s confidence scores into human-interpretable concentration levels. To stabilize learning and prevent overfitting, the model incorporates dropout regularization, batch normalization, and extensive data augmentation. Comprehensive evaluations using confusion matrices, ROC–AUC, and precision–recall analyses demonstrate an accuracy of 98.42%. The proposed framework offers a scalable and interpretable solution for secure and reliable online exam proctoring.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Academic integrity and plagiarism · Emotion and Mood Recognition · Face recognition and analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Laboratory of Research in Computer Science, Faculty of Sciences, Ibn Tofail University, Kenitra 14000, Morocco
References (25)
Show source-provided references
1. Improved FCN for partial face recognition with gallery, probe, and modified LBP-based texture features10.1007/s11042-023-16086-2 ↗
2. A novel fast hybrid face recognition approach using convolutional Kernel extreme learning machine with HOG feature extractor
3. Pose-Invariant Face Recognition via Facial Landmark Based Ensemble Learning10.1109/ACCESS.2023.3271997 ↗
4. Robust local binary pattern for face recognition in different challenges10.1007/s11042-022-13006-8 ↗
5. Create and implement a new method for robust video face recognition using convolutional neural network algorithms10.1016/j.prime.2023.100241 ↗
6. Taigman, Y., Yang, M., Ranzato, M., and Wolf, L. (2014, January 23–28). DeepFace: Closing the Gap to Human-Level Performance in Face Verification. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.220 ↗
7. Schroff, F., Kalenichenko, D., and Philbin, J. (2015, January 7–12). FaceNet: A Unified Embedding for Face Recognition and Clustering. Proceedings of the 2015 IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298682 ↗
8. Parkhi, O.M., Vedaldi, A., and Zisserman, A. (2015, January 7–10). Deep Face Recognition. Proceedings of the BMVC, Swansea, UK.
9. ArcFace: Additive Angular Margin Loss for Deep Face Recognition
10. Goodfellow, I., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative Adversarial Nets. arXiv.
11. Tran, L., Yin, X., and Liu, X. (2017, January 21–26). Disentangled Representation Learning GAN for Pose-Invariant Face Recognition. Proceedings of the CVPR, Honolulu, HI, USA.10.1109/CVPR.2017.141 ↗
12. Choi, Y., Choi, M., Kim, M., Ha, J.W., Kim, S., and Choo, J. (2018, January 18–22). StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation. Proceedings of the CVPR, Salt Lake City, UT, USA.10.1109/CVPR.2018.00916 ↗
13. A new facial age estimation method using centrally overlapped block based local texture features10.1007/s11042-017-4572-6 ↗
14. Zhang, L., Chu, R., Xiang, S., Liao, S., and Li, S.Z. (2007). Face detection based on Multi-Block LBP representation. Advances in Biometrics, Proceedings of the International Conference, ICB 2007, Seoul, Republic of Korea, 27–29 August 2007, Springer.10.1007/978-3-540-74549-5_2 ↗
15. Multiresolution grayscale and rotation invariant texture classification with local binary patterns10.1109/TPAMI.2002.1017623 ↗
16. Picha, S.G., Chanti, D.A., and Caplier, A. (2023, January 19–21). How far generated data can impact Neural Networks performance?. Proceedings of the 18th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, Lisbon, Portugal.
17. GAN Based Three-Stage-Training Algorithm for Multi-view Facial Expression Recognition10.1007/s11063-021-10591-x ↗
18. Revolutionizing online education: Advanced facial expression recognition for real-time student progress tracking via deep learning model10.1007/s11042-024-19392-5 ↗
19. Recognition of Learners’ Cognitive States using Facial Expressions in E-Learning Environments
20. Modeling adaptive E-Learning environment using facial expressions and fuzzy logic10.1016/j.eswa.2020.113460 ↗
21. Jadoon, R.N., Nadeem, A., Shafi, J., Khan, M.U., ELAffendi, M., Shah, S., and Ali, G. (2023). A Method for Predicting the Visual Attention Area in Real-Time Using Evolving Neuro-Fuzzy Models. Electronics, 12.10.3390/electronics12102243 ↗
22. Emotion recognition for enhanced learning: Using AI to detect students’ emotions and adjust teaching methods10.1186/s40561-025-00374-5 ↗
23. Facial Recognition Using Hidden Markov Model and Convolutional Neural Network10.3390/ai5030079 ↗
24. Low-cost embedded facial recognition system based on overlapped local binary pattern10.1016/j.prime.2025.100924 ↗
25. Soni, N., Sharma, E.K., and Kapoor, A. (2021). Novel BSSSO-Based Deep Convolutional Neural Network for Face Recognition with Multiple Disturbing Environments. Electronics, 10.10.3390/electronics10050626 ↗