Study on Eye Gaze Detection Using Deep Transfer Learning Approaches
Source abstract
Abstract
Many applications, including security systems, medical diagnostics, and human-computer interfaces, depend on eye gaze recognition. However, due to factors including individual variations, occlusions, and shifting illumination conditions, real-world scenarios continue to provide difficulties for accurate and consistent eye gaze recognition. This work is aimed at investigating the potential benefits of employing transfer learning to improve eye gaze detection ability and efficiency. Transfer learning is the process of fine-tuning pre-trained models on smaller, domain-specific datasets after they have been trained on larger datasets. We study several transfer learning algorithms and evaluate their effectiveness on eye gaze identification, including both Regression and Classification tasks, using a range of deep learning architectures, namely AlexNet, Visual Geometry Group (VGG), InceptionV3, and ResNet. In this study, we evaluate the effectiveness of transfer learning-based models against models that were trained from scratch using eye-gazing datasets on grounds of various performance and loss metrics such as Precision, Accuracy, and Mean Absolute Error. We investigate the effects of different pre-trained models, dataset sizes, and domain gaps on the transfer learning process, and the findings of our study clarify the efficacy of transfer learning for eye gaze detection and offer suggestions for the most successful transfer learning strategies to apply in real-world situations.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Gaze Tracking and Assistive Technology
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (42)
Show source-provided references
1. Eye tracking biomarkers for autism spectrum disorder detection using machine learning and deep learning techniques: review10.1016/j.rasd.2023.102228 ↗
2. Exploring eye gaze visualization techniques for identifying distracted students in educational VR
3. Pupil detection and tracking using multiple light sources10.1016/S0262-8856(99)00053-0 ↗
4. Real-time human-computer interaction using eye gazes10.1016/j.mfglet.2023.07.024 ↗
5. Gaze estimation with semi-supervised eye landmark detection as an auxiliary task10.1016/j.patcog.2023.109980 ↗
6. Deep transfer learning-based gaze tracking for behavioral activity recognition10.1016/j.neucom.2021.06.100 ↗
7. EyeMU interactions: gaze + IMU gestures on mobile devices
8. Valliappan · Nat Commun · 2020 · 11 · 455310.1038/s41467-020-18360-5 ↗
9. Robust eye detection using deeply-learned gaze shifting path10.1016/j.jvcir.2018.07.013 ↗
10. Eye tracking algorithms, techniques, tools, and applications with an emphasis on machine learning and Internet of Things technologies10.1016/j.eswa.2020.114037 ↗
11. Eye gaze estimation: a survey on deep learning-based approaches10.1016/j.eswa.2022.116894 ↗
12. Convolutional neural network-based methods for eye gaze estimation: a survey10.1109/ACCESS.2020.3013540 ↗
13. Illumination-free gaze estimation method for first-person vision wearable device
14. Eye tracking to investigate cue processing in medical decision-making: a scoping review10.1016/j.chb.2016.09.022 ↗
15. Human gaze control during real-world scene perception10.1016/j.tics.2003.09.006 ↗
16. Eye gaze tracking using an active stereo head
17. A review on conventional machine learning vs deep learning
18. Real-time gaze estimation with online calibration10.1109/MMUL.2014.54 ↗
19. A crowdsourced system for robust eye tracking10.1016/j.jvcir.2019.01.007 ↗
20. Object-gaze distance: quantifying near-peripheral gaze behavior in real-world applications10.16910/jemr.14.1.5 ↗
21. Eye tracking reveals expertise-related differences in the time-course of medical image inspection and diagnosis10.1117/1.JMI.7.5.051203 ↗
22. Eye detection and coarse localization of pupil for video-based eye tracking systems10.1016/j.eswa.2023.121316 ↗
23. Robust pupil center detection using a curvature algorithm10.1016/S0169-2607(98)00105-9 ↗
24. FRCNN-GNB: cascade faster R-CNN with Gabor filters and Naïve Bayes for enhanced eye detection10.1109/ACCESS.2021.3052851 ↗
25. Robust and accurate pupil detection for head-mounted eye tracking10.1016/j.compeleceng.2021.107193 ↗
26. Remote eye gaze tracking research: a comparative evaluation on past and recent progress10.3390/electronics10243165 ↗
27. In the eye of the beholder: a survey of gaze tracking techniques10.1016/j.patcog.2022.108944 ↗
28. Krafka K, Khosla A, Kellnhofer P, Kannan H, Bhandarkar S, Matusik W, et al. Eye tracking for everyone. arXiv:1606.05814. 2016.10.1109/CVPR.2016.239 ↗
29. Deep learning based eye tracking on smartphones for dynamic visual stimuli10.1016/j.procs.2024.09.183 ↗
30. Driver gaze tracking and eyes off the road detection10.1016/j.matpr.2022.10.046 ↗
31. A method to estimate eye gaze direction when wearing glasses
32. The SBVPI dataset. [cited 2025 Jan 1]. Available from: http://sclera.fri.uni-lj.si/.
33. SSBC 2020: sclera segmentation benchmarking competition in the mobile environment
34. A comprehensive investigation into sclera biometrics: a novel dataset and performance study10.1007/s00521-020-04782-1 ↗
35. IPAD: iterative pruning with activation deviation for sclera biometrics10.1016/j.jksuci.2023.101630 ↗
36. Shah K. Eye-dataset. San Francisco, CA, USA: Kaggle; 2020. doi:10.34740/KAGGLE/DSV/1093317.
37. Imagenet classification with deep convolutional neural networks
38. Deep residual learning for image recognition
39. Rot · Handbook of vascular biometrics · 2019
40. An efficient deep sclera recognition framework with novel sclera segmentation, vessel extraction and gaze detection10.1016/j.image.2021.116349 ↗
41. Riccio · Progress in pattern recognition, image analysis, computer vision, and applications · 2018
42. OcularSeg: accurate and efficient multi-modal ocular segmentation in non-constrained scenarios10.3390/electronics13101967 ↗