journal article·2025-04-30Open access

YOLO Model-Based Eye Movement Detection During Closed-Eye State

Shigui Zhang, Junhui He, Yuanwen Zou

Applied Sciences· Volume 15· Issue 9

Abstract

Eye movement detection technology holds significant potential across medicine, psychology, and human–computer interaction. However, traditional methods, which primarily rely on tracking the pupil and cornea during the open-eye state, are ineffective when the eye is closed. To address this limitation, we developed a novel system capable of real-time eye movement detection even in the closed-eye state. Utilizing a micro-camera based on the OV9734 image sensor, our system captures image data to construct a dataset of eyelid images during ocular movements. We performed extensive experiments with multiple versions of the YOLO algorithm, including v5s, v8s, v9s, and v10s, in addition to testing different sizes of the YOLO v11 model (n < s < m < l < x), to achieve optimal performance. Ultimately, we selected YOLO11m as the optimal model based on its highest AP0.5 score of 0.838. Our tracker achieved a mean distance error of 0.77 mm, with 90% of predicted eye position distances having an error of less than 1.67 mm, enabling real-time tracking at 30 frames per second. This study introduces an innovative method for the real-time detection of eye movements during eye closure, enhancing and diversifying the applications of eye-tracking technology.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Gaze Tracking and Assistive Technology · EEG and Brain-Computer Interfaces · Retinal Imaging and Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Biomedical Engineering, Sichuan University, Chengdu 610065, China

References (37)

Show source-provided references
1. Eye movement disorders in movement disorders10.1002/mdc3.13413 ↗
2. Mao, Y., He, Y., Liu, L., and Chen, X. (2020). Disease classification based on eye movement features with decision tree and random forest. Front. Neurosci., 14.10.3389/fnins.2020.00798 ↗
3. Human eye tracking and related issues: A review
4. Mahanama, B., Jayawardana, Y., Rengarajan, S., Jayawardena, G., Chukoskie, L., Snider, J., and Jayarathna, S. (2022). Eye movement and pupil measures: A review. Front. Comp. Sci., 3.10.3389/fcomp.2021.733531 ↗
5. Best practices in eye tracking research10.1016/j.ijpsycho.2020.05.010 ↗
6. Fernandes, F., Barbalho, I., Bispo Junior, A., Alves, L., Nagem, D., Lins, H., Arrais Junior, E., Coutinho, K.D., Morais, A.H., and Santos, J.P.Q. (2023). Digital Alternative Communication for Individuals with amyotrophic lateral sclerosis: What we have. J. Clin. Med., 12.10.3390/jcm12165235 ↗
7. Efficient machine learning approach for volunteer eye-blink detection in real-time using webcam10.1016/j.eswa.2021.116073 ↗
8. Estrany, B., and Fuster-Parra, P. (2022). Human Eye Tracking Through Electro-Oculography (EOG): A Review, Springer International Publishing.10.1007/978-3-031-16538-2_8 ↗
9. Belkhiria, C., Boudir, A., Hurter, C., and Peysakhovich, V. (2022). Eog-based human–computer interface: 2000–2020 review. Sensors, 22.10.3390/s22134914 ↗
10. Belkhiria, C., and Peysakhovich, V. (2020). Electro-encephalography and electro-oculography in aeronautics: A review over the last decade (2010–2020). Front. Neuroergonomics, 1.10.3389/fnrgo.2020.606719 ↗
11. Deng, W., Huang, J., Kong, S., Zhan, Y., Lv, J., and Cui, Y. (2023). Pupil trajectory tracing from video-oculography with a new definition of pupil location. Biomed. Signal Process. Control, 79.10.1016/j.bspc.2022.104196 ↗
12. Automatic recording of the target location during smooth pursuit eye movement testing using video-oculography and deep learning-based object detection10.1167/tvst.10.6.1 ↗
13. Rojas, M., Lopez, J.A., Sosa, F.S., Velasco, C.R., Ponce, P., Balderas, D.C., and Molina, A. (2023, January 8–10). Design of a Low-Cost Prototype with 3D Printed Glasses for Real Time Eye-Tracking System. Proceedings of the 2023 10th International Conference on Electrical and Electronics Engineering (ICEEE), Istanbul, Turkiye.10.1109/ICEEE59925.2023.00017 ↗
14. Smartphones versus goggles for video-oculography: Current status and future direction10.21790/rvs.2024.009 ↗
15. Crafa, D.M., Di Giacomo, S., Natali, D., Fiorini, C., Carminati, M., Merigo, L., and Ongarello, T. (2024, January 23–25). IR Light Sensing at the Edges of Glasses Lenses for Invisible Eye Tracking. Proceedings of the 2024 IEEE Sensors Applications Symposium (SAS), Naples, Italy.10.1109/SAS60918.2024.10636540 ↗
16. Modi, N., and Singh, J. (2021). A review of various state of art eye gaze estimation techniques. Advances in Computational Intelligence and Communication Technology: Proceedings of Cict 2019, Springer.10.1007/978-981-15-1275-9_41 ↗
17. in Corneal reflection based eye tracking technology to overcome the limitations of infrared rays based eye tracking, AIP Conf
18. Low-noise magnetic coil system for recording 3-D eye movements10.1109/TIM.2020.3020682 ↗
19. Bell, A., Green, R., and Everitt, A. (2024, January 4–6). Measurement of Ocular Torsion Using Feature Matching on the Iris and Sclera. Proceedings of the 2024 39th International Conference on Image and Vision Computing New Zealand (IVCNZ), Christchurch, New Zealand.10.1109/IVCNZ64857.2024.10794482 ↗
20. Teiwes, W., Merfeld, D.M., Young, L.R., and Clarke, A.H. (2020). Comparison of the scleral search coil and video-oculography techniques for three-dimensional eye movement measurement. Three-Dimensional Kinematics of the Eye, Head and Limb Movements, Routledge.10.1201/9780203735701-51 ↗
21. Development of a new scleral contact lens with encapsulated photodetectors for eye tracking10.1364/OE.399823 ↗
22. Qian, K., Arichi, T., Price, A., Dall Orso, S., Eden, J., Noh, Y., Rhode, K., Burdet, E., Neil, M., and Edwards, A.D. (2021). An eye tracking based virtual reality system for use inside magnetic resonance imaging systems. Sci. Rep., 11.10.1038/s41598-021-95634-y ↗
23. Franceschiello, B., Di Sopra, L., Minier, A., Ionta, S., Zeugin, D., Notter, M.P., Bastiaansen, J.A., Jorge, J., Yerly, J., and Stuber, M. (2020). 3-Dimensional magnetic resonance imaging of the freely moving human eye. Prog. Neurobiol., 194.10.1016/j.pneurobio.2020.101885 ↗
24. Magnetic resonance-based eye tracking using deep neural networks10.1038/s41593-021-00947-w ↗
25. Two auto-detection methods for eye movements during eyes closed10.1046/j.1440-1819.2001.00823.x ↗
26. Differential eye movements in mild traumatic brain injury versus normal controls10.1097/HTR.0000000000000036 ↗
27. Leigh, R.J., and Zee, D.S. (2015). Disorders of ocular motility due to disease of the brainstem, cerebellum, and diencephalon. The Neurology of Eye Movements, Oxford University Press.10.1093/med/9780199969289.003.0013 ↗
28. Intra-operative electromyographic monitoring of extra-ocular motor nerves (Nn. III, VI) in skull base surgery10.1007/s007010170105 ↗
29. Novel method of intraoperative ocular movement monitoring using a piezoelectric device: Experimental study of ocular motor nerve activating piezoelectric potentials (OMNAPP) and clinical application for skull base surgeries10.1007/s10143-018-1028-z ↗
30. Vegetative state
31. Ting, W.K., Perez Velazquez, J.L., and Cusimano, M.D. (2014). Eye movement measurement in diagnostic assessment of disorders of consciousness. Front. Neurol., 5.10.3389/fneur.2014.00137 ↗
32. Deep face profiler (DeFaP): Towards explicit, non-restrained, non-invasive, facial and gaze comprehension10.1016/j.eswa.2024.124425 ↗
33. Surgical strategies for eyelid defect reconstruction: A review on principles and techniques10.1007/s40123-022-00533-8 ↗
34. Mathew, A., Amudha, P., and Sivakumari, S. (2021). Deep learning techniques: An overview. Advanced Machine Learning Technologies and Applications: Proceedings of Amlta 2020, Springer.10.1007/978-981-15-3383-9_54 ↗
35. Khanam, R., and Hussain, M. (2024). Yolov11: An overview of the key architectural enhancements. arXiv.
36. Rasheed, A.F., and Zarkoosh, M. (2024). YOLOv11 Optimization for Efficient Resource Utilization. arXiv.
37. Wang, C., and Liang, G. (2023, January 17–19). Overview of Research on Object Detection Based on YOLO. Proceedings of the 4th International Conference on Artificial Intelligence and Computer Engineering, Dalian, China.10.1145/3652628.3652671 ↗