A New Gaze Estimation Method Based on Homography Transformation Derived from Geometric Relationship
Source abstract
Abstract
In recent years, the gaze estimation system, as a new type of human-computer interaction technology, has received extensive attention. The gaze estimation model is one of the main research contents of the system. The quality of the model will directly affect the accuracy of the entire gaze estimation system. To achieve higher accuracy even with simple devices, this paper proposes an improved mapping equation model based on homography transformation. In the process of experiment, the model mainly uses the “Zhang Zhengyou calibration method” to obtain the internal and external parameters of the camera to correct the distortion of the camera, and uses the LM(Levenberg-Marquardt) algorithm to solve the unknown parameters contained in the mapping equation. After all the parameters of the equation are determined, the gaze point is calculated. Different comparative experiments are designed to verify the experimental accuracy and fitting effect of this mapping equation. The results show that the method can achieve high experimental accuracy, and the basic accuracy is kept within 0.6∘. The overall trend shows that the mapping method based on homography transformation has higher experimental accuracy, better fitting effect and stronger stability.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Gaze Tracking and Assistive Technology · Advanced Computing and Algorithms · Hand Gesture Recognition Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Guangdong Provincial Key Laboratory of Quantum Engineering and Quantum Materials, School of Physics and Telecommunication Engineering, South China Normal University, Guangzhou 510006, China
Guangdong-Hong Kong Joint Laboratory of Quantum Matter, South China Normal University, Guangzhou 510006, China
Guangdong Provincial Engineering Research Center for Optoelectronic Instrument, South China Normal University, Guangzhou 510006, China
SCNU Qingyuan Institute of Science and Technology Innovation Co. Ltd., Qingyuan 511517, China
Funding
National Natural Science Foundation of China · Science and Technology Project of Guangzhou, China · The National Natural Science Foundation of China Guangdong big data Science Center Project
References (51)
Show source-provided references
1. In the eye of the beholder: A survey of models for eyes and gaze10.1109/TPAMI.2009.30 ↗
2. Baluja, S., and Pomerleau, D. (1994). Non-Intrusive Gaze Tracking Using Artificial Neural Networks. Advances in Neural Information Processing Systems 6, ACM. DTIC Document.
3. Eye tracking on unmodified common tablets: Challenges and solutions
4. Xu, L., Machin, D., and Sheppard, P. (1998, January 1). A novel approach to real-time non-intrusive gaze finding. Proceedings of the British Machine Vision Conference (BMVC), York, UK.10.5244/C.12.43 ↗
5. Hansen, D.W., Hansen, J.P., Nielsen, M., Johansen, A.S., and Stegmann, M.B. (2002, January 4). Eye typing using Markov and active appearance models. Proceedings of the IEEE Conference on Applications of Computer Vision Workshops, Orlando, FL, USA.
6. Appearance-based gaze estimation using visual saliency10.1109/TPAMI.2012.101 ↗
7. Spatially dynamic calibration of an eye-tracking system10.1109/21.247897 ↗
8. Newman, R., Matsumoto, Y., Rougeaux, S., and Zelinsky, A. (2000, January 28–30). Real-time stereo tracking for head pose and gaze estimation. Proceedings of the IEEE Conference on Automatic Face and Gesture Recognition, Grenoble, France.
9. Morimoto, C.H., Amir, A., and Flickner, M. (2002, January 11–15). Detecting eye position and gaze from a single camera and 2 light sources. Proceedings of the IEEE Conference Computer Vision and Pattern Recognition, Quebec City, QC, Canada.
10. A non-contact device for tracking gaze in a human computer interface10.1016/j.cviu.2004.07.005 ↗
11. Estimating the eye gaze from one eye10.1016/j.cviu.2004.07.008 ↗
12. General theory of remote gaze estimation using the pupil center and corneal reflections10.1109/TBME.2005.863952 ↗
13. Meyer, A., Böhme, M., Martinetz, T., and Barth, E. (2006). A single-camera remote eye tracker. Perception and Interactive Technologies, Springer.10.1007/11768029_25 ↗
14. Hennessey, C., Noureddin, B., and Lawrence, P. (2006, January 27–29). A single camera eye-gaze tracking system with free head motion. Proceedings of the Symposium on Eye Tracking Research and Applications, San Diego, CA, USA.10.1145/1117309.1117349 ↗
15. An automatic personal calibration procedure for advanced gaze estimation systems10.1109/TBME.2009.2039351 ↗
16. Eye tracking: Pupil orientation geometrical modeling10.1016/j.imavis.2005.06.001 ↗
17. Gaze tracking system model based on physical parameters10.1142/S0218001407005697 ↗
18. Nagamatsu, T., Hiroe, M., and Rigoll, G. (2019, January 26–31). Corneal-Reflection-Based Wide Range Gaze Tracking for a Car. Proceedings of the International Conference on Human-Computer Interaction, Orlando, FL, USA.10.1007/978-3-030-22649-7_31 ↗
19. Brolly, X.L., and Mulligan, J.B. (July, January 27). Implicit calibration of a remote gaze tracker. Proceedings of the IEEE Conference on Applications of Computer Vision Workshop, Washington, DC, USA.
20. Ebisawa, Y., and Satoh, S.I. (1993, January 31). Effectiveness of pupil area detection technique using two light sources and image difference method. Proceedings of the IEEE Conference on Engineering in Medicine and Biology Society, San Diego, CA, USA.
21. Eye tracking in the wild10.1016/j.cviu.2004.07.013 ↗
22. Real-time eye, gaze, and face pose tracking for monitoring driver vigilance10.1006/rtim.2002.0279 ↗
23. Sparse and semi-supervised visual mapping with the sˆ3gp
24. Cerrolaza, J.J., Villanueva, A., and Cabeza, R. (2008, January 26–28). Taxonomic study of polynomial regressions applied to the calibration of video-oculographic systems. Proceedings of the Symposium on Eye Tracking Research and Applications, Savannah, GA, USA.10.1145/1344471.1344530 ↗
25. Cerrolaza, J.J., Villanueva, A., and Cabeza, R. (2012, January 28–30). Error characterization and compensation in eye tracking systems. Proceedings of the Symposium on Eye Tracking Research and Applications, Santa Barbara, CA, USA.10.1145/2168556.2168595 ↗
26. Zhu, J., and Yang, J. (2002, January 21). Subpixel eye gaze tracking. Proceedings of the Conference on Automatic Face and Gesture Recognition, Washington, DC, USA.
27. Accurate gaze tracking from single camera using gabor corner detector10.1007/s11042-014-2288-4 ↗
28. Shao, G., Che, M., Zhang, B., Cen, K., and Gao, W. (2010, January 26–28). A novel simple 2D model of eye gaze estimation. Proceedings of the IEEE Conference on Intelligent Human Machine Systems and Cybernetics, Nanjing, China.10.1109/IHMSC.2010.81 ↗
29. Mapping the pupil-glint vector to gaze coordinates in a simple video-based eye tracker
30. Fast and accurate algorithmfor eye localisation for gaze tracking in low-resolution images10.1049/iet-cvi.2015.0316 ↗
31. Tong, Q., Hua, X., and Qiu, J. (2018, January 12). A new mapping function in table-mounted eye tracker. Proceedings of the 2017 International Conference on Optical Instruments and Technology: Optoelectronic Imaging/Spectroscopy and Signal Processing Technology, Tianjin, China.10.1117/12.2295594 ↗
32. Li, W., Che, M., and Li, F. (2012, January 1). Gaze Estimation Research with Single Camera. Proceedings of the Conference on e Business Techology and Strategy, Tianjin. China.10.1007/978-3-642-34447-3_53 ↗
33. Gaze estimation in a gaze tracking system10.1007/s11432-011-4243-6 ↗
34. Screen-Light Decomposition Framework for Point-of-Gaze Estimation Using a Single Uncalibrated Camera and Multiple Light Sources10.1007/s10851-020-00947-8 ↗
35. Wang, J., Zhang, G., and Shi, J. (2016). 2D Gaze Estimation Based on Pupil-Glint Vector Using an Artificial Neural Network. Appl. Sci., 6.10.3390/app6060174 ↗
36. Gazing point dependent eye gaze estimation10.1016/j.patcog.2017.04.026 ↗
37. A novel non-intrusive eye gaze estimation using cross-ratio under large head motion10.1016/j.cviu.2004.07.011 ↗
38. Improving the usability of remote eye gaze tracking for human-device interaction10.1109/TCE.2014.6937335 ↗
39. Hansen, D.W., Agustin, J.S., and Villanueva, A. (2010, January 22–24). Homography normalization for robust gaze estimation in uncalibrated setups. Proceedings of the 2010 Symposium on Eye-Tracking Research & Applications, Austin, TX, USA.10.1145/1743666.1743670 ↗
40. Novel eye gaze tracking techniques under natural head movement10.1109/TBME.2007.895750 ↗
41. Remote measurement of eye direction allowing subject motion over one cubic foot of space10.1109/TBME.1974.324318 ↗
42. Pupil detection and tracking multiple light sources10.1016/S0262-8856(99)00053-0 ↗
43. Eye gaze tracking techniques for interactive applications10.1016/j.cviu.2004.07.010 ↗
44. A novel eye gaze tracking technique based on pupil center cornea reflection technique10.3724/SP.J.1016.2010.01272 ↗
45. Improved remote gaze estimation using corneal reflection-adaptive geometric transforms10.1117/1.OE.53.5.053112 ↗
46. Huang, J.-B., Cai, Q., Liu, Z., Ahuja, N., and Zhang, Z. (2014, January 26–28). Towards accurate and robust cross-ratio based gaze trackers through learning from simulation. Proceedings of the Symposium on Eye Tracking Research and Applications, Safety Harbor, FL, USA.10.1145/2578153.2578162 ↗
47. Direct least square fitting of ellipses10.1109/34.765658 ↗
48. Ruan, Y., Zhou, H., and Huang, J. (2018, January 4–8). An Improved Method for Human Eye State Detection Based on Least Square Ellipse Fitting Algorithm. Proceedings of the 2018 13th World Congress on Intelligent Control and Automation (WCICA), Changsha, China.10.1109/WCICA.2018.8630514 ↗
49. Fitzgibbon, A.W., and Fisher, R.B. (1995, January 1). A Buyer’s Guide to Conic Fitting. Proceedings of the British Machine Vision Conference, Birmingham, UK.10.5244/C.9.51 ↗
50. Hartley, R., and Zisserman, A.F. (2000). Multiple View Geometry in Computer Vision, Cambridge University Press.
51. Zhang, Z. (1999, January 20–27). Flexible camera calibration by viewing a plane from unknown orientations. Proceedings of the Seventh IEEE International Conference on Computer Vision, Kerkyra, Greece.