Design of a Binocular Pupil and Gaze Point Detection System Utilizing High Definition Images
Source abstract
Abstract
This study proposes a novel binocular pupil and gaze detection system utilizing a remote full high definition (full HD) camera and employing LabVIEW. LabVIEW is inherently parallel and has fewer time-consuming algorithms. Many eye tracker applications are monocular and use low resolution cameras due to real-time image processing difficulties. We utilized the computer’s direct access memory channel for rapid data transmission and processed full HD images with LabVIEW. Full HD images make easier determinations of center coordinates/sizes of pupil and corneal reflection. We modified the camera so that the camera sensor passed only infrared (IR) images. Glints were taken as reference points for region of interest (ROI) area selection of the eye region in the face image. A morphologic filter was applied for erosion of noise, and a weighted average technique was used for center detection. To test system accuracy with 11 participants, we produced a visual stimulus set up to analyze each eye’s movement. Nonlinear mapping function was utilized for gaze estimation. Pupil size, pupil position, glint position and gaze point coordinates were obtained with free natural head movements in our system. This system also works at 2046 × 1086 resolution at 40 frames per second. It is assumed that 280 frames per second for 640 × 480 pixel images is the case. Experimental results show that the average gaze detection error for 11 participants was 0.76° for the left eye, 0.89° for right eye and 0.83° for the mean of two eyes.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Gaze Tracking and Assistive Technology · Glaucoma and retinal disorders · Ocular Surface and Contact Lens
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical and Electronics Engineering, Ankara University, Ankara 06830, Turkey
References (40)
Show source-provided references
1. Pupil and glint detection using wearable camera sensor and near-infrared LED array10.3390/s151229792 ↗
2. (2016, December 15). NeoMam Studios. Available online: http://neomam.com/interactive/13reasons.
3. (2016, December 15). Tobii Pro. Available online: http://www.tobiipro.com/about/new-to-eye-tracking.
4. Quantitative electro-oculography and electroencephalography as indices of alertness10.1016/S0013-4694(97)00128-4 ↗
5. A method of measuring eye movements using a scleral search coil in a magnetic field
6. A Breadth-first survey of eye tracking applications10.3758/BF03195475 ↗
7. Yarbus, A.L. (1967). Eye Movements and Vision, Plenum Press.10.1007/978-1-4899-5379-7 ↗
8. The angle velocity of eye movements10.1037/h0076100 ↗
9. Hybrid method for 3-D gaze tracking using glint and contour features10.1109/TCSVT.2014.2329362 ↗
10. Mapping the pupil-glint vector to gaze coordinates in a simple video-based eye tracker
11. A novel gaze tracking method based on the generation of virtual calibration points10.3390/s130810802 ↗
12. Nonwearable gaze tracking system for controlling home appliance10.1155/2014/303670 ↗
13. Remote gaze tracking system on a large display10.3390/s131013439 ↗
14. Eye gaze tracking techniques for interactive applications10.1016/j.cviu.2004.07.010 ↗
15. Gaze estimation interpolation methods based on binocular data10.1109/TBME.2012.2201716 ↗
16. Improving the accuracy and reliability of remote system-calibration-free eye-gaze tracking10.1109/TBME.2009.2015955 ↗
17. Robust gaze-tracking method by using frontal-viewing and eye-tracking cameras10.1117/1.3275453 ↗
18. New computer interface combining gaze tracking and brainwave measurements10.1109/TCE.2011.6131137 ↗
19. Eye and gaze tracking for interactive graphic display10.1007/s00138-004-0139-4 ↗
20. A novel approach to 3-D gaze tracking using stereo cameras10.1109/TSMCB.2003.811128 ↗
21. Fuhl, W., Santini, T.C., Kübler, T., and Kasneci, E. (2016, January 14–17). Else: Ellipse selection for robust pupil detection in real-world environments. Proceedings of the Ninth Biennial ACM Symposium on Eye Tracking Research & Applications, Charleston, SC, USA.10.1145/2857491.2857505 ↗
22. Fuhl, W., Kübler, T., Sippel, K., Rosenstiel, W., and Kasneci, E. (2015, January 2–4). Excuse: Robust pupil detection in real-world scenarios. Proceedings of the International Conference on Computer Analysis of Images and Patterns, Valletta, Malta.10.1007/978-3-319-23192-1_4 ↗
23. Fuhl, W., Santini, T., Kasneci, G., and Kasneci, E. (arXiv, 2016). PupilNet: Convolutional neural networks for robust pupil detection, arXiv.
24. Pupil detection for head-mounted eye tracking in the wild: An evaluation of the state of the art10.1007/s00138-016-0776-4 ↗
25. Iris center corneal reflection method for gaze tracking using visible light10.1109/TBME.2010.2087330 ↗
26. General theory of remote gaze estimation using the pupil center and corneal reflections10.1109/TBME.2005.863952 ↗
27. Gonzalez, R.C., and Woods, R.E. (2008). Digital Image Processing, Pearson/Prentice Hall. [3rd ed.].
28. Clinical applications of pupillography10.1097/00041327-200303000-00010 ↗
29. An open-source, FireWire camera-based, Labview-controlled image acquisition system for automated, dynamic pupillometry and blink detection10.1016/j.cmpb.2013.07.011 ↗
30. Exploring eye activity as an ındication of emotional states using an eye-tracking sensor
31. (2017, February 15). Tobii. Available online: http://www.tobiipro.com/product-listing.
32. (2017, February 15). SMI. Available online: https://www.smivision.com/products.
33. Gaze tracking system for user wearing glasses10.3390/s140202110 ↗
34. A new gaze estimation method considering external light10.3390/s150305935 ↗
35. (2013). User’s Manual for Camera Link Cameras, Basler. Version 04.
36. (2017, February 15). NI. Available online: http://www.ni.com/en-tr/support/model.pcie-1473.html.
37. OSRAM (2006). IEC 62471: Photobiological Safety of Lamps and Lamp Systems, OSRAM.
38. The psychophysics toolbox10.1163/156856897X00357 ↗
39. The VideoToolbox software for visual psychophysics: Transforming numbers into movies10.1163/156856897X00366 ↗
40. What’s new in Psychtoolbox-3