Ocular Biometrics Recognition by Analyzing Human Exploration during Video Observations
Source abstract
Abstract
Soft biometrics provide information about the individual but without the distinctiveness and permanence able to discriminate between any two individuals. Since the gaze represents one of the most investigated human traits, works evaluating the feasibility of considering it as a possible additional soft biometric trait have been recently appeared in the literature. Unfortunately, there is a lack of systematic studies on clinically approved stimuli to provide evidence of the correlation between exploratory paths and individual identities in “natural” scenarios (without calibration, imposed constraints, wearable tools). To overcome these drawbacks, this paper analyzes gaze patterns by using a computer vision based pipeline in order to prove the correlation between visual exploration and user identity. This correlation is robustly computed in a free exploration scenario, not biased by wearable devices nor constrained to a prior personalized calibration. Provided stimuli have been designed by clinical experts and then they allow better analysis of human exploration behaviors. In addition, the paper introduces a novel public dataset that provides, for the first time, images framing the faces of the involved subjects instead of only their gaze tracks.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Gaze Tracking and Assistive Technology · Visual Attention and Saliency Detection · Retinal and Optic Conditions
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Interdisciplinary Centre for Security, Reliability and Trust (SnT), University of Luxembourg, 29, Avenue J. F. Kennedy, 1855 Luxembourg, Luxembourg
Institute of Applied Sciences and Intelligent Systems, National Research Council of Italy, via Monteroni snc, 73100 Lecce, Italy
References (65)
Show source-provided references
1. Bertillon, A., and Müller, G. (1889). Instructions for Taking Descriptions for the Identification Of Criminals and Others by the Means of Anthropometric Indications, Kessinger Publishing.
2. Rhodes, H.T.F. (1956). Alphonse Bertillon, Father of Scientific Detection, Abelard-Schuman.
3. Jain, A.K., Dass, S.C., and Nandakumar, K. (2004, January 15–17). Soft biometric traits for personal recognition systems. Proceedings of the International Conference on Biometric Authentication, Hong Kong, China.10.1007/978-3-540-25948-0_99 ↗
4. Bag of soft biometrics for person identification10.1007/s11042-010-0635-7 ↗
5. Jaha, E.S., and Nixon, M.S. (October, January 29). Soft biometrics for subject identification using clothing attributes. Proceedings of the IEEE International Joint Conference on Biometrics, Clearwater, FL, USA.
6. Soft biometrics for surveillance: An overview10.1016/B978-0-444-53859-8.00013-8 ↗
7. Abdelwhab, A., and Viriri, S. (2018). A Survey on Soft Biometrics for Human Identification. Mach. Learn. Biom., 37.10.5772/intechopen.76021 ↗
8. Zewail, R., Elsafi, A., Saeb, M., and Hamdy, N. (2004, January 25–28). Soft and hard biometrics fusion for improved identity verification. Proceedings of the 2004 47th Midwest Symposium on Circuits and Systems, Hiroshima, Japan.
9. Jaha, E.S. (2019, January 10–12). Augmenting Gabor-based Face Recognition with Global Soft Biometrics. Proceedings of the 2019 7th International Symposium on Digital Forensics and Security (ISDFS), Barcelos, Portugal.10.1109/ISDFS.2019.8757553 ↗
10. What else does your biometric data reveal? A survey on soft biometrics10.1109/TIFS.2015.2480381 ↗
11. Soft biometric traits for continuous user authentication10.1109/TIFS.2010.2075927 ↗
12. Carcagnì, P., Cazzato, D., Del Coco, M., Distante, C., and Leo, M. (2014, January 6–12). Visual interaction including biometrics information for a socially assistive robotic platform. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.10.1007/978-3-319-16199-0_28 ↗
13. Geng, L., Zhang, K., Wei, X., and Feng, X. (2017, January 24–31). Soft biometrics in online social networks: A case study on Twitter user gender recognition. Proceedings of the 2017 IEEE Winter Applications of Computer Vision Workshops (WACVW), Santa Rosa, CA, USA.10.1109/WACVW.2017.8 ↗
14. Leo, M., Carcagnì, P., Mazzeo, P.L., Spagnolo, P., Cazzato, D., and Distante, C. (2020). Analysis of Facial Information for Healthcare Applications: A Survey on Computer Vision-Based Approaches. Information, 11.10.3390/info11030128 ↗
15. Eye fixations and cognitive processes10.1016/0010-0285(76)90015-3 ↗
16. Porta, M., and Barboni, A. (2019, January 10–13). Strengthening Security in Industrial Settings: A Study on Gaze-Based Biometrics through Free Observation of Static Images. Proceedings of the 2019 24th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Zaragoza, Spain.10.1109/ETFA.2019.8868961 ↗
17. Unobtrusive arousal detection on the web using pupillary response10.1016/j.ijhcs.2019.09.003 ↗
18. Deravi, F., and Guness, S.P. (2011, January 26–29). Gaze Trajectory as a Biometric Modality. Proceedings of the International Conference on Bio-inspired Systems and Signal Processing (BIOSIGNALS-2011), Rome, Italy.
19. Cazzato, D., Leo, M., Evangelista, A., and Distante, C. (2015, January 26–29). Soft Biometrics by Modeling Temporal Series of Gaze Cues Extracted in the Wild. Proceedings of the International Conference on Advanced Concepts for Intelligent Vision Systems, Catania, Italy.10.1007/978-3-319-25903-1_34 ↗
20. A low-cost and calibration-free gaze estimator for soft biometrics: An explorative study10.1016/j.patrec.2015.10.015 ↗
21. Yarbus, A.L. (2013). Eye Movements and Vision, Springer.
22. A theory of eye movements during target acquisition10.1037/a0013118 ↗
23. The long and the short of it: Spatial statistics at fixation vary with saccade amplitude and task10.1016/j.visres.2005.12.005 ↗
24. Itti, L., and Baldi, P.F. (2006). Bayesian surprise attracts human attention. Advances in Neural Information Processing Systems, MIT.
25. Salient object detection: A survey10.1007/s41095-019-0149-9 ↗
26. Exploring the role of gaze behavior and object detection in scene understanding10.3389/fpsyg.2013.00917 ↗
27. Judd, T., Durand, F., and Torralba, A. (2012). A Benchmark of Computational Models of Saliency to Predict Human Fixations, MIT.
28. Mehrani, P., and Veksler, O. (September, January 31). Saliency Segmentation based on Learning and Graph Cut Refinement. Proceedings of the British Machine Vision Conference, BMVC 2010, Aberystwyth, UK.10.5244/C.24.110 ↗
29. Nelson, D. (2020). Using Gaze Detection to Change Timing and Behavior. (No. 10,561,928), US Patent.
30. Katsini, C., Opsis, H., Abdrabou, Y., Raptis, G.E., Khamis, M., and Alt, F. (2020, January 25–30). The Role of Eye Gaze in Security and Privacy Applications: Survey and Future HCI Research Directions. Proceedings of the 38th Annual ACM Conference on Human Factors in Computing Systems, Honolulu, HI, USA.10.1145/3313831.3376840 ↗
31. Cerf, M., Harel, J., Einhäuser, W., and Koch, C. (2008). Predicting human gaze using low-level saliency combined with face detection. Advances in Neural Information Processing Systems, NIPS.
32. Maeder, A.J., and Fookes, C.B. (2003). A visual attention approach to personal identification. Proceedings of the 8th Australian & New Zealand Intelligent Information Systems Conference, Queensland University of Technology.
33. Kasprowski, P., and Ober, J. (2004, January 15). Eye movements in biometrics. Proceedings of the International Workshop on Biometric Authentication, Prague, Czech Republic.10.1007/978-3-540-25976-3_23 ↗
34. Gaze as a biometric
35. Cantoni, V., Porta, M., Galdi, C., Nappi, M., and Wechsler, H. (2014, January 23–27). Gender and age categorization using gaze analysis. Proceedings of the 2014 Tenth International Conference on Signal-Image Technology and Internet-Based Systems, Marrakech, Morocco.10.1109/SITIS.2014.40 ↗
36. GANT: Gaze analysis technique for human identification10.1016/j.patcog.2014.02.017 ↗
37. Biometric recognition via eye movements: Saccadic vigor and acceleration cues
38. Sluganovic, I., Roeschlin, M., Rasmussen, K.B., and Martinovic, I. (2016, January 24–28). Using reflexive eye movements for fast challenge-response authentication. Proceedings of the 2016 ACM SIGSAC Conference on Computer and Communications Security, Vienna, Austria.10.1145/2976749.2978311 ↗
39. Kasprowski, P., Komogortsev, O.V., and Karpov, A. (2012, January 23–27). First eye movement verification and identification competition at BTAS 2012. Proceedings of the 2012 IEEE fifth international conference on biometrics: Theory, applications and systems (BTAS), Arlington, VA, USA.10.1109/BTAS.2012.6374577 ↗
40. Eye movement analysis for human authentication: A critical survey10.1016/j.patrec.2016.11.002 ↗
41. Judd, T., Ehinger, K., Durand, F., and Torralba, A. (October, January 29). Learning to predict where humans look. Proceedings of the 2009 IEEE 12th International Conference on Computer Vision, Kyoto, Japan.10.1109/ICCV.2009.5459462 ↗
42. Fusion of eye movement and mouse dynamics for reliable behavioral biometrics10.1007/s10044-016-0568-5 ↗
43. Cazzato, D., Leo, M., Carcagnì, P., Cimarelli, C., and Voos, H. (2019, January 27–29). Understanding and Modelling Human Attention for Soft Biometrics Purposes. Proceedings of the 2019 3rd International Conference on Artificial Intelligence and Virtual Reality, Singapore.10.1145/3348488.3348500 ↗
44. Vitek, M., Rot, P., Štruc, V., and Peer, P. (2020). A comprehensive investigation into sclera biometrics: A novel dataset and performance study. Neural Comput. Appl., 1–15.10.1007/s00521-020-04782-1 ↗
45. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
46. Baltrusaitis, T., Robinson, P., and Morency, L.P. (2013, January 2–8). Constrained local neural fields for robust facial landmark detection in the wild. Proceedings of the IEEE International Conference on Computer Vision Workshops, Sydney, NSW, Australia.10.1109/ICCVW.2013.54 ↗
47. Localizing parts of faces using a consensus of exemplars10.1109/TPAMI.2013.23 ↗
48. Le, V., Brandt, J., Lin, Z., Bourdev, L., and Huang, T.S. (2012). Interactive facial feature localization. Proceedings of the European Conference on Computer Vision, Florence, Italy, 7–13 October 2012, Springer.10.1007/978-3-642-33712-3_49 ↗
49. Deformable model fitting by regularized landmark mean-shift10.1007/s11263-010-0380-4 ↗
50. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography10.1145/358669.358692 ↗
51. Amos, B., Ludwiczuk, B., and Satyanarayanan, M. (2016). Openface: A General-Purpose Face Recognition Library With Mobile Applications, CMU School of Computer Science.
52. Wood, E., Baltrusaitis, T., Zhang, X., Sugano, Y., Robinson, P., and Bulling, A. (2015, January 7–13). Rendering of eyes for eye-shape registration and gaze estimation. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.428 ↗
53. Smoothing and differentiation of data by simplified least squares procedures10.1021/ac60214a047 ↗
54. What is a Savitzky-Golay filter? [lecture notes]10.1109/MSP.2011.941097 ↗
55. Hein, M., and Bühler, T. (2010). An inverse power method for nonlinear eigenproblems with applications in 1-spectral clustering and sparse PCA. Advances in Neural Information Processing Systems, NIPS.
56. Takane, Y. (2013). Constrained Principal Component Analysis and Related Techniques, CRC Press.
57. Fix, E. (1951). Discriminatory Analysis: Nonparametric Discrimination, Consistency Properties, USAF School of Aviation Medicine.10.1037/e471672008-001 ↗
58. TabletGaze: Dataset and analysis for unconstrained appearance-based gaze estimation in mobile tablets10.1007/s00138-017-0852-4 ↗
59. Variability of eye movements when viewing dynamic natural scenes10.1167/10.10.28 ↗
60. Understanding scene understanding10.3389/fpsyg.2013.00954 ↗
61. What attributes guide the deployment of visual attention and how do they do it?10.1038/nrn1411 ↗
62. The influence of the presentation of camera surveillance on cheating and pro-social behavior10.3389/fpsyg.2018.01937 ↗
63. A portable, unobtrusive device for videorecording clinical interactions10.3758/BF03206411 ↗
64. Visualizing data using t-SNE
65. Joint head pose/soft label estimation for human recognitionin-the-wild10.1109/TPAMI.2016.2522441 ↗