Review of Studies on User Research Based on EEG and Eye Tracking
Source abstract
Abstract
Under the development of interdisciplinary fusion, user research has been greatly influenced by technology-driven neuroscience and sensory science, in terms of thinking and methodology. The use of technical methods, such as EEG and eye-tracking, has gradually become a research trend and hotspot in this field, in order to explore the deep cognitive states behind users’ objective behaviors. This review outlines the applications of EEG and eye-tracking technology in the field of user research, with the aim of promoting future research and proposing reliable reference indicators and a research scope. It provides important reference information for other researchers in the field. The article summarizes the key reference indicators and research paradigms of EEG and eye-tracking in current user research, focusing on the user research situation in industrial products, digital interfaces and spatial environments. The limitations and research trends in current technological applications are also discussed. The feasibility of experimental equipment in outdoor environments, the long preparation time of EEG experimental equipment, and the accuracy error of physiological signal acquisition are currently existing problems. In the future, research on multi-sensory and behavioral interactions and universal studies of multiple technology fusions will be the next stage of research topics. The measurement of different user differentiation needs can be explored by integrating various physiological measurements such as EEG signals and eye-tracking signals, skin electrical signals, respiration, and heart rate.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Gaze Tracking and Assistive Technology · EEG and Brain-Computer Interfaces · Color perception and design
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Furnishings and Industrial Design, Nanjing Forestry University, Longpan Road, 159, Nanjing 210037, China
References (100+)
Show source-provided references
1. Neef, C., Linden, K., and Richert, A. (2023). Exploring the Influencing Factors on User Experience in Robot-Assisted Health Monitoring Systems Combining Subjective and Objective Health Data. Appl. Sci., 13.10.3390/app13063537 ↗
2. Michel, C.M., and Brunet, D. (2019). EEG Source Imaging: A Practical Review of the Analysis Steps. Front. Neurol., 10.10.3389/fneur.2019.00325 ↗
3. Krigolson, O.E., Williams, C.C., Norton, A., Hassall, C.D., and Colino, F.L. (2017). Choosing MUSE: Validation of a Low-Cost, Portable EEG System for ERP Research. Front. Neurosci., 11.10.3389/fnins.2017.00109 ↗
4. Low-Cost Assessment of User eXperience through EEG Signals10.1109/ACCESS.2020.3017685 ↗
5. Combining eye tracking, pupil dilation and EEG analysis for predicting web users click intention10.1016/j.inffus.2016.09.003 ↗
6. Lim, J.Z., Mountstephens, J., and Teo, J. (2020). Emotion Recognition Using Eye-Tracking: Taxonomy, Review and Current Challenges. Sensors, 20.10.3390/s20082384 ↗
7. Quantifying the qualities of aesthetics in product design using eye-tracking technology10.1016/j.ergon.2015.05.011 ↗
8. Eye tracking for screening design parameters in adjective-based design of yacht hull10.1016/j.oceaneng.2018.08.026 ↗
9. Ilhan, A.E., and Togay, A. (2023). Pursuit of methodology for data input related to taste in design: Using eye tracking technology. Displays, 76.10.1016/j.displa.2022.102335 ↗
10. Kulke, L.V., Atkinson, J., and Braddick, O. (2016). Neural Differences between Covert and Overt Attention Studied using EEG with Simultaneous Remote Eye Tracking. Front. Hum. Neurosci., 10.10.3389/fnhum.2016.00592 ↗
11. Lopez-Gil, J.M., Virgili-Goma, J., Gil, R., and Garcia, R. (2016). Method for Improving EEG Based Emotion Recognition by Combining It with Synchronized Biometric and Eye Tracking Technologies in a Non-invasive and Low Cost Way. Front. Comput. Neurosci., 10.10.3389/fncom.2016.00085 ↗
12. Measurement of saccadic eye movements by electrooculography for simultaneous EEG recording10.3758/s13428-019-01280-8 ↗
13. A novel method for the evaluation of fashion product design based on data mining10.1007/s40436-017-0201-x ↗
14. Distinguishing and quantifying the visual aesthetics of a product: An integrated approach of eye-tracking and EEG10.1016/j.ergon.2019.02.006 ↗
15. Consumer neuroscience on branding and packaging: A review and future research agenda
16. Lin, W., and Li, C. (2023). Review of Studies on Emotion Recognition and Judgment Based on Physiological Signals. Appl. Sci., 13.10.3390/app13042573 ↗
17. Bazzani, A., Ravaioli, S., Trieste, L., Faraguna, U., and Turchetti, G. (2020). Is EEG suitable for marketing research? A systematic review. Front. Neurosci., 14.10.3389/fnins.2020.594566 ↗
18. PRISMA 2020 and PRISMA-S: Common questions on tracking records and the flow diagram
19. Extending the PRISMA statement to equity-focused systematic reviews (PRISMA-E 2012): Explanation and elaboration10.1080/19439342.2015.1113196 ↗
20. Knowledge mapping of platform research: A visual analysis using VOSviewer and CiteSpace10.1007/s10660-020-09410-7 ↗
21. Application of EEG technology in industrial design
22. Neuroaesthetics10.1016/j.tics.2014.03.003 ↗
23. Fadeev, K.A., Smirnov, A.S., Zhigalova, O.P., Bazhina, P.S., Tumialis, A.V., and Golokhvast, K.S. (2020). Too Real to Be Virtual: Autonomic and EEG Responses to Extreme Stress Scenarios in Virtual Reality. Behav. Neurol., 2020.10.1155/2020/5758038 ↗
24. Evaluation Interactive Prototype Scheme Based on Emotional EEG
25. Zhang, Z., and Zhang, L. (2023). A Two-Step Framework to Recognize Emotion Using the Combinations of Adjacent Frequency Bands of EEG. Appl. Sci., 13.10.3390/app13031954 ↗
26. Aesthetic reward research based on event-related potentials
27. ERP: A literature survey10.1007/s00170-011-3756-x ↗
28. How to get statistically significant effects in any ERP experiment (and why you shouldn’t)10.1111/psyp.12639 ↗
29. Attention and emotion: An integrative review of emotional face processing as a function of attention10.1016/j.cortex.2020.06.010 ↗
30. ERP based measures of cognitive workload: A review10.1016/j.neubiorev.2020.07.020 ↗
31. A systematic literature review on the usage of eye-tracking in software engineering10.1016/j.infsof.2015.06.008 ↗
32. A review of eye-tracking applications as tools for training10.1007/s10111-012-0234-7 ↗
33. In the Eye of the Beholder: A Survey of Models for Eyes and Gaze10.1109/TPAMI.2009.30 ↗
34. A study on airline pilots’ visual attention allocation during emergency
35. The identification of viewing patterns of chocolate snack packages using eye-tracking techniques10.1016/j.foodqual.2014.08.002 ↗
36. Impact of mainstream classroom setting on attention of children with autism spectrum disorder: An eye-tracking study10.1007/s10209-020-00749-0 ↗
37. Boardman, R., McCormick, H., and Henninger, C.E. (2022). Exploring attention on a retailer’s homepage: An eye-tracking & qualitative research study. Behav. Inf. Technol.10.1080/0144929X.2022.2059396 ↗
38. Heilmann, F., and Witte, K. (2021). Perception and Action under Different Stimulus Presentations: A Review of Eye-Tracking Studies with an Extended View on Possibilities of Virtual Reality. Appl. Sci., 11.10.3390/app11125546 ↗
39. Differential detection of global luminance and contrast changes across saccades and flickers during active scene perception10.1016/j.visres.2007.10.008 ↗
40. Scene Perception and Its Research Paradigms
41. Using event-related potentials to explore processing mechanism of three auditory Oddball paradigms in the brain
42. Research on Weak EEG Signal Extraction Method
43. Human-computer interaction: Intention recognition based on EEG and eye tracking
44. Research on EEG’s Multi-parameter Visualization System
45. Liu, H., Wang, F., and Zhang, D. (2023). Inspiring Real-Time Evaluation and Optimization of Human-Robot Interaction with Psychological Findings from Human-Human Interaction. Appl. Sci., 13.10.3390/app13020676 ↗
46. Aesthetic study of patterns based on event-related potential and eye-tracking: Taking the decorative patterns of the Tang dynasty as an example10.1002/jsid.958 ↗
47. Design of Cockpit Warning Information Based on EEG
48. Intelligent wheelchair human-machine interaction using a/β wave of EEG
49. User Perception-oriented Interactive Experience of Children’s Rehabil litation Products
50. A Novel EOG/EEG Hybrid Human-Machine Interface Adopting Eye Movements and ERPs: Application to Robot Control10.1109/TBME.2014.2369483 ↗
51. Analysis of the cognitive of southern official hat chair styling features based on eye tracking
52. Huang, Y., Ma, W., and Yang, Y. (2020, January 12–13). Eye Movement Experiment Research on Users’ Aesthetic Preferences of Car Seats. Proceedings of the 13th International Symposium on Computational Intelligence and Design (ISCID), Hangzhou, China.10.1109/ISCID51228.2020.00075 ↗
53. Using event related potentials to identify a user’s behavioural intention aroused by product form design10.1016/j.apergo.2016.01.018 ↗
54. Huang, J.P., Peng, Y.B., and Wan, X.A. (2021). The color-flavor incongruency effect in visual search for food labels: An eye-tracking study. Food Qual. Prefer., 88.10.1016/j.foodqual.2020.104078 ↗
55. A Relationship Between Visual Complexity and Aesthetic Appraisal of Car Front Images: An Eye-Tracker Study10.1177/0301006615596882 ↗
56. Barros, R.Q., Tavares, A.S., Albuquerque, W., da Silva, J.C., de Lemos, I.A., Siqueira de Albuquerque Cardoso, R.L., Soares, M.M., and Cairrao, M.R. (2016, January 17–22). Analysis of Product Use by Means of Eye Tracking and EEG: A Study of Neuroergonomics. Proceedings of the 5th International Conference on Design, User Experience, and Usability (DUXU) held as part of 18th International Conference on Human-Computer Interaction (HCI International), Toronto, ON, Canada.10.1007/978-3-319-40355-7_51 ↗
57. Using EEG Frontal Asymmetry to Predict IT User’s Perceptions Regarding Usefulness, Ease of Use and Playfulness10.1007/s10484-017-9379-8 ↗
58. Interest as a Proxy of Engagement in News Reading: Spectral and Entropy Analyses of EEG Activity Patterns10.1109/TAFFC.2017.2682089 ↗
59. Frontal alpha EEG asymmetry before and after behavioral activation treatment for depression10.1016/j.biopsycho.2014.03.003 ↗
60. Stergiadis, C., Kostaridou, V.D., Veloudis, S., Kazis, D., and Klados, M.A. (2022). A Personalized User Authentication System Based on EEG Signals. Sensors, 22.10.3390/s22186929 ↗
61. Application of EEG Technology in Emotional Design of Cultural and Creative Products
62. Wang, Y.H., Yu, S.H., Ma, N., Wang, J.L., Hu, Z.G., Liu, Z., and He, J.B. (2020). Prediction of product design decision Making: An investigation of eye movements and EEG features. Adv. Eng. Inform., 45.10.1016/j.aei.2020.101095 ↗
63. Empirical analysis of domain ontology usage on the Web: eCommerce domain in focus10.1002/cpe.3089 ↗
64. Wu, O., Chen, Y., Li, B., and Hu, W. (2011, January 9–12). Evaluating the visual quality of web pages using a computational aesthetic approach. Proceedings of the Fourth ACM International Conference on Web Search and Data Mining, Hong Kong, China.10.1145/1935826.1935883 ↗
65. User-interfaces layout optimization using eye-tracking, mouse movements and genetic algorithms10.1016/j.apergo.2019.03.004 ↗
66. Guo, F., Jiang, J.-Y., Tian, X.-H., and Chen, J.-H. (2019). Applying Event-Related Potentials to Measure Perceptual Experience toward the Navigation Interface of a Mobile Game for Improving the Design. Symmetry, 11.10.3390/sym11050710 ↗
67. Wang, S., Xu, C.H., Xiao, L., and Ding, A.S. (2021). The Implicit Aesthetic Preference for Mobile Marketing Interface Layout-An ERP Study. Front. Hum. Neurosci., 15.10.3389/fnhum.2021.728895 ↗
68. Mobile Typical Interface Structure Based on Eye-Tracking Browsing Rules
69. Research on human-computer interaction experiment of university library WeChat public platform
70. Hou, K.-C., and Ho, C.-H. (2013, January 26–30). A preliminary study on aesthetic of apps icon design. Proceedings of the IASDR 2013 5th International Congress of International Association of Societies of Design Research, Tokyo, Japan.
71. Pan, L. (2018). Research on Cognitive Performance and EEG Index Evaluation Method of Digital Interface Graphics and Text. [Master’s Thesis, Southeast University].
72. APP Usability of Terminal Communication Operators Based on Eye-Tracking Technology
73. Niu, Y.F., Shi, B.Z., Qiu, L.C., Li, B., Shen, Q.Y., and Xue, C.Q. (2018, January 29–31). Research on Binding Memory of Icon Features Based on Event-related Potential. Proceedings of the 9th Asia Conference on Mechanical and Aerospace Engineering (ACMAE), Singapore.
74. Fang, Q. (2022). Research on ERP Visual Cognition and Graphic Feature Measurement of Icon Aesthetics. [Master’s Thesis, Huaqiao University].
75. Domain specificity versus expertise: Factors influencing distinct processing of faces10.1016/S0010-0277(01)00162-7 ↗
76. Effects of Luminance Contrast and Combinations on IVIS Inter face Cognition
77. Experimental study on the relationship between the harmony and cognitive load of business intelligence dashboard color combinations10.1002/col.22768 ↗
78. Liu, Z., Lv, Y., and Xiao, Y. (2022, January 16–18). Research on the Exhibition Mode of Airport Cultural Space Based on Visual Attraction in Interest Area: Take Guangzhou Baiyun International Airport as an Example. Proceedings of the 2022 National Conference on Teaching and Research of Architectural Digital Technology and DADA2022 Conference on Digital Architecture, Xiamen, China, Nanjing, China.
79. Research of Spatial Cognition Based on the Synchronous Detection of EEG and Eye Movement in the Underground Public Space
80. Exploring Neuro-Physiological Correlates of Drivers’ Mental Fatigue Caused by Sleep Deprivation Using Simultaneous EEG, ECG, and fNIRS Data10.3389/fnhum.2016.00219 ↗
81. Ohkubo, T., Yamamaru, K., and Koshimizu, S. (2018, January 5–8). Development of the impression detection system by using a portable EEG device for tourist impression analysis. Proceedings of the Joint 10th International Conference on Soft Computing and Intelligent Systems (SCIS)/19th International Symposium on Advanced Intelligent Systems (ISIS), Toyama, Japan.10.1109/SCIS-ISIS.2018.00200 ↗
82. Spatial Quality Analysis of Traditional Villages Based on Eye Tracking Technology
83. Optimization Design of Urban Tunnel Lighting
84. Fixation distribution of driver while driving through passageways with different widths
85. Jagerbrand, A.K., Antonson, H., and Ahlstrom, C. (2018). Speed reduction effects over distance of animal-vehicle collision countermeasures—A driving simulator study. Eur. Transp. Res. Rev., 10.10.1186/s12544-018-0314-8 ↗
86. Traffic Engineering Facility Information Threshold Based on Driver’s Visual Area of Interest
87. Cognitive processing of traffic signs in immersive virtual reality environment: An ERP study10.1016/j.neulet.2010.08.059 ↗
88. Semantic processing and emotional evaluation in the traffic sign understanding process: Evidence from an event-related potential study10.1016/j.trf.2018.08.020 ↗
89. Influence of Visual Stimuli on Driving Behavior in the form of Linear Spatial Layout of Urban Expressway Median Strip
90. Influences of Spatial Physical Order on Badminton Players’ Sports Moral Judgement Based on ERP
91. An image segmentation compression method based on visual entropy
92. Devlin, S.P., Brown, N.L., Drollinger, S., Sibley, C., Alami, J., and Riggs, S.L. (2022). Scan-based eye tracking measures are predictive of workload transition performance. Appl. Ergon., 105.10.1016/j.apergo.2022.103829 ↗
93. An ldentification Method of Fatigue Driving Based on ROC Curves
94. How Do Expert Reviews and Consumer Reviews Affect Purchasing Decisions? An Event-Related Potential Study10.1037/npe0000157 ↗
95. Practical Field Use of Eye-tracking Devices for Consumer Research in the Retail Environment10.21273/HORTTECH.23.4.517 ↗
96. Bialkova, S., Grunert, K.G., and van Trijp, H. (2020). From desktop to supermarket shelf: Eye-tracking exploration on consumer attention and choice. Food Qual. Prefer., 81.10.1016/j.foodqual.2019.103839 ↗
97. Consumer neuroscience: Assessing the brain response to marketing stimuli using electroencephalogram (EEG) and eye tracking10.1016/j.eswa.2012.12.095 ↗
98. The shopping brain: Math anxiety modulates brain responses to buying decisions10.1016/j.biopsycho.2011.10.011 ↗
99. Cherubino, P., Caratu, M., Modica, E., Rossi, D., Trettel, A., Maglione, A.G., Della Casa, R., Dall’Olio, M., Quadretti, R., and Babiloni, F. (December, January 30). Assessing Cerebral and Emotional Activity During the Purchase of Fruit and Vegetable Products in the Supermarkets. Proceedings of the Conference on Computational Methods in Experimental Economics (CMEE), Szczecin, Poland.
100. Etienne, A., Laroia, T., Weigle, H., Afelin, A., Kelly, S.K., Krishnan, A., and Grover, P. (2020, January 20–24). Novel Electrodes for Reliable EEG Recordings on Coarse and Curly Hair. Proceedings of the 42nd Annual International Conference of the IEEE-Engineering-in-Medicine-and-Biology-Society (EMBC), Montreal, QC, Canada.10.1109/EMBC44109.2020.9176067 ↗