journal article·2021-05-12Open access

Recognition of Customers’ Impulsivity from Behavioral Patterns in Virtual Reality

Masoud Moghaddasi, Javier Marín-Morales, Jaikishan Khatri, Jaime Guixeres, Irene Alice Chicchi Giglioli, Mariano Alcañiz

Applied Sciences· Volume 11· Issue 10

Abstract

Virtual reality (VR) in retailing (V-commerce) has been proven to enhance the consumer experience. Thus, this technology is beneficial to study behavioral patterns by offering the opportunity to infer customers’ personality traits based on their behavior. This study aims to recognize impulsivity using behavioral patterns. For this goal, 60 subjects performed three tasks—one exploration task and two planned tasks—in a virtual market. Four noninvasive signals (eye-tracking, navigation, posture, and interactions), which are available in commercial VR devices, were recorded, and a set of features were extracted and categorized into zonal, general, kinematic, temporal, and spatial types. They were input into a support vector machine classifier to recognize the impulsivity of the subjects based on the I-8 questionnaire, achieving an accuracy of 87%. The results suggest that, while the exploration task can reveal general impulsivity, other subscales such as perseverance and sensation-seeking are more related to planned tasks. The results also show that posture and interaction are the most informative signals. Our findings validate the recognition of customer impulsivity using sensors incorporated into commercial VR devices. Such information can provide a personalized shopping experience in future virtual shops.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Consumer Retail Behavior Studies · Color perception and design · Multisensory perception and integration

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Instituto de Investigación e Innovación en Bioingeniería, Universitat Politécnica de València, 46022 València, Spain

Funding

European Commission · Generalitat Valenciana · The European Regional Development Fund program of the Valencian Community

References (76)

Show source-provided references
1. How virtual reality affects consumer choice10.1016/j.jbusres.2020.06.004 ↗
2. Earnshaw, R.A. (2014). Virtual Reality Systems, Academic Press.
3. Cheng, L., Liu, Q., and Ronzhin, A. (2016). Hot-Redundancy CPCI Measurement and Control System Based on Probabilistic Neural Networks. Advances in Neural Networks—ISNN 2016, Springer International Publishing.10.1007/978-3-319-40663-3 ↗
4. Xi, N., and Hamari, J. (2019, January 15–17). VR shopping: A review of literature. Proceedings of the 25th Americas Conference on Information Systems (AMCIS), Cancun, Mexico.
5. Mar, J., Llinares, C., Guixeres, J., and Alcañiz, M. (2020). Emotion Recognition in Immersive Virtual Reality: From Statistics to Affective Computing. Sensors, 20.10.3390/s20185163 ↗
6. The emma project: Emotions as a determinant of presence
7. Virtual reality in marketing: A framework, review, and research agenda
8. Virtual Reality Now a Research Reality
9. A new marketing paradigm for electronic commerce10.1080/019722497129278 ↗
10. Modeling innovative points of sales through virtual and immersive technologies10.1016/j.jretconser.2012.02.002 ↗
11. Using a 3D virtual supermarket to measure food purchase behavior: A validation study10.2196/jmir.3774 ↗
12. Adapting to a retail environment: Modeling consumer-environment interactions10.1016/j.jbusres.2009.05.004 ↗
13. When demand accelerates demand: Trailing the bandwagon10.1016/j.jcps.2009.01.001 ↗
14. Can a virtual supermarket bring realism into the lab? Comparing shopping behavior using virtual and pictorial store representations to behavior in a physical store10.1016/j.appet.2016.07.033 ↗
15. A Novel Integrating Virtual Reality Approach for the Assessment of the Attachment Behavioral System10.3389/fpsyg.2017.00959 ↗
16. Rossi, P., and Krey, N. (2019). Visual Attention in Virtual Reality Settings: An Abstract. Finding New Ways to Engage and Satisfy Global Customers, Springer International Publishing.10.1007/978-3-030-02568-7 ↗
17. Development and evaluation of a virtual reality grocery shopping application using a multi-kinect walking-in-place approach10.1007/978-3-319-73888-8_57 ↗
18. Combining virtual reality and mobile eye tracking to provide a naturalistic experimental environment for shopper research10.1016/j.jbusres.2017.09.028 ↗
19. Stephanidis, C., and Antona, M. (2020). Segmentation of Areas of Interest Inside a Virtual Reality Store. HCI International 2020—Posters, Springer International Publishing.
20. Speicher, M., Hell, P., Daiber, F., Simeone, A., and Krüger, A. (June, January 29). A virtual reality shopping experience using the apartment metaphor. Proceedings of the 2018 International Conference on Advanced Visual Interfaces, Castiglione della Pescaia, Italy.10.1145/3206505.3206518 ↗
21. Consumers’ food selection behaviors in three-dimensional (3D) virtual reality10.1016/j.foodres.2018.02.033 ↗
22. Evaluating the effects of collaboration and competition in navigation tasks and spatial knowledge acquisition within virtual reality environments10.1016/j.future.2018.02.029 ↗
23. Stephanidis, C., and Antona, M. (2020). Optimizing Virtual Reality Eye Tracking Fixation Algorithm Thresholds Based on Shopper Behavior and Age. HCI International 2020—Posters, Springer International Publishing.
24. The past, present, and future of virtual and augmented reality research: A network and cluster analysis of the literature10.3389/fpsyg.2018.02086 ↗
25. Marketing Strategies in Virtual Worlds10.1145/1314234.1314248 ↗
26. The examination of virtual reality at the intersection of consumer experience, shopping journey and physical retailing10.1016/j.jretconser.2019.02.016 ↗
27. Jung, T., and Tom Dieck, M.C. (2018). Augmented Reality and Virtual Reality in Physical and Online Retailing: A Review, Synthesis and Research Agenda. Augmented Reality and Virtual Reality: Empowering Human, Place and Business, Springer International Publishing.10.1007/978-3-319-64027-3 ↗
28. Stone, M., and D’Onfro, J. (2021, January 10). The Inspiring Life Story of Alibaba Founder Jack Ma, Now the Richest Man in China. Available online: https://www.businessinsider.com/the-inspiring-life-story-of-alibaba-founder-jack-ma-2014-10.
29. Virtual reality through the customer journey: Framework and propositions10.1016/j.jretconser.2020.102056 ↗
30. Marín-Morales, J., Higuera-Trujillo, J.L., Greco, A., Guixeres, J., Llinares, C., Gentili, C., Scilingo, E.P., Alcañiz, M., and Valenza, G. (2019). Real vs. immersive-virtual emotional experience: Analysis of psycho-physiological patterns in a free exploration of an art museum. PLoS ONE, 14.10.1371/journal.pone.0223881 ↗
31. Navigation Comparison between a Real and a Virtual Museum: Time-dependent Differences using a Head Mounted Display10.1093/iwc/iwz018 ↗
32. A prospective randomized study to test the transfer of basic psychomotor skills from virtual reality to physical reality in a comparable training setting10.1097/01.sla.0000154552.89886.91 ↗
33. Tian, P., Wang, Y., Lu, Y., Zhang, Y., Wang, X., and Wang, Y. (2019, January 14–17). Behavior analysis of indoor escape route-finding based on head-mounted vr and eye tracking. Proceedings of the 2019 International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData), Atlanta, GA, USA.10.1109/iThings/GreenCom/CPSCom/SmartData.2019.00090 ↗
34. Yin, H., Camacho, D., Novais, P., and Tallón-Ballesteros, A.J. (2018). Finding the Importance of Facial Features in Social Trait Perception. Intelligent Data Engineering and Automated Learning—IDEAL 2018, Springer International Publishing.10.1007/978-3-030-03493-1 ↗
35. Pfeiffer, J., Pfeiffer, T., Meißner, M., and Weiß, E. (2020). Eye-Tracking-Based Classification of Information Search Behavior Using Machine Learning: Evidence from Experiments in Physical Shops and Virtual Reality Shopping Environments. Inf. Syst. Res.10.1287/isre.2019.0907 ↗
36. The Effect of Individual Differences on Adolescents’ Impulsive Buying Behavior
37. The Influence of Impulsive Personality Traits and Store Environment on Impulse Buying of Consumer in Karachi
38. Testing and incorporating additional determinants of ethics in counterfeiting luxury research according to the theory of planned behavior10.2298/PSI170211014Z ↗
39. The effects of personality, culture and store stimuli on impulsive buying behavior: Evidence from emerging market of Pakistan10.1108/APJML-09-2018-0377 ↗
40. How website quality affects online impulse buying: Moderating effects of sales promotion and credit card use10.1108/APJML-04-2017-0073 ↗
41. Customer impulse purchasing behavior10.1177/002224376700400102 ↗
42. Personality and impulsive buying behaviors. A necessary condition analysis
43. Effect of family environment on adolescent compulsive buying: Mediating role of self-esteem10.1108/APJML-05-2015-0082 ↗
44. The Buying Impulse10.1086/209105 ↗
45. Normative Behavior Influences on Impulsive Buying Trait Aspects of Buying Impulsiveness10.1086/209452 ↗
46. The influence of website characteristics on a consumer’s urge to buy impulsively10.1287/isre.1070.0157 ↗
47. The role of impulsiveness in a TAM-based online purchasing behavior model10.4018/irmj.2006040104 ↗
48. Online Impulse Buying: Understanding the Interplay between Consumer Impulsiveness and Website Quality
49. The Five Factor Model and impulsivity: Using a structural model of personality to understand impulsivity10.1016/S0191-8869(00)00064-7 ↗
50. Buss, A.H., and Plomin, R. (1975). A Temperament Theory of Personality Development, Wiley & Sons.
51. Age norms for impulsiveness, venturesomeness and empathy in adults10.1016/0191-8869(85)90011-X ↗
52. Functional and Dysfunctional Impulsivity: Personality and Cognitive Correlates10.1037/0022-3514.58.1.95 ↗
53. Factor structure of the Barratt Impulsiveness Scale10.1002/1097-4679(199511)51:6<768::AID-JCLP2270510607>3.0.CO;2-1 ↗
54. Die Skala Impulsives Verhalten-8 (I-8) [The Scale Impulsive Behaviour-8 (I-8)]
55. Running on empty—Users’ charging behavior of electric vehicles versus traditional refueling10.1016/j.trf.2018.09.024 ↗
56. Pessimistic outcome expectancy does not explain ambiguity aversion in decision-making under uncertainty10.1038/s41598-019-48707-y ↗
57. Lindheimerid, N., Nicolai, J., and Moshagen, M. (2020). General rather than specific: Cognitive deficits in suppressing task irrelevant stimuli are associated with buying-shopping disorder. PLoS ONE, 15.10.1371/journal.pone.0237093 ↗
58. Coping with distress by eating or drinking: Role of trait urgency and expectancies10.1037/0893-164X.18.3.269 ↗
59. Impulsivity-like traits and risky driving behaviors among college students10.1016/j.aap.2013.01.009 ↗
60. Negative Urgency and Lack of Perseverance: Identification of Differential Pathways of Onset and Maintenance Risk in the Longitudinal Prediction of Nonsuicidal Self-Injury10.1016/j.beth.2015.03.002 ↗
61. A systematic review of consumer behaviour prediction studies
62. Jain, P.K., and Pamula, R. (2020). A systematic literature review on machine learning applications for consumer sentiment analysis using online reviews. arXiv, Available online: https://arxiv.org/abs/2008.10282.10.1016/j.cosrev.2021.100413 ↗
63. Alcañiz Raya, M., Marín-Morales, J., Minissi, M.E., Teruel Garcia, G., Abad, L., and Chicchi Giglioli, I.A. (2020). Machine Learning and Virtual Reality on Body Movements’ Behaviors to Classify Children with Autism Spectrum Disorder. J. Clin. Med., 9.10.3390/jcm9051260 ↗
64. Lopes, P., Tian, N., and Boulic, R. (2020, January 22–26). Exploring Blink-Rate Behaviors for Cybersickness Detection in VR. Proceedings of the 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Atlanta, GA, USA.10.1109/VRW50115.2020.00248 ↗
65. Sorensen, H. (2016). Inside the Mind of the Shopper: The Science of Retailing, FT Press.
66. De-Juan-Ripoll, C., Llanes-Jurado, J., Giglioli, I.A.C., Marín-Morales, J., and Alcañiz, M. (2021). An Immersive Virtual Reality Game for Predicting Risk Taking through the Use of Implicit Measures. Appl. Sci., 11.10.3390/app11020825 ↗
67. The Spheres & Shield Maze Task: A Virtual Reality Serious Game for the Assessment of Risk Taking in Decision Making10.1089/cyber.2019.0761 ↗
68. (2021, January 10). © 2021 Unity Technologies. Available online: https://unity.com/.
69. (2021, January 10). © 2021–2021 HTC Corporation. Available online: https://www.vive.com/.
70. (2021, January 10). VIVE Pro Eye Specs & User Guide. Available online: https://developer.vive.com/resources/vive-sense/hardware-guide/vive-pro-eye-specs-user-guide/.
71. Llanes-Jurado, J., Marín-Morales, J., Guixeres, J., and Alcañiz, M. (2020). Development and calibration of an eye-tracking fixation identification algorithm for immersive virtual reality. Sensors, 20.10.3390/s20174956 ↗
72. Overfitting and Undercomputing in Machine Learning10.1145/212094.212114 ↗
73. An introduction to ROC analysis10.1016/j.patrec.2005.10.010 ↗
74. Defensive Postures Decrease Consumption Desire and Purchase Intention
75. Accommodative and vergence responses to conflicting blur and disparity stimuli during development10.1167/9.11.4 ↗
76. Screen Door Effect Mitigation and Its Quantitative Evaluation in VR Display10.1002/sdtp.11847 ↗