The Trail Making Test in Virtual Reality (TMT-VR): The Effects of Interaction Modes and Gaming Skills on Cognitive Performance of Young Adults
Source abstract
Abstract
Virtual Reality (VR) is increasingly used in neuropsychological assessments due to its ability to simulate real-world environments. This study aimed to develop and evaluate the Trail Making Test in VR (TMT-VR) and investigate the effects of different interaction modes and gaming skills on cognitive performance. A total of 71 young female and male adults (aged 18–35) with high and low gaming skills participated in this study. Participants completed the TMT-VR using three interaction modes as follows: eye-tracking, head movement, and controller. Performance metrics included task completion time and accuracy. User experience, usability, and acceptability of TMT-VR were also examined. Results showed that both eye tracking and head movement modes significantly outperformed the controller in terms of task completion time and accuracy. No significant differences were found between eye tracking and head movement modes. Gaming skills did not significantly influence task performance using any interaction mode. The TMT-VR demonstrates high usability, acceptability, and user experience among participants. The findings suggest that VR-based assessments can effectively measure cognitive performance without being influenced by prior gaming skills, indicating potential applicability for diverse populations.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Virtual Reality Applications and Impacts · Spatial Cognition and Navigation · Gaze Tracking and Assistive Technology
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Psychology, The American College of Greece, 15342 Athens, Greece
Department of Informatics & Telecommunications, National and Kapodistrian University of Athens, 16122 Athens, Greece
Department of Psychology, National and Kapodistrian University of Athens, 15784 Athens, Greece
Department of Psychology, The University of Edinburgh, Edinburgh EH8 9Y, UK
References (82)
Show source-provided references
1. The Use of Virtual Reality in Psychology: A Case Study in Visual Perception10.1155/2015/151702 ↗
2. How Immersive Virtual Reality Methods May Meet the Criteria of the National Academy of Neuropsychology and American Academy of Clinical Neuropsychology: A Software Review of the Virtual Reality Everyday Assessment Lab (VR-EAL)10.1016/j.chbr.2021.100151 ↗
3. Using Simple Virtual Environments to Study the Differentiation and Integration of Sensory Cues in Complex Scenes10.1121/10.0022970 ↗
4. Thurley, K. (2022). Naturalistic Neuroscience and Virtual Reality. Front. Syst. Neurosci., 16.10.3389/fnsys.2022.896251 ↗
5. What Do Randomized Controlled Trials Say about Virtual Rehabilitation in Stroke? A Systematic Literature Review and Meta-Analysis of Upper-Limb and Cognitive Outcomes10.1186/s12984-018-0370-2 ↗
6. Virtual Reality for Stroke Rehabilitation
7. Georgiev, D.D., Georgieva, I., Gong, Z., Nanjappan, V., and Georgiev, G.V. (2021). Virtual Reality for Neurorehabilitation and Cognitive Enhancement. Brain Sci., 11.10.3390/brainsci11020221 ↗
8. Cybersickness in Virtual Reality Questionnaire (CSQ-VR): A Validation and Comparison against SSQ and VRSQ10.3390/virtualworlds2010002 ↗
9. The Opportunities of Virtual Reality in the Rehabilitation of Children with Attention Deficit Hyperactivity Disorder: A Literature Review10.3345/kjp.2017.60.11.337 ↗
10. Kourtesis, P., Kouklari, E.-C., Roussos, P., Mantas, V., Papanikolaou, K., Skaloumbakas, C., and Pehlivanidis, A. (2023). Virtual Reality Training of Social Skills in Adults with Autism Spectrum Disorder: An Examination of Acceptability, Usability, User Experience, Social Skills, and Executive Functions. Behav. Sci., 13.10.36227/techrxiv.22638736.v1 ↗
11. Action-Specific Perception & Performance on a Fitts’s Law Task in Virtual Reality: The Role of Haptic Feedback10.1109/TVCG.2022.3203003 ↗
12. Virtual Reality in Specialist Palliative Care: A Feasibility Study to Enable Clinical Practice Adoption10.1136/bmjspcare-2020-002327 ↗
13. Is Clinical Virtual Reality Ready for Primetime?10.1037/neu0000405 ↗
14. The Most Frequently Used Tests for Assessing Executive Functions in Aging10.1590/1980-57642015DN92000009 ↗
15. Antona, M., and Stephanidis, C. (2019). Taking Neuropsychological Test to the Next Level: Commercial Virtual Reality Video Games for the Assessment of Executive Functions. Proceedings of the Universal Access in Human-Computer Interaction. Multimodality and Assistive Environments, Orlando, FL, USA, 26–31 July 2019, Springer International Publishing.
16. Practice Effects Due to Serial Cognitive Assessment: Implications for Preclinical Alzheimer’s Disease Randomized Controlled Trials
17. Virtual Reality in Neuroscience Research and Therapy10.1038/nrn3122 ↗
18. Park, J.-H. (2022). Can the Virtual Reality-Based Spatial Memory Test Better Discriminate Mild Cognitive Impairment than Neuropsychological Assessment?. Int. J. Environ. Res. Public Health, 19.10.3390/ijerph19169950 ↗
19. Virtual Reality Stroop Task for Neurocognitive Assessment
20. Multimodal Virtual Reality-Based Assessment of Adult ADHD: A Feasibility Study in Healthy Subjects10.1177/10731911221089193 ↗
21. Can the Trail Making Test Be Substituted by a 3D Computerized Visit to a Supermarket? Clinical Implications
22. The Unity and Diversity of Executive Functions and Their Contributions to Complex “Frontal Lobe” Tasks: A Latent Variable Analysis10.1006/cogp.1999.0734 ↗
23. Comparison of Mental Rotation Ability, Attentional Capacity and Cognitive Flexibility in Action Video Gamers and Non-Gamers10.5817/CP2022-2-8 ↗
24. Enhanced Visual Short-Term Memory in Action Video Game Players10.3758/s13414-013-0487-0 ↗
25. Using Video Games to Improve Capabilities in Decision Making and Cognitive Skill: A Literature Review10.1016/j.procs.2020.12.027 ↗
26. Different Cognitive Abilities Displayed by Action Video Gamers and Non-Gamers10.1016/j.chb.2018.07.010 ↗
27. Impact of Playing Action and Puzzle Video-games on Attention and Executive Function
28. Virtual Reality Evaluation of the Spatial Learning Strategies in Gamers
29. Stadler, S., Cornet, H., and Frenkler, F. (2019, January 23–27). A Study in Virtual Reality on (Non-)Gamers’ Attitudes and Behaviors. Proceedings of the 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR), Osaka, Japan.10.1109/VR.2019.8797750 ↗
30. Virtual Reality for Psychological Assessment in Clinical Practice10.1037/pri0000028 ↗
31. Parsons, T.D. (2015). Virtual Reality for Enhanced Ecological Validity and Experimental Control in the Clinical, Affective and Social Neurosciences. Front. Hum. Neurosci., 9.10.3389/fnhum.2015.00660 ↗
32. Kourtesis, P., Collina, S., Doumas, L.A.A., and MacPherson, S.E. (2019). Technological Competence Is a Pre-Condition for Effective Implementation of Virtual Reality Head Mounted Displays in Human Neuroscience: A Technological Review and Meta-Analysis. Front. Hum. Neurosci., 13.10.3389/fnhum.2019.00342 ↗
33. Examining the Academic Trends in Neuropsychological Tests for Executive Functions Using Virtual Reality: Systematic Literature Review10.2196/30249 ↗
34. The Virtual Reality Head-Mounted Display Oculus Rift Induces Motion Sickness and Is Sexist in Its Effects10.1007/s00221-016-4846-7 ↗
35. Kourtesis, P., Korre, D., Collina, S., Doumas, L.A.A., and MacPherson, S.E. (2020). Guidelines for the Development of Immersive Virtual Reality Software for Cognitive Neuroscience and Neuropsychology: The Development of Virtual Reality Everyday Assessment Lab (VR-EAL), a Neuropsychological Test Battery in Immersive Virtual Reality. Front. Comput. Sci., 1.10.3389/fcomp.2019.00012 ↗
36. Cybersickness, Cognition, & Motor Skills: The Effects of Music, Gender, and Gaming Experience10.1109/TVCG.2023.3247062 ↗
37. Cybersickness in Virtual Reality: The Role of Individual Differences, Its Effects on Cognitive Functions and Motor Skills, and Intensity Differences during and after Immersion10.3390/virtualworlds3010004 ↗
38. Neural Correlates of a Standardized Version of the Trail Making Test in Young and Elderly Adults: A Functional near-Infrared Spectroscopy Study10.1016/j.neuropsychologia.2014.01.019 ↗
39. Administration and interpretation of the Trail Making Test10.1038/nprot.2006.390 ↗
40. Validation of the Virtual Reality Everyday Assessment Lab (VR-EAL): An Immersive Virtual Reality Neuropsychological Battery with Enhanced Ecological Validity10.1017/S1355617720000764 ↗
41. Kourtesis, P., Collina, S., Doumas, L.A.A., and MacPherson, S.E. (2019). Validation of the Virtual Reality Neuroscience Questionnaire: Maximum Duration of Immersive Virtual Reality Sessions Without the Presence of Pertinent Adverse Symptomatology. Front. Hum. Neurosci., 13.10.3389/fnhum.2019.00417 ↗
42. A Systematic Review of a Virtual Reality System from the Perspective of User Experience10.1080/10447318.2019.1699746 ↗
43. Cognitive Offloading Benefits Eye Gaze Interaction10.1002/acp.4098 ↗
44. Mutasim, A.K., Batmaz, A.U., and Stuerzlinger, W. (2021, January 25–27). Pinch, Click, or Dwell: Comparing Different Selection Techniques for Eye-Gaze-Based Pointing in Virtual Reality. Proceedings of the ACM Symposium on Eye Tracking Research and Applications, Virtual Event.10.1145/3448018.3457998 ↗
45. Eye Tracking in Virtual Reality: A Broad Review of Applications and Challenges10.1007/s10055-022-00738-z ↗
46. A Review of the Use of Virtual Reality Head-Mounted Displays in Education and Training10.1007/s10639-017-9676-0 ↗
47. A Combination of Eye-Gaze and Head-Gaze Interactions Improves Efficiency and User Experience in an Object Positioning Task in Virtual Environments10.1016/j.apergo.2022.103785 ↗
48. Comparison of Eye-Based and Controller-Based Selection in Virtual Reality10.1080/10447318.2020.1826190 ↗
49. Dual-Gain Mode of Head-Gaze Interaction Improves the Efficiency of Object Positioning in a 3D Virtual Environment10.1080/10447318.2023.2223861 ↗
50. Hansen, J.P., Rajanna, V., MacKenzie, I.S., and Bækgaard, P. (2018, January 15). A Fitts’ Law Study of Click and Dwell Interaction by Gaze, Head and Mouse with a Head-Mounted Display. Proceedings of the Workshop on Communication by Gaze Interaction, Warsaw, Poland.10.1145/3206343.3206344 ↗
51. Luro, F., and Sundstedt, V. (2019, January 25–28). A Comparative Study of Eye Tracking and Hand Controller for Aiming Tasks in Virtual Reality. Proceedings of the 2019 Symposium on Eye Tracking Research and Applications, Denver, CO, USA.10.1145/3317956.3318153 ↗
52. Špakov, O., Istance, H., Räihä, K.-J., Viitanen, T., and Siirtola, H. (2019, January 25–28). Eye Gaze and Head Gaze in Collaborative Games. Proceedings of the 11th ACM Symposium on Eye Tracking Research & Applications, Denver, CO, USA.10.1145/3317959.3321489 ↗
53. Lewis, J.R., and Sauro, J. (2021). Usability and User Experience: Design and Evaluation. Handbook of Human Factors and Ergonomics, John Wiley & Sons.10.1002/9781119636113.ch38 ↗
54. Mobile Technology in Medicine: Development and Validation of an Adapted System Usability Scale (SUS) Questionnaire and Modified Technology Acceptance Model (TAM) to Evaluate User Experience and Acceptability of a Mobile Application in MRI Safety Screening10.1055/s-0042-1758198 ↗
55. Virtual Reality Exposure-Based Therapy for the Treatment of Post-Traumatic Stress Disorder: A Review of Its Efficacy, the Adequacy of the Treatment Protocol, and Its Acceptability10.2147/NDT.S89542 ↗
56. Feasibility, Acceptability, and Clinical Implementation of an Immersive Virtual Reality Intervention to Address Psychological Well-Being in Children and Adolescents With Cancer10.1177/1043454220917859 ↗
57. A Mixed-Methods Investigation Into the Acceptability, Usability, and Perceived Effectiveness of Active and Passive Virtual Reality Scenarios in Managing Pain Under Experimental Conditions10.1093/jbcr/iry052 ↗
58. (2010). Ergonomics of Human-System Interaction (Standard No. ISO 9241-210:2010). Available online: https://www.iso.org/standard/52075.html.
59. de Clerk, M., Dangelmaier, M., Schmierer, G., and Spath, D. (2019). User Centered Design of Interaction Techniques for VR-Based Automotive Design Reviews. Front. Robot. AI, 6.10.3389/frobt.2019.00013 ↗
60. A Survey of 3D Object Selection Techniques for Virtual Environments10.1016/j.cag.2012.12.003 ↗
61. Mohan, P., Goh, W.B., Fu, C.-W., and Yeung, S.-K. (2018, January 16–20). DualGaze: Addressing the Midas Touch Problem in Gaze Mediated VR Interaction. Proceedings of the 2018 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Munich, Germany.10.1109/ISMAR-Adjunct.2018.00039 ↗
62. Controllers or Bare Hands? A Controlled Evaluation of Input Techniques on Interaction Performance and Exertion in Virtual Reality10.1109/TVCG.2023.3320211 ↗
63. Eschbach, R., Marcu, G.G., and Tominaga, S. (2008). Color Universal Design: The Selection of Four Easily Distinguishable Colors for All Color Vision Types. Proceedings of the Color Imaging XIII: Processing, Hardcopy, and Applications, San Jose, CA, USA, 27–31 January 2008, SPIE.
64. Validation of the Gaming Skills Questionnaire in Adolescence: Effects of Gaming Skills on Cognitive and Affective Functioning
65. Zioga, T., Ferentinos, A., Konsolaki, E., Nega, C., and Kourtesis, P. (2024). Video Game Skills across Diverse Genres and Cognitive Functioning in Early Adulthood: Verbal and Visuospatial Short-Term and Working Memory, Hand–Eye Coordination, and Empathy. Behav. Sci., 14.10.3390/bs14100874 ↗
66. Quantifying Beliefs Regarding Telehealth: Development of the Whole Systems Demonstrator Service User Technology Acceptability Questionnaire10.1177/1357633X16649531 ↗
67. Design and Evaluation of a Short Version of the User Experience Questionnaire (UEQ-S)
68. SUS: A Retrospective
69. R Core Team (2022). R: A Language and Environment for Statistical Computing, R Foundation for Statistical Computing.
70. RStudio Team (2022). RStudio: Integrated Development Environment for R, RStudio, PBC.
71. Peterson, R.A. (2024, September 03). bestNormalize: Normalizing Transformation Functions. Available online: https://cran.r-project.org/web/packages/bestNormalize/index.html.
72. Wickham, H. (2016). Ggplot2, Springer International Publishing. [2nd ed.].10.1007/978-3-319-24277-4 ↗
73. Wei, T., and Simko, V. (2024, September 03). Corrplot: Visualization of a Correlation Matrix. Available online: https://cran.r-project.org/web/packages/corrplot/index.html.
74. Singmann, H., Bolker, B., Westfall, J., Aust, F., and Ben-Shachar, M.S. (2024, September 03). Afex: Analysis of Factorial Experiments. Available online: https://cran.r-project.org/web/packages/afex/index.html.
75. Eichenberg, C., and Wolters, C. (2012). Virtual Realities in the Treatment of Mental Disorders: A Review of the Current State of Research. Virtual Reality in Psychological, Medical and Pedagogical Applications, BoD–Books on Demand.10.5772/50094 ↗
76. Neuroscience of Virtual Reality: From Virtual Exposure to Embodied Medicine10.1089/cyber.2017.29099.gri ↗
77. Davis, S., Nesbitt, K., and Nalivaiko, E. (2014, January 2–3). A Systematic Review of Cybersickness. Proceedings of the IE2014, Newcastle, NSW, Australia.10.1145/2677758.2677780 ↗
78. A Discussion of Cybersickness in Virtual Environments10.1145/333329.333344 ↗
79. Eye Tracking in Virtual Reality10.16910/jemr.12.1.3 ↗
80. Blattgerste, J., Renner, P., and Pfeiffer, T. (2018, January 15). Advantages of Eye-Gaze over Head-Gaze-Based Selection in Virtual and Augmented Reality under Varying Field of Views. Proceedings of the Workshop on Communication by Gaze Interaction, Warsaw, Poland.10.1145/3206343.3206349 ↗
81. Ahram, T., and Falcão, C. (2018). What Distinguishes a Traditional Gaming Experience from One in Virtual Reality? An Exploratory Study. Proceedings of the Advances in Human Factors in Wearable Technologies and Game Design, Los Angeles, CA, USA, 17–21 July 2017, Springer International Publishing.10.1007/978-3-319-60639-2 ↗
82. Meta-Analysis of Action Video Game Impact on Perceptual, Attentional, and Cognitive Skills10.1037/bul0000130 ↗