Evaluating the Impact of VR Training Strategies on HRI Cooperative Assembly Performance
Source abstract
Abstract
Virtual Reality (VR) has emerged as a powerful tool for improving training strategies in advanced manufacturing through immersive experiences. Within this context, this study examines the impact of two training strategies, VR and Video-Based (VB) instructions, on system performance (execution time and human errors) in a cooperative Human–Robot Interaction (HRI) assembly task. Overall, 26 participants completed the task after receiving either VR or VB training, and a sub-sample of 6 people per group returned one month later to repeat the task, enabling an evaluation of performance over time. Objective and subjective metrics were collected, and statistical and effect size analyses were conducted to compare training effects across sessions. Results show that execution times and number of errors were comparable between VR and VB in the first real session. After one month, both groups exhibited improved performance, but VR-trained participants retained, on average, lower error rates, with a 71% reduction and the number of errors dropping to zero, and more stable error patterns, whereas VB-trained participants displayed greater variability and occasional accuracy degradation during repeated task execution. Moreover, within-group comparisons show that VR training is more effective for accuracy-critical cooperative HRI tasks. At the same time, VB remains a low-cost option for time-focused contexts, shedding light on how training modalities influence learning and forgetting in Industry 5.0.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Augmented Reality Applications · Virtual Reality Applications and Impacts · Teleoperation and Haptic Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Industrial Engineering, University of Salerno, 84084 Fisciano, Italy
References (62)
Show source-provided references
1. Challenges and Opportunities in Human Robot Collaboration Context of Industry 4.0—A State of the Art Review10.1108/IR-04-2021-0077 ↗
2. A Taxonomy of Factors Influencing Worker’s Performance in Human–Robot Collaboration10.1049/cim2.12069 ↗
3. Collaborative Assembly in Hybrid Manufacturing Cells: An Integrated Framework for Human-Robot Interaction10.1109/TASE.2017.2748386 ↗
4. Di Pasquale, V., Cutolo, P., Esposito, C., Franco, B., Iannone, R., and Miranda, S. (2024). Virtual Reality for Training in Assembly and Disassembly Tasks: A Systematic Literature Review. Machines, 12.10.3390/machines12080528 ↗
5. Dwivedi, P., Cline, D., Joe, C., and Etemadpour, R. (2018, January 9–13). Manual Assembly Training in Virtual Environments. Proceedings of the IEEE 18th International Conference on Advanced Learning Technologies (ICALT), Mumbai, India.10.1109/ICALT.2018.00100 ↗
6. Assessing Operator Stress in Collaborative Robotics: A Multimodal Approach10.1016/j.apergo.2024.104418 ↗
7. A Comprehensive Method to Design and Assess Mixed Reality Simulations10.1007/s10055-022-00632-8 ↗
8. Virtual Reality as a Tool for Learning: The Past, Present and the Prospect
9. Integration of Wearable Electronics and Heart Rate Variability for Human Physical and Mental Well-Being Assessment10.1088/1674-4926/24080026 ↗
10. Agile Implementation of Virtual Reality in Learning Factories10.1016/j.promfg.2020.04.029 ↗
11. Learning and Transfer of Complex Motor Skills in Virtual Reality: A Perspective Review10.1186/s12984-019-0587-8 ↗
12. A Systematic Review of Immersive Virtual Reality Applications for Higher Education: Design Elements, Lessons Learned, and Research Agenda10.1016/j.compedu.2019.103778 ↗
13. Virtual Reality in Human-Robot Interaction: Challenges and Benefits10.3934/era.2023121 ↗
14. Liu, O., Rakita, D., Mutlu, B., and Gleicher, M. (September, January 28). Understanding Human-Robot Interaction in Virtual Reality. Proceedings of the 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN), Lisbon, Portugal.
15. 135. The Virtualization of Human–Robot Interactions: A User-Centric Workload Assessment10.1007/s10055-022-00667-x ↗
16. Plomin, J., Schweidler, P., and Oehme, A. (2023). Virtual Reality Check: A Comparison of Virtual Reality, Screen-Based, and Real World Settings as Research Methods for HRI. Front. Robot. AI, 10.10.3389/frobt.2023.1156715 ↗
17. Multimodal Human–Robot Interaction for Human-Centric Smart Manufacturing: A Survey10.1002/aisy.202300359 ↗
18. Zhu, Q., and Du, J. (2020). Neural Functional Analysis in Virtual Reality Simulation: Example of a Human-Robot Collaboration Tasks. Proceedings of the Winter Simulation Conference, Institute of Electrical and Electronics Engineers Inc.10.1109/WSC48552.2020.9384065 ↗
19. Higgins, P., Barron, R., Engel, D., and Matuszek, C. (2023). A Comparative Analysis of VR-Based and Real-World Human-Robot Collaboration for Small-Scale Joining. Proceedings of the 2023 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops, VRW 2023, Institute of Electrical and Electronics Engineers Inc.10.1109/VRW58643.2023.00265 ↗
20. Virtual Reality in Manufacturing: Immersive and Collaborative Artificial-Reality in Design of Human-Robot Workspace10.1080/0951192X.2019.1690685 ↗
21. Takahashi, N., Inamura, T., Mizuchi, Y., and Choi, Y. (2021, January 8–12). Evaluation of the Difference of Human Behavior between VR and Real Environments in Searching and Manipulating Objects in a Domestic Environment. Proceedings of the 2021 30th IEEE International Conference on Robot & Human Interactive Communication (RO-MAN), Vancouver, BC, Canada.10.1109/RO-MAN50785.2021.9515393 ↗
22. Effectiveness and Acceptability of a Virtual Environment for Assessing Human–Robot Collaboration in Manufacturing10.1007/s00170-017-0428-5 ↗
23. Urrea, C., and Kern, J. (2025). Recent Advances and Challenges in Industrial Robotics: A Systematic Review of Technological Trends and Emerging Applications. Processes, 13.10.3390/pr13030832 ↗
24. Hoedt, S., Claeys, A., Aghezzaf, E.H., and Cottyn, J. (2020). Real Time Implementation of Learning-Forgetting Models for Cycle Time Predictions of Manual Assembly Tasks after a Break. Sustainability, 12.10.3390/su12145543 ↗
25. Higgins, P., Barron, R., Engel, D., and Matuszek, C. (2021). Lessons from a Small-Scale Robot Joining Experiment in VR, Association for Computing Machinery.
26. Measurement of Cognitive Load in Instructional Research10.2466/pms.1994.79.1.419 ↗
27. Exploring the Impact of Human-Robot Interaction on Workers’ Mental Stress in Collaborative Assembly Tasks10.1016/j.apergo.2024.104224 ↗
28. Cognitive Architecture and Instructional Design10.1023/A:1022193728205 ↗
29. Man and Automation10.2307/2002208 ↗
30. The Role of Human Error in Human Robot Interaction10.1016/j.procs.2025.01.295 ↗
31. Testing Robot System Safety by Creating Hazardous Human Worker Behavior in Simulation10.1109/LRA.2021.3133612 ↗
32. Kalatzis, A., Rahman, S., Girishan Prabhu, V., Stanley, L., and Wittie, M. (2023). A Multimodal Approach to Investigate the Role of Cognitive Workload and User Interfaces in Human-Robot Collaboration. Proceedings of the ACM International Conference Proceeding Series, Association for Computing Machinery.10.1145/3577190.3614112 ↗
33. Evaluation of User Experience in Human–Robot Interaction: A Systematic Literature Review10.1007/s12369-022-00957-z ↗
34. Farina, P., Rinaldi, M., Di Pasquale, V., Fera, M., Macchiaroli, R., and Riemma, S. (2025, January 10–12). Mental Stress in Human-Robot Interaction: Experimental Insights from a Cooperative Assembly Task. Proceedings of the XXX Summer School F. Turco-AIDI, Lecce, Italy.
35. Evaluating Quality in Human-Robot Interaction: A Systematic Search and Classification of Performance and Human-Centered Factors, Measures and Metrics towards an Industry 5.010.1016/j.jmsy.2022.04.007 ↗
36. Paletta, L., Pszeida, M., Ganster, H., Fuhrmann, F., Weiss, W., Ladstatter, S., Dini, A., Murg, S., Mayer, H., and Brijacak, I. (2019, January 10–13). Gaze-Based Human Factors Measurements for the Evaluation of Intuitive Human-Robot Collaboration in Real-Time. Proceedings of the 24th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Zaragoza, Spain.10.1109/ETFA.2019.8869270 ↗
37. Spielberger, C.D. (1983). State-Trait Anxiety Inventory. The Corsini Encyclopedia of Psychology, John Wiley & Sons, Inc.10.1037/t06496-000 ↗
38. Bartneck, C. (2023). Godspeed Questionnaire Series: Translations and Usage. International Handbook of Behavioral Health Assessment, Springer.10.1007/978-3-030-89738-3_24-1 ↗
39. Human-Robot Interaction: A Conceptual Framework for Task Performance Analysis
40. Human–Robot Interaction in Industry: A Tertiary Study10.1016/j.procs.2025.01.231 ↗
41. Alves, J., Lima, T.M., and Gaspar, P.D. (2023). Is Industry 5.0 a Human-Centred Approach? A Systematic Review. Processes, 11.10.3390/pr11010193 ↗
42. Rossi, P.G. (2017). Social Robotics, Springer.10.1515/rem-2017-0001 ↗
43. A Global Measure of Perceived Stress10.2307/2136404 ↗
44. MEC Spatial Presence Questionnaire (MEC-SPQ)
45. Lewis, J.R., Utesch, B.S., and Maher, D.E. (May, January 27). UMUX-LITE—When There’s No Time for the SUS. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Paris, France.
46. Virtual Reality Sickness Questionnaire (VRSQ): Motion Sickness Measurement Index in a Virtual Reality Environment10.1016/j.apergo.2017.12.016 ↗
47. A Transparency-Based Action Model Implemented in a Robotic Physical Trainer for Improved HRI
48. Aschenbrenner, D., Leutert, F., Çençen, A., Verlinden, J., Schilling, K., Latoschik, M., and Lukosch, S. (2019). Comparing Human Factors for Augmented Reality Supported Single-User and Collaborative Repair Operations of Industrial Robots. Front. Robot. AI, 6.10.3389/frobt.2019.00037 ↗
49. Hader, B., Wendelin, T., and Schlund, S. (2024). Improving Human-Robot Interaction Through Decision Support and Workplace-Based Learning: Prototype of a Worker Assistance System for Adaptive Task Sharing Between Robots and Humans. Learning Factories of the Future; Lecture Notes in Networks and Systems, Springer.10.1007/978-3-031-65411-4_34 ↗
50. Macdonald, S., Bretin, R., and Salma, E. (2024). Evaluating Transferable Emotion Expressions for Zoomorphic Social Robots using VR Prototyping. arXiv.10.1109/ISMAR62088.2024.00125 ↗
51. Interval and Effect Size10.4097/kjae.2016.69.6.555 ↗
52. Fitting Linear Mixed-Effects Models Using Lme410.18637/jss.v067.i01 ↗
53. Virtual Reality Simulation of Human-Robot Coexistence for an Aircraft Final Assembly Line: Process Evaluation and Ergonomics Assessment10.1080/0951192X.2021.1946855 ↗
54. Fratczak, P., Goh, Y.M., Kinnell, P., Soltoggio, A., and Justham, L. (2019). Understanding Human Behaviour in Industrial Human-Robot Interaction by Means of Virtual Reality. Proceedings of the ACM International Conference Proceeding Series, Association for Computing Machinery.10.1145/3363384.3363403 ↗
55. EUROCONTROL (2007). Human Factors Integration Framework Guidelines—HFIG–WP3: Detailed Framework and General Guidelines for Integration into ATM SMS, EUROCONTROL. Working Draft, Edition 1.0.
56. Multiple Resources and Mental Workload10.1518/001872008X288394 ↗
57. Reorganization and Plasticity in the Adult Brain during Learning of Motor Skills10.1016/j.conb.2005.03.004 ↗
58. A General Cost Model to Assess the Implementation of Collaborative Robots in Assembly Processes10.1007/s00170-023-10942-z ↗
59. Sustainability of Human-Robot Cooperative Configurations: Findings from a Case Study10.1016/j.cie.2023.109383 ↗
60. A New Engineering Design Paradigm—The Quadruple Bottom Line10.1016/j.procir.2014.06.145 ↗
61. Impact of VR-Based Training on Human–Robot Interaction for Remote Operating Construction Robots10.1061/(ASCE)CP.1943-5487.0001016 ↗
62. Design of a Virtual Reality Training System for Human–Robot Collaboration in Manufacturing Tasks10.1007/s12008-015-0259-2 ↗