Effectiveness of Driving Simulators for Drivers’ Training: A Systematic Review
Source abstract
Abstract
Although driving simulators could be commonly assumed as very useful technological resources for both novel and experienced drivers’ instruction under risk control settings, the evidence addressing their actual effectiveness seems substantially limited. Therefore, this study aimed to analyze the existing original literature on driving simulators as a tool for driver training/instruction, considering study features, their quality, and the established degree of effectiveness of simulators for these purposes. Methods: This study covered a final number of 17 empirical studies, filtered and analyzed in the light of the PRISMA methodology for systematic reviews of the literature. Results: Among a considerably reduced set of original research studies assessing the effectiveness of driving simulators for training purposes, most sources assessing the issue provided reasonably good insights into their value for improving human-based road safety under risk control settings. On the other hand, there are common limitations which stand out, such as the use of very limited research samples, infrequent follow-up of the training outcomes, and reduced information about the limitations targeted during the simulator-based training processes. Conclusions: Despite the key shortcomings highlighted here, studies have commonly provided empirical support on the training value of simulators, as well as endorsed the need for further evaluations of their effectiveness. The data provided by the studies included in this systematic review and those to be carried out in the coming years might provide data of interest for the development and performance improvement of specific training programs using simulators for driver instruction.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Traffic and Road Safety · Human-Automation Interaction and Safety · Older Adults Driving Studies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Research Institute on Traffic and Road Safety (INTRAS), University of Valencia, 46022 Valencia, Spain
Research Institute on Robotics, Information and Communication Technologies (IRTIC), University of Valencia, 46980 Valencia, Spain
Funding
Generalitat Valenciana
References (92)
Show source-provided references
1. Woodruff, R., Smith, J.F., Fuller, J.R., and Weyer, D.C. (1976). Full Mission Simulation in Undergraduate Pilot Training: An Exploratory Study, Defense Technical Information Center, Department of Defense.10.21236/ADA039267 ↗
2. Rolfe, J.M., and Staples, K.J. (1988). Flight Simulation, Cambridge University Press. No. 1.
3. Spencer, S.N. (2015). Proceedings of the 14th ACM SIGGRAPH International Conference on Virtual Reality Continuum and Its Applications in Industry, Kobe, Japan 30 October–1 November 2015, ACM.
4. Huang, H.M., Hira, R., and Feldman, P. (1992). A Submarine Simulator Driven by a Hierarchical Real-Time Control System Architecture, National Institute of Standards and Technology. NIST IR 4875.10.6028/NIST.IR.4875 ↗
5. The design of a submarine voyage training simulator10.1109/ICSMC.1998.726664 ↗
6. Alcohol effects on driving behavior and performance in a car simulator10.1109/TSMC.1975.5408372 ↗
7. Wymann, B., Espié, E., Guionneau, C., Dimitrakakis, C., Coulom, R., and Sumner, A. (2023, January 07). Torcs, the Open Racing Car Simulator. Available online: http://torcs.sourceforge.net.
8. Robin, J.L., Knipling, R.R., Tidwell, S.A., Derrickson, L., Antonik, C., and McFann, J. (2005). Truck Simulator Validation (“SimVal”) Training Effectiveness Study, International Truck and Bus Safety and Security Symposium. Available online: https://trid.trb.org/view/1156437.
9. Sleepiness and performance of professional drivers in a truck simulator—Comparisons between day and night driving10.1046/j.1365-2869.1996.00013.x ↗
10. Hulbert, S., and Wojcik, C. (1972). Driving Tak Simulation. Human Factors in Highway Traffic Safety Research, Michigan State University.
11. A novel classification method for driving simulators based on existing flight simulator classification standards10.1016/j.trc.2014.02.011 ↗
12. Galloway, R.T. (2001, January 15–19). Model validation topics for real time simulator design courses. Proceedings of the Society for Modeling and Simulation International, 2001 Summer Computer Simulation Conference, Orlando, FL, USA.
13. Review on visualization technology in simulation training system for major natural disasters10.1007/s11069-022-05277-z ↗
14. Ng, T.S. (2021). Robotic Vehicles: Systems and Technology, Springer.10.1007/978-981-33-6687-9 ↗
15. Ploner-Bernard, H., Sontacchi, A., Lichtenegger, G., Vössner, S., and Braunstingl, R. (2005, January 20–22). Sound-system design for a professional full-flight simulator. Proceedings of the 8th International Conference on Digital Audio Effects (DAFx-05), Madrid, Spain.
16. Adaptive haptic feedback steering wheel for driving simulators10.1109/TVT.2008.2004493 ↗
17. Mohellebi, H., Espié, S., Arioui, H., Amouri, A., and Kheddar, A. (, January November). Low cost motion platform for driving simulator. Proceedings of the ICMA: International Conference on Machine Automation, Japan.
18. VR to OR: A review of the evidence that virtual reality simulation improves operating room performance10.1007/s00268-007-9307-9 ↗
19. Parkes, A.M., Reed, N., and Ride, N.M. (2005). Behavioural Research in Road Safety 2005: Fifteenth Seminar, Department for Transport.
20. Distinguishing games and simulation games from simulators10.1145/1129006.1129021 ↗
21. The new frontiers of edutainment: The development of an educational and socio-cultural phenomenon over time of globalization
22. Information technology and edutainment: Education and entertainment in the age of interactivity10.4018/jdldc.2013010102 ↗
23. Edutainment10.1177/14687984010013003 ↗
24. Cognitive styles and approaches to studying in management education10.1177/1052562905284674 ↗
25. Are Adult Driver Education Programs Effective? A Systematic Review of Evaluations of Accident Prevention Training Courses
26. Valero-Mora, P.M., Zacarés, J.J., Sánchez-García, M., Tormo-Lancero, M.T., and Faus, M. (2021). Conspiracy beliefs are related to the use of smartphones behind the wheel. Int. J. Environ. Health Res., 18.10.3390/ijerph18157725 ↗
27. Straus, S.H. (2005). New, Improved, Comprehensive, and Automated Driver’s License Test and Vision Screening System, Arizona Department of Transportation. No. FHWA-AZ-04- 559 (1).
28. Sætren, G.B., Pedersen, P.A., Robertsen, R., Haukeberg, P., Rasmussen, M., and Lindheim, C. (2018). Safety and Reliability–Safe Societies in a Changing World, CRC Press.
29. Effect of driving experience and driving inactivity on young driver’s hazard mitigation skills10.1016/j.trf.2018.09.003 ↗
30. Strain out a gnat and swallow a camel?—Vision and driving in the Nordic countries10.1111/aos.13741 ↗
31. Al-Garawi, N., Dalhat, M.A., and Aga, O. (2021). Assessing the road traffic crashes among novice female drivers in Saudi Arabia. Sustainability, 13.10.3390/su13158613 ↗
32. Performance measurement in simulation-based training: A review and best practices10.1177/1046878108326734 ↗
33. Schmitt, N., and Borman, W. (1993). Personnel Selection in Organizations, Jossey-Bass.
34. Ness, J.W., Tepe, V., and Ritzer, D. (2004). The Science and Simulation of Human Performance, Elsevier.10.1016/S1479-3601(2004)5 ↗
35. Designing performance measurement systems for teams: Theory and practice10.1108/00251740310496233 ↗
36. 25 years of team effectiveness in organizations: Research themes and emerging needs
37. Wilson, J.R., and Corlett, N. (2005). Evaluation of Human Work, Taylor & Francis. [3rd ed.].10.1201/9781420055948 ↗
38. A temporally based framework and taxonomy of team processes10.2307/259182 ↗
39. Team mental model: Construct or metaphor?
40. Castellan, N.J.J. (1993). Individual and Group Decision Making, Lawrence Erlbaum.
41. The influence of shared mental models on team process and performance10.1037/0021-9010.85.2.273 ↗
42. An analysis of team evolution and maturation10.1080/00221309.1993.9711148 ↗
43. Understanding team adaptation: A conceptual analysis & model10.1037/0021-9010.91.6.1189 ↗
44. Team leadership10.1016/S1048-9843(01)00093-5 ↗
45. Pearce, C.L., and Conger, J.A. (2004). Shared Leadership: Reframing the Hows and Whys of Leadership, Sage.10.4135/9781452229539 ↗
46. Backing up behaviors in teams: The role of personality and legitimacy of need10.1037/0021-9010.88.3.391 ↗
47. Time to create sound teamwork
48. The measurement of team mental models: We have no shared schema10.1177/109442810032001 ↗
49. Wilson, J.R., and Corlett, N. (2005). Evaluation of Human Work, Taylor & Francis.10.1201/9781420055948 ↗
50. The critical incident technique10.1037/h0061470 ↗
51. Salas, E., and Fiore, S.M. (2004). Team Cognition: Understanding the Factors that Drive Process and Performance, American Psychiatric Association.10.1037/10690-000 ↗
52. Retranslations or expectations: An approach to the construction of unambiguous anchors for rating scales
53. The recency effect: Implicit learning with explicit retrieval?10.3758/BF03202726 ↗
54. Smith, M.J., Salvendy, G., Harris, D., and Koubek, R.J. (2001). Usability Evaluation and Interface Design, Lawrence Erlbaum.
55. A measurement tool for simulation-based training in emergency medicine: The Simulation Module for Assessment of Resident Targeted Event Responses (SMARTER) approach10.1097/SIH.0b013e318173038d ↗
56. Papakostas, C., Troussas, C., Krouska, A., and Sgouropoulou, C. (2021). Measuring User Experience, Usability and Interactivity of a Personalized Mobile Augmented Reality Training System. Sensors, 21.10.3390/s21113888 ↗
57. User acceptance of augmented reality welding simulator in engineering training10.1007/s10639-020-10418-7 ↗
58. Are social networks effective in promoting healthy behaviors? A systematic review of evaluations of public health campaigns broadcast on Twitter10.3389/fpubh.2022.1045645 ↗
59. Alonso, F., Faus, M., Tormo, M.T., and Useche, S.A. (2022). Could technology and intelligent transport systems help improve mobility in an emerging country? Challenges, opportunities, gaps and other evidence from the caribbean. Appl. Sci., 12.10.3390/app12094759 ↗
60. Systematic literature review X narrative review10.1590/S0103-21002007000200001 ↗
61. Updating guidance for reporting systematic reviews: Development of the PRISMA 2020 statement10.1016/j.jclinepi.2021.02.003 ↗
62. Lundh, A., and Gøtzsche, P.C. (2008). Recommendations by Cochrane Review Groups for assessment of the risk of bias in studies. BMC Med. Res. Methodol., 8.10.1186/1471-2288-8-22 ↗
63. Scoping studies: Towards a methodological framework10.1080/1364557032000119616 ↗
64. Implementing surrogate safety measures in driving simulator and evaluating the safety effects of simulator-based training on risky driving behaviors10.1155/2020/7525721 ↗
65. Effectiveness of two cognitive training programs on the performance of older drivers with a cognitive self-assessment bias10.1007/s12544-016-0207-7 ↗
66. The evaluation of traditional and early driver training with simulated accident scenarios10.1177/0018720811413765 ↗
67. Behavioral and workload measures in real and simulated driving: Do they tell us the same thing about the validity of driving simulation?10.1016/j.ssci.2020.105046 ↗
68. Evaluation of a risk awareness perception training program on novice teen driver behavior at left-turn intersections10.3141/2516-03 ↗
69. Lavallière, M., Simoneau, M., Tremblay, M., Laurendeau, D., and Teasdale, N. (2012). Active training and driving-specific feedback improve older drivers’ visual search prior to lane changes. BMC Geriatr., 12.10.1186/1471-2318-12-5 ↗
70. A simulator evaluation of the effects of attention maintenance training on glance distributions of younger novice drivers inside and outside the vehicle10.1016/j.trf.2013.07.004 ↗
71. Long-lasting virtual motorcycle-riding trainer effectiveness10.3389/fpsyg.2015.01653 ↗
72. Does the use of a head mounted display increase the success of risk awareness and perception training (RAPT) for drivers?10.1016/j.apergo.2020.103076 ↗
73. Relationships between driving simulator performance and driving test results10.1080/00140130802277521 ↗
74. The drive-wise project: Driving simulator training increases real driving performance in healthy older drivers10.3389/fnagi.2014.00085 ↗
75. Speed-of-processing and driving simulator training result in improved driving performance10.1518/hfes.45.2.218.27241 ↗
76. Allen, R.W., Park, G.D., Cook, M.L., and Fiorentino, D. (2007, January 12–14). The effect of driving simulator fidelity on training effectiveness. Proceedings of the Driving Simulation Conference, North America 2007 (DSC-NA 2007), Iowa City, IA, USA.
77. Using eye movements to evaluate a PC-based risk awareness and perception training program on a driving simulator10.1518/001872006778606787 ↗
78. Can novice drivers be trained to scan for information that will reduce their likelihood of a crash?10.1136/ip.2006.012021 ↗
79. Optimising the value of the critical appraisal skills programme (CASP) tool for quality appraisal in qualitative evidence synthesis
80. Driver behavior modeling using game engine and real vehicle: A learning-based approach10.1109/TIV.2020.2991948 ↗
81. Carsten, O., and Jamson, A.H. (2011). Handbook of Traffic Psychology, Academic Press.
82. Systematic review of driving simulator validation studies10.1016/j.ssci.2019.04.004 ↗
83. An analysis of the relationship between driver characteristics and driving safety using structural equation models10.1016/j.trf.2019.02.004 ↗
84. Efficacy of training with driving simulators in improving safety in young novice or learner drivers: A systematic review10.1016/j.trf.2018.12.006 ↗
85. Transfer of skills learned on a driving simulator to on-road driving behavior10.3141/2660-01 ↗
86. Effectiveness evaluation of simulative workshops for newly licensed drivers10.1016/j.aap.2013.09.018 ↗
87. van Paridon, K., Timmis, M.A., and Sadeghi Esfahlani, S. (2021). Development and evaluation of a virtual environment to assess cycling hazard perception skills. Sensors, 21.10.3390/s21165499 ↗
88. Salvati, L., d’Amore, M., Fiorentino, A., Pellegrino, A., Sena, P., and Villecco, F. (2020). Development and Testing of a Methodology for the Assessment of Acceptability of LKA Systems. Machines, 8.10.3390/machines8030047 ↗
89. Alonso, F., Faus, M., Esteban, C., and Useche, S.A. (2021). Is there a predisposition towards the use of new technologies within the traffic field of emerging countries? The case of the Dominican Republic. Electronics, 10.10.3390/electronics10101208 ↗
90. Useche, S.A., Peñaranda-Ortega, M., Gonzalez-Marin, A., and Llamazares, F.J. (2022). Assessing the Effect of Drivers’ Gender on Their Intention to Use Fully Automated Vehicles. Appl. Sci., 12.10.3390/app12010103 ↗
91. Availability, Demand, Perceived Constraints and Disuse of ADAS Technologies in Spain: Findings from a National Study10.1109/ACCESS.2019.2939302 ↗
92. Dealing with the positive publication bias: Why you should really publish your negative results