Model for Evaluating the Effectiveness of Practical Training with the Use of a High-End Driving Simulator
Source abstract
Abstract
Despite the progressive development of modern technology, there is a lack of adequate and reliable training and information materials. Analyses carried out in this area show that most drivers do not have the skills to use safety systems or acquire these skills while driving. Drivers often demonstrate an incomplete understanding of them and overestimate their skills, which can jeopardize road safety. In this context, the authors of the paper set out to develop a model for evaluating the effectiveness of practical training using a high-end simulator. The research goal of the paper was to objectively measure drivers’ progress in operating safety systems after receiving practical training conducted in the AS1200-6 driving simulator located at the Motor Transport Institute. The main findings indicate that the innovative model was highly effective, with 81% of participants achieving a level rated as “acceptable” or “very good”. The model enabled more accurate and objective assessments of skills in comparison with the traditional subjective assessment of trainers, especially where driver progress was not clearly evident. The results suggest that combining the data model with trainer evaluation can be an effective evaluation mechanism in ADAS training.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Human-Automation Interaction and Safety · Traffic and Road Safety · Technology and Human Factors in Education and Health
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Motor Transport Institute, 80 Jagiellońska St., 03-301 Warsaw, Poland
Division of Air Transport Engineering and Teleinformatics, Faculty of Transport, Warsaw University of Technology, 75 Koszykowa St., 00-662 Warsaw, Poland
References (53)
Show source-provided references
1. Bęczkowska, S., Czerepicki, A., Grabarek, I., Kozłowski, M., and Zysk, Z. (2023). Autonomous Vehicles as Viewed by Future Users in Poland. Sustainability, 15.10.3390/su152416627 ↗
2. Kędziorek, P., Kasprzyk, Z., Rychlicki, M., and Rosiński, A. (2023). Analysis and Evaluation of Methods Used in Measuring the Intensity of Bicycle Traffic. Energies, 16.10.3390/en16020752 ↗
3. Tomczuk, K., Tomczuk, P., and Chrzanowicz, M. (2024). Exploring the Feasibility of Autonomous Lighting Systems for Pedestrian Crossings in Off-Grid Areas. Appl. Sci., 14.10.3390/app14073054 ↗
4. Tomczuk, P., Wytrykowska, A., and Chrzanowicz, M. (2023). Analysis of Luminance Contrast Values at Illuminated Pedestrian Crossings in Urban Conditions. Energies, 16.10.3390/en16248031 ↗
5. Zamojski, W., Mazurkiewicz, J., Sugier, J., Walkowiak, T., and Kacprzyk, J. (July, January 30). Increasing Performance of SMS Based Information Systems. Proceedings of the Ninth International Conference on Dependability and Complex Systems DepCoS-RELCOMEX, Brunów, Poland. Advances in Intelligent Systems and Computing.
6. Rychlicki, M., Kasprzyk, Z., Pełka, M., and Rosiński, A. (2024). Use of Wireless Sensor Networks for Area-Based Speed Control and Traffic Monitoring. Appl. Sci., 14.10.3390/app14209243 ↗
7. Kowaleczko, P., Kamiński, T., Rychlicki, M., Kasprzyk, Z., Stawowy, M., and Trzeszkowski, J. (2025). Applying Machine Learning to Preselective Weighing of Moving Vehicles. Appl. Sci., 15.10.3390/app15041743 ↗
8. Park, J., Thota, B.K., and Somashekar, K. (2024). Sensor-Fused Nighttime System for Enhanced Pedestrian Detection in ADAS and Autonomous Vehicles. Sensors, 24.10.3390/s24144755 ↗
9. Scenario Identification and Classification to Support the Assessment of Advanced Driver Assistance Systems10.3390/applmech5030032 ↗
10. Bosurgi, G., Pellegrino, O., Ruggeri, A., and Sollazzo, G. (2023). The Role of ADAS While Driving in Complex Road Contexts: Support or Overload for Drivers?. Sustainability, 15.10.3390/su15021334 ↗
11. Bosurgi, G., Pellegrino, O., Ruggeri, A., and Sollazzo, G. (2023). The Effects of ADAS on Driving Behavior: A Case Study. Sensors, 23.10.3390/s23041758 ↗
12. Yang, E., and Yi, O. (2024). Enhancing Road Safety: Deep Learning-Based Intelligent Driver Drowsiness Detection for Advanced Driver-Assistance Systems. Electronics, 13.10.3390/electronics13040708 ↗
13. Sim, S., and Kim, C. (2024). Proposal of a Cost-Effective and Adaptive Customized Driver Inattention Detection Model Using Time Series Analysis and Computer Vision. World Electr. Veh. J., 15.10.3390/wevj15090400 ↗
14. Driver training challenges, barriers and needs arising from ADAS development10.5604/01.3001.0053.7074 ↗
15. Pełka, M. (2024). The Method for Evaluating the Effectiveness of Driver Training in Terms of Enhancing Road Safety. [Ph.D. Dissertation, Warsaw University of Technology].
16. Murtaza, M., Cheng, C.-T., Fard, M., and Zeleznikow, J. (2024). Assessing Training Methods for Advanced Driver Assistance Systems and Autonomous Vehicle Functions: Impact on User Mental Models and Performance. Appl. Sci., 14.10.3390/app14062348 ↗
17. Violations and errors during simulator-based driver training10.1080/00140130601032721 ↗
18. Piaseczna, N., Doniec, R., Sieciński, S., Barańska, K., Jędrychowski, M., and Grzegorzek, M. (2024). Driving Reality vs. Simulator: Data Distinctions. Electronics, 13.10.20944/preprints202404.1490.v1 ↗
19. Relationships between driving simulator performance and driving test results10.1080/00140130802277521 ↗
20. Allen, R.W., Park, G.D., Cook, M.L., and Fiorentino, D. (2007, January 12–14). The effect of driving simulator fidelity on training effectiveness. Proceedings of the Driving Simulator Conference North America 2007, Iowa City, IA, USA.
21. Simulator fidelity and validity in a transferof-training context10.3141/2185-06 ↗
22. Experience with a low cost PC-based system for young driver training
23. The TRAINER Project: The evaluation of a new simulator-based driver training methodology
24. Vlakveld, W.P. (2025, April 17). The use of simulators in basic driver training. Available online: https://www.researchgate.net/publication/228996846_The_use_of_simulators_in_basic_driver_training.
25. Alonso, F., Faus, M., Riera, J.V., Fernandez-Marin, M., and Useche, S.A. (2023). Effectiveness of Driving Simulators for Drivers’ Training: A Systematic Review. Appl. Sci., 13.10.3390/app13095266 ↗
26. Automated Driving Systems: Comparison of Training Methods’ Effectiveness10.20858/tp.2023.19.2.02 ↗
27. Eichberger, A., Kraut, M., and Koglbauer, I.V. (2022). Improved Perception of Motorcycles by Simulator-Based Driving Education. Sustainability, 14.10.3390/su14095283 ↗
28. I Drive Well, the Problem is the Other Driver, A Study About the Self-Assessment of the Ability to Drive10.15446/rcp.v30n2.78948 ↗
29. Characteristics of driving self-assessments and factors related to inaccurate self-assessment in Japanese older adults10.1016/j.aap.2021.106235 ↗
30. Effect of educational intervention addressing inaccurate self-assessment of driving performance in older Japanese adults10.1016/j.aap.2021.106460 ↗
31. Lajunen, T., Sullman, M.J., and Gaygısız, E. (2022). Self-Assessed Driving Skills and Risky Driver Behaviour Among Young Drivers: A Cross-Sectional Study. Front. Psychol., 13.10.3389/fpsyg.2022.840269 ↗
32. Accuracy of young male drivers’ self-assessments of driving skill10.1016/j.trf.2017.03.001 ↗
33. Stanton, N. (2018). Comparison Between Young Male Drivers’ Self-assessed and Objectively Measured Driving Skills. Advances in Human Aspects of Transportation. AHFE 2017, Springer. Advances in Intelligent Systems and Computing.
34. Self-evaluation of drivers’ skill: A cross-cultural comparison10.1016/0001-4575(89)90012-2 ↗
35. Factors underlying illusory self-assessment of driving skill in males and females10.1016/0001-4575(91)90034-3 ↗
36. Cross-cultural differences in driver self-assessment10.1016/0001-4575(89)90028-6 ↗
37. The application of learning theory to driving confidence: The effect of age and the impact of random breath testing10.1016/0001-4575(90)90061-O ↗
38. Are we all less risky and more skillful than our fellow driver?10.1016/0001-6918(81)90005-6 ↗
39. An exploration of the perceptions of the average driver’s speed compared to perceived safety and driving skill10.1016/S0001-4575(98)00035-9 ↗
40. Perception of the risk of an accident by young and older drivers10.1016/0001-4575(86)90043-6 ↗
41. Why it can’t happen to me: The base rate matters, but overestimating skill leads to underestimating risk10.1111/j.1559-1816.1997.tb00658.x ↗
42. It won’t happen to me: Unrealistic optimism or illusion of control?10.1111/j.2044-8295.1993.tb02461.x ↗
43. Assessing one’s own and others’ driving ability: Influences of sex, age and experience10.1016/0001-4575(89)90083-3 ↗
44. Comparative perceptions of driver ability—A confirmation and expansion10.1016/0001-4575(86)90004-7 ↗
45. Risks of road transportation in a psychological perspective10.1016/0001-4575(78)90029-5 ↗
46. Self-assessed driver competence among novice drivers—A comparison of driving test candidate assessments and examiner assessments in a Dutch and Finnish sample10.1016/j.jsr.2009.04.006 ↗
47. Age differences in male drivers’ perception of accident risk: The role of perceived driving ability10.1016/0001-4575(86)90044-8 ↗
48. (2025, April 17). Fuzy Logic Toolbox, User Guide. Available online: https://www.mathworks.com/help/fuzzy/types-of-fuzzy-inference-systems.html.
49. (2023, April 03). Forecasting Methods: Basics of Fuzzy Logic. Available online: https://m6.pk.edu.pl/materialy/mp/MP_06_logika_rozmyta.pdf.
50. Piegat, A. (1999). Fuzzy Modeling and Control, Academic Publishing House EXIT.
51. Ross, T.J. (2010). Fuzzy Logic with Engineering Applications, Wiley. [3rd ed.].10.1002/9781119994374 ↗
52. Rutkowska, D., Pilinski, M., and Rutkowski, L. (1997). Neural Networks, Genetic Algorithms and Fuzzy Systems, WN PWN.
53. Yager, R.R., and Filev, D.P. (1995). Fundamentals of Fuzzy Modeling and Control, WNT.