Vision Control of a Vehicle Intended for Tourist Routes Designed for People with Special Needs
Source abstract
Abstract
Off-road vehicles, including those intended for mountain tourism, are also designed for people with special needs. These designs primarily concern the design of the drive of the vehicle, which can be manual, foot-powered, electric or a combination of these. Unusual forms of controlling these vehicles are also used, which use various parts of the body for this purpose, including the torso. In addition to using specific parts of the body to control the vehicle, an alternative is to use vision for this purpose, such as through eye tracking and similar techniques. The problem with these applications is the high prices of the devices and software used. They are mainly implemented in military solutions. The cost of these forms of vehicle control is too high; often higher than the price of the vehicle. This article presents an overview of the broad concept and technical solutions used to control various vehicles using hardware that can interact with the organ of vision. An extremely cheap prototype of this type of solution for several dozen EUR is also proposed in this article. The device uses methods based on vision techniques using the OpenCV 4_11 library. The research results in this area are presented, stating that such control is efficient.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Gaze Tracking and Assistive Technology · Autonomous Vehicle Technology and Safety · Control and Dynamics of Mobile Robots
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Transport and Aviation Engineering, Silesian University of Technology, 40-019 Katowice, Poland
Funding
National Centre for Research and Development
References (79)
Show source-provided references
1. Vision and driving10.1016/j.visres.2010.05.021 ↗
2. The importance of the vehicle driver’s cognitive processes in shaping road safety
3. Vision Based Intelligent Vehicle Steering Control Using Single Camera for Automated Highway System10.1016/j.procs.2018.07.111 ↗
4. Dickmanns, E.D. (2020). May a Pair of ‘Eyes’ Be Optimal for Vehicles Too?. Electronics, 9.10.3390/electronics9050759 ↗
5. Learning vision based autonomous lateral vehicle control without supervision10.1007/s10489-023-04478-8 ↗
6. Sensitivity of eye-movement measures to in-vehicle task difficulty10.1016/j.trf.2005.04.014 ↗
7. Dickmanns, E.D. (2024). Evolution of the “4-D Approach” to Dynamic Vision for Vehicles. Electronics, 13.10.3390/electronics13204133 ↗
8. (2025, July 12). Current Research and Practices, Principles of Visibility, Available online: https://highways.dot.gov/safety/other/visibility/roadway-visibility-research-needs-assessment/2-current-research-and.
9. Positioning control algorithm of vehicle navigation system based on wireless tracking technology10.1155/2021/8620409 ↗
10. Qiu, C., Tang, H., Yang, Y., Wan, X., Xu, X., Lin, S., Lin, Z., Meng, M., and Zha, C. (2024). Machine vision-based autonomous road hazard avoidance system for self-driving vehicles. Sci. Rep., 14.10.1038/s41598-024-62629-4 ↗
11. Guidance control of vehicles based on visual feedback via internet10.1186/s13638-015-0391-5 ↗
12. Edvardsson Björnberg, K., Hansson, S.O., Belin, M.Å., and Tingvall, C. (2023). Automated Vehicles: How Do They Relate to Vision Zero. . The Vision Zero Handbook, Springer.10.1007/978-3-030-76505-7 ↗
13. The visual control of interceptive steering: How do people steer a car to intercept a moving target?10.1167/19.14.11 ↗
14. Navarro, J., Lappi, O., Osiurak, F., Hernout, E., Gabaude, C., and Reynaud, E. (2021). Dynamic scan paths investigations under manual and highly automated driving. Sci. Rep., 11.10.1038/s41598-021-83336-4 ↗
15. Deep learning for autonomous driving systems: Technological innovations, strategic implementations, and business implications—A comprehensive review10.20517/ces.2024.83 ↗
16. Horgan, J., Hughes, C., McDonald, J., and Yogamani, J. (2015, January 15–18). Vision-based Driver Assistance Systems: Survey, Taxonomy and Advances. Proceedings of the 2015 IEEE 18th International Conference on Intelligent Transportation Systems, Gran Canaria, Spain.10.1109/ITSC.2015.329 ↗
17. Burnett, G.I. (2009, January 21–22). Drivers quality ratings for switches in cars: Assessing the role of the vision, hearing and touch senses. Proceedings of the First International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Essen, Germany.10.1145/1620509.1620530 ↗
18. Lu, J. (2022, January 25–27). Autonomous Vision of Driverless car in Machine Learning Advances in Economics, Business and Management Research. Proceedings of the 2022 7th International Conference on Social Sciences and Economic Development, Wuhan, China.10.2991/aebmr.k.220405.356 ↗
19. Yke, E., Eijssen, D., and de Winter, J. (2022). What Attracts the Driver’s Eye? Attention as a Function of Task and Events. Information, 13.10.3390/info13070333 ↗
20. Guo, R., and Wu, J. (2024, January 24–26). Intelligent Car Control System Based on Vision Tracking Technology. Proceedings of the 2024 3rd International Symposium on Control Engineering and Robotics, Changsha, China.10.1145/3679409.3679412 ↗
21. Zhao, Y., Lei, C., Shen, Y., Du, Y., and Chen, Q. (2022). Human-vehicle Cooperative Visual Perception for Autonomous Driving under Complex Road and Traffic Scenarios. European Conference on Computer Vision, Springer.10.1007/978-3-031-25056-9_41 ↗
22. Vision, Visibility, and Perception in Driving10.1068/p090183 ↗
23. Yonghua, Y., and Ming, X. (2025, July 22). Vision-Based Hand Gesture Recognition for Human-Vehicle Interaction. Available online: https://www.researchgate.net/publication/2386425_Vision-Based_Hand_Gesture_Recognition_for_Human-Vehicle_Interaction.
24. Sudkamp, J., Bocian, M., and Souto, D. (2011). The role of eye movements in perceiving vehicle speed and time-to-arrival at the roadside. Sci. Rep., 11.10.1038/s41598-021-02412-x ↗
25. A review of human sensory dynamics for application to models of driver steering and speed control10.1007/s00422-016-0682-x ↗
26. Singh, P., Chang, C.M., and Igarashi, T. (2022). I See You: Eye Control Mechanisms for Robotic Eyes on an Autonomous Car. Adjunct Proceedings of the 14th International Conference on Automotive User Interfaces and Interactive Vehicular Applications, Association for Computing Machinery.10.1145/3544999.3552320 ↗
27. Human Vision System and Its Application for Safety and Security
28. Andersh, J., and Mettler, B. (2018). Modeling the Human Visuo-Motor System to Support Remote-Control Operation. Sensors, 18.10.3390/s18092979 ↗
29. Attention for Vision-Based Assistive and Automated Driving: A Review of Algorithms and Datasets
30. Maintaining Lane Position with Peripheral Vision during In-Vehicle Tasks10.1518/001872096778701944 ↗
31. Can gaze control steering?10.1167/jov.23.7.12 ↗
32. Lappi, O. (2022). Gaze strategies in driving–An ecological approach. Front. Psychol., 13.10.3389/fpsyg.2022.821440 ↗
33. Auto Safety and Human Adaptation
34. Human-Vehicle Interaction to Support Driver’sSituation Awareness in Automated Vehicles: Systematic Review
35. Xia, Y., Kim, J., Canny, J., Zipser, K., Canas-Bajo, T.Y., and Whitney, D. (2025, July 22). Periphery-Fovea Multi-Resolution Driving Model Guided by Human Attention. Available online: https://whitneylab.berkeley.edu/PDFs/Xia_Driving_Model_Human_Attention_WACV_2020.pdf.10.1109/WACV45572.2020.9093524 ↗
36. Understanding and modeling the human driver10.1076/vesd.40.1.101.15875 ↗
37. Liu, B., Zhang, G., and Cui, Y. (2024, January 24–26). The Application of Eye Tracking Technology in Human-Machine Co-driving System under the Background of Intelligent Vehicle Development. Proceedings of the 3rd International Conference on Art Design and Digital Technology, ADDT 2024, Luoyang, China.10.4108/eai.24-5-2024.2350120 ↗
38. Compare and Contrast LiDAR and Non-LiDAR Technology in an Autonomous Vehicle: Developing a Safety Framework10.4236/ojsst.2023.133006 ↗
39. Viveash, J., White, J., Boughton, J., King, S., and Kaye, M. (2002, January 15–17). Remote Control of Vehicles. Proceedings of the RTO HFM Symposium on Spatial Disorientation in Military Vehicles: Causes, Consequences and Cures, La Coruña, Spain.
40. Sullivan, J.L., Hayhoe, B., and Ballard, D.M. (2014). Predicting humanvisuomotor behaviour in a driving task. Philos. Trans. R. Soc. B Biol. Sci., 369.10.1098/rstb.2013.0044 ↗
41. Behavioural Gap Assessment of Human-Vehicle Interaction in Real and Virtual Reality-Based Scenarios in Autonomous Driving10.1080/10447318.2024.2385514 ↗
42. Eyes, Brains, and Autos10.1001/archopht.122.4.641 ↗
43. Bian, Z., Pierce, R., and Andersen, G. (2011, January 27–30). Eye movement patterns and driving performance. Proceedings of the Sixth International Driving Symposium on Human Factors in Driver Assessment, Training and Vehicle Design, Lake Tahoe, CA, USA.10.17077/drivingassessment.1439 ↗
44. The Impact of Visual Field Loss on Driving Skills: A Systematic Narrative Review10.22599/bioj.129 ↗
45. Roth, N., Rolfs, M., Hellwich, O., and Obermayer, K. (2023). Objects guide human gaze behavior in dynamic real-world scenes. PLOS Comput. Biol., 19.10.1101/2023.03.14.532608 ↗
46. Porter, B.E. (2011). Visual attention while driving. Handbook of Traffic Psychology, Elsevier.
47. Eye Tracking Study on Visual Search Performance of Automotive Human–Machine Interface for Elderly Users10.1109/ACCESS.2024.3439553 ↗
48. Driving around bends with manipulated eye-steering coordination10.1167/8.11.10 ↗
49. Visual attention in driving: The effects of cognitive load and visual disruption10.1518/001872007X215791 ↗
50. Robust real-time face detection10.1023/B:VISI.0000013087.49260.fb ↗
51. An extended set of haar-like features for rapid object detection10.1109/ICIP.2002.1038171 ↗
52. Eye Detection using Haar Cascade Classifier
53. Vikram, K., and Padmavathi, S. (2017, January 6–7). Facial parts detection using Viola Jones algorithm. Proceedings of the 2017 4th International Conference on Advanced Computing and Communication Systems (ICACCS), Coimbatore, India.10.1109/ICACCS.2017.8014636 ↗
54. Fast and accurate algorithm for eye localisation for gazetracking in low-resolution images10.1049/iet-cvi.2015.0316 ↗
55. Fitriyani, N.L., Yang, C.K., and Syafrudin, M. (2016, January 11–14). Real-time eye state detection system using haar cascade classifier and circular hough transform. Proceedings of the 2016 IEEE 5th Global Conference on Consumer Electronics, Kyoto, Japan.10.1109/GCCE.2016.7800424 ↗
56. Detection of Iris Localization in Facial Images Using Haar Cascade Circular Hough
57. Research methods and solutions to current transport problems
58. Staniek, M., Celiński, I., and Sierpiński, G. (2024, January 10–11). Adapting the parameters of mountain trails for off-road vehicles for people with special needs. Transport Systems Theory and Practice. Proceedings of the 20th Scientific and Technical Conference, Katowice, Poland.
59. (2025, July 14). Tobii. Available online: https://www.tobii.com/products/eye-trackers/wearables/tobii-pro-glasses-3.
60. (2025, July 14). Available online: https://www.roadtovr.com/smi-3d-eye-tracking-glasses/.
61. Młyńczak, J., Burdzik, R., and Celiński, I. (2015). Remote monitoring of the train driver along with the locomotive motion dynamics in the course of shunting using mobile devices. Dynamical systems: Control and Stability, Politechnika Łódzka.
62. (2025, July 14). Available online: https://opencv.org/.
63. (2025, July 14). Available online: https://www.ovt.com/products/#image-sensor.
64. (2025, July 14). Available online: https://www.raspberrypi.com/products/raspberry-pi-zero-2-w/.
65. (2025, July 10). Available online: https://www.raspberrypi.com/products/raspberry-pi-4-model-b/.
66. (2025, July 14). Available online: https://web.eece.maine.edu/~vweaver/group/green_machines.html.
67. (2025, July 14). Available online: https://www.python.org/downloads/release/python-3135/.
68. Schmidt, A., and Kasiński, A. (2007). The Performance of the Haar Cascade Classifiers Applied to the Face and Eyes Detection. Computer Recognition Systems, Springer.10.1007/978-3-540-75175-5_101 ↗
69. Heterochromia iridis: More than beautiful eyes10.1136/postgradmedj-2020-137621 ↗
70. Vijila, S.S.D., and Shastika, M. (2022, January 15–16). Air xylophone Using OpenCV. Proceedings of the 2022 International Conference on Innovative Computing, Intelligent Communication and Smart Electrical Systems, Chennai, India.
71. Staniek, M., and Celiński, I. (2025). The use of LoRa technology as an alternative to GPS in the navigation of a mountain vehicle intended for people with special needs. AoT, Available online: https://archivesoftransport.com.
72. (2025, July 14). Available online: https://www.worldtimeserver.com/atomic-clock/.
73. (2025, July 14). Available online: https://www.freepik.com.
74. (2025, July 14). Available online: https://www.waveshare.com/d200-lidar-kit.htm.
75. Macioszek, E., Sierpiński, G., and Jurdana, I. (2026). Digital Twin of Specialized Off-Road Vehicle for Peoples with Special Needs, Springer Nature. Smart, and Environmentally Friendly Contemporary Road Traffic and Transportation Solution.
76. (2025, October 02). Official RT-DETR (RTDETR paddle pytorch), Real-Time DEtection TRansformer. Available online: https://github.com/lyuwenyu/RT-DETR.
77. (2025, October 02). Ultralytics. Available online: https://www.ultralytics.com/.
78. Zhao, Y., Lv, W., Xu, S., Wei, J., Wang, G., Dang, Q., Liu, Y., and Chen, J. (2024). DETRs Beat YOLOs on Real-time Object Detection. arXiv.10.1109/CVPR52733.2024.01605 ↗
79. Heuristic approach in a multimodal travel planner to support local authorities in urban traffic management