Leveraging Augmented Reality, Semantic-Segmentation, and VANETs for Enhanced Driver’s Safety Assistance
Source abstract
Abstract
Overtaking is a crucial maneuver in road transportation that requires a clear view of the road ahead. However, limited visibility of ahead vehicles can often make it challenging for drivers to assess the safety of overtaking maneuvers, leading to accidents and fatalities. In this paper, we consider atrous convolution, a powerful tool for explicitly adjusting the field-of-view of a filter as well as controlling the resolution of feature responses generated by Deep Convolutional Neural Networks in the context of semantic image segmentation. This article explores the potential of seeing-through vehicles as a solution to enhance overtaking safety. See-through vehicles leverage advanced technologies such as cameras, sensors, and displays to provide drivers with a real-time view of the vehicle ahead, including the areas hidden from their direct line of sight. To address the problems of safe passing and occlusion by huge vehicles, we designed a see-through vehicle system in this study, we employed a windshield display in the back car together with cameras in both cars. The server within the back car was used to segment the car, and the segmented portion of the car displayed the video from the front car. Our see-through system improves the driver’s field of vision and helps him change lanes, cross a large car that is blocking their view, and safely overtake other vehicles. Our network was trained and tested on the Cityscape dataset using semantic segmentation. This transparent technique will instruct the driver on the concealed traffic situation that the front vehicle has obscured. For our findings, we have achieved 97.1% F1-score. The article also discusses the challenges and opportunities of implementing see-through vehicles in real-world scenarios, including technical, regulatory, and user acceptance factors.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Autonomous Vehicle Technology and Safety · Image Enhancement Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (41)
Show source-provided references
1. Driving assistance algorithm for self-driving cars based on semantic segmentation
2. Semantic segmentation of 3D car parts using UAV-based images10.1016/j.cag.2022.07.008 ↗
3. Using layer-wise training for road semantic segmentation in autonomous cars
4. Evaluation of deep learning algorithms for semantic segmentation of car parts10.1007/s40747-021-00397-8 ↗
5. The cityscapes dataset for semantic urban scene understanding
6. Playing for benchmarks
7. VANET-enabled safety and comfort-oriented car-following system
8. Scenes segmentation in self-driving car perception system based U-Net and FCN models
9. A real-time augmented reality system to see-through cars10.1109/TVCG.2016.2593768 ↗
10. Understanding traffic bottlenecks of long freeway tunnels based on a novel location-dependent lighting-related car-following model10.1016/j.tust.2023.105098 ↗
11. A lightweight augmented reality system to see-through cars
12. Making vehicles transparent through V2V video streaming10.1109/TITS.2012.2188289 ↗
13. The see-through system: From implementation to test-drive
14. Augmented reality driving supported by vehicular ad hoc networking
15. Multi-vehicle cooperative perception and augmented reality for driver assistance: A possibility to ‘see’ through front vehicle
16. A real-time vehicular vision system to seamlessly see-through cars
17. The See-Through System: A VANET-enabled assistant for overtaking maneuvers
18. Driver activity recognition for intelligent vehicles: A deep learning approach10.1109/TVT.2019.2908425 ↗
19. The synthia dataset: A large collection of synthetic images for semantic segmentation of urban scenes
20. Model-free deep reinforcement learning for urban autonomous driving
21. Deep learning-based traffic safety solution for a mixture of autonomous and manual vehicles in a 5G-enabled intelligent transportation system10.1109/TITS.2020.3042504 ↗
22. Sensing and communication integrated system for autonomous driving vehicles
23. The effect of see-through truck on driver monitoring patterns and responses to critical events in truck platooning
24. F. FCC, “Amendment of the commission’s rules regarding dedicated short-range communication services in the 5.850-5.925 GHz band,” https://www.fcc.gov/document/amendment-commissions-rules-regardingdedicated-short-range-0/ Report and Order 03-324, Tech. Rep, 2003.
25. Towards an international standard for wireless access in vehicular environments
26. Backpropagation applied to handwritten zip code recognition10.1162/neco.1989.1.4.541 ↗
27. Imagenet classification with deep convolutional neural networks
28. K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” arXiv:1409.1556, 2014.
29. Deep residual learning for image recognition
30. Adaptive deconvolutional networks for mid and high level feature learning
31. Fully convolutional networks for semantic segmentation
32. Learning deconvolution network for semantic segmentation
33. U-Net: Convolutional networks for biomedical image segmentation
34. Large kernel matters—improve semantic segmentation by global convolutional network
35. P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus et al., “OverFeat: Integrated recognition, localization and detection using convolutional networks,” arXiv:1312.6229, 2013.
36. Modeling local and global deformations in deep learning: Epitomic convolution, multiple instance learning, and sliding window detection
37. Understanding convolution for semantic segmentation
38. Beyond bags of features: Spatial pyramid matching for recognizing natural scene categories
39. The pyramid match kernel: Discriminative classification with sets of image features
40. W. Liu, A. Rabinovich and A. C. Berg, “ParseNet: Looking wider to see better,” arXiv:1506.04579, 2015.
41. Pyramid scene parsing network