Research on Negative Road Obstacle Detection Based on Multimodal Feature Enhancement and Fusion
Source abstract
Abstract
To address the issues of low recognition rates and poor detection accuracy for road negative obstacles caused by insufficient feature representation, we propose a novel detection framework: the Negative Road Obstacles Segmentation Network (NROSegNet). The detection performance of the algorithm is improved through a data enhancement strategy based on feature splicing and an adaptive feature enhancement module. Specifically, the data augmentation strategy introduces negative obstacle features into other datasets through geometric transformations and random splicing, effectively increasing the diversity of training data. This can solve the problem of an uneven distribution of data features while improving the performance of the model in capturing illumination changes and local details. The framework further adopts a dynamic multi-scale feature enhancement module to improve the perception of local details and global semantics. A robust multimodal data fusion mechanism and edge-aware optimization strategy are designed to effectively alleviate the problems of noise interference and boundary blur. The experimental results show that the NROSegNet proposed in this paper achieves 70.6 and 83.0 in mIoU and mF1, respectively, which is 2.8 percentage points and 2.9 percentage points higher than other methods. The results fully demonstrate its excellent performance in precise segmentation and boundary detail processing.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Technology and Security Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Wuhu HIT Robot Technology Research Institute Co., Ltd., Wuhu 241007, China
Fujian (Quanzhou) Institute of Advanced Manufacturing Technology, Quanzhou 362000, China
Funding
Anhui Polytechnic University · Scientific and Technological Project of Quanzhou City
References (20)
Show source-provided references
1. Segmentation of Road Negative Obstacles Based on Dual Semantic-feature Complementary Fusion for Autonomous Driving10.1109/TIV.2024.3376534 ↗
2. Heckman, N., Lalonde, J.F., Vandapel, N., and Hebert, M. (2007, January 10). Potential negative obstacle detection by occlusion labeling. Proceedings of the 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems, San Diego, CA, USA. Available online: https://ieeexplore.ieee.org/abstract/document/4398970.10.1109/IROS.2007.4398970 ↗
3. Larson, J., and Trivedi, M. (2011, January 5–7). Lidar based off-road negative obstacle detection and analysis. Proceedings of the 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC), Washington, DC, USA. Available online: https://ieeexplore.ieee.org/abstract/document/6083105.10.1109/ITSC.2011.6083105 ↗
4. Shang, E., An, X., Li, J., and He, H. (2014, January 8–11). A novel setup method of 3D LIDAR for negative obstacle detection in field environment. Proceedings of the 17th International IEEE Conference on Intelligent Transportation Systems (ITSC), Qingdao, China. Available online: https://ieeexplore.ieee.org/abstract/document/6957888.10.1109/ITSC.2014.6957888 ↗
5. Hu, T., Nie, Y., Wu, T., and He, H. (2011, January 8). Negative obstacle detection from image sequences. Proceedings of the Third International Conference on Digital Image Processing (ICDIP 2011), Chengdu, China. Available online: https://www.spiedigitallibrary.org/conference-proceedings-of-spie/8009/80090Y/Negative-obstacle-detection-from-image-sequences/10.1117/12.896288.short.10.1117/12.896288 ↗
6. Lidar based negative obstacle detection for field autonomous land vehicles10.1002/rob.21609 ↗
7. Stereo obstacle detection for unmanned surface vehicles by IMU-assisted semantic segmentation10.1016/j.robot.2018.02.017 ↗
8. Design of dual-LiDAR high precision natural navigation system10.1109/JSEN.2022.3153900 ↗
9. César-Tondreau, B., Warnell, G., Kochersberger, K., and Waytowich, N.R. (2022). Towards fully autonomous negative obstacle traversal via imitation learning based control. Robotics, 11.10.3390/robotics11040067 ↗
10. Guan, L., Jia, L., Xie, Z., and Yin, C. (2022). A lightweight framework for obstacle detection in the railway image based on fast region proposal and improved YOLO-tiny network. IEEE Trans. Instrum. Meas., 71.10.1109/TIM.2022.3150584 ↗
11. Convex vision-based negative obstacle detection framework for autonomous vehicles10.1109/TIV.2022.3146877 ↗
12. Positive and Negative Obstacles Detection Based on Dual-LiDAR in Field Environments10.1109/LRA.2024.3414256 ↗
13. Or-El, R., Rosman, G., Wetzler, A., Kimmel, R., and Bruckstein, A.M. (2015, January 7–12). Rgbd-fusion: Real-time high precision depth recovery. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA. Available online: https://openaccess.thecvf.com/content_cvpr_2015/html/El_RGBD-Fusion_Real-Time_High_2015_CVPR_paper.html.10.1109/CVPR.2015.7299179 ↗
14. Zhu, H., Weibel, J.B., and Lu, S. (2016, January 27–30). Discriminative multi-modal feature fusion for rgbd indoor scene recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA. Available online: https://openaccess.thecvf.com/content_cvpr_2016/html/Zhu_Discriminative_Multi-Modal_Feature_CVPR_2016_paper.html.10.1109/CVPR.2016.324 ↗
15. Texture-less object detection and 6D pose estimation in RGB-D images10.1016/j.robot.2017.06.003 ↗
16. RGBD co-saliency detection via multiple kernel boosting and fusion10.1007/s11042-017-5576-y ↗
17. Guerry, J., Le Saux, B., and Filliat, D. (2017, January 6–8). “Look at this one” detection sharing between modality-independent classifiers for robotic discovery of people. Proceedings of the European conference on mobile robots (ECMR), Paris, France. Available online: https://ieeexplore.ieee.org/abstract/document/8098679.10.1109/ECMR.2017.8098679 ↗
18. Zhang, Z., Zhao, R., Liu, E., Yan, K., and Ma, Y. (2018). Scale estimation and correction of the monocular simultaneous localization and mapping (SLAM) based on fusion of 1D laser range finder and vision data. Sensors, 18.10.3390/s18061948 ↗
19. FAFNet: Fully aligned fusion network for RGBD semantic segmentation based on hierarchical semantic flows10.1049/ipr2.12614 ↗
20. Wang, H., Wang, W., Li, W., and Pan, X. (2023). Dense captioning and multidimensional evaluations for indoor robotic scenes. Front. Neurorobot., 17.10.3389/fnbot.2023.1280501 ↗