journal article·2025Open access

CFH-Net: Transformer-Based Unstructured Road-Free Space Detection Network

Jingcheng Yang, Lili Fan, Hongmei Liu

Computers, Materials & Continua· Volume 83· Issue 3

Abstract

With the advancement of deep learning in the automotive domain, more and more researchers are focusing on autonomous driving. Among these tasks, free space detection is particularly crucial. Currently, many model-based approaches have achieved autonomous driving on well-structured urban roads, but these efforts primarily focus on urban road environments. In contrast, there are fewer deep learning methods specifically designed for off-road traversable area detection, and their effectiveness is not yet satisfactory. This is because detecting traversable areas in complex outdoor environments poses significant challenges, and current methods often rely on single-image inputs, which do not align with contemporary multimodal approaches. Therefore, in this study, we propose a CFH-Net model for off-road traversable area detection. This model employs a Transformer architecture to enhance its capability of capturing global information. For multimodal feature extraction and fusion, we integrate the CM-FRM module for feature extraction and introduce the novel FFX module for feature fusion, thereby improving the perception capability of autonomous vehicles on unstructured roads. To address upsampling, we propose a new convolution precorrection method to reduce model parameters and computational complexity while enhancing the model’s ability to capture complex features. Finally, we conducted experiments on the ORFD off-road dataset and achieved outstanding results. The code is available at: (accessed on 11 January 2025).
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Automated Road and Building Extraction · Autonomous Vehicle Technology and Safety · Video Surveillance and Tracking Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (48)

Show source-provided references
1. Real-time assessment of terrain traversability for autonomous rover navigation
2. Segnet: a deep convolutional encoder-decoder architecture for image segmentation10.1109/TPAMI.2016.2644615 ↗
3. Estimating drivable collision-free space from monocular video
4. Minimizing supervision for free-space segmentation
5. A RUGD dataset for autonomous navigation and visual perception in unstructured outdoor environments
6. ShapeConv: shape-aware convolutional layer for indoor RGB-D semantic segmentation
7. Spatial information guided convolution for real-time RGBD semantic segmentation10.1109/TIP.2021.3049332 ↗
8. Chen · Computer Vision—ECCV 2020 · 2020 · 56110.1007/978-3-030-58621-8_33 ↗
9. ABMDRNet: adaptive-weighted bi-directional modality difference reduction network for RGB-T semantic segmentation
10. FEANet: feature-enhanced attention network for RGB-thermal real-time semantic segmentation
11. LightYOLO: lightweight model based on YOLOv8n for defect detection of ultrasonically welded wire terminations
12. Bonding analysis of ultrasonic welded multi-wire joints with additional root gaps10.1016/j.aej.2024.12.082 ↗
13. A new performance measure and evaluation benchmark for road detection algorithms
14. Orfd: a dataset and benchmark for off-road freespace detection
15. Rethinking semantic segmentation from a sequence-to-sequence perspective with transformers
16. Vision transformers for dense prediction
17. Pyramid scene parsing network
18. Deep high-resolution representation learning for visual recognition10.1109/TPAMI.2020.2983686 ↗
19. BiSeNet V2: bilateral network with guided aggregation for real-time semantic segmentation10.1007/s11263-021-01515-2 ↗
20. Xie · Advances in neural information processing systems · 2021
21. Strudel R, Garcia R, Laptev I, Schmid C. Segmenter: transformer for semantic segmentation. arXiv:2105.05633. 2021.10.1109/ICCV48922.2021.00717 ↗
22. The cityscapes dataset for semantic urban scene understanding
23. Vision meets robotics: the KITTI dataset10.1177/0278364913491297 ↗
24. Large kernel matters—improve semantic segmentation by global convolutional network
25. Deep learning for image and point cloud fusion in autonomous driving: a review10.1109/TITS.2020.3023541 ↗
26. PointAugmenting: cross-modal augmentation for 3D object detection
27. Multi-modal 3D object detection in autonomous driving: a survey10.1007/s11263-023-01784-z ↗
28. Are we ready for autonomous driving? The KITTI vision benchmark suite
29. Deep learning for LiDAR point clouds in autonomous driving: a review10.1109/TNNLS.2020.3015992 ↗
30. Scalability in perception for autonomous driving: waymo open dataset
31. X-view: non-egocentric multi-view 3D object detector10.1109/TIP.2023.3245337 ↗
32. Seeing through fog without seeing fog: deep multimodal sensor fusion in unseen adverse weather
33. DMFNet: deep multi-modal fusion network for RGB-D indoor scene segmentation10.1109/ACCESS.2019.2955101 ↗
34. Learning common and specific features for RGB-D semantic segmentation with deconvolutional networks
35. SCN: switchable context network for semantic segmentation of RGB-D images10.1109/TCYB.2018.2885062 ↗
36. Hazirbas · 213
37. Sne-roadseg: incorporating surface normal information into semantic segmentation for accurate freespace detection
38. FSN-swin: a network for freespace detection in unstructured environments10.1109/ACCESS.2024.3354721 ↗
39. Three-filters-to-normal: an accurate and ultrafast surface normal estimator10.1109/LRA.2021.3067308 ↗
40. Zhang · IEEE Trans Intell Transp Syst · 2023 · 24 · 1467910.1109/TITS.2023.3300537 ↗
41. 2DPASS: 2D priors assisted semantic segmentation on LiDAR point clouds
42. MSeg3D: multi-modal 3D semantic segmentation for autonomous driving
43. Hendrycks D, Gimpel K. Gaussian error linear units (GELUs). arXiv:160608415. 2016.
44. Efficient attention: attention with linear complexities
45. Paszke · Advances in neural information processing systems · 2019
46. Some methods of speeding up the convergence of iteration methods10.1016/0041-5553(64)90137-5 ↗
47. Jeon Y, Son EI, Seo SW. Follow the footprints: self-supervised traversability estimation for off-road vehicle navigation based on geometric and visual cues. arXiv:240215363. 2024.10.1109/ICRA57147.2024.10611198 ↗
48. Swin transformer: hierarchical vision transformer using shifted windows