Cross-Domain Feature Fusion Network: A Lightweight Road Extraction Model Based on Multi-Scale Spatial-Frequency Feature Fusion
Source abstract
Abstract
Road extraction is a key task in the field of remote sensing image processing. Existing road extraction methods primarily leverage spatial domain features of remote sensing images, often neglecting the valuable information contained in the frequency domain. Spatial domain features capture semantic information and accurate spatial details for different categories within the image, while frequency domain features are more sensitive to areas with significant gray-scale variations, such as road edges and shadows caused by tree occlusions. To fully extract and effectively fuse spatial and frequency domain features, we propose a Cross-Domain Feature Fusion Network (CDFFNet). The framework consists of three main components: the Atrous Bottleneck Pyramid Module (ABPM), the Frequency Band Feature Separator (FBFS), and the Domain Fusion Module(DFM). First, the FBFS is used to decompose image features into low-frequency and high-frequency components. These components are then integrated with shallow spatial features and deep features extracted through the ABPM. Finally, the DFM is employed to perform spatial–frequency feature selection, ensuring consistency and complementarity between the spatial and frequency domain features. The experimental results on the CHN6_CUG and Massachusetts datasets confirm the effectiveness of CDFFNet.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Automated Road and Building Extraction · Image Processing and 3D Reconstruction · Remote Sensing and LiDAR Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information Science and Engineering, Shenyang Ligong University, Shenyang 110159, China
School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China
Funding
Liaoning Province Applied Basic Research Program · ShenyangYouth Science and Technology Innovation Talent Support Program · Basic Research Special Funds for Undergraduate Universities in Liaoning Province
References (41)
Show source-provided references
1. Hou, Z.Q., Chen, Y., Yuan, W.H., and Chen, J.M. (2024). The Study on the Recent Suspended Sediment Variation Characteristics in Yangshan Deepwater Port Area Based on Landsat 8 Satellite Data. Port Waterw. Eng.
2. Long-term Trend of HCHO Column Concentration in Shanxi Based on Satellite Remote Sensing
3. Road extraction with satellite images and partial road maps
4. Zhang, Y., Zhang, J., Li, T., and Sun, K. (2016, January 10–15). Road Extraction and Intersection Detection Based on Tensor Voting. Proceedings of the 2016 IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Beijing, China.10.1109/IGARSS.2016.7729405 ↗
5. Urban land-use mapping using a deep convolutional neural network with high spatial resolution multispectral remote sensing imagery10.1016/j.rse.2018.04.050 ↗
6. Bastani, F., He, S., Abbar, S., Alizadeh, M., Balakrishnan, H., Chawla, S., Madden, S., and DeWitt, D. (2018, January 18–23). Roadtracer: Automatic Extraction of Road Networks from Aerial Images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00496 ↗
7. A Multi-Scale and Multi-Direction Feature Fusion Network for Road Detection From Satellite Imagery
8. SemiRoadExNet: A semi-supervised network for road extraction from remote sensing imagery via adversarial learning10.1016/j.isprsjprs.2023.03.012 ↗
9. Multiscale probability map guided index pooling with attention-based learning for road and building segmentation10.1016/j.isprsjprs.2023.11.002 ↗
10. Stagewise unsupervised domain adaptation with adversarial self-training for road segmentation of remote-sensing images
11. DiResNet: Direction-aware residual network for road extraction in VHR remote sensing images10.1109/TGRS.2020.3034011 ↗
12. Fully convolutional networks for semantic segmentation of very high resolution remotely sensed images combined with DSM10.1109/LGRS.2018.2795531 ↗
13. UNet: Convolutional networks for biomedical image segmentation10.1109/ACCESS.2021.3053408 ↗
14. Chen, L.C. (2014). Semantic image segmentation with deep convolutional nets and fully connected CRFs. arXiv.
15. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs10.1109/TPAMI.2017.2699184 ↗
16. Chen, L.C. (2017). Rethinking atrous convolution for semantic image segmentation. arXiv.10.1007/978-3-030-01234-2_49 ↗
17. Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., and Adam, H. (2018, January 8–14). Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_49 ↗
18. Chaurasia, A., and Culurciello, E. (2017, January 10–13). Linknet: Exploiting Encoder Representations for Efficient Semantic Segmentation. Proceedings of the 2017 IEEE visual communications and image processing (VCIP), St. Petersburg, FL, USA.10.1109/VCIP.2017.8305148 ↗
19. Zhou, L., Zhang, C., and Wu, M. (2018, January 18–23). D-LinkNet: LinkNet with Pretrained Encoder and Dilated Convolution for High Resolution Satellite Imagery Road Extraction. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.10.1109/CVPRW.2018.00034 ↗
20. CoANet: Connectivity attention network for road extraction from satellite imagery10.1109/TIP.2021.3117076 ↗
21. Qi, Y., He, Y., Qi, X., Zhang, Y., and Yang, G. (2023, January 2–3). Dynamic Snake Convolution Based on Topological Geometric Constraints for Tubular Structure Segmentation. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.00558 ↗
22. Promoting connectivity of network-like structures by enforcing region separation
23. Road extraction from satellite imagery by road context and full-stage feature
24. Road extraction by deep residual u-net10.1109/LGRS.2018.2802944 ↗
25. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
26. Road detection and centerline extraction via deep recurrent convolutional neural network U-Net10.1109/TGRS.2019.2912301 ↗
27. Remote Sensing Image Semantic Segmentation Method Based on Improved DeepLabV3+
28. Multiscale road extraction in remote sensing images10.1155/2019/2373798 ↗
29. A lightweight high-resolution RS image road extraction method combining multi-scale and attention mechanism10.1109/ACCESS.2023.3313390 ↗
30. Bandara, W.G.C., Valanarasu, J.M.J., and Patel, V.M. (2022, January 23–27). Spin Road Mapper: Extracting Roads from Aerial Images via Spatial and Interaction Space Graph Reasoning for Autonomous Driving. Proceedings of the 2022 International Conference on Robotics and Automation (ICRA), Philadelphia, PA, USA.10.1109/ICRA46639.2022.9812134 ↗
31. Sea ice change detection in SAR images based on convolutional-wavelet neural networks10.1109/LGRS.2019.2895656 ↗
32. Multi-scale wavelet network algorithm for pediatric echocardiographic segmentation via hierarchical feature guided fusion10.1016/j.asoc.2021.107386 ↗
33. Morphtext: Deep morphology regularized accurate arbitrary-shape scene text detection10.1109/TMM.2022.3172547 ↗
34. Xu, C., Fu, H., Ma, L., Jia, W., Zhang, C., Xia, F., Ai, X., Li, B., and Zhang, W. (November, January 28). Seeing Text in the Dark: Algorithm and Benchmark. Proceedings of the 32nd ACM International Conference on Multimedia, Melbourne, Australia.
35. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18–23). Mobilenetv2: Inverted Residuals and Linear Bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
36. Chollet, F. (2017, January 21–26). Xception: Deep Learning with Depthwise Separable Convolutions. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.195 ↗
37. Ross, T.Y., and Dollár, G. (2017, January 21–26). Focal Loss for Dense Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.
38. Mnih, V. (2013). Machine Learning for Aerial Image Labeling. [Ph.D. Thesis, University of Toronto].
39. Zhao, H., Shi, J., Qi, X., Wang, X., and Jia, J. (2017, January 21–26). Pyramid Scene Parsing Network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.660 ↗
40. Sun, K., Zhao, Y., Jiang, B., Cheng, T., Xiao, B., Liu, D., Mu, Y., Wang, X., Liu, W., and Wang, J. (2019). High-resolution representations for labeling pixels and regions. arXiv.
41. SegFormer: Simple and efficient design for semantic segmentation with transformers