MSPNet: Multi-Scale Strip Pooling Network for Road Extraction from Remote Sensing Images
Source abstract
Abstract
Extracting roads from remote sensing images can support a range of geo-information applications. However, it is challenging due to factors such as the complex distribution of ground objects and occlusion of buildings, trees, shadows, etc. Pixel-wise classification often fails to predict road connectivity and thus produces fragmented road segments. In this paper, we propose a multi-scale strip pooling network (MSPNet) to learn the linear features of roads. Motivated by the strip pooling being more aligned with the shape of roads, which are long-span and narrow, we develop a multi-scale strip pooling (MSP) module that utilizes strip pooling layers with long but narrow kernel shapes to capture multi-scale long-range context from horizontal and vertical directions. The proposed MSP module focuses on establishing relationships along the road region to guarantee the connectivity of roads. Considering the complex distribution of ground objects, the spatial pyramid pooling is applied to enhance the learning ability of complex features in different sub-regions. In addition, to alleviate the problem caused by an imbalanced distribution of road and non-road pixels, we use binary cross-entropy and dice-coefficient loss functions to jointly train our proposed deep learning model. Then, we perform ablation experiments to adjust the loss contributions to suit the task of road extraction. Comparative experiments on a popular benchmark DeepGlobe dataset demonstrate that our proposed MSPNet establishes new competitive results in both IoU and F1-score.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Automated Road and Building Extraction · Remote Sensing and LiDAR Applications · Wildlife-Road Interactions and Conservation
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Software, Henan University, Kaifeng 475001, China
Institute of Intelligence Networks System, Henan University, Kaifeng 475001, China
Intelligent Data Processing Engineering Research Center of Henan Province, Kaifeng 475001, China
References (37)
Show source-provided references
1. Imagenet classification with deep convolutional neural networks
2. Fully Convolutional Networks for Semantic Segmentation
3. Extracting road maps from high-resolution satellite imagery using refined DSE-LinkNet10.1080/09540091.2020.1807466 ↗
4. DiResNet: Direction-Aware Residual Network for Road Extraction in VHR Remote Sensing Images10.1109/TGRS.2020.3034011 ↗
5. Automatic Extraction of Urban Road Centerlines from High-Resolution Satellite Imagery Using Automatic Thresholding and Morphological Operation Method
6. Accurate urban road centerline extraction from VHR imagery via multiscale segmentation and tensor voting10.1016/j.neucom.2016.04.026 ↗
7. Development and prospect of road extraction method for optical remote sensing image
8. Xin, J., Zhang, X.C., Zhang, Z.Q., and Fang, W. (2019). Road Extraction of High-Resolution Remote Sensing Images Derived from DenseUNet. Remote Sens., 11.10.3390/rs11212499 ↗
9. Road extraction from high resolution remote sensing image via a deep residual and pyramid pooling network10.1049/ipr2.12296 ↗
10. Ren, Y.F., Yu, Y.T., and Guan, H.Y. (2020). DA-CapsUNet: A Dual-Attention Capsule U-Net for Road Extraction from Remote Sensing Imagery. Remote Sens., 12.10.3390/rs12182866 ↗
11. Fan, K.L., Li, Y.X., Yuan, L., Si, Y., and Tong, L. (October, January 26). New Network Based on D-Linknet and Resnext for High Resolution Satellite Imagery Road Extraction. Proceedings of the IGARSS 2020—2020 IEEE International Geoscience and Remote Sensing Symposium, Waikoloa, HI, USA.10.1109/IGARSS39084.2020.9323493 ↗
12. Road Detection from Optical Remote Sensing Imagery Using Circular Projection Matching and Tracking Strategy10.1007/s12524-013-0295-y ↗
13. Extracting roads based on Retinex and improved Canny operator with shape criteria in vague and unevenly illuminated aerial images10.1117/1.JRS.6.063610 ↗
14. Herumurti, D., Uchimura, K., Koutaki, G., and Uemura, T. (2013, January 2–5). Urban Road Network Extraction Based on Zebra Crossing Detection From a Very High Resolution RGB Aerial Image and DSM Data. Proceedings of the 2013 International Conference on Signal-Image Technology and Internet-Based Systems (Sitis), Kyoto, Japan.10.1109/SITIS.2013.24 ↗
15. Road extraction using SVM and image segmentation10.14358/PERS.70.12.1365 ↗
16. CoANet: Connectivity Attention Network for Road Extraction from Satellite Imagery10.1109/TIP.2021.3117076 ↗
17. Ding, C., Weng, L.G., Xia, M., and Lin, H.F. (2021). Non-Local Feature Search Network for Building and Road Segmentation of Remote Sensing Image. ISPRS Int. J. Geo-Inf., 10.10.3390/ijgi10040245 ↗
18. Mnih, V., and Hinton, G.E. (2010, January 5–11). Learning to Detect Roads in High-Resolution Aerial Images. Proceedings of the Computer Vision—ECCV 2010—11th European Conference on Computer Vision, Heraklion, Crete, Greece. Part VI.10.1007/978-3-642-15567-3_16 ↗
19. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention, Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
20. Chaurasia, A., and Culurciello, E. (2017, January 10–13). LinkNet: Exploiting Encoder Representations for Efficient Semantic Segmentation. Proceedings of the IEEE Visual Communications and Image Processing (VCIP), St. Petersburg, FL, USA.10.1109/VCIP.2017.8305148 ↗
21. Zhou, K., Xie, Y., Gao, Z., Miao, F., and Zhang, L. (2021). FuNet: A Novel Road Extraction Network with Fusion of Location Data and Remote Sensing Imagery. ISPRS Int. J. Geo-Inf., 10.10.3390/ijgi10010039 ↗
22. Road Extraction by Deep Residual U-Net10.1109/LGRS.2018.2802944 ↗
23. Zhou, L.C., Zhang, C., and Wu, M. (2018, January 18–22). D-LinkNet: LinkNet with Pretrained Encoder and Dilated Convolution for High Resolution Satellite Imagery Road Extraction. Proceedings of the 2018 IEEE/Cvf Conference on Computer Vision and Pattern Recognition Workshops (Cvprw), Salt Lake City, UT, USA.10.1109/CVPRW.2018.00034 ↗
24. Xie, Y., Miao, F., Zhou, K., and Peng, J. (2019). HsgNet: A Road Extraction Network Based on Global Perception of High-Order Spatial Information. ISPRS Int. J. Geo-Inf., 8.10.3390/ijgi8120571 ↗
25. Road Extraction from High Spatial Resolution Remote Sensing Image Based on Multi-Task Key Point Constraints10.1109/ACCESS.2021.3094536 ↗
26. Simultaneous Road Surface and Centerline Extraction From Large-Scale Remote Sensing Images Using CNN-Based Segmentation and Tracing10.1109/TGRS.2020.2991733 ↗
27. Demir, I., Koperski, K., Lindenbaum, D., Pang, G., Huang, J., Basu, S., Hughes, F., Tuia, D., and Raskar, R. (2018, January 18–22). Deepglobe 2018: A challenge to parse the earth through satellite images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, Salt Lake City, UT, USA.10.1109/CVPRW.2018.00031 ↗
28. Road Segmentation in SAR Satellite Images With Deep Fully Convolutional Neural Networks10.1109/LGRS.2018.2864342 ↗
29. SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation10.1109/TPAMI.2016.2644615 ↗
30. He, K.M., Zhang, X.Y., Ren, S.Q., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
31. Deng, J., Dong, W., Socher, R., Li, L.J., Li, K., and Fei-Fei, L. (2009, January 20–25). Imagenet: A large-scale hierarchical image database. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206848 ↗
32. Zhao, H.S., Shi, J.P., Qi, X.J., Wang, X.G., and Jia, J.Y. (2017, January 21–26). Pyramid Scene Parsing Network. Proceedings of the 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.660 ↗
33. Tian, T., Chu, Z., Hu, Q., and Ma, L. (2021). Class-Wise Fully Convolutional Network for Semantic Segmentation of Remote Sensing Images. Remote Sens., 13.10.3390/rs13163211 ↗
34. Hou, Q., Zhang, L., Cheng, M.M., and Feng, J. (2020, January 14–19). Strip Pooling: Rethinking Spatial Pooling for Scene Parsing. Proceedings of the CVPR, Seattle, WA, USA.10.1109/CVPR42600.2020.00406 ↗
35. Deeplab: Semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected crfs10.1109/TPAMI.2017.2699184 ↗
36. Lin, Y.E., Xu, D.Y., Wang, N., Shi, Z., and Chen, Q.X. (2020). Road Extraction from Very-High-Resolution Remote Sensing Images via a Nested SE-Deeplab Model. Remote Sens., 12, Erratum in Remote Sens. 2021, 13, 783.10.3390/rs13040783 ↗
37. Li, J., Liu, Y., Zhang, Y.N., and Zhang, Y. (2021). Cascaded Attention DenseUNet (CADUNet) for Road Extraction from Very-High-Resolution Images. Isprs Int. J. Geo-Inf., 10.10.3390/ijgi10050329 ↗