Semantic Segmentation of Sparse Array-SAR 3D Point Clouds Using an Enhanced PointNet++ Framework
Source abstract
Abstract
The semantic segmentation of sparse array synthetic aperture radar (SAR) 3D point clouds remains a significant challenge. These datasets are characterized by extreme sparsity, irregular distribution, and structural discontinuity, factors that diminish the reliability of local neighborhoods and impede the performance of traditional segmentation algorithms. This study introduces an enhanced PointNet++ framework specifically tailored for the semantic segmentation of sparse array-SAR 3D point clouds. Utilizing PointNet++ as a hierarchical backbone, the proposed architecture incorporates three geometry-oriented modifications: a feature enhancement strategy integrating normalized height, surface normals, and local density; an EdgeConv module positioned at an intermediate abstraction stage to reinforce local geometric modeling; and an FP-Refine module designed to optimize cross-scale feature propagation and recovery within sparse regions. Rather than proposing a fundamentally distinct universal architecture, this research focuses on a task-oriented adaptation of PointNet++ to address the neighborhood instability and structural gaps inherent in sparse array-SAR data. Experimental evaluations using the SARMV3D-1.0 dataset indicate that the proposed method consistently outperforms the PointNet++ baseline, maintaining stable performance across various random seeds with an mIoU between 55% and 58%. Further validation through ablation studies, parameter sensitivity analyses, and perturbation-based robustness assessments confirms the utility of the integrated components. Additionally, cross-dataset experiments on S3DIS and Toronto3D suggest that the framework generalizes effectively to point clouds with varying densities and spatial configurations. The findings demonstrate that the method is particularly successful for categories defined by distinct vertical geometry and structural continuity, such as trees, roofs, and facades, though performance remains limited for weakly structured classes like roads.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Remote Sensing and LiDAR Applications · 3D Shape Modeling and Analysis · Synthetic Aperture Radar (SAR) Applications and Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, Beijing 100044, China
Funding
the National Natural Science Foundation of China
References (38)
Show source-provided references
1. Very High Resolution Spaceborne SAR Tomography in Urban Environment10.1109/TGRS.2010.2050487 ↗
2. Yang, Z.L., Wang, Y.Y., Zhang, C.D., Zhan, X., Sun, G.H., Liu, Y.X., and Mao, Y.R. (2025). Array Three-Dimensional SAR Imaging via Composite Low-Rank and Sparse Prior. Remote Sens., 17.10.3390/rs17020321 ↗
3. Three-Dimensional Array SAR Sparse Imaging Based on Hybrid Regularization10.1109/JSEN.2024.3386901 ↗
4. Zhang, H., Lin, Y., Teng, F., and Hong, W. (2022). A Probabilistic Approach for Stereo 3D Point Cloud Reconstruction from Airborne Single-Channel Multi-Aspect SAR Image Sequences. Remote Sens., 14.10.3390/rs14225715 ↗
5. DBSCAN-based Point Cloud Extraction for Tomographic Synthetic Aperture Radar (TomoSAR) Three-Dimensional (3D) Building Reconstruction10.1080/01431161.2020.1851062 ↗
6. Geometry-Semantic Enhanced TomoSAR Reconstruction Algorithm in Urban Areas: Analysis and Application10.34133/remotesensing.0583 ↗
7. Wang, Y., He, Z., Zhan, X., Fu, Y., and Zhou, L. (2022). Three-Dimensional Sparse SAR Imaging with Generalized Lq Regularization. Remote Sens., 14.10.3390/rs14020288 ↗
8. MRDDANet: A Multiscale Residual Dense Dual Attention Network for SAR Image Denoising
9. PPDistiller: Weakly-supervised 3D point cloud semantic segmentation framework via point-to-pixel distillation10.1016/j.knosys.2024.112654 ↗
10. Progressive background–foreground difference enhancement for few-shot 3D point cloud semantic segmentation10.1016/j.imavis.2025.105656 ↗
11. Chen, Y., Liu, G., Xu, Y., Pan, P., and Xing, Y. (2021). PointNet++ Network Architecture with Individual Point Level and Global Features on Centroid for ALS Point Cloud Classification. Remote Sens., 13.10.3390/rs13030472 ↗
12. Deep Learning for 3D Point Clouds: A Survey10.1109/TPAMI.2020.3005434 ↗
13. Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 22–25). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.
14. Qian, G., Li, Y., Peng, H., Mai, J., Hammoud, H., Elhoseiny, M., and Ghanem, B. (2022). PointNeXt: Revisiting PointNet++ with Improved Training and Scaling. arXiv.10.52202/068431-1685 ↗
15. Dynamic Graph CNN for Learning on Point Clouds10.1145/3326362 ↗
16. Zhao, H., Jiang, L., and Jia, J. (2021, January 11–17). Point Transformer. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada.10.1109/ICCV48922.2021.01595 ↗
17. Shi, M., Zhang, F., Chen, L., Liu, S., Yang, L., and Zhang, C. (2024). Position-Feature Attention Network-Based Approach for Semantic Segmentation of Urban Building Point Clouds from Airborne Array Interferometric SAR. Remote Sens., 16.10.3390/rs16071141 ↗
18. 3D point cloud semantic segmentation based on visual guidance and feature enhancement10.1007/s00530-025-01777-7 ↗
19. SmartPoints: Enhanced local feature extraction and neighborhood diffusion network for 3D point cloud segmentation10.1016/j.cag.2025.104486 ↗
20. Le, T., and Duan, Y. (2018, January 18–22). PointGrid: A Deep Network for 3D Shape Understanding. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00959 ↗
21. Engelmann, F., Bokeloh, M., Fathi, A., Leibe, B., and Nießner, M. (2020, January 13–19). 3D-MPA: Multi-Proposal Aggregation for 3D Semantic Instance Segmentation. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00905 ↗
22. Searching Efficient 3D Architectures with Sparse Point-Voxel Convolution10.1007/978-3-030-58604-1_41 ↗
23. Multi-scale sparse convolution and point convolution adaptive fusion point cloud semantic segmentation method10.1038/s41598-025-88905-5 ↗
24. Sparse point-voxel aggregation network for efficient point cloud semantic segmentation10.1049/cvi2.12131 ↗
25. Yan, X., Zheng, C., Li, Z., Wang, S., and Cui, S. (2020, January 13–19). PointASNL: Robust Point Clouds Processing Using Nonlocal Neural Networks with Adaptive Sampling. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00563 ↗
26. PointMS: Semantic Segmentation for Point Cloud Based on Multi-scale Directional Convolution10.1007/s12555-020-0571-x ↗
27. Fein-Ashley, J., Ye, T., Kannan, R., Prasanna, V., and Busart, C. (2023). Benchmarking Deep Learning Classifiers for SAR Automatic Target Recognition. 2023 IEEE High Performance Extreme Computing Conference (HPEC), IEEE.10.1109/HPEC58863.2023.10363455 ↗
28. Retrieving Multiaspect Point Clouds from a Multichannel K-Band SAR Drone10.1109/JSTARS.2025.3532126 ↗
29. Li, X., Zhang, F., Li, Y., Guo, Q., Wan, Y., Bu, X., Liu, Y., and Liang, X. (2021). An elevation ambiguity resolution method based on segmentation and reorganization of TomoSAR point cloud in 3D mountain reconstruction. Remote Sens., 13.10.3390/rs13245118 ↗
30. Error Analysis and 3D Reconstruction Using Airborne Array InSAR Images10.1016/j.isprsjprs.2022.06.005 ↗
31. Urban 3D Imaging Using Airborne TomoSAR: Contextual Information-Based Approach in the Statistical Way10.1016/j.isprsjprs.2020.10.013 ↗
32. Chen, Z., Wang, Y., Shi, Y., and Zhu, X.X. (2026). Reconstructing Building Height from Spaceborne TomoSAR Point Clouds Using a Dual-Topology Network. IEEE Transactions on Geoscience and Remote Sensing, IEEE.10.1109/TGRS.2026.3656340 ↗
33. Small but mighty: Enhancing 3D point cloud semantic segmentation with U-Next framework
34. Improved Indoor 3D Point Cloud Semantic Segmentation Method Based on PointNet++10.1109/ACCESS.2025.3572137 ↗
35. DeepAqua: Semantic Segmentation of Wetland Water Surfaces with SAR Imagery Using Deep Neural Networks without Manually Annotated Data
36. Shen, Y., Chen, Y., Wang, Y., Ma, L., and Zhang, X. (2025). DATNet: Dynamic Adaptive Transformer Network for SAR Image Denoising. Remote Sens., 17.10.3390/rs17173031 ↗
37. Ren, Y., Zhan, X., Hu, Y., Ma, X., Liu, L., Wang, M., Shi, J., Wei, S., Zeng, T., and Zhang, X. (2024). Technical report: Towards Spatial Feature Regularization in Deep-Learning-Based Array-SAR Reconstruction. arXiv.
38. LYU Shouye6 SARMV3D-1.0: Synthetic Aperture Radar Microwave Vision 3D Imaging Dataset