Point Cloud Semantic Segmentation Network Design with Neighborhood Feature Enhancement
Source abstract
Abstract
The complex structures and diverse object categories in indoor environments pose significant challenges for point cloud semantic segmentation. To address the insufficient capability of extracting local features in complex scenes, this paper proposes a point cloud segmentation network based on neighborhood feature enhancement termed PKA-Net. First, to obtain richer and more discriminative feature representations, we design a local feature encoding module that extracts geometric features, color information, and spatial information from local regions of the point cloud for joint feature encoding. Furthermore, we enhance the hierarchical feature extraction by integrating Kolmogorov–Arnold Networks (KAN) to form the SAPK module, improving the network’s ability to fit complex geometric structures. A residual structure is also adopted to optimize feature propagation and alleviate the problem of gradient vanishing. Finally, we propose the dual attention mechanism C-MSCA, which dynamically selects and strengthens key features through the synergistic action of channel and spatial attention, enhancing the network’s perception of local details and global structure. To evaluate the performance of the proposed PKA-Net, extensive experiments were conducted on the S3DIS dataset. Experimental results demonstrate that PKA-Net improves OA by 2.1%, mAcc by 2.9%, and mIoU by 4% compared to the baseline model. It outperforms other mainstream models, delivering enhanced overall segmentation performance.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: 3D Shape Modeling and Analysis · 3D Surveying and Cultural Heritage · Remote Sensing and LiDAR Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Arts and Communication, China University of Geosciences, Wuhan 430074, China
School of Computer Science, China University of Geosciences, Wuhan 430074, China
References (32)
Show source-provided references
1. Series Active Disturbance Rejection Autopilot Design for Hyper Velocity Projectiles10.1109/ACCESS.2020.3014626 ↗
2. Automated Evaluation of Semantic Segmentation Robustness for Autonomous Driving10.1109/TITS.2019.2909066 ↗
3. Yang, B., Huang, R., Li, J., Tian, M., Dai, W., and Zhong, R. (2017). Automated Reconstruction of Building LoDs from Airborne LiDAR Point Clouds Using an Improved Morphological Scale Space. Remote Sens., 9.10.3390/rs9010014 ↗
4. Large-scale 3D point-cloud semantic segmentation of urban and rural scenes using data volume decomposition coupled with pipeline parallelism10.1016/j.autcon.2021.103995 ↗
5. Merkle, D., and Reiterer, A. (2022). Overview of 3D point cloud annotation and segmentation techniques for smart city applications. Remote Sensing Technologies and Applications in Urban Environments VII, International Society for Optics and Photonics.10.1117/12.2635845 ↗
6. A review of deep learning-based semantic segmentation for point cloud10.1109/ACCESS.2019.2958671 ↗
7. Papon, J., Abramov, A., Schoeler, M., and Worgotter, F. (2013, January 25–27). Voxel Cloud Connectivity Segmentation—Supervoxels for Point Clouds. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA.10.1109/CVPR.2013.264 ↗
8. Ferraz, A., Bretar, F., Jacquemoud, S., Gonçalves, G., and Pereira, L. (2010, January 26–29). 3D segmentation of forest structure using a mean-shift based algorithm. Proceedings of the 2010 IEEE International Conference on Image Processing, Hong Kong.10.1109/ICIP.2010.5651310 ↗
9. Segmentation and Reconstruction of Polyhedral Building Roofs From Aerial Lidar Point Clouds10.1109/TGRS.2009.2030180 ↗
10. Unsupervised robust planar segmentation of terrestrial laser scanner point clouds based on fuzzy clustering methods10.1016/j.isprsjprs.2007.07.010 ↗
11. Zhang, X., Li, G., Xiong, Y., and He, F. (2008, January 23–25). 3D Mesh Segmentation Using Mean-Shifted Curvature. Proceedings of the 5th International Conference on Geometric Modeling and Processing, Hangzhou, China.
12. Segmentation of Point Clouds Using Smoothness Constraint
13. Christoph Stein, S., Schoeler, M., Papon, J., and Worgotter, F. (2014, January 23–28). Object Partitioning using Local Convexity. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.10.1109/CVPR.2014.46 ↗
14. Imagenet classification with deep convolutional neural networks
15. Liu, Z., Wang, Y., Vaidya, S., Ruehle, F., Halverson, J., Soljačić, M., Hou, T.Y., and Tegmark, M. (2024). KAN: Kolmogorov-Arnold Networks. arXiv.
16. SegNeXt: Rethinking Convolutional Attention Design for Semantic Segmentation
17. Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21–26). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.
18. PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space
19. PointCNN: Convolution On X-Transformed Points
20. Thomas, H., Qi, C.R., Deschaud, J.E., Marcotegui, B., Goulette, F., and Guibas, L.J. (November, January 27). KPConv: Flexible and Deformable Convolution for Point Clouds. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.
21. Zhao, H., Jiang, L., Fu, C.W., and Jia, J. (2019, January 15–20). PointWeb: Enhancing Local Neighborhood Features for Point Cloud Processing. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00571 ↗
22. Hu, Q., Yang, B., Xie, L., Rosa, S., Guo, Y., Wang, Z., Trigoni, N., and Markham, A. (2020, January 14–19). RandLA-Net: Efficient Semantic Segmentation of Large-Scale Point Clouds. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01112 ↗
23. Zhao, H., Jiang, L., Jia, J., Torr, P.H., and Koltun, V. (2021, January 11–17). Point Transformer. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Virtual.10.1109/ICCV48922.2021.01595 ↗
24. PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategies
25. Wu, X., Jiang, L., Wang, P.S., Liu, Z., Liu, X., Qiao, Y., Ouyang, W., He, T., and Zhao, H. (2024, January 17–18). Point Transformer V3: Simpler Faster Stronger. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR52733.2024.00463 ↗
26. Pct: Point cloud transformer10.1007/s41095-021-0229-5 ↗
27. Liu, Y., Fan, B., Meng, G., Lu, J., Xiang, S., and Pan, C. (November, January 27). Densepoint: Learning densely contextual representation for efficient point cloud processing. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
28. Xu, M., Ding, R., Zhao, H., and Qi, X. (2021, January 19–25). Paconv: Position adaptive convolution with dynamic kernel assembling on point clouds. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Virtual.10.1109/CVPR46437.2021.00319 ↗
29. PVT: Point-voxel transformer for point cloud learning10.1002/int.23073 ↗
30. Yu, X., Tang, L., Rao, Y., Huang, T., Zhou, J., and Lu, J. (2022, January 18–24). Point-bert: Pre-training 3D point cloud transformers with masked point modeling. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01871 ↗
31. Armeni, I., Sener, O., Zamir, A.R., Jiang, H., Brilakis, I., Fischer, M., and Savarese, S. (2016, January 27–30). 3D Semantic Parsing of Large-Scale Indoor Spaces. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.170 ↗
32. Yan, X., Zheng, C., Li, Z., Wang, S., and Cui, S. (2020, January 14–19). PointASNL: Robust Point Clouds Processing Using Nonlocal Neural Networks With Adaptive Sampling. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00563 ↗