journal article·2025-08-29Open access

Local Contextual Attention for Enhancing Kernel Point Convolution in 3D Point Cloud Semantic Segmentation

Onur Can Bayrak, Melis Uzar

Applied Sciences· Volume 15· Issue 17

Abstract

Point cloud segmentation underpins various applications in geospatial analysis, such as autonomous navigation, urban planning, and management. Kernel Point Convolution (KPConv) has become a de facto standard for such tasks, yet its fixed geometric kernel limits the modeling of fine-grained contextual relationships—particularly in heterogeneous, real-world point cloud data. In this paper, we introduce the adaptation of a Local Contextual Attention (LCA) mechanism for the KPConv network, with reweighting kernel coefficients based on local feature similarity in the spatial proximity domain. Crucially, our lightweight design preserves KPConv’s distance-based weighting while embedding adaptive context aggregation, improving boundary delineation and small-object recognition without incurring significant computational or memory overhead. Our comprehensive experiments validate the efficacy of the proposed LCA block across multiple challenging benchmarks. Specifically, our method significantly improves segmentation performance by achieving a 20% increase in mean Intersection over Union (mIoU) on the STPLS3D dataset. Furthermore, we observe a 16% enhancement in mean F1 score (mF1) on the Hessigheim3D benchmark and a notable 15% improvement in mIoU on the Toronto3D dataset. These performance gains place LCA-KPConv among the top-performing methods reported in these benchmark evaluations. Trained models, prediction results, and the code of LCA are available in a GitHub opensource repository.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: 3D Shape Modeling and Analysis · 3D Surveying and Cultural Heritage · Image Processing and 3D Reconstruction

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Geomatic Engineering, Yildiz Technical University, Istanbul 34220, Türkiye

References (93)

Show source-provided references
1. Establishing Semantic 3D City Models by GRextADE: The Case of the Greece10.1007/s41651-022-00114-0 ↗
2. Iman Zolanvari, S.M., Ruano, S., Rana, A., Cummins, A., Da Silva, R.E., Rahbar, M., and Smolic, A. (2019, January 9–12). DublinCity: Annotated LiDAR Point Cloud and Its Applications. Proceedings of the 30th British Machine Vision Conference 2019, BMVC 2019, Cardiff, UK.
3. YCANet: Target Detection for Complex Traffic Scenes Based on Camera-LiDAR Fusion10.1109/JSEN.2024.3357826 ↗
4. Drone-Based Public Surveillance Using 3D Point Clouds and Neuro-Fuzzy Classifier
5. Road Type Classification of MLS Point Clouds Using Deep Learning
6. Deep Learning-Based Pipe Segmentation and Geometric Reconstruction from Poorly Scanned Point Clouds Using BIM-Driven Data Alignment10.1016/j.autcon.2025.106071 ↗
8. LightGBM: A Highly Efficient Gradient Boosting Decision Tree
9. Chen, T., and Guestrin, C. (2016, January 13–17). XGBoost: A Scalable Tree Boosting System. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
10. Semantic Point Cloud Interpretation Based on Optimal Neighborhoods, Relevant Features and Efficient Classifiers10.1016/j.isprsjprs.2015.01.016 ↗
11. Hu, Q., Yang, B., Xie, L., Rosa, S., Guo, Y., Wang, Z., Trigoni, N., and Markham, A. (2020, January 13–19). Randla-Net: Efficient Semantic Segmentation of Large-Scale Point Clouds. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01112 ↗
12. Hu, Q., Yang, B., Khalid, S., Xiao, W., Trigoni, N., and Markham, A. (2021, January 20–25). Towards Semantic Segmentation of Urban-Scale 3D Point Clouds: A Dataset, Benchmarks and Challenges. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00494 ↗
13. Beyond Single Receptive Field: A Receptive Field Fusion-and-Stratification Network for Airborne Laser Scanning Point Cloud Classification10.1016/j.isprsjprs.2022.03.019 ↗
14. Classification Method for Imbalanced LiDAR Point Cloud Based on Stack Autoencoder10.3934/era.2023175 ↗
15. (2025, August 04). Benchmark on High Density Aerial Image Matching. Available online: https://ifpwww.ifp.uni-stuttgart.de/benchmark/hessigheim/results.aspx.
16. Thomas, H., Qi, C.R., Deschaud, J.E., Marcotegui, B., Goulette, F., and Guibas, L. (November, January 27). KPConv: Flexible and Deformable Convolution for Point Clouds. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Republic of Korea.
17. Deep Learning-Based 3D Point Cloud Classification: A Systematic Survey and Outlook10.1016/j.displa.2023.102456 ↗
18. Su, H., Maji, S., Kalogerakis, E., and Learned-Miller, E. (2015, January 7–13). Multi-View Convolutional Neural Networks for 3D Shape Recognition. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.114 ↗
19. Yu, T., Meng, J., and Yuan, J. (2018, January 18–23). Multi-View Harmonized Bilinear Network for 3D Object Recognition. Proceedings of the Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00027 ↗
20. Ren, H., Wang, J., Yang, M., and Velipasalar, S. (2024, January 17–18). PointOfView: A Multi-Modal Network for Few-Shot 3D Point Cloud Classification Fusing Point and Multi-View Image Features. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, Seattle, WA, USA.10.1109/CVPRW63382.2024.00083 ↗
21. Kim, Y., Cho, B., Ryoo, S., and Lee, S. (2025). Multi-View Structural Convolution Network for Domain-Invariant Point Cloud Recognition of Autonomous Vehicles. arXiv.
22. Deep Learning for 3D Point Clouds: A Survey10.1109/TPAMI.2020.3005434 ↗
23. Maturana, D., and Scherer, S. (October, January 28). VoxNet: A 3D Convolutional Neural Network for Real-Time Object Recognition. Proceedings of the IEEE International Conference on Intelligent Robots and Systems, Hamburg, Germany.
24. Toward Better Boundary Preserved Supervoxel Segmentation for 3D Point Clouds10.1016/j.isprsjprs.2018.05.004 ↗
25. IBALR3D: ImBalanced-Aware Long-Range 3D Semantic Segmentation
26. Bie, L., Xiao, G., Li, Y., and Gao, Y. (Fundam. Res., 2025). HyperG-PS: Voxel Correlation Modeling via Hypergraph for LiDAR Panoptic Segmentation, Fundam. Res., in press.10.1016/j.fmre.2024.03.033 ↗
27. Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 22–25). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2017, Honolulu, HI, USA.
28. Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017). PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. Adv. Neural Inf. Process. Syst., 30.
29. Choy, C., Gwak, J., and Savarese, S. (2019, January 15–20). 4D Spatio-Temporal Convnets: Minkowski Convolutional Neural Networks. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00319 ↗
30. PointGT: A Method for Point-Cloud Classification and Segmentation Based on Local Geometric Transformation10.1109/TMM.2024.3374580 ↗
31. Twin Deformable Point Convolutions for Airborne Laser Scanning Point Cloud Classification10.1016/j.isprsjprs.2025.01.031 ↗
32. Zhao, H., Jiang, L., Jia, J., Torr, P.H.S., and Koltun, V. (2021, January 11–17). Point Transformer. Proceedings of the 2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), Montreal, BC, Canada.10.1109/ICCV48922.2021.01595 ↗
33. Zhao, H., Jia, J., and Koltun, V. (2020, January 13–19). Exploring Self-Attention for Image Recognition. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01009 ↗
34. Point Transformer V2: Grouped Vector Attention and Partition-Based Pooling
35. Wu, X., Jiang, L., Wang, P.-S., Liu, Z., Liu, X., Qiao, Y., Ouyang, W., He, T., and Zhao, H. (2024, January 16–22). Point Transformer V3: Simpler, Faster, Stronger. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.00463 ↗
36. SAPFormer: Shape-Aware Propagation Transformer for Point Clouds10.1016/j.patcog.2025.111578 ↗
37. Improving Performance of Deep Learning Models for 3D Point Cloud Semantic Segmentation via Attention Mechanisms10.1016/j.cag.2022.06.010 ↗
38. Zhao, L., Xu, S., Liu, L., Ming, D., and Tao, W. (2022). SVASeg: Sparse Voxel-Based Attention for 3D LiDAR Point Cloud Semantic Segmentation. Remote Sens., 14.10.3390/rs14184471 ↗
39. Yu, X., Tang, L., Rao, Y., Huang, T., Zhou, J., and Lu, J. (2022, January 18–24). Point-BERT: Pre-Training 3D Point Cloud Transformers with Masked Point Modeling. Proceedings of the Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01871 ↗
40. PointGPT: Auto-Regressively Generative Pre-Training from Point Clouds
41. Point Attention Network for Point Cloud Semantic Segmentation10.1007/s11432-021-3387-7 ↗
42. Zhang, C., Wan, H., Shen, X., and Wu, Z. (2022, January 18–24). PatchFormer: An Efficient Point Transformer with Patch Attention. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01150 ↗
43. LWSNet: A Lightweight Network for Automated Welding Point Cloud Segmentation10.1016/j.measurement.2024.116290 ↗
44. Efficient and Lightweight Semantic Segmentation Network for Land Cover Point Cloud with Local-Global Feature Fusion10.1109/TGRS.2025.3559590 ↗
45. Tao, W., Qu, X., Lu, K., Wan, J., He, S., and Wang, J. (2025). BAGNet: A Boundary-Aware Graph Attention Network for 3D Point Cloud Semantic Segmentation. arXiv.
46. Le, T., and Duan, Y. (2018, January 18–23). PointGrid: A Deep Network for 3D Shape Understanding. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00959 ↗
47. Zhang, R., Guo, Z., Zhang, W., Li, K., Miao, X., Cui, B., Qiao, Y., Gao, P., and Li, H. (2022, January 18–24). PointCLIP: Point Cloud Understanding by CLIP. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00836 ↗
48. Afham, M., Dissanayake, I., Dissanayake, D., Dharmasiri, A., Thilakarathna, K., and Rodrigo, R. (2022, January 18–24). CrossPoint: Self-Supervised Cross-Modal Contrastive Learning for 3D Point Cloud Understanding. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00967 ↗
49. Distribution-Aware Contrastive Learning for Domain Adaptation in 3D LiDAR Segmentation10.1016/j.cviu.2025.104438 ↗
50. Chang, W.L., Wang, H.P., Peng, W.H., and Chiu, W.C. (2019, January 15–20). All about Structure: Adapting Structural Information across Domains for Boosting Semantic Segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00200 ↗
51. Adaptive Batch Normalization for Practical Domain Adaptation10.1016/j.patcog.2018.03.005 ↗
52. Zhao, H., Zhang, J., Chen, Z., Zhao, S., and Tao, D. (2024, January 16–22). UniMix: Towards Domain Adaptive and Generalizable LiDAR Semantic Segmentation in Adverse Weather. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.01400 ↗
53. Unsupervised Domain Adaptation for Cross-Scene Multispectral Point Cloud Classification
54. PGFormer: A Point Cloud Segmentation Network for Urban Scenes Combining Grouped Transformer and KPConv10.1109/TGRS.2025.3592194 ↗
55. Hybrid Cross-Transformer-KPConv for Point Cloud Segmentation10.1109/LSP.2023.3343253 ↗
56. A Dual Attention KPConv Network Combined with Attention Gates for Semantic Segmentation of ALS Point Clouds
57. Zhang, R., Chen, S., Wang, X., and Zhang, Y. (2023). IPCONV: Convolution with Multiple Different Kernels for Point Cloud Semantic Segmentation. Remote Sens., 15.10.3390/rs15215136 ↗
58. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
59. Chen, M., Hu, Q., Yu, Z., Thomas, H., Feng, A., Hou, Y., McCullough, K., Ren, F., and Soibelman, L. (2022, January 21–24). STPLS3D: A Large-Scale Synthetic and Real Aerial Photogrammetry 3D Point Cloud Dataset. Proceedings of the BMVC 2022—33rd British Machine Vision Conference Proceedings, London, UK.
60. The Hessigheim 3D (H3D) Benchmark on Semantic Segmentation of High-Resolution 3D Point Clouds and Textured Meshes from UAV LiDAR and Multi-View-Stereo10.1016/j.ophoto.2021.100001 ↗
61. Tan, W., Qin, N., Ma, L., Li, Y., Du, J., Cai, G., Yang, K., and Li, J. (2020, January 14–19). Toronto-3D: A Large-Scale Mobile LiDAR Dataset for Semantic Segmentation of Urban Roadways. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, Seattle, WA, USA.10.1109/CVPRW50498.2020.00109 ↗
62. (2025, August 04). HuguesTHOMAS/KPConv-PyTorch: Kernel Point Convolution Implemented in PyTorch. Available online: https://github.com/HuguesTHOMAS/KPConv-PyTorch.
63. (2025, August 04). STPLS3D/KPConv-PyTorch at Main Meidachen/STPLS3D. Available online: https://github.com/meidachen/STPLS3D/tree/main/KPConv-PyTorch.
64. PointSGLN: A Novel Point Cloud Classification Network Based on Sampling Grouping and Local Point Normalization10.1007/s00530-024-01303-1 ↗
65. Point Cloud Classification with Deep Normalized Reeb Graph Convolution10.1016/j.imavis.2020.104092 ↗
66. (2025, August 04). STPLS3D|LEADERBOARD. Available online: https://www.stpls3d.com/leaderboard.
67. Fan, S., Dong, Q., Zhu, F., Lv, Y., Ye, P., and Wang, F.Y. (2021, January 19–25). SCF-Net: Learning Spatial Contextual Features for Large-Scale Point Cloud Segmentation. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Virtual.10.1109/CVPR46437.2021.01427 ↗
68. 3D Point Cloud Semantic Segmentation Based on Visual Guidance and Feature Enhancement10.1007/s00530-025-01777-7 ↗
69. A Local-Global Feature Fusing Method for Point Clouds Semantic Segmentation10.1109/ACCESS.2023.3293161 ↗
70. PointRas: Uncertainty-Aware Multi-Resolution Learning for Point Cloud Segmentation10.1109/TIP.2022.3205208 ↗
71. Weakly-Supervised Point Cloud Semantic Segmentation Based on Dilated Region
72. Tran, A.T., Le, H.S., Lee, S.H., and Kwon, K.R. (2024, January 3–8). PointCT: Point Central Transformer Network for Weakly-Supervised Point Cloud Semantic Segmentation. Proceedings of the 2024 IEEE Winter Conference on Applications of Computer Vision, WACV 2024, Waikoloa, HI, USA.10.1109/WACV57701.2024.00352 ↗
73. Gao, F., Yan, Y., Lin, H., and Shi, R. (2022). PIIE-DSA-Net for 3D Semantic Segmentation of Urban Indoor and Outdoor Datasets. Remote Sens., 14.10.3390/rs14153583 ↗
74. Grilli, E., Daniele, A., Bassier, M., Remondino, F., and Serafini, L. (2023). Knowledge Enhanced Neural Networks for Point Cloud Semantic Segmentation. Remote Sens., 15.10.3390/rs15102590 ↗
75. Point-Wise Classification of High-Density UAV-LiDAR Data Using Gradient Boosting Machines
76. (2025, August 04). GitHub—WeikaiTan/Toronto-3D: A Large-Scale Mobile LiDAR Dataset for Semantic Segmentation of Urban Roadways. Available online: https://github.com/WeikaiTan/Toronto-3D.
77. Dynamic Graph Cnn for Learning on Point Clouds10.1145/3326362 ↗
78. Multi-Scale Point-Wise Convolutional Neural Networks for 3D Object Segmentation from LiDAR Point Clouds in Large-Scale Environments10.1109/TITS.2019.2961060 ↗
79. TGNet: Geometric Graph CNN on 3-D Point Cloud Segmentation10.1109/TGRS.2019.2958517 ↗
80. Lin, M., and Feragen, A. (2022). DiffConv: Analyzing Irregular Point Clouds with an Irregular View. Computer Vision—ECCV 2022 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part III, Springer.10.1007/978-3-031-20062-5_22 ↗
81. Yoo, S., Jeong, Y., Jameela, M., and Sohn, G. (2023, January 17–24). Human Vision Based 3D Point Cloud Semantic Segmentation of Large-Scale Outdoor. Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Vancouver, BC, Canada.10.1109/CVPRW59228.2023.00699 ↗
82. Dynamic Clustering Transformer Network for Point Cloud Segmentation
83. Rim, B., Lee, A., and Hong, M. (2021). Semantic Segmentation of Large-Scale Outdoor Point Clouds by Encoder–Decoder Shared MLPs with Multiple Losses. Remote Sens., 13.10.3390/rs13163121 ↗
84. Continuous Mapping Convolution for Large-Scale Point Clouds Semantic Segmentation10.1109/LGRS.2021.3107006 ↗
85. ResDLPS-Net: Joint Residual-Dense Optimization for Large-Scale Point Cloud Semantic Segmentation10.1016/j.isprsjprs.2021.09.024 ↗
86. Large-Scale Point Cloud Semantic Segmentation via Local Perception and Global Descriptor Vector10.1016/j.eswa.2024.123269 ↗
87. A Point-Based Deep Learning Network for Semantic Segmentation of MLS Point Clouds10.1016/j.isprsjprs.2021.03.001 ↗
88. Finding the Optimal Convolutional Kernel Size for Semantic Segmentation of Pole-like Objects in Lidar Point Clouds10.5194/isprs-archives-XLVIII-G-2025-1747-2025 ↗
89. Jiang, L., Ma, J., Zhou, H., Shangguan, B., Xiao, H., and Chen, Z. (2025). Large-Scale Point Cloud Semantic Segmentation with Density-Based Grid Decimation. ISPRS Int. J. Geo-Inf., 14.10.20944/preprints202505.0798.v1 ↗
90. BADet: Boundary-Aware 3D Object Detection from Point Clouds10.1016/j.patcog.2022.108524 ↗
91. Zhao, W., Zhang, R., Wang, Q., Cheng, G., and Huang, K. (2025, January 10–17). BFANet: Revisiting 3D Semantic Segmentation with Boundary Feature Analysis. Proceedings of the Computer Vision and Pattern Recognition Conference, Nashville, TN, USA.10.1109/CVPR52734.2025.02737 ↗
92. Multi-Scale Neighborhood Feature Extraction and Aggregation for Point Cloud Segmentation10.1109/TCSVT.2020.3023051 ↗
93. Sparse Single Sweep LiDAR Point Cloud Segmentation via Learning Contextual Shape Priors from Scene Completion