journal article·2023-06-05Open access

Towards Intricate Stand Structure: A Novel Individual Tree Segmentation Method for ALS Point Cloud Based on Extreme Offset Deep Learning

Yizhuo Zhang, Hantao Liu, Xingyu Liu, Huiling Yu

Applied Sciences· Volume 13· Issue 11

Abstract

Due to the complex structure of high-canopy-density forests, the traditional individual tree segmentation (ITS) algorithms based on ALS point cloud, which set segmentation threshold manually, is difficult to adequately cover a variety of complex situations, so the ITS accuracy is unsatisfactory. In this paper, a top-down segmentation strategy is adopted to propose an adaptive segmentation method based on extreme offset deep learning, and the ITS set aggregation strategy based on gradient change criterion is designed for the over-segmentation generated by random offset, and the precise ITS is realized. Firstly, the segmentation sub-plot is set as 25 m × 25 m, the regional point cloud and its treetop are marked, and the offset network is trained. Secondly, the extreme offset network is designed to carry out spatial transformation of the original point cloud, and each point is offset to the position near the treetop to obtain the offset point cloud with a high density at the treetop, which enhances the discrimination among individual trees. Thirdly, the self-adaptive mean shift algorithm based on average neighboring distance is designed to divide and mark the offset point cloud. Fourthly, the offset point cloud, after clustering, is mapped back to the original space to complete the preliminary segmentation. Finally, according to the gradient change among different canopies, the ITS aggregation method is designed to aggregate adjacent canopies with a gentle gradient change. In order to investigate the universality of the proposed method on different stand structures, two coniferous forest plots (U1, U2) in the Blue Ridge area of Washington, USA, and two mixed forest plots (G1, G2) in Bretten, Germany, are selected in the experiment. The learning rate of the deep network is set as 0.001, the sampled point number of the sub-plot is 900, the transformer dimension is 512 × 512, the neighboring search number of points is 16, and the number of up-sampling blocks is 3. Experimental results show that in mixed forests (G1, G2) with complex structures, the F-score of the proposed method reaches 0.89, which is about 4% and 7% higher than the classical SHDR and improved DK, respectively. In high-canopy-density areas (U2, G2), the F-score of the proposed method reaches 0.89, which is about 3% and 4% higher than the SHDR and improved DK, respectively. The results show that the proposed method has high universality and accuracy, even in a complex stand environment with high canopy density.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Remote Sensing and LiDAR Applications · Forest ecology and management · Forest Ecology and Biodiversity Studies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science, Changzhou University, Changzhou 213000, China

References (31)

Show source-provided references
1. Research Progress of Lidar in Forest Biomass Estimation
2. Pu, Y., Xu, D., Wang, H., Li, X., and Xu, X. (2023). A New Strategy for Individual Tree Detection and Segmentation from Leaf-on and Leaf-off UAV-LiDAR Point Clouds Based on Automatic Detection of Seed Points. Remote Sens., 15.10.3390/rs15061619 ↗
3. Exploration of Individual Tree Segmentation Method in Subtropical Coniferous Forest Using Airborne Radar Data
4. Xu, D., Wang, H., Xu, W., Luan, Z., and Xu, X. (2021). LiDAR applications to estimate forest biomass at individual tree scale: Opportunities, challenges and future perspectives. Forests, 12.10.3390/f12050550 ↗
5. Kong, M. (2021). Single Tree Extraction of Airborne Forest Point Cloud Based on Deep Learning of Candidate Regions, China University of Geosciences.
6. Hui, Z., Jin, S., Li, D., Ziggah, Y.Y., and Liu, B. (2021). Individual Tree Extraction from Terrestrial LiDAR Point Clouds Based on Transfer Learning and Gaussian Mixture Model Separation. Remote Sens., 13.10.3390/rs13020223 ↗
7. Combining trunk detection with canopy segmentation to delineate single deciduous trees using airborne LiDAR data10.1109/ACCESS.2020.2995389 ↗
8. Towards low vegetation identification: A new method for tree crown segmentation from LiDAR data based on a symmetrical structure detection algorithm (SSD)10.1016/j.rse.2021.112857 ↗
9. Review on Individual Tree Detection Based on Airborne LiDAR10.3788/LOP55.082805 ↗
10. Research on the improvement of single tree segmentation algorithm based on airborne LiDAR point cloud10.1515/geo-2020-0266 ↗
11. Fu, H., Li, H., Dong, Y., Xu, F., and Chen, F. (2022). Segmenting Individual Tree from TLS Point Clouds Using Improved DBSCAN. Forests, 13.10.3390/f13040566 ↗
12. A new method for segmenting individual trees from the lidar point cloud10.14358/PERS.78.1.75 ↗
13. Improving the efficiency and accuracy of individual tree crown delineation from high-density LiDAR data
14. A robust approach for tree segmentation in deciduous forests using small-footprint airborne LiDAR data
15. Individual tree crown segmentation from airborne LiDAR data using a novel Gaussian filter and energy function minimization-based approach10.1016/j.rse.2021.112307 ↗
16. Yan, W., Guan, H., Cao, L., Yu, Y., Li, C., and Lu, J. (2020). A self-adaptive mean shift tree-segmentation method using UAV LiDAR data. Remote Sens., 12.10.3390/rs12030515 ↗
17. Overview on deep learning
18. Weinstein, B.G., Marconi, S., Bohlman, S., Zare, A., and White, E. (2019). Individual tree-crown detection in RGB imagery using semi-supervised deep learning neural networks. Remote Sens., 11.10.1101/532952 ↗
19. Chen, X., Jiang, K., Zhu, Y., Wang, X., and Yun, T. (2021). Individual tree crown segmentation directly from UAV-borne LiDAR data using the PointNet of deep learning. Forests, 12.10.3390/f12020131 ↗
20. Wang, F., and Bryson, M. (2023). Tree Segmentation and Parameter Measurement from Point Clouds Using Deep and Handcrafted Features. Remote Sens., 15.10.3390/rs15041086 ↗
21. Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21–26). Pointnet: Deep learning on point sets for 3d classification and segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.
22. Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017, January 4–9). Pointnet++: Deep hierarchical feature learning on point sets in a metric space. Advances in neural information processing systems. Proceedings of the Neural Information Processing Systems, Long Beach, CA, USA.
23. Qi, C.R., Litany, O., He, K., and Guibas, L.J. (November, January 27). Deep hough voting for 3d object detection in point clouds. Proceedings of the IEEE/CVF International Conference on Computer Vision 2019, Seoul, Republic of Korea.10.1109/ICCV.2019.00937 ↗
24. Jiang, L., Zhao, H., Shi, S., Liu, S., Fu, C.W., and Jia, J. (2020, January 13–19). Pointgroup: Dual-set point grouping for 3d instance segmentation. Proceedings of the IEEE/CVF Conference on Computer Vision and PATTERN Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.00492 ↗
25. Chen, S., Fang, J., Zhang, Q., Liu, W., and Wang, X. (2021, January 11–17). Hierarchical aggregation for 3d instance segmentation. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.01518 ↗
26. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017). Attention is all you need. arXiv.
27. Zhao, H., Jiang, L., Jia, J., Torr, P.H., and Koltun, V. (2021, January 11–17). Point transformer. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.01595 ↗
28. Zhang, W., Qi, J., Wan, P., Wang, H., Xie, D., Wang, X., and Yan, G. (2016). An easy-to-use airborne LiDAR data filtering method based on cloth simulation. Remote Sens., 8.10.3390/rs8060501 ↗
29. Chen, W., Hu, X., Chen, W., Hong, Y., and Yang, M. (2018). Airborne LiDAR Remote Sensing for Individual Tree Forest Inventory Using Trunk Detection-Aided Mean Shift Clustering Techniques. Remote Sens., 10.10.3390/rs10071078 ↗
30. Individual tree point clouds and tree measurements from multi-platform laser scanning in German forests10.5194/essd-14-2989-2022 ↗
31. Utility of multitemporal lidar for forest and carbon monitoring: Tree growth, biomass dynamics, and carbon flux10.1016/j.rse.2017.09.007 ↗