Automatic Measurement of Inclination Angle of Utility Poles Using 2D Image and 3D Point Cloud
Source abstract
Abstract
The utility pole inclination angle is an important parameter for determining pole health conditions. Without depth information, the angle cannot be estimated from a 2D image, and without large labeled reference pole data, it is time consuming to locate the pole in the 3D point cloud. Therefore, this paper proposes a method that processes the pole data from the 2D image and 3D point cloud to automatically measure the pole inclination angle. Firstly, the mask of the pole skeleton is obtained from an improved Mask R-CNN. Secondly, the pole point cloud is extracted from a PointNet that deals with the generated frustum from the pole skeleton mask and depth map fusion. Finally, the angle is calculated by fitting the central axis of the pole cloud data. ApolloSpace open dataset and laboratory data are used for evaluation. The experimental results show that the AP75 of improved Mask R-CNN is 58.15%, the accuracy of PointNet is 92.4%, the average error of pole inclination is 0.66°, and the variance is 0.12°. It is proved that the method can effectively realize the automatic measurement of pole inclination.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Planetary Science and Exploration · Space Satellite Systems and Control · Image and Object Detection Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Mechanical and Electrical Engineering, Wuhan University of Technology, Wuhan 430070, China
References (40)
Show source-provided references
1. Research on active safety protection technology of distribution network poles
2. Review of power system security and stability defense methods under natural disasters
3. Resilience assessment of power systems considering typhoon weather
4. Risk assessment method for distribution network considering operation status under typhoon disaster scenario
5. Wind-Resistant monitoring technology of pole-line structure in transmission lines
6. Kim, J., Kamari, M., Lee, S., and Ham, Y. (2021). Large-scale visual data–driven probabilistic risk assessment of utility poles regarding the vulnerability of power distribution infrastructure systems. J. Constr. Eng. Manag., 147.10.1061/(ASCE)CO.1943-7862.0002153 ↗
7. Comparison of several transmission line tower inclination measurement methods
8. Transmission tower deformation and tilt detection research status10.1016/j.powtec.2018.04.011 ↗
9. Tragulnuch, P., Kasetkasem, T., Isshiki, T., Chanvimaluang, T., and Ingprasert, S. (2018, January 7–9). High voltage transmission tower detection and tracking in aerial video sequence using object-based image classification. Proceedings of the International Conference on Embedded Systems and Intelligent Technology (ICESIT)/International Conference on Information and Communication Technology for Embedded Systems (ICICTES), Khon Kaen, Thailand.10.1109/ICESIT-ICICTES.2018.8442058 ↗
10. Yang, Y., Chen, Y., Chen, Y., Xiao, F., and He, W. (2018, January 22–27). A new method of retrieving the inclination direction of power transmission tower by geocoding. Proceedings of the 38th IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Valencia, Spain.10.1109/IGARSS.2018.8517695 ↗
11. Li, L., Gao, X., and Liu, W. (2021, January 18–20). On-line monitoring method of transmission tower tilt based on remote sensing satellite optical image and neural network. Proceedings of the 11th International Conference on Power and Energy Systems (ICPES), Shanghai, China.10.1109/ICPES53652.2021.9683819 ↗
12. Automatic assessment and prediction of the resilience of utility poles using unmanned aerial vehicles and computer vision techniques10.1007/s13753-020-00254-1 ↗
13. Mo, Y.F., Xie, R., Pan, Q., and Zhang, B. (2021, January 12–14). Automatic power transmission towers detection based on the deep learning algorithm. Proceedings of the 2nd International Conference on Computer Engineering and Intelligent Control (ICCEIC), Chongqing, China.10.1109/ICCEIC54227.2021.00010 ↗
14. Zhang, W., Witharana, C., Li, W., Zhang, C., Li, X., and Parent, J. (2018). Using deep learning to identify utility poles with crossarms and estimate their locations from google street view images. Sensors, 18.10.3390/s18082484 ↗
15. Gomes, M., Silva, J., Goncalves, D., Zamboni, P., Perez, J., Batista, E., Ramos, A., Osco, L., Matsubara, E., and Li, J. (2020). Mapping utility poles in aerial orthoimages using ATSS deep learning method. Sensors, 20.10.3390/s20216070 ↗
16. Intelligent damage classification and estimation in power distribution poles using unmanned aerial vehicles and convolutional neural networks10.1109/TSG.2020.2970156 ↗
17. Lu, Z., Gong, H., Jin, Q., Hu, Q., and Wang, S. (2022). A transmission tower tilt state assessment approach based on dense point cloud from UAV-Based LiDAR. Remote Sens., 14.10.3390/rs14020408 ↗
18. A risk analysis framework for transmission towers under potential pluvial flood—LiDAR survey and geometric modelling10.1016/j.ijdrr.2020.101862 ↗
19. The method of power transmission tower inclination detection based on UAV image
20. Shi, Z., Kang, Z., Lin, Y., Liu, Y., and Chen, W. (2018). Automatic recognition of Pole-Like objects from mobile laser scanning point clouds. Remote Sens., 10.10.3390/rs10121891 ↗
21. Voxel-Based extraction and classification of 3-D Pole-Like objects from mobile LiDAR point cloud data10.1109/JSTARS.2018.2869801 ↗
22. Pole-Like road object detection from mobile lidar system using a Coarse-to-Fine approach10.1109/JSTARS.2015.2467160 ↗
23. Automated localization and classification of expressway Pole-Like road facilities from mobile laser scanning data
24. A review of image semantic segmentation methods based on deep learning
25. A review of case segmentation based on deep learning
26. He, K., Gkioxari, G., Dollar, P., and Girshick, R. (2017, January 22–29). Mask r-cnn. Proceedings of the 16th IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.322 ↗
27. Review of semantic segmentation of point cloud based on deep learning
28. Ma, C., and Huang, M. (2015, January 6–7). A unified cone, cone, cylinder fitting method. Proceedings of the Ninth Beijing-Hong Kong-Macao Surveying and Mapping Geographic Information Technology Exchange Conference, Beijing, China.
29. Ghiasi, G., Lin, T., Le, Q.V., and Soc, I.C. (2019, January 16–20). Nas-fpn: Learning scalable feature pyramid architecture for object detection. Proceedings of the 32nd IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00720 ↗
30. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
31. Woo, S.H., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8–14). Cbam: Convolutional block attention module. Proceedings of the 15th European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
32. Qi, C., Liu, W., Wu, C., Su, H., and Guibas, L.J. (2018, January 18–23). Frustum pointnets for 3D object detection from RGB-D data. Proceedings of the 31st IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00102 ↗
33. Qi, C., Su, H., Mo, K.C., and Guibas, L.J. (2017, January 21–26). Pointnet: Deep learning on point sets for 3d classification and segmentation. Proceedings of the 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.
34. Brachmann, E., and Rother, C. (November, January 27). Neural-Guided RANSAC: Learning where to sample model hypotheses. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.
35. Spatial linear fitting algorithm based on total least squares
36. The apolloscape open dataset for autonomous driving and its application10.1109/TPAMI.2019.2926463 ↗
37. Summarization of 3D object detection methods based on deep learning
38. Lin, T.-Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014). European Conference on Computer Vision (ECCV), Zurich, Switzerland, 6–12 September 2014, Springer.
39. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
40. Song, S., Lichtenberg, S.P., and Xiao, J. (2015, January 7–12). Sun rgb-d: A rgb-d scene understanding benchmark suite. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298655 ↗