A LiDAR Multi-Object Detection Algorithm for Autonomous Driving
Source abstract
Abstract
Three-dimensional object detection is the core of an autonomous driving perception system, which detects and analyzes targets around the vehicle to obtain their sizes, shapes, and categories to provide reliable operational decisions for achieving autonomous driving. To improve the detection and localization accuracy of multi-object targets such as surrounding vehicles and pedestrians in autonomous driving scenarios, based on PointPillars fast object detection network, a three-dimensional object detection algorithm based on the channel attention mechanism, ECA Modules-PointPillars, is proposed. Firstly, the improved algorithm uses point cloud columnarization features to convert a three-dimensional point cloud into a two-dimensional pseudo-image. Then, combining the 2D backbone network for feature extraction with the Efficient Channel Attention (ECA) modules to achieve the enhancement of the positional feature information in the pseudo-image and the weakening of the irrelevant feature information such as background noise. Finally, the single-shot multibox detector (SSD) algorithm was used to complete the 3D object detection task. The experimental results show that the improved algorithm improves the mAP by 3.84% and 4.04% in BEV mode and 3D mode, respectively, compared to PointPillars, which improves the mAP by 4.64% and 5.89% in BEV mode and 3D mode, respectively, compared to F-PointNet, improves the mAP by 11.78% and 14.19% in BEV mode and 3D mode, respectively, compared to VoxelNet, and improves the mAP by 9.47% and 6.55% in BEV mode and 3D mode, respectively, compared to SECOND, demonstrating the effectiveness and reliability of the improved algorithms in autonomous driving scenarios.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Remote Sensing and LiDAR Applications · Autonomous Vehicle Technology and Safety
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Communication and Information Engineering, Xi’an University of Science and Technology, Xi’an 710600, China
Funding
National Natural Science Foundation of China · UWB Radar Life Information Feature Extraction and Quantitative Identification for Mine Drill Hole Rescue project
References (38)
Show source-provided references
1. Key technology and application algorithm of intelligent driving vehicle LiDAR
2. Target segmentation method for three-dimensional LiDAR point cloud based on depth image
3. Review of 3D Object Detection for Autonomous Driving
4. Deep learning based on semantic segmentation for three-dimensional object detection from point clouds
5. 3D point cloud object detection method in view of voxel based on graph convolution network
6. Review of 3D Target Detection Methods Based on LIDAR Point Clouds
7. Li, B., Zhang, T., and Xia, T. (2016). Vehicle detection from 3D lidar using fully convolutional network. arXiv.10.15607/RSS.2016.XII.042 ↗
8. Zhou, Y., and Tuzel, O. (2018, January 18–23). VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00472 ↗
9. Yang, B., Luo, W., and Urtasun, R. (2018, January 18–22). Pixor: Real-time 3D object detection from point clouds. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00798 ↗
10. Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21–26). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation. Proceedings of the 30th IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.
11. Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017, January 4–9). PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. Proceedings of the Annual Conference on Neural Information Processing Systems (NIPS), Long Beach, CA, USA.
12. Qi, C.R., Liu, W., Wu, C., Su, H., and Guibas, L.J. (2018, January 18–23). Frustum pointnets for 3D object detection from rgb-d data. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00102 ↗
13. Research of deep learning based semantic segmentation for 3D point cloud
14. A survey of 3D detection algorithms
15. Yan, Y., and Mao, Y. (2018). SECOND: Sparsely Embedded Convolutional Detection. Sensors, 18.10.3390/s18103337 ↗
16. Lang, A.H., Vora, S., Caesar, H., Zhou, L., Yang, J., and Beijbom, O. (2019, January 16–20). PointPillars: Fast Encoders for Object Detection from Point Clouds. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.01298 ↗
17. Engelcke, M., Rao, D., Wang, D.Z., Tong, C.H., and Posner, I. (June, January 29). Vote3deep: Fast object detection in 3D point clouds using efficient convolutional neural networks. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.10.1109/ICRA.2017.7989161 ↗
18. Shu, X., Chang, F., Zhang, X., Shao, C., and Yang, X. (2022). ECAU-Net: Efficient channel attention U-Net for fetal ultrasound cerebellum segmentation. Biomed. Signal Process. Control, 75.10.1016/j.bspc.2022.103528 ↗
19. Lidar 3D Target Detection Based on Improved PointPillars
20. Chen, X., Ma, H., Wan, J., Li, B., and Xia, T. (2017, January 21–26). Multi-view 3D object detection network for autonomous driving. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.691 ↗
21. Ku, J., Mozifian, M., Lee, J., Harakeh, A., and Waslander, S.L. (2018, January 1–5). Joint 3D proposal generation and object detection from view aggregation. Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.10.1109/IROS.2018.8594049 ↗
22. Simon, M., Milz, S., Amende, K., and Gross, H.-M. (2018). Complex-YOLO: Real-time 3D Object Detection on Point Clouds. arXiv.10.1109/CVPRW.2019.00158 ↗
23. 3D object detection in voxelized point cloud scene10.37188/CJLCD.2022-0082 ↗
24. Ioffe, S., and Szegedy, C. (2015, January 6–11). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the 32nd International Conference on Machine Learning, ICML, Lile, France.
25. Nair, V., and Hinton, G.E. (2010, January 21–24). Rectified linear units improve restricted boltzmann machines. Proceedings of the 27th International Conference on Machine Learning (ICML-10), Haifa, Israel.
26. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016, January 11–14). Ssd: Single shot multibox detector. Proceedings of the Computer Vision-ECCV 2016: 14th European Conference, Amsterdam, The Netherlands. Part I 14.10.1007/978-3-319-46448-0_2 ↗
27. The pascal visual object classes (voc) challenge10.1007/s11263-009-0275-4 ↗
28. Lin, T.Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2017, January 22–29). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.324 ↗
29. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
30. Paszke, A., Gross, S., Chintala, S., Chanan, G., Yang, E., DeVito, Z., Lin, Z., Desmaison, A., Antiga, L., and Lerer, A. (2017, October 28). Automatic Differentiation in PyTorch. Available online: https://openreview.net/forum?id=BJJsrmfCZ.
31. 3D Object Detection Based on Extremely Sparse Laser Point Cloud and RGB Images
32. Vision meets robotics: The kitti dataset10.1177/0278364913491297 ↗
33. 3D object proposals for accurate object class detection
34. An attention-based PointPillars+3D object detection
35. Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16–21). Are we ready for autonomous driving? The kitti vision benchmark suite. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.10.1109/CVPR.2012.6248074 ↗
36. Deng, J., Shi, S., Li, P., Zhou, W., Zhang, Y., and Li, H. (2021, January 2–9). Voxel r-cnn: Towards high performance voxel-based 3D object detection. Proceedings of the AAAI Conference on Artificial Intelligence, Virtually.10.1609/aaai.v35i2.16207 ↗
37. Yang, Z., Sun, Y., Liu, S., and Jia, J. (2020, January 13–19). 3DSSD: Point-based 3D single stage object detector. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01105 ↗
38. Song, S., Lichtenberg, S.P., and Xiao, J. (2015, January 7–12). Sun RGB-D: A RGB-D scene understanding benchmark suite. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298655 ↗