journal article·2026-02-11Open access

Attention-Augmented PointPillars for Enhanced Mining Personnel Detection

Pingan Peng, Chaowei Zhang, Bing Cui

Applied Sciences· Volume 16· Issue 4

Abstract

The intricate layout of underground mine tunnels and the operation of large-scale mining equipment create extensive blind zones, leading to an average of 17 personnel collision accidents per 100,000 working hours in China’s metal mines. To tackle this issue, we constructed a specialized Jinchuan Underground Mining Personnel Dataset covering intersecting tunnels and long straight tunnels, with precise bounding box annotations for personnel locations under varying illumination and dust conditions. We propose the Attention-Augmented PointPillars for Enhanced Mining Personnel Detection. Incorporating Recursive Gated Convolutions into the feature extraction network enables long-range modeling and higher-order spatial interactions. Moreover, the pyramidal design in gn Conv with channel width gradually increasing during spatial interactions enhances the model’s efficiency in processing complex spatial information. Additionally, a Channel and Spatial Attention module integrating spatial and channel attention feature fusion strengthens feature expression via multiple weighting mechanisms. Field tests in Jinchuan underground mine show optimal performance with a batch size of 8, a learning rate of 0.003, and a spatial interaction order of 5, achieving 3% higher accuracy than the original network. Furthermore, comparisons with mainstream methods on the Underground Personnel Dataset confirm our method’s state-of-the-art performance.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Occupational Health and Safety Research · Multimodal Machine Learning Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Resources and Safety Engineering, Central South University, Changsha 410083, China

State Key Laboratory for Fine Exploration and Intelligent Development of Coal Resources, Xuzhou 221116, China

Norinmining Co., Ltd., Beijing 100055, China

Funding

National Natural Science Foundation of China · Fundamental Research Funds for the Central Universities of Central South University · National Key Research and Development Program of China · Science and Technology Innovation Program of Hunan Province · Research Fund of The State Key Laboratory for Fine Exploration and Intelligent Development of Coal Resources

References (50)

Show source-provided references
1. Efficient and Accurate Mapping Method of Underground Metal Mines Using Mobile Mining Equipment and Solid-State Lidar10.1016/j.measurement.2023.113581 ↗
2. Industrial Internet of Things-Enabled Monitoring and Maintenance Mechanism for Fully Mechanized Mining Equipment10.1016/j.aei.2022.101782 ↗
3. Longitudinal and Lateral Trajectory Planning for the Typical Duty Cycle of Autonomous Load Haul Dump10.1109/ACCESS.2019.2937668 ↗
4. Opportunities and Challenges in Deep Mining: A Brief Review10.1016/J.ENG.2017.04.024 ↗
5. Virtual Design Modifications Yield Line-of-Sight Improvements for LHD Operators10.1016/j.ergon.2007.04.002 ↗
6. Factors Influencing Load–Haul–Dump Operator Line of Sight in Underground Mining10.1016/j.apergo.2003.12.002 ↗
7. Schwabe, N., and Godwin, A. (2017). Implications of Articulating Machinery on Operator Line of Sight and Efficacy of Camera Based Proximity Detection Systems. Safety, 3.10.3390/safety3030017 ↗
8. Anee, R.-E.-A., and Karmakar, N.C. (2015, January 6–9). Anti-Collision Methods for Chipless RFID Systems. Proceedings of the 2015 Asia-Pacific Microwave Conference (APMC), Nanjing, China.10.1109/APMC.2015.7413055 ↗
9. Chipless RFID Sensors for IoT Sensing and Potential Applications in Underground Mining—A Review10.1109/JSEN.2023.3259973 ↗
10. Application of Radio-Frequency Identification Systems to Collision Avoidance in Metal/Nonmetal Mines10.1109/28.903133 ↗
11. Application of RFID Technology to Prevention of Collision Accident with Heavy Equipment10.1016/j.autcon.2009.12.008 ↗
12. Tong, H., Xin, N., Su, X., Chen, T., and Wu, J. (2020). A Robust PDR/UWB Integrated Indoor Localization Approach for Pedestrians in Harsh Environments. Sensors, 20.10.3390/s20010193 ↗
13. Performance Evaluation of Ultra Wideband Technology for Construction Resource Location Tracking in Harsh Environments10.1016/j.autcon.2011.05.001 ↗
14. A Target Detection Model Based on Improved Tiny-Yolov3 Under the Environment of Mining Truck10.1109/ACCESS.2019.2928603 ↗
15. Wang, L., Li, W., Zhang, Y., and Wei, C. (2017, January 3–5). Pedestrian Detection Based on YOLOv2 with Skip Structure in Underground Coal Mine. Proceedings of the 2017 IEEE 3rd Information Technology and Mechatronics Engineering Conference (ITOEC), Chongqing, China.10.1109/ITOEC.2017.8122550 ↗
16. Pedestrian Detection in Underground Mines via Parallel Feature Transfer Network10.1016/j.patcog.2020.107195 ↗
17. Improved RefineDNet Algorithm for Precise Environmental Perception of Autonomous Earthmoving Machinery under Haze and Fugitive Dust Conditions10.1016/j.aei.2023.102326 ↗
18. Improved YOLOv4 Network Using Infrared Images for Personnel Detection in Coal Mines
19. Dickens, J.S., van Wyk, M.A., and Green, J.J. (2011, January 13–15). Pedestrian Detection for Underground Mine Vehicles Using Thermal Images. Proceedings of the IEEE Africon’ 11, Livingstone, Zambia.10.1109/AFRCON.2011.6072167 ↗
20. Safety Monitoring Method of Moving Target in Underground Coal Mine Based on Computer Vision Processing10.1038/s41598-022-22564-8 ↗
21. Zhou, X., Chen, K., and Zhou, Q. (2017, January 10–13). Human Tracking by Employing the Scene Information in Underground Coal Mines. Proceedings of the 2017 IEEE Visual Communications and Image Processing (VCIP), St. Petersburg, FL, USA.10.1109/VCIP.2017.8305031 ↗
22. Visual Performance for Incandescent and Solid-State Cap Lamps in an Underground Mining Environment10.1109/TIA.2011.2162793 ↗
23. Real-Time Semantic Segmentation for Underground Mine Tunnel10.1016/j.engappai.2024.108269 ↗
24. Pole-like Objects Recognition from Mobile Laser Scanning Data Using Smoothing and Principal Component Analysis10.5194/isprsarchives-XXXVIII-5-W12-115-2011 ↗
25. Zermas, D., Izzat, I., and Papanikolopoulos, N. (June, January 29). Fast Segmentation of 3D Point Clouds: A Paradigm on LiDAR Data for Autonomous Vehicle Applications. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.10.1109/ICRA.2017.7989591 ↗
26. Nan, Z., Zhu, G., Zhang, X., Lin, X., and Yang, Y. (2024). A Novel High-Precision Railway Obstacle Detection Algorithm Based on 3D LiDAR. Sensors, 24.10.3390/s24103148 ↗
27. Multi-Class Object Detection in Tunnels from 3D Point Clouds: An Auto-Optimized Lazy Learning Approach10.1016/j.aei.2022.101543 ↗
28. Extracting Geometric and Semantic Point Cloud Features with Gateway Attention for Accurate 3D Object Detection10.1016/j.engappai.2023.106227 ↗
29. Qi, C.R., Su, H., Mo, K., and Guibas, L.J. (2017, January 21–26). PointNet: Deep Learning on Point Sets for 3D Classification and Segmentation 2017. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.
30. Qi, C.R., Yi, L., Su, H., and Guibas, L.J. (2017). PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Space. Proceedings of the Advances in Neural Information Processing Systems, Curran Associates, Inc.
31. Zhou, Y., and Tuzel, O. VoxelNet: End-to-End Learning for Point Cloud Based 3D Object Detection. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.10.1109/CVPR.2018.00472 ↗
32. Yan, Y., Mao, Y., and Li, B. (2018). SECOND: Sparsely Embedded Convolutional Detection. Sensors, 18.10.3390/s18103337 ↗
33. Shi, S., Wang, X., and Li, H. (2019, January 15–20). PointRCNN: 3D Object Proposal Generation and Detection from Point Cloud 2019. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00086 ↗
34. Yang, Z., Sun, Y., Liu, S., and Jia, J. (2020, January 13–19). 3DSSD: Point-Based 3D Single Stage Object Detector. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01105 ↗
35. Shi, S., Guo, C., Jiang, L., Wang, Z., Shi, J., Wang, X., and Li, H. (2020, January 13–19). PV-RCNN: Point-Voxel Feature Set Abstraction for 3D Object Detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01054 ↗
36. Yin, T., Zhou, X., and Krahenbuhl, P. Center-Based 3D Object Detection and Tracking. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).10.1109/CVPR46437.2021.01161 ↗
37. An Object Detection Algorithm Combining Semantic and Geometric Information of the 3D Point Cloud10.1016/j.aei.2023.101971 ↗
38. Lang, A.H., Vora, S., Caesar, H., Zhou, L., Yang, J., and Beijbom, O. (2019, January 15–20). PointPillars: Fast Encoders for Object Detection from Point Clouds. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.01298 ↗
39. Liu, Z., Zhao, X., Huang, T., Hu, R., Zhou, Y., and Bai, X. (2020, January 7–12). TANet: Robust 3D Object Detection from Point Clouds with Triple Attention. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i07.6837 ↗
40. CBAM: Convolutional Block Attention Module10.1007/978-3-030-01234-2_1 ↗
41. HorNet: Efficient High-Order Spatial Interactions with Recursive Gated Convolutions
42. Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. Feature Pyramid Networks for Object Detection. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).10.1109/CVPR.2017.106 ↗
43. Shaw, P., Uszkoreit, J., and Vaswani, A. (2018). Self-Attention with Relative Position Representations. arXiv.10.18653/v1/N18-2074 ↗
44. Geiger, A., Lenz, P., and Urtasun, R. (2012, January 16–21). Are We Ready for Autonomous Driving? The KITTI Vision Benchmark Suite. Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition, Providence, RI, USA.10.1109/CVPR.2012.6248074 ↗
45. Kong, W., Du, Y., He, L., and Li, Z. (2024). Improved 3D Object Detection Based on PointPillars. Electronics, 13.10.3390/electronics13152915 ↗
46. Deng, J., Shi, S., Li, P., Zhou, W., Zhang, Y., and Li, H. (2021, January 2–9). Voxel R-CNN: Towards High Performance Voxel-Based 3D Object Detection. Proceedings of the AAAI Conference on Artificial Intelligence, Virtual.10.1609/aaai.v35i2.16207 ↗
47. Liu, Y., Pan, X., and Zhu, J. (2024, January 21–23). 3D Pedestrian Detection Based on Pointpillar: SelfAttention-Pointpillar. Proceedings of the 2024 9th International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), Okinawa, Japan.10.1109/ICIIBMS62405.2024.10792799 ↗
48. Zhang, L., Meng, H., Yan, Y., and Xu, X. (2023). Transformer-Based Global PointPillars 3D Object Detection Method. Electronics, 12.10.3390/electronics12143092 ↗
49. Wang, S., and Chen, M. (2023). A LiDAR Multi-Object Detection Algorithm for Autonomous Driving. Appl. Sci., 13.10.3390/app132312747 ↗
50. PLOT: A 3D Point Cloud Object Detection Network for Autonomous Driving10.1017/S0263574722001837 ↗