journal article·2023-10-19Open access

A “Hardware-Friendly” Foreign Object Identification Method for Belt Conveyors Based on Improved YOLOv8

Bingxin Luo, Ziming Kou, Cong Han, Juan Wu

Applied Sciences· Volume 13· Issue 20

Abstract

As a crucial element in coal transportation, conveyor belts play a vital role, and monitoring their health is essential for the coal mine transportation system’s safe and efficient operation. This paper introduces a new ‘hardware-friendly’ method for monitoring belt conveyor damage, aiming to address the issue of large parameters and computational requirements in existing deep learning-based foreign object detection methods and their challenges in deploying on edge devices with limited computing power. This method is tailored towards edge computing and aims to reduce the parameters and computational load of foreign object recognition networks deployed on edge computing devices. This method improves the YOLOv8 object detection network and redesigns a novel lightweight ShuffleNetV2 network as the backbone network, making the network more delicate in recognizing foreign object features while reducing redundant parameters. Additionally, a simple parameter-free attention mechanism called SimAM is introduced to further enhance recognition efficiency without imposing additional computational burden. Experimental results demonstrate that the improved foreign object recognition method achieves a detection accuracy of 95.6% with only 1.6 M parameters and 4.7 G model computational load (FLOPs). Compared to the baseline YOLOv8n, the detection accuracy has improved by 3.3 percentage points, while the number of parameters and model computational load have been reduced by 48.4% and 42.0%, respectively. These works are more friendly to edge computing devices that tend to “hardware friendly” algorithms. The improved algorithm can reduce latency in the data transmission process, enabling the accurate and timely detection of non-coal foreign objects on the conveyor belt. This provides assurance for the subsequent host computer system to promptly identify and address foreign objects, thereby ensuring the safety and efficiency of the belt conveyor.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Belt Conveyor Systems Engineering · Advanced Neural Network Applications · Power Line Inspection Robots

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

College of Mechanical and Vehicle Engineering, Taiyuan University of Technology, Taiyuan 030024, China

Shanxi Provincial Engineering Laboratory for Mine Fluid Control, Taiyuan 030024, China

Shandong Libo Heavy Industry Technology Co., Ltd., Taian 271025, China

Funding

National Natural Science Foundation of China · Taishan Industry Leading Talent Program · Key R&D Plan Projects in Shanxi Province · Unmanned Management System for Belt Conveyors Based on Multiple Perception Technology · Shanxi Science Administration for Market Regulation

References (33)

Show source-provided references
1. Integrating renewable sources into energy system for smart city as a sagacious strategy towards clean andsustainable process10.1016/j.jclepro.2021.127161 ↗
2. Intelligent and ecological coal mining as well as clean utilization technology in China: Review and prospects10.1016/j.ijmst.2018.06.005 ↗
3. Green mining efficiency and improvement countermeasures for China’s coal mining industry10.3389/fenrg.2020.00018 ↗
4. Key technologies and equipment for a fully mechanized top-coal caving operation with a large mining height at ultra-thick coal seams10.1007/s40789-015-0071-4 ↗
5. Zhou, K., Liu, T., and Zhou, L. (2015, January 15–17). Industry 4.0: Towards future industrial opportunities and challenges. Proceedings of the 2015 12th International Conference on Fuzzy Systems and Knowledge Discovery (FSKD), Zhangjiajie, China.10.1109/FSKD.2015.7382284 ↗
6. Design and implementation of intelligent energy efficient conveyor system model based on variable speed drive control and physical modeling10.14257/ijca.2016.9.6.36 ↗
7. A deep learning-based method for deviation status detection in intelligent conveyor belt system10.1016/j.jclepro.2022.132575 ↗
8. Failure of belt in conveyor system: An analysis
9. Deep learning-based damage detection of mining conveyor belt10.1016/j.measurement.2021.109130 ↗
10. Zhang, M., Zhang, Y., Zhou, M., Jiang, K., Shi, H., Yu, Y., and Hao, N. (2021). Application of Lightweight Convolutional Neural Network for Damage Detection of Conveyor Belt. Appl. Sci., 11.10.3390/app11167282 ↗
11. Research on ADCN method for damage detection of mining conveyor belt10.1109/JSEN.2020.3048057 ↗
12. A review of object detection based on deep learning10.1007/s11042-020-08976-6 ↗
13. Gkioxari, G., Hariharan, B., Girshick, R., and Malik, J. (2014). R-cnns for pose estimation and action detection. arXiv.
14. Girshick, R. (2015, January 7–13). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.169 ↗
15. Ren, S., He, K., Girshick, R., and Sun, J. (2015). Faster R-CNN: Towards real-time object detection with region proposal networks. Adv. Neural Inf. Process. Syst., 28.
16. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016). Computer Vision–ECCV 2016, Proceedings of the 14th European Conference, Amsterdam, The Netherlands, 11–14 October 2016, Springer International Publishing. Proceedings, Part I 14.
17. Deep learning based non-coal foreign object recognition method for belt conveyor
18. Proactive measures to prevent conveyor belt Failures: Deep Learning-based faster foreign object detection10.1016/j.engfailanal.2022.106653 ↗
19. Coal gangue target detection of belt conveyor based on YOLOv5s-SDE
20. Foreign object recognition of coal mine belt conveyor based on improved YOLOv7
21. Sifre, L., and Mallat, S. (2014). Rigid-motion scattering for texture classification. arXiv.
22. Zhang, X., Zhou, X., Lin, M., and Jian, S. (2018, January 18–23). Shufflenet: An extremely efficient convolutional neural network for mobile devices. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00716 ↗
23. Ma, N., Zhang, X., Zheng, H.T., and Zheng, J. (2018, January 8–14). Shufflenet v2: Practical guidelines for efficient cnn architecture design. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01264-9_8 ↗
24. Yang, L., Zhang, R.Y., Li, L., and Xie, X. (2021, January 18–24). SimAM: A simple, parameter-free attention module for convolutional neural networks. Proceedings of the 38th International Conference on Machine Learning, Virtual.
25. Sensory Gain Control (Amplification) as a Mechanism of Selec-tive Attention: Electrophysiological and Neuroimaging evidence10.1098/rstb.1998.0281 ↗
26. Redmon, J., and Farhadi, A. (2018). Yolov3: An incrementalimprovement. arXiv.
27. Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2022). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv.10.1109/CVPR52729.2023.00721 ↗
28. DiCENet: Dimension-wise convolutions for efficient networks
29. Tan, M., and Le, Q. (2019, January 9–15). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the International Conference on Machine Learning, PMLR, Long Beach, CA, USA.
30. Mobile next-generation networks10.1109/MMUL.2004.1261110 ↗
31. Cui, C., Gao, T., Wei, S., Du, Y., Guo, R., Dong, S., Lu, B., Zhou, Y., Lv, X., and Liu, Q. (2021). PP-LCNet: A lightweight CPU convolutional neural network. arXiv.
32. Ghost2
33. Chen, J., Kao, S., He, H., Zhuo, W., Wen, S., Lee, C.-H., and Chan, S.-H.G. (2023, January 17–24). Run, Don’t Walk: Chasing Higher FLOPS for Faster Neural Networks. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.01157 ↗