Improved Lightweight YOLOv4 Foreign Object Detection Method for Conveyor Belts Combined with CBAM
Source abstract
Abstract
During the operation of the belt conveyor, foreign objects such as large gangue and anchor rods may be mixed into the conveyor belt, resulting in tears and fractures, which affect transportation efficiency and production safety. In this paper, we propose a lightweight target detection algorithm, GhostNet-CBAM-YOLOv4, to resolve the problem of the difficulty of detecting foreign objects at high-speed movement in an underground conveyor belt. The Kmeans++ clustering method was used to preprocess the data set to obtain the anchor box suitable for the foreign object size. The GhostNet lightweight module replaced the backbone network, reducing the model’s parameters. The CBAM attention module was introduced to enhance the ability of feature extraction facing the complex environment under the mine. The depth separable convolution was used to simplify the model structure and reduce the number of parameters and calculations. The detection accuracy of the improved method on the foreign body data set reached 99.32%, and the detection rate reached 54.7 FPS, which was 6.83% and 42.1% higher than the original YOLOv4 model, respectively. The improved method performed better than the original model on the other two datasets and could effectively avoid misdetection and omission detection. In comparison experiments with similar methods, our proposed method also demonstrated good performance, verifying its effectiveness.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Belt Conveyor Systems Engineering · Mineral Processing and Grinding · Robot Manipulation and Learning
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mechanical and Equipment Engineering, Hebei University of Engineering, Handan 056038, China
Funding
Hebei Natural Science Foundation
References (48)
Show source-provided references
1. Characteristics of coal resources in China and statistical analysis and preventive measures for coal mine accidents10.1007/s40789-023-00582-9 ↗
2. Economic resilience assessment and policy interaction of coal resource oriented cities for the low carbon economy based on AI10.1016/j.resourpol.2023.103522 ↗
3. Image detection and fault recognition method for longitudinal tearing of mining conveyor belt
4. Khasawneh, N., Fraiwan, M., Fraiwan, L., Khassawneh, B., and Ibnian, A. (2021). Detection of COVID-19 from Chest X-ray Images Using Deep Convolutional Neural Networks. Sensors, 21.10.3390/s21175940 ↗
5. Automatic Recognition of Coal and Gangue Based on Gray Level Co occurrence Matrix
6. Research on the Extraction of Gray Information and Texture Features of Coal and Gangue Images
7. An Improved Gaussian Mixture Model for Coal Gangue Video Detection
8. Object detection in 20 years: A survey10.1109/JPROC.2023.3238524 ↗
9. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the IEEE International Conference on Computer Vision, Stanford, CA, USA.10.1109/CVPR.2016.91 ↗
10. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2015, January 7–13). SSD: Single Shot multibox detector. Proceedings of the 2015 14th European Conference on Computer Vision (ECCV), Santiago, Chile.
11. Redmon, J., and Farhadi, A. (2017, January 21–26). YOLO9000: Better, faster, stronger. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
12. Redmon, J., and Farhadi, A. (2018). YOLOv3: An incremental improvement. arXiv.
13. Improved YOLOv5 network for real-time multi-scale traffic sign detection10.1007/s00521-022-08077-5 ↗
14. Li, C., Li, L., Jiang, H., Weng, K., Geng, Y., Li, L., Ke, Z., Li, Q., Cheng, M., and Nie, W. (2022). YOLOv6: A single-stage object detection framework for industrial applications. arXiv.
15. Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2022). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. arXiv.
16. Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020, January 23–27). End-to-end object detection with transformers. Proceedings of the European Conference on Computer Vision, Cham, Switzerland.10.1007/978-3-030-58452-8_13 ↗
17. Foreign body identification method of conveyor belt based on improved FPN
18. Lv, Z. (2020). Research on Image Recognition of Foreign Body in Coal Mine Belt Transportation in Complex Environment. [Master’ Thesis, China University of Mining and Technology].
19. Detection of K-complexes in EEG waveform images using faster R-CNN and deep transfer learning10.1186/s12911-022-02042-x ↗
20. Development of a core feature identification application based on the Faster R-CNN algorithm10.1016/j.engappai.2022.105200 ↗
21. Foreign Body Detection in Coal Mine Belt Conveyor
22. Detection of Foreign body in Coal Mine Belt Transportation based on Fast_YOLOv3 Algorithm
23. Research on lightweight coal and gangue target detection method
24. Foreign Body Detection in Coal Mine Conveyor Belt Based on CBAM-YOLOV5
25. Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8–14). CBAM: Convolutional block attention module. Proceedings of the 15th European Conference, Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
26. Li, Z., Li, B., Ni, H., Ren, F., Lv, S., and Kang, X. (2022). An Effective Surface Defect Classification Method Based on RepVGG with CBAM Attention Mechanism (RepVGG-CBAM) for Aluminum Profiles. Metals, 12.10.3390/met12111809 ↗
27. AVNC: Attention-Based VGG-Style Network for COVID-19 Diagnosis by CBAM10.1109/JSEN.2021.3062442 ↗
28. Image captioning model using attention and object features to mimic human image understanding10.1186/s40537-022-00571-w ↗
29. Aircraft Detection in Remote Sensing Imagery Based on Improved YOLOv410.1088/1742-6596/2260/1/012063 ↗
30. Hu, Y., Liu, G., Chen, Z., and Guo, J. (2022). Object Detection Algorithm for Wheeled Mobile Robot Based on an Improved YOLOv4. Appl. Sci., 12.10.3390/app12094769 ↗
31. Juyal, A., Sharma, S., and Matta, P. (2021, January 3–5). Deep learning methods for object detection in autonomous vehicles. Proceedings of the 2021 5th International Conference on Trends in Electronics and Informatics (ICOEI), Tirunelveli, India.10.1109/ICOEI51242.2021.9452932 ↗
32. Omar, M., and Kumar, P. (2020, January 8–9). Detection of roads potholes using YOLOv4. Proceedings of the 2020 International Conference on Information Science and Communications Technologies (ICISCT), Karachi, Pakistan.10.1109/ICISCT50599.2020.9351373 ↗
33. A modified YOLOv4 detection method for a vision-based underwater garbage cleaning robot10.1631/FITEE.2100473 ↗
34. Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature Pyramid Networks for Object Detection. Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
35. Iandola, F.N., Han, S., Moskewicz, M.W., Ashraf, K., Dally, W.J., and Keutzer, K. (2016). SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size. arXiv.
36. Howard, A.G., Zhu, M., Chen, B., Kalenichenko, D., Wang, W., Weyand, T., Andreetto, M., and Adam, H. (2017). MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications. arXiv.
37. Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., and Chen, L.C. (2018, January 18–22). Mobilenetv2: Inverted residuals and linear bottlenecks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00474 ↗
38. Howard, A., Sandler, M., Chu, G., Chen, L.C., Chen, B., Tan, M., Wang, W., Zhu, Y., Pang, R., and Vasudevan, V. (November, January 27). Searching for mobilenetv3. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
39. Han, K., Wang, Y., Tian, Q., Guo, J., Xu, C., and Xu, C. (2020, January 19). GhostNet: More Features From Cheap Operations. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.00165 ↗
40. Deep unfolding for singular value decomposition compressed ghost imaging10.1007/s00340-022-07903-x ↗
41. GHOST: Adjusting the Decision Threshold to Handle Imbalanced Data in Machine Learning10.1021/acs.jcim.1c00160 ↗
42. Yang, X., Yu, Z., Jiang, P., Xu, L., Hu, J., Wu, L., Zou, B., Zhang, Y., and Zhang, J. (2022). Deblurring Ghost Imaging Reconstruction Based on Underwater Dataset Generated by Few-Shot Learning. Sensors, 22.10.3390/s22166161 ↗
43. Gong, W., Tian, J., and Liu, J. (2022). Underwater Object Classification Method Based on Depthwise Separable Convolution Feature Fusion in Sonar Images. Appl. Sci., 12.10.3390/app12073268 ↗
44. Fiber Clustering Acceleration With a Modified Kmeans++ Algorithm Using Data Parallelism10.3389/fninf.2021.727859 ↗
45. Optimization and Parallelization of Fuzzy Clustering Algorithm Based on the Improved Kmeans++ Clustering10.1088/1757-899X/768/7/072106 ↗
46. Shahrezaei, M.H., and Tavoli, R. (2019). Parallelization of Kmeans++ using CUDA. arXiv.
47. The pascal visual object classes (voc) challenge10.1007/s11263-009-0275-4 ↗
48. The pascal visual object classes challenge: A retrospective10.1007/s11263-014-0733-5 ↗