Autonomous Multiple Tramp Materials Detection in Raw Coal Using Single-Shot Feature Fusion Detector
Source abstract
Abstract
In the coal mining process, various types of tramp materials will be mixed into the raw coal, which will affect the quality of the coal and endanger the normal operation of the equipment. Automatic detection of tramp materials objects is an important process and basis for efficient coal sorting. However, previous research has focused on the detection of gangue, ignoring the detection of other types of tramp materials, especially small targets. Because the initial Single Shot MultiBox Detector (SSD) lacks the efficient use of feature maps, it is difficult to obtain stable results when detecting tramp materials objects. In this article, an object detection algorithm based on feature fusion and dense convolutional network is proposed, which is called tramp materials in raw coal single-shot detector (TMRC-SSD), to detect five types of tramp materials such as gangue, bolt, stick, iron sheet, and iron chain. In this algorithm, a modified DenseNet is first designed and a four-stage feature extractor is used to down-sample the feature map stably. After that, we use the dilation convolution and multi-branch structure to enrich the receptive field. Finally, in the feature fusion module, we designed cross-layer feature fusion and attention fusion modules to realize the semantic interaction of feature maps. The experiments show that the module we designed is effective. This method is better than the existing model. When the input image is 300 × 300 pixels, it can reach 96.12% MAP and 24FPS. Especially in the detection of small objects, the detection accuracy has increased by 4.1 to 95.57%. The experimental results show that this method can be applied to the actual detection of tramp materials objects in raw coal.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Mineral Processing and Grinding · Coal Properties and Utilization · Belt Conveyor Systems Engineering
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Mechanical Electronic & Information Engineering, China University of Mining & Technology, Beijing 100083, China
College of Applied Science & Technology, Beijing Union University, Beijing 100012, China
Community Service & Management, University of Science & Technology Beijing, Beijing 100083, China
Funding
the National Key Research and Development Program of China under Grant
References (36)
Show source-provided references
1. Stone coal in China: A review10.1080/00206814.2017.1378131 ↗
2. Progress in developments of dry coal beneficiation10.1007/s40789-014-0014-5 ↗
3. Intelligent Mining Technology for an Underground Metal Mine Based on Unmanned Equipment10.1016/j.eng.2018.05.013 ↗
4. Coal fires burning out of control around the world: Thermodynamic recipe for environmental catastrophe10.1016/j.coal.2003.03.002 ↗
5. Energy relations between China and the countries along the Belt and Road: An analysis of the distribution of energy resources and interdependence relationships10.1016/j.rser.2019.03.007 ↗
6. Machine learning applications in minerals processing: A review10.1016/j.mineng.2018.12.004 ↗
7. 3D laser imaging for surface roughness analysis10.1016/j.ijrmms.2012.08.001 ↗
8. Sun, Z., Lu, W., Xuan, P., Li, H., Zhang, S., Niu, S., and Jia, R. (2019). Separation of gangue from coal based on supplementary texture by morphology. Int. J. Coal Prep. Util., 1–17.10.1080/19392699.2019.1590346 ↗
9. Separating coal and gangue using three-dimensional laser scanning10.1016/j.minpro.2017.10.010 ↗
10. Coal and gangue recognition under four operating conditions by using image analysis and Relief-SVM10.1080/19392699.2018.1540416 ↗
11. Research on methods to differentiate coal and gangue using image processing and a support vector machine10.1080/19392699.2018.1496912 ↗
12. Identification of Coal and Gangue by Feed-forward Neural Network Based on Data Analysis10.1080/19392699.2017.1290609 ↗
13. Underground pneumatic separation of coal and gangue with large size in green mining based on the machine vision system10.1016/j.powtec.2015.03.027 ↗
14. An Image-Based Hierarchical Deep Learning Framework for Coal and Gangue Detection10.1109/ACCESS.2019.2961075 ↗
15. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016). SSD: Single Shot MultiBox Detector, Springer.10.1007/978-3-319-46448-0_2 ↗
16. Zhao, Y., and He, X. (2012, January 24–25). Recognition of Coal and Gangue Based on X-ray. Proceedings of the International Conference on Applied Mechanics and Materials (ICAMM 2012), Sanya, China.
17. Automated microlithotype analysis on particulate coal10.1021/ef020246k ↗
18. Sun, Z., Xuan, P., Song, Z., Li, H., and Jia, R. (2019). A texture fused superpixel algorithm for coal mine waste rock image segmentation. Int. J. Coal Prep. Util., 12.10.1080/19392699.2019.1699546 ↗
19. Liu, K., Zhang, X., and Chen, Y. (2018). Extraction of Coal and Gangue Geometric Features with Multifractal Detrending Fluctuation Analysis. Appl. Sci., 8.10.3390/app8030463 ↗
20. Fu, C., Lu, F., and Zhang, G. (2020). Discrimination analysis of coal and gangue using multifractal properties of optical texture. Int. J. Coal Prep. Util., 1–13.
21. A Study of Multispectral Technology and Two-Dimension Autoencoder for Coal and Gangue Recognition10.1109/ACCESS.2020.2983740 ↗
22. Su, L., Cao, X., Ma, H., and Li, Y. (2018, January 25–27). Research on Coal Gangue Identification by Using Convolutional Neural Network. Proceedings of the 2018 2nd IEEE Advanced Information Management, Communicates, Electronic and Automation Control Conference (IMCEC), Xi’an, China.10.1109/IMCEC.2018.8469674 ↗
23. Pu, Y., Apel, D.B., Szmigiel, A., and Chen, J. (2019). Image Recognition of Coal and Coal Gangue Using a Convolutional Neural Network and Transfer Learning. Energies, 12.10.3390/en12091735 ↗
24. Coal/Gangue Recognition Using Convolutional Neural Networks and Thermal Images10.1109/ACCESS.2020.2990200 ↗
25. Coal and gangue identification method based on the intensity image of lidar and DenseNet10.1364/AO.422498 ↗
26. Gao, R., Sun, Z., Li, W., Pei, L., Hu, Y., and Xiao, L. (2020). Automatic Coal and Gangue Segmentation Using U-Net Based Fully Convolutional Networks. Energies, 13.10.3390/en13040829 ↗
27. Sun, Z., Huang, L., and Jia, R. (2021). Coal and Gangue Separating Robot System Based on Computer Vision. Sensors, 21.10.3390/s21041349 ↗
28. Cascade network for detection of coal and gangue in the production context10.1016/j.powtec.2020.08.088 ↗
29. Reducing the dimensionality of data with neural networks10.1126/science.1127647 ↗
30. ImageNet Classification with Deep Convolutional Neural Networks10.1145/3065386 ↗
31. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich feature hierarchies for accurate object detection and semantic segmentation. Proceedings of the 27th IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
32. Girshick, R. (2015, January 11–18). Fast R-CNN. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.169 ↗
33. Ren, S.Q., He, K.M., Girshick, R., and Sun, J. (2015, January 7–12). Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks. Proceedings of the 29th Annual Conference on Neural Information Processing Systems (NIPS), Montreal, QC, Canada.
34. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR.2016.91 ↗
35. Lin, T.-Y., Dollar, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature Pyramid Networks for Object Detection. Proceedings of the 30th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
36. Fu, C., Liu, W., Ranga, A., Tyagi, A., and Berg, A.C. (2017). DSSD: Deconvolutional Single Shot Detector. arXiv.