Real-Time Foreign Object and Production Status Detection of Tobacco Cabinets Based on Deep Learning
Source abstract
Abstract
Visual inspection plays an important role in industrial production and can detect product defects at the production stage to avoid major economic losses. Most factories mainly rely on manual inspection, resulting in low inspection efficiency, high costs, and potential safety hazards. A real-time production status and foreign object detection framework for smoke cabinets based on deep learning is proposed in this paper. Firstly, the tobacco cabinet is tested for foreign objects based on the YOLOX, and if there is a foreign object, all production activities will be immediately stopped to avoid safety and quality problems. Secondly, the production status of tobacco cabinet is judged to determine whether it is in the feeding state by the YOLOX position locating method and canny threshold method. If it is not in the feeding state, then the three states of empty, full, and material status of the tobacco cabinet conveyor belt are judged based on the ResNet-18 image classification network. Ultilizing our proposed method, the accuracy of foreign object detection, feeding state detection and the conveyor belt of tobacco cabinet state detection are 99.13%, 96.36% and 95.30%, respectively. The overall detection time was less than 1 s. The experimental results show the effectiveness of our method. It has important practical significance for the safety, well-being and efficient production of cigarette factories.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Advanced Neural Network Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Computer Science & Technology, Qingdao University, Qingdao 266071, China
Funding
National Natural Science Foundation of China · National Statistical Science Research Project
References (30)
Show source-provided references
1. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
2. Redmon, J., and Farhadi, A. (2017, January 21–26). YOLO9000: Better, faster, stronger. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
3. Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv.
4. Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). Yolov4: Optimal speed and accuracy of object detection. arXiv.
5. (2021, July 15). Glenn Jocher; Yolov5. Available online: https://github.com/ultralytics/yolov5.
6. Ge, Z., Liu, S., Wang, F., Li, Z., and Sun, J. (2021). Yolox: Exceeding Yolo Series in 2021. arXiv.
7. Complete and accurate holly fruits counting using YOLOX object detection10.1016/j.compag.2022.107062 ↗
8. Real-time detection of uneaten feed pellets in underwater images for aquaculture using an improved YOLO-V4 network10.1016/j.compag.2021.106135 ↗
9. Yu, J., and Zhang, W. (2021). Face mask wearing detection algorithm based on improved YOLO-v4. Sensors, 21.10.3390/s21093263 ↗
10. Yang, W., and Jiachun, Z. (2018, January 23–27). Real-time face detection based on YOLO. Proceedings of the 2018 1st IEEE International Conference on Knowledge Innovation and Invention (ICKII), Jeju, Korea.10.1109/ICKII.2018.8569109 ↗
11. El-Sawy, A., El-Bakry, H., and Loey, M. (2016, January 24–26). CNN for handwritten arabic digits recognition based on LeNet-5. Proceedings of the International Conference on Advanced Intelligent Systems and Informatics, Cairo, Egypt.10.1007/978-3-319-48308-5_54 ↗
12. Pedestrian detection based on improved LeNet-5 convolutional neural network10.1177/1748302619873601 ↗
13. The image-based analysis and classification of urine sediments using a LeNet-5 neural network10.1080/21681163.2019.1608307 ↗
14. Ma, M., Gao, Z., Wu, J., Chen, Y., and Zheng, X. (2018, January 8–12). A smile detection method based on improved LeNet-5 and support vector machine. Proceedings of the 2018 IEEE Smartworld, Guangzhou, China.10.1109/SmartWorld.2018.00104 ↗
15. Zhang, Z., Luo, P., Loy, C.C., and Tang, X. (2014, January 6–12). Facial landmark detection by deep multi-task learning. Proceedings of the European Conference on Computer Vision, Zurich, Switzerland.10.1007/978-3-319-10599-4_7 ↗
16. (2021, August 16). The MPLab GENKI Database, GENKI-4K Subset. Available online: http://mplab.ucsd.edu.
17. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.322 ↗
18. Mozaffari, M.H., and Lee, W.S. (2020, January 5–7). Semantic Segmentation with Peripheral Vision. Proceedings of the International Symposium on Visual Computing, San Diego, CA, USA.10.1007/978-3-030-64559-5_33 ↗
19. Wang, J., and Zhang, X. (2019). A Method for Recognizing Cigarettes in Cigarette Cabinet Based on Deep. (CN201811100834.4), Learning. Patent.
20. Zhou, J.M., Zhou, Q.X., Liu, Y.D., Dong-Dong, X.U., and Feng, Z.Y. (2010). Application of infrared imaging techniques in automatic processing of agricultural products. Chin. Agric. Mech., Available online: http://en.cnki.com.cn/Article_en/CJFDTOTAL-GLJH201006020.htm.
21. Apple bruise detect with hyperspectral imaging technique10.3788/COL201412.S11101 ↗
22. A method for detecting tobacco foreign bodies based on support vector machines
23. Research on tobacco foreign object detection device based on machine vision10.1177/0142331220929816 ↗
24. Mozaffari, M.H., and Tay, L.L. (2020). Anomaly detection using 1D convolutional neural networks for surface enhanced raman scattering. SPIE Future Sensing Technologies, SPIE—International Society for Optics and Photonics. Available online: https://www.spiedigitallibrary.org/conference-proceedings-of-spie/11525/115250S/Anomaly-detection-using-1D-convolutional-neural-networks-for-surface-enhanced/10.1117/12.2576447.short.10.1117/12.2576447 ↗
25. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
26. Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature pyramid networks for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
27. Sigmoid-weighted linear units for neural network function approximation in reinforcement learning10.1016/j.neunet.2017.12.012 ↗
28. Platt, J. (2021, August 16). Sequential Minimal Optimization: A Fast Algorithm for Training Support Vector Machines. Available online: https://www.microsoft.com/en-us/research/publication/sequential-minimal-optimization-a-fast-algorithm-for-training-support-vector-machines/.
29. Gradient-based learning applied to document recognition10.1109/5.726791 ↗
30. Krizhevsky, A., Sutskever, I., and Hinton, G.E. (2012). Imagenet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst., 25, Available online: https://proceedings.neurips.cc/paper/2012/hash/c399862d3b9d6b76c8436e924a68c45b-Abstract.html.