A Multi-Scale Rebar Detection Network with an Embedded Attention Mechanism
Source abstract
Abstract
With the rapid development of computer vision and machine vision, methods based on deep learning have achieved good results in the field of object detection, identification, and tracking. However, for the detection and identification of rebars in smart construction sites, it is very difficult to perform accurate real-time detection of rebars by using object detection technology on the equipment in the field because of the problems of the dense cross-section between bundled bars, the mutual adhesion of cross-section boundaries, and mutual occlusion between cross-sections. To address the above problems, we propose a multi-scale rebar detection network RebarNet with an embedded attention mechanism based on YOLOv5, combining the K-means++ algorithm, attention mechanism, a newly designed SD_IoU Loss, and multi-scale feature fusion, aiming to solve the problems of missed and false detection in dense small object detection. Due to the problems of scarce rebar cross-section datasets, no publicly available large datasets, and weak rebar cross-sectional features, we constructed a new rebar cross-sectional dataset, used a semi-automatic annotation method to annotate part of the dataset, and then used the data enhancement algorithm to expand the rebar dataset. The experimental results show that the average accuracy (mAP) of our proposed RebarNet network is 97.9%, which is comparable to mainstream target detection algorithms such as Faster R-CNN, SSD, RetinaNet, CenterNet, CornerNet, YOLOv3, YOLOv4, and YOLOv5s. mAP0.5 is improved by 8.1%, 13%, 26.4%, 25.8%, 26.2%, 11.7%, 7.6%, and 9%, respectively. In addition, the frames per second (FPS) transmission reaches 89 frames per second, the model weight is only 17.0 MB. In summary, the proposed RebarNet can effectively reduce missed and false detections in the rebar counting detection task based on real-time detection.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · 3D Surveying and Cultural Heritage · Industrial Vision Systems and Defect Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Computer Science and Technology, Henan Polytechnic University, Jiaozuo 454003, China
Funding
National Natural Science Foundation of China · 2022 Henan Provincial Key R&D and Promotion Special Project (Science and Technology Research) · Henan University National Student Innovation and Entrepreneurship Training Program · Henan Provincial Higher Education Key Research Project Funding Program · Doctoral Foundation of Henan Polytechnic University
References (33)
Show source-provided references
1. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich feature hierarchies for accurate object detection and semantic. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
2. Girshick, R. (2015, January 7–13). Fast R-CNN. Proceedings of the 2015 IEEE International Conference on Computer Vision, Santiago, Chile.10.1109/ICCV.2015.169 ↗
3. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
4. He, K.M., Gkioxari, G., DOLLÁR, P., and Girshick, R. (2017, January 22–29). Mask R-CNN. Proceedings of the 2017 IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.322 ↗
5. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016, January 11–14). SSD: Single shot multibox detector. Proceedings of the 2016 European Conference on Computer Vision, LNCS 9905, Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_2 ↗
6. Fu, C.Y., Liu, W., Ranga, A., Tyagi, A., and Berg, A.C. (2017). DSSD: Deconvolutional single shot detector. arXiv.
7. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
8. Redmon, J., and Farhadi, A. (2017, January 21–26). YOLO9000: Better, faster, stronger. Proceedings of the 2017 IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.690 ↗
9. Redmon, J., and Farhadi, A. (2018). YOLOv3: An incremental improvement. arXiv.
10. Bochkovskiy, A., Wang, C.Y., and Liao, H.Y.M. (2020). YOLOv4: Optimal speed and accuracy of object detection. arXiv.
11. Lin, T.Y., Goyal, P., Girshick, R., He, K., and Dollar, P. (2017, January 22–29). Focal loss for dense object detection. Proceedings of the 2017 IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.324 ↗
12. Zhang, X.M., Ma, M., He, T.T., and Xu, X. (2017, January 6–9). Steel bars counting method based on image and video processing. Proceedings of the 2017 International Symposium on Intelligent Signal Processing and Communication Systems (ISPACS), Xiamen, China.
13. Wu, Y., Zhou, X., and Zhang, Y. (2015, January 8–12). Steel bars counting and splitting method based on machine vision. Proceedings of the 2015 IEEE International Conference on Cyber Technology in Automation, Control, and Intelligent Systems (CYBER), Shenyang, China.10.1109/CYBER.2015.7287974 ↗
14. Zhao, J., Xia, X., Wang, H., and Kong, S. (2016, January 27–28). Design of real-time steel bars recognition system based on machine vision. Proceedings of the 2016 8th International Conference on Intelligent Human-Machine Systems and Cybernetics (IHMSC), Hangzhou, China.10.1109/IHMSC.2016.75 ↗
15. Wang, H., Polden, J., Jirgens, J., Yu, Z., and Pan, Z. (August, January 29). Automatic rebar counting using image processing and machine learning. Proceedings of the 2019 IEEE 9th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER), Suzhou, China.10.1109/CYBER46603.2019.9066509 ↗
16. End-face localization and segmentation of steel bar based on convolution neural network10.1109/ACCESS.2020.2989300 ↗
17. A deep learning approach for real-time rebar counting on the construction site based on YOLOv3 detector10.1016/j.autcon.2021.103602 ↗
18. Qu, F., Li, C.M., Peng, K., Qu, C., and Lin, C. (2020, January 18–21). Research on detection andidentification of dense rebar based on lightweight network. Proceedings of the 2020 International Conference of Pioneering Computer Scientists, Engineers and Educators, CCIS 1257, Taiyuan, China.10.1007/978-981-15-7981-3_32 ↗
19. He, K.M., Zhang, X.Y., Ren, S.Q., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
20. Neubeck, A., and Van Gool, L. (2006, January 20–24). Efficient non-maximum suppression. Proceedings of the 18th International Conference on Pattern Recognition, Hong Kong, China.10.1109/ICPR.2006.479 ↗
21. Detection and localization of rebar in concrete by deep learning using ground penetrating radar10.1016/j.autcon.2020.103279 ↗
22. Computer Vision–Based Counting Model for Dense Steel Pipe on Construction Sites10.1061/(ASCE)CO.1943-7862.0002217 ↗
23. Castrejon, L., Kundu, K., Urtasun, R., and Fidler, S. (2017, January 21–26). Annotating object instances with a polygon-rnn. Proceedings of the IEEE conference on computer vision and pattern recognition, Honolulu, HI, USA.10.1109/CVPR.2017.477 ↗
24. Acuna, D., Ling, H., Kar, A., and Fidler, S. (2018, January 18–22). Efficient interactive annotation of segmentation datasets with polygon-rnn++. Proceedings of the IEEE conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00096 ↗
25. Lin, T.Y., Maire, M., Belongie, S., Hays, J., Perona, P., Ramanan, D., Dollár, P., and Zitnick, C.L. (2014, January 6–12). Microsoft coco: Common objects in context. Proceedings of the Computer Vision–ECCV 2014: 13th European Conference, Zurich, Switzerland. Proceedings, Part V 13.10.1007/978-3-319-10602-1_48 ↗
26. The global k-means clustering algorithm10.1016/S0031-3203(02)00060-2 ↗
27. Arthur, D., and Vassilvitskii, S. (2007, January 7–9). K-Means++: The Advantages of Careful Seeding. Proceedings of the 18th Annual ACM-SIAM Symposium on Discrete Algorithms, Philadelphia, PA, USA.
28. Hou, Q., Zhou, D., and Feng, J. (2021, January 20–25). Coordinate attention for efficient mobile network design. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01350 ↗
29. Zheng, Z., Wang, P., Liu, W., Li, J., Ye, R., and Ren, D. (2020, January 7–12). Distance-IoU loss: Faster and better learning for bounding box regression. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i07.6999 ↗
30. Gevorgyan, Z. (2022). SIoU Loss: More Powerful Learning for Bounding Box Regression. arXiv.
31. Liang, Z., Shao, J., Zhang, D., and Gao, L. (2018, January 21–22). Small object detection using deep feature pyramid networks. Proceedings of the Pacific Rim Conference on Multimedia, Hefei, China.10.1007/978-3-030-00764-5_51 ↗
32. Multi-scale object detection in remote sensing imagery with convolutional neural networks10.1016/j.isprsjprs.2018.04.003 ↗
33. Ketkar, N. (2017). Deep Learning with Python, Apress.10.1007/978-1-4842-2766-4 ↗