FLE-YOLO: A Faster, Lighter, and More Efficient Strategy for Autonomous Tower Crane Hook Detection
Source abstract
Abstract
To address the complexities of crane hook operating environments, the challenges faced by large-scale object detection algorithms on edge devices, and issues such as frame rate mismatch causing image delays, this paper proposes a faster, lighter, and more efficient object detection algorithm called FLE-YOLO. Firstly, the FasterNet is used as the backbone for feature extraction, and the Triplet Attention mechanism is integrated to effectively emphasize target information while maintaining network lightweightness effectively. Additionally, the Slim-neck module is introduced in the neck connection layer, utilizing a lightweight convolutional network GSconv to further streamline the network structure without compromising recognition accuracy. Lastly, the Dyhead module is employed in the head section to unify multiple attention operations, improve the ability to resist interference from small objects and complex backgrounds. Experimental evaluations on public datasets VOC2012 and COCO2017 demonstrate the effectiveness of our proposed algorithm in terms of lightweight design and detection accuracy. Experimental evaluations were also conducted using images of crane hooks captured under complex operating conditions. The results demonstrate that compared to the original algorithm, the proposed approach achieves a reduction in computational complexity to 19.4 GFLOPs, an increase in FPS to 142.857 f/s, and the precision reached 97.3%. Additionally, the AP50 reaches 98.3%, reflecting 0.6% improvement. Ultimately, the testing carried out at the construction site successfully facilitated the identification and tracking of hooks, thereby ensuring the safety and efficiency of tower crane operations.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Infrastructure Maintenance and Monitoring · Vehicle License Plate Recognition · Structural Health Monitoring Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Energy and Electrical Engineering, Chang’an University, Xi’an 710064, China
School of Electronics and Control Engineering, Chang’an University, Xi’an 710064, China
Funding
Key Industrial Chain Project in Xi’an City · Shaanxi Qin Chuang yuan “Scientist + Engineer” Team Construction · Xianyang City Key Research and Development Program Project
References (50)
Show source-provided references
1. Investigation on an Integrated Evacuation Route Planning Method Based on Real-Time Data Acquisition for High-Rise Building Fire10.1109/TITS.2012.2237398 ↗
2. Field vibration evaluation and dynamics estimation of a super high-rise building under typhoon conditions: Data-model dual driven10.1007/s13349-022-00634-9 ↗
3. Configurable model for real-time crane erection visualization10.1016/j.advengsoft.2013.04.013 ↗
4. Vision-Based System for 3D Tower Crane Monitoring10.1109/JSEN.2020.3042532 ↗
5. Research on vibration damping model of flat-head tower crane system based on particle damping vibration absorber10.1007/s40430-023-04496-0 ↗
6. Statistical analysis of safety accident cases of tower cranes from 2014 to 2022
7. Safety supervision of tower crane operation on construction sites: An evolutionary game analysis10.1016/j.ssci.2021.105578 ↗
8. Vision System for Tower Cranes10.1061/(ASCE)0733-9364(2008)134:5(320) ↗
9. Adaptive sway reduction for tower crane systems with varying cable lengths10.1016/j.autcon.2020.103342 ↗
10. A Practical Application Combining Wireless Sensor Networks and Internet of Things: Safety Management System for Tower Crane Groups10.3390/s140813794 ↗
11. Topology optimization of Shell–Infill structures with enhanced edge-detection and coating thickness control10.1016/j.advengsoft.2023.103587 ↗
12. Swing angle detection system of bridge crane based on YOLOv3
13. A Transformer Guides YOLOv5 to Identify Illegal Operation of High-altitude Hooks
14. Research on Dangerous Area Identification Method of Tower Crane Based on Improved YOLOv5s
15. Sun, X., Lu, X., Wang, Y., He, T., and Tian, Z. (2024). Development and Application of Small Object Visual Recognition Algorithm in Assisting Safety Management of Tower Cranes. Buildings, 14.10.3390/buildings14123728 ↗
16. Small target detection model in overlooking scenes on tower cranes based on improved real-time detection Transformer
17. Pei, J., Wu, X., Liu, X., Gao, L., Yu, S., and Zheng, X. (July, January 30). SGD-YOLOv5: A Small Object Detection Model for Complex Industrial Environments. Proceedings of the 2024 International Joint Conference on Neural Networks (IJCNN), Yokohama, Japan.10.1109/IJCNN60899.2024.10650927 ↗
18. Fixed-time observer-based back-stepping controller design for tower cranes with mismatched disturbance10.1007/s11071-022-07851-3 ↗
19. Chen, J., Kao, S.-h., He, H., Zhuo, W., Wen, S., Lee, C.-H., and Chan, S.-H.G. (2023, January 18–22). Run, Don’t Walk: Chasing Higher FLOPS for Faster Neural Networks. Proceedings of the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.10.1109/CVPR52729.2023.01157 ↗
20. Misra, D., Nalamada, T., Arasanipalai, A.U., and Hou, Q. (2021, January 5–9). Rotate to Attend: Convolutional Triplet Attention Module. Proceedings of the 2021 IEEE Winter Conference on Applications of Computer Vision (WACV), Virtual.10.1109/WACV48630.2021.00318 ↗
21. Slim-neck by GSConv: A lightweight-design for real-time detector architectures10.1007/s11554-024-01436-6 ↗
22. Dai, X., Chen, Y., Xiao, B., Chen, D., Liu, M., Yuan, L., and Zhang, L. (2021, January 20–25). Dynamic Head: Unifying Object Detection Heads with Attentions. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.00729 ↗
23. Automatic Detection and Classification System of Domestic Waste via Multimodel Cascaded Convolutional Neural Network10.1109/TII.2021.3085669 ↗
24. Damage detection in slab structures based on two-dimensional curvature mode shape method and Faster R-CNN10.1016/j.advengsoft.2022.103371 ↗
25. Girshick, R., Donahue, J., Darrell, T., and Malik, J. (2014, January 23–28). Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.81 ↗
26. Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks10.1109/TPAMI.2016.2577031 ↗
27. Development of a core feature identification application based on the Faster R-CNN algorithm10.1016/j.engappai.2022.105200 ↗
28. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
29. DMA-YOLO: Multi-scale object detection method with attention mechanism for aerial images10.1007/s00371-023-03095-3 ↗
30. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., and Berg, A.C. (2016). SSD: Single Shot MultiBox Detector. arXiv.10.1007/978-3-319-46448-0_2 ↗
31. Lin, T.-Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2017, January 22–29). Focal Loss for Dense Object Detection. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.324 ↗
32. Tan, M., Pang, R., and Le, Q.V. (2020, January 14–19). EfficientDet: Scalable and Efficient Object Detection. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01079 ↗
33. Zhou, X., Wang, D., and Krähenbühl, P. (2019). Objects as Points. arXiv.
34. Kumar, D., and Zhang, X. (2021, January 11–16). Improving More Instance Segmentation and Better Object Detection in Remote Sensing Imagery Based on Cascade Mask R-CNN. Proceedings of the 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, Brussels, Belgium.10.1109/IGARSS47720.2021.9554512 ↗
35. CornerNet: Detecting Objects as Paired Keypoints10.1007/s11263-019-01204-1 ↗
36. Dynamics-based nonsingular interval model and luffing angular response field analysis of the DACS with narrowly bounded uncertainty10.1007/s11071-017-3826-1 ↗
37. Adaptive integral sliding mode control with payload sway reduction for 4-DOF tower crane systems10.1007/s11071-020-05471-3 ↗
38. UAV vision detection method for crane surface cracks based on Faster R-CNN and image segmentation10.1007/s13349-022-00577-1 ↗
39. He, J., He, Z., Wang, W., Wang, S., and Li, Z. (2023, January 27). Visual system design of tower crane based on improved YOLO. Proceedings of the CNIOT’23: Proceedings of the 2023 4th International Conference on Computing, Networks and Internet of Things, Xiamen, China.10.1145/3603781.3603923 ↗
40. Sun, H., Dong, Y., Liu, Z., Sun, L., and Yu, H. (2023, January 26–28). Design and implementation of a smart site supervision system based on Internet of Things. Proceedings of the 2023 IEEE 3rd International Conference on Information Technology, Big Data and Artificial Intelligence (ICIBA), Chongqing, China.10.1109/ICIBA56860.2023.10165424 ↗
41. Sleiman, J.-P., Zankoul, E., Khoury, H., and Hamzeh, F. (June, January 31). Sensor-Based Planning Tool for Tower Crane Anti-Collision Monitoring on Construction Sites. Proceedings of the Construction Research Congress, San Juan, Puerto Rico.
42. Digital twin: Stability analysis for tower crane hoisting safety with a scale model10.1016/j.autcon.2022.104257 ↗
43. Yu, J.-L., Zhou, R.-F., Miao, M.-X., and Huang, H.-Q. (2015, January 8–10). An Application of Artificial Neural Networks in Crane Operation Status Monitoring. Proceedings of the 2015 Chinese Intelligent Automation Conference, Fuzhou, China.10.1007/978-3-662-46463-2_24 ↗
44. Wang, J., Zhang, Q., Yang, B., and Zhang, B. (2023). Vision-Based Automated Recognition and 3D Localization Framework for Tower Cranes Using Far-Field Cameras. Sensors, 23.10.3390/s23104851 ↗
45. Wu, D., Jiang, S., Zhao, E., Liu, Y., Zhu, H., Wang, W., and Wang, R. (2022). Detection of Camellia oleifera Fruit in Complex Scenes by Using YOLOv7 and Data Augmentation. Appl. Sci., 12.10.3390/app122211318 ↗
46. Combining YOLO and background subtraction for small dynamic target detection10.1007/s00371-024-03342-1 ↗
47. Zhang, G., Tian, Y., Hao, J., and Zhang, J. (2022, January 14–16). A Mongolian-Chinese neural machine translation model based on Transformer’s two-branch gating structure. Proceedings of the 2022 4th International Conference on Intelligent Information Processing (IIP), Guangzhou, China.10.1109/IIP57348.2022.00085 ↗
48. A review on the attention mechanism of deep learning10.1016/j.neucom.2021.03.091 ↗
49. Woo, S., Park, J., Lee, J.-Y., and Kweon, I.S. (2018, January 8–14). CBAM: Convolutional Block Attention Module. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
50. Zhou, B., Khosla, A., Lapedriza, A., Oliva, A., and Torralba, A. (2016, January 27–30). Learning Deep Features for Discriminative Localization. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.319 ↗