journal article·2024-05-22Open access

A Vision-Based Bolt Looseness Detection Method for a Multi-Bolt Connection

Lin Deng, Ye Sa, Xiufang Li, Miao Lv, Sidong Kou, Zhan Gao

Applied Sciences· Volume 14· Issue 11

Abstract

Many vision-based bolt looseness detection methods that directly observe the bolts have been developed. However, these methods have many limitations in terms of the conditions and processes of their implementation. To address these problems, this paper proposed a fully automated vision-based bolt looseness detection method for a rigid multi-bolt connection. The proposed method combines digital shearing speckle pattern interferometry (DSSPI) and recurrent neural network (RNN) and involves capturing speckle fringe patterns under various looseness cases using the DSSPI system and classifying these patterns with an RNN model to detect the loose bolts. The proposed method can detect all the bolts within the measured surface at one time, which is efficient. On the other hand, it eliminates the need for prior information such as the initial angle and position of each bolt. It can even detect unseen bolts in multi-bolt connections, making it applicable for connections in complex structures in which occlusion often occurs. Additionally, the method eliminates the complex process of distortion rectification. These features make the method achieve a single-judgment time (four bolts at one detection) of only 4.70 millisecond with a detection accuracy over 99%, which has potential for the real-time detection of loose bolts in multi-bolt connections.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Optical measurement and interference techniques · Structural Health Monitoring Techniques · Image Processing Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Key Laboratory of Luminescence and Optical Information of Ministry of Education, Beijing Jiaotong University, Beijing 100044, China

Funding

National Natural Science Foundation of China

References (31)

Show source-provided references
1. Miao, R., Shen, R., Zhang, S., and Xue, S. (2020). A Review of Bolt Tightening Force Measurement and Loosening Detection. Sensors, 20.10.3390/s20113165 ↗
2. A Review Paper on Looseness Detection Methods in Bolted Structures10.1590/1679-78254231 ↗
3. Quantitative evaluation of residual torque of a loose bolt based on wave energy dissipation and vibro-acoustic modulation: A comparative study10.1016/j.jsv.2016.07.001 ↗
4. Review of Bolted Connection Monitoring10.1155/2013/871213 ↗
5. Comparison of Visual Inspection and Structural-Health Monitoring As Bridge Condition Assessment Methods10.1061/(ASCE)CF.1943-5509.0000802 ↗
6. Bolt assessment of wind turbine hub using nonlinear ultrasound methods10.1177/0309524X19887739 ↗
7. A novel percussion-based method for multi-bolt looseness detection using one-dimensional memory augmented convolutional long short-term memory networks10.1016/j.ymssp.2021.107955 ↗
8. IWSHM 2017: Structural health monitoring of the loosening in a multi-bolt structure using linear and modulated nonlinear ultrasound acoustic moments approach10.1177/1475921718806141 ↗
9. Continuous Monitoring of Residual Torque of Loose Bolt in a Bolted Joint10.1016/j.proeng.2017.04.485 ↗
10. Eraliev, O., Lee, K.-H., and Lee, C.-H. (2022). Vibration-Based Loosening Detection of a Multi-Bolt Structure Using Machine Learning Algorithms. Sensors, 22.10.3390/s22031210 ↗
11. Multi-bolt looseness state monitoring using the recursive analytic based active sensing technique10.1016/j.measurement.2022.110779 ↗
12. Synchronous detection of bolts looseness position and degree based on fusing electro-mechanical impedance10.1016/j.ymssp.2022.109068 ↗
13. Monitoring of multi-bolt connection looseness using entropy-based active sensing and genetic algorithm-based least square support vector machine10.1016/j.ymssp.2019.106507 ↗
14. Smart crawfish: A concept of underwater multi-bolt looseness identification using entropy-enhanced active sensing and ensemble learning10.1016/j.ymssp.2020.107186 ↗
15. Sun, Y., Li, M., Dong, R., Chen, W., and Jiang, D. (2022). Vision-Based Detection of Bolt Loosening Using YOLOv5. Sensors, 22.10.3390/s22145184 ↗
16. A Vision-Based Monitoring Method for the Looseness of High-Strength Bolt10.1109/TIM.2021.3101316 ↗
17. Quasi-autonomous bolt-loosening detection method using vision-based deep learning and image processing10.1016/j.autcon.2019.102844 ↗
18. Vision-based technique for bolt-loosening detection in wind turbine tower10.12989/was.2015.21.6.709 ↗
19. Design of a New Vision-Based Method for the Bolts Looseness Detection in Flange Connections10.1109/TIE.2019.2899555 ↗
20. Vision-based autonomous bolt-looseness detection method for splice connections: Design, lab-scale evaluation, and field application10.1016/j.autcon.2021.103591 ↗
21. Vision-based detection of loosened bolts using the Hough transform and support vector machines10.1016/j.autcon.2016.06.008 ↗
22. Fully automated vision-based loosened bolt detection using the Viola–Jones algorithm10.1177/1475921718757459 ↗
23. Autonomous bolt loosening detection using deep learning10.1177/1475921719837509 ↗
24. 3D vision-based bolt loosening assessment using photogrammetry, deep neural networks, and 3D point-cloud processing10.1016/j.jobe.2023.106326 ↗
25. Looseness inspection of fasteners based on digital shearing speckle pattern interferometry and convolutional neural network10.1117/1.OE.63.5.054102 ↗
26. Shearography and its applications—A chronological review
27. Shearography for non-destructive testing of specular reflecting objects using scattered light illumination10.1016/j.optlastec.2018.11.029 ↗
28. Sultana, F., Sufian, A., and Dutta, P. (2018, January 22–23). Advancements in Image Classification using Convolutional Neural Network. Proceedings of the 2018 Fourth International Conference on Research in Computational Intelligence and Communication Networks (ICRCICN), Kolkata, India.10.1109/ICRCICN.2018.8718718 ↗
29. Neural networks and physical systems with emergent collective computational abilities10.1073/pnas.79.8.2554 ↗
30. Lipton, Z.C., Berkowitz, J., and Elkan, C. (2015). A Critical Review of Recurrent Neural Networks for Sequence Learning. arXiv.
31. Deep Recurrent Neural Networks for Hyperspectral Image Classification10.1109/TGRS.2016.2636241 ↗