journal article·2025-06-26Open access

Vision-Based Detection, Localization, and Optimized Path Planning for Rebar Intersections in Automated Construction

Chengxiang Li, Weimin Zhang, Fangxing Li, Meijun Guo, Shicheng Fan

Applied Sciences· Volume 15· Issue 13

Abstract

The accurate detection and precise spatial localization of rebar intersection points are essential for advancing automation in construction tasks, such as robotic rebar tying. This paper presents a vision-based methodology that integrates RGB-D sensing, camera calibration, and coordinate transformation techniques to robustly detect and localize rebar crossing points. A structured detection framework efficiently extracts intersection coordinates from RGB-D imagery, subsequently mapping these points to a global reference frame using extrinsic camera calibration parameters. To achieve comprehensive site coverage and optimize operational efficiency, the path planning challenge is reformulated as a sequencing optimization problem of the identified intersections. We propose a greedy optimization algorithm that generates smooth, snake-like traversal paths in an efficient manner. Experimental validation confirms the effectiveness of our approach, demonstrating detection accuracy exceeding 99%, an average processing time below 125 ms per intersection point, and a maximum coordinate transformation error under 2 mm. The presented solution offers a lightweight, precise, and scalable framework, significantly facilitating the integration of vision-based methods into automated construction workflows.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrastructure Maintenance and Monitoring · 3D Surveying and Cultural Heritage · Image and Object Detection Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Mechatronical Engineering, Beijing Institute of Technology, Beijing 100081, China

Zhengzhou Research Institute, Beijing Institute of Technology, Zhengzhou 450000, China

Funding

Technology and Development Joint Research Foundation of Henan Province

References (36)

Show source-provided references
1. Recent advancements of robotics in construction10.1016/j.autcon.2022.104591 ↗
2. Asadi, K., Ramshankar, H., Pullagurla, H., Bhandare, A., Shanbhag, S., Mehta, P., Kundu, S., Han, K., Lobaton, E., and Wu, T. (2018). Building an integrated mobile robotic system for real-time applications in construction. arXiv.10.22260/ISARC2018/0063 ↗
3. Robotics in the Construction Sector: Trends, Advances, and Challenges10.1007/s10846-024-02104-4 ↗
4. Bock, T., and Linner, T. (2015). Robotic Industrialization, Cambridge University Press.10.1017/CBO9781139924153 ↗
5. Genealogy of construction robotics10.1016/j.autcon.2024.105607 ↗
6. Effects of Rebar Tying Machine on Trunk Flexion and Productivity10.1177/154193120504901418 ↗
7. Technological advances in rebar tying jobs: A comparative analysis of the associated yields and illnesses
8. Rebar binding point location method based on improved YOLOv5 and thinning algorithm10.1016/j.measurement.2024.116029 ↗
9. Robotic rebar-tying system uses artificial intelligence
10. Vision transformers in domain adaptation and domain generalization: A study of robustness10.1007/s00521-024-10353-5 ↗
11. BIM-driven computational design for robotic manufacturing in off-site construction: An integrated Design-to-Manufacturing (DtM) approach10.1016/j.autcon.2023.104782 ↗
12. The impact of tool selection on back and wrist injury risk in tying steel reinforcement bars: A single case experiment
13. Understanding deep learning (still) requires rethinking generalization10.1145/3446776 ↗
14. Wang, T.L., Ao, L., Zheng, J., and Sun, Z.B. (2023). Reconstructing depth images for time-of-flight cameras based on second-order correlation functions. Photonics, 10.10.3390/photonics10111223 ↗
15. ToF cameras for active vision in robotics10.1016/j.sna.2014.07.014 ↗
16. A new technique for fully autonomous and efficient 3 d robotics hand/eye calibration10.1109/70.34770 ↗
17. A comparative review of hand-eye calibration techniques for vision guided robots10.1109/ACCESS.2021.3104514 ↗
18. Real-time assessment of rebar intervals using a computer vision-based DVNet model for improved structural integrity
19. Robotics, A.C. (2025, January 08). TyBOT: Autonomous Rebar Tying Robot. Available online: https://www.constructionrobots.com/tybot.
20. Ventures, C. (2025, January 08). SkyMul, SkyTy Automated Rebar Tying System. Available online: https://www.cemexventures.com/skymul.
21. Development of the rebar tying robot “T-iROBO Rebar”
22. Wang, H., Ye, Z., Wang, D., Jiang, H., and Liu, P. (2023). Synthetic datasets for rebar instance segmentation using mask r-cnn. Buildings, 13.10.3390/buildings13030585 ↗
23. Feng, R., Jia, Y., Wang, T., and Gan, H. (2024). Research on the System Design and Target Recognition Method of the Rebar-Tying Robot. Buildings, 14.10.3390/buildings14030838 ↗
24. A variant of the Hough Transform for the combined detection of corners, segments, and polylines10.1186/s13640-017-0180-7 ↗
25. James, T.O. (2019). A Hardware Track-Trigger for CMS: At the High Luminosity LHC, Springer Nature.10.1007/978-3-030-31934-2 ↗
26. Hassanein, A.S., Mohammad, S., Sameer, M., and Ragab, M.E. (2015). A survey on Hough transform, theory, techniques and applications. arXiv.
27. Adatrao, S., and Mittal, M. (2016, January 15–17). An analysis of different image preprocessing techniques for determining the centroids of circular marks using hough transform. Proceedings of the 2016 2nd International Conference on Frontiers of Signal Processing (ICFSP), Warsaw, Poland.10.1109/ICFSP.2016.7802966 ↗
28. Vision detection and path planning of mobile robots for rebar binding10.1002/rob.22356 ↗
29. BIM-based task planning method for wheeled-legged rebar binding robot
30. Movement and binding control strategy based on a new type of rebar-binding robot10.1108/IR-12-2023-0326 ↗
31. A survey of path planning algorithms for mobile robots10.3390/vehicles3030027 ↗
32. Planning for terrestrial laser scanning in construction: A review10.1016/j.autcon.2021.103551 ↗
33. Research on the A Star Algorithm for Finding Shortest Path10.54097/hset.v46i.7697 ↗
34. Hand-eye calibration10.1177/027836499501400301 ↗
35. General hand–eye calibration based on reprojection error minimization10.1109/LRA.2019.2893612 ↗
36. Globally optimal symbolic hand-eye calibration10.1109/TMECH.2020.3019306 ↗