Development of Sensing Algorithms for Object Tracking and Predictive Safety Evaluation of Autonomous Excavators
Source abstract
Abstract
This article presents the sensing and safety algorithms for autonomous excavators operating on construction sites. Safety is a key concern for autonomous construction to reduce collisions and machinery damage. Taking this point into consideration, our study deals with LiDAR data processing that allows for object detection, motion tracking/prediction, and track management, as well as safety evaluation in terms of potential collision risk. In the safety algorithm developed in this study, potential collision risks can be evaluated based on information from excavator working areas, predicted states of detected objects, and calculated safety indices. Experiments were performed using a modified mini hydraulic excavator with Velodyne VLP-16 LiDAR. Experimental validations prove that the developed algorithms are capable of tracking objects, predicting their future states, and assessing the degree of collision risks with respect to distance and time. Hence, the proposed algorithms can be applied to diverse autonomous machines for safety enhancement.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Hydraulic and Pneumatic Systems · Robot Manipulation and Learning · Industrial Automation and Control Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Automotive and Mechatronics Engineering, Ontario Tech University, Oshawa, ON L1G 0C5, Canada
Department of Mechanical and Mechatronics Engineering, University of Waterloo, Waterloo, ON N2L 3G1, Canada
Funding
Natural Sciences and Engineering Research Council of Canada
References (26)
Show source-provided references
1. Iterative learning-based admittance control for autonomous excavation10.1007/s10846-019-00994-3 ↗
2. Earthmoving equipment automation: A review of technical advances and future outlook
3. Zhang, M., Cao, T., and Zhao, X. (2017). Applying sensor-based technology to improve construction safety management. Sensors, 17.10.3390/s17081841 ↗
4. RFID-based real-time locating system for construction safety management10.1061/(ASCE)CP.1943-5487.0000144 ↗
5. Tracking the location of materials on construction job sites10.1061/(ASCE)0733-9364(2006)132:9(911) ↗
6. Computer vision techniques for construction safety and health monitoring10.1016/j.aei.2015.02.001 ↗
7. Teizer, T. (2015, January 15–18). Magnetic field proximity detection and alert technology for safe heavy construction equipment operation. Proceedings of the 32nd International Symposium on Automation and Robotics in Construction and Mining (ISARC 2015), Oulu, Finland.10.22260/ISARC2015/0062 ↗
8. Nieto Vega, A. (2001). Development of a Real-Time Proximity Warning and 3-D Mapping System Based on Wireless Networks, Virtual Reality Graphics, and GPS to Improve Safety in Open-Pit Mines. [Ph.D. Thesis, Colorado School of Mines].
9. A vision-based motion capture and recognition framework for behavior-based safety management10.1016/j.autcon.2013.05.001 ↗
10. Kim, J., Yoo, S., Kim, M., Kim, M., and Lee, G. (2018, January 26–30). Safety control of automatic excavator for swing collision avoidance. Proceedings of the 2018 15th International Conference on Ubiquitous Robots (UR), Honolulu, HI, USA.10.1109/URAI.2018.8441774 ↗
11. Image-based construction hazard avoidance system using augmented reality in wearable device10.1016/j.autcon.2017.06.014 ↗
12. 3D Lidar-based static and moving obstacle detection in driving environments: An approach based on voxels and multi-region ground planes10.1016/j.robot.2016.06.007 ↗
13. Vatavu, A., Nedevschi, S., and Oniga, F. (2010, January 26–28). Real-time environment representation based on occupancy grid temporal analysis using a dense stereo-vision system. Proceedings of the 2010 IEEE 6th International Conference on Intelligent Computer Communication and Processing, Cluj-Napoca, Romania.10.1109/ICCP.2010.5606439 ↗
14. Fuerstenberg, K., and Dietmayer, K. (2004, January 14–17). Object tracking and classification for multiple active safety and comfort applications using a multilayer laser scanner. Proceedings of the IEEE Intelligent Vehicles Symposium, Parma, Italy.
15. Predicting movements of onsite workers and mobile equipment for enhancing construction site safety10.1016/j.autcon.2016.04.009 ↗
16. Kampker, A., Sefati, M., Rachman, A., Kreisköther, K., and Campoy, P. (2018, January 16–18). Towards multi-object detection and tracking in urban scenario under uncertainties. Proceedings of the 4th International Conference on Vehicle Technology and Intelligent Transport Systems, Funchal, Spain.10.5220/0006706101560167 ↗
17. Development of a predictive safety control algorithm using laser scanners for excavators on construction sites10.1177/0954407018764046 ↗
18. (2020, October 18). Puck Lidar Sensor, High-Value Surround Lidar. Available online: https://velodynelidar.com/products/puck.
19. MLESAC: A new robust estimator with application to estimating image geometry10.1006/cviu.1999.0832 ↗
20. Muja, M., and David, L. (2009, January 5–8). Fast Approximate nearest neighbors with automatic algorithm configuration. Proceedings of the Fourth International Conference on Computer Vision Theory and Applications, Lisboa, Portugal.
21. Compact representation of dynamic driving environments for ADAS by parametric free space and dynamic object maps10.1109/TITS.2015.2472965 ↗
22. Sualeh, M., and Kim, G.-W. (2019). Dynamic multi-Lidar based multiple object detection and tracking. Sensors, 19.10.3390/s19061474 ↗
23. Sonar tracking of multiple targets using joint probabilistic data association10.1109/JOE.1983.1145560 ↗
24. Rezatofighi, S., Milan, A., Zhang, Z., Shi, Q., Dick, A., and Reid, I. (2015, January 7–13). Joint probabilistic data association revisited. Proceedings of the IEEE Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.349 ↗
25. Di Nardo, M., Madonna, M., Murino, T., and Castagna, F. (2020). Modelling a safety management system using system dynamics at the Bhopal incident. Appl. Sci., 10.10.3390/app10030903 ↗
26. Safety management system: A system dynamics approach to manage risks in a process plant