Intelligent SLAM Algorithm Fusing Low-Cost Sensors at Risk of Building Collapses
Source abstract
Abstract
When firefighters search inside a building that is at risk of collapse due to abandonment or disasters such as fire, they use old architectural drawings or a simple monitoring method involving a video device attached to a robot. However, using these methods, the disaster situation inside a building at risk of collapse is difficult to detect and identify. Therefore, we investigate the generation of digital maps for a disaster site to accurately analyze internal situations. In this study, a robot combined with a low-cost camera and two-dimensional light detection and ranging (2D-lidar) traverses across a floor to estimate the location of obstacles while drawing an internal map of the building. We propose an algorithm that detects the floor and then determines the possibility of entry, tracks collapses, and detects obstacles by analyzing patterns on the floor. The robot’s location is estimated, and a digital map is created based on Hector simultaneous localization and mapping (SLAM). Subsequently, the positions of obstacles are estimated based on the range values detected by 2D-lidar, and the position of the obstacles are identified on the map using the map update method in semantic SLAM. All equipment are implemented using low-specification devices, and the experiments are conducted using a low-cost robot that affords near-real-time performance. The experiments are conducted in various actual internal environments of buildings. In terms of obstacle detection performance, almost all obstacles are detected, and their positions identified on the map with a high accuracy of 89%.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Robotics and Sensor-Based Localization · Robotic Path Planning Algorithms · 3D Surveying and Cultural Heritage
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (50)
Show source-provided references
1. M. Ahrens and B. Evarts, “Fire loss in the United States during 2020,” National Fire Protection Association (NFPA), MA, USA: NFPA Research, 2021. [Online]. Available: https://www.nfpa.org//-/media/Files/News-and-Research/Fire-statistics-and-reports/US-Fire-Problem/osFireLoss.pdf.
2. D. Bailey, D. Brown, A. L. González, M. Hills, T. Housden et al., “Miami building collapse: What happened, and how quickly?,” BBC, London, UK: BBC News, 2021. [Online]. Available: https://www.bbc.com/news/world-us-canada-57609620.
3. S. Petherick, “Remains of grenfell tower may be pulled down after fire that killed 72,” METRO, London, UK: Metro news, 2021. [Online]. Available: https://metro.co.uk/2021/05/12/remains-of-grenfell-tower-might-be-pulled-down-after-fire-that-killed-72-14562219/#metro-comments-container.
4. Y. H. Seok, “Ha, end robot, around the disaster scene. safety to humans,” Electronic Newspapers Internet, Seoul, Korea: Etnews, 2021. [Online]. Available: https://news.v.daum.net/v/20210725180107826.
5. E. Ackerman and E. Guizzo, “Centauro: A new disaster response robot from IIT,” IEEE Spectrum, NY, USA: Institute of Electrical and Electronics Engineers, 2018. [Online]. Available: https://spectrum.ieee.org/centauro-a-new-disaster-response-robot-from-iit.
6. J. Ramos, A. Wang and K. Sangbae, “Human reflexes help MIT’s hermes rescue robot keep its footing,” IEEE Spectrum, NY, USA: Institute of Electrical and Electronics Engineers, 2019. [Online]. Available: https://spectrum.ieee.org/human-reflexes-help-mits-hermes-rescue-robot-keep-its-footing.
7. A flexible and scalable SLAM system with full 3D motion estimation
8. Representing and updating objects’ identities in semantic SLAM
9. M3d-RPM: Monocular 3D region proposal network for object detection
10. Multi-object detection and tracking (MODT) machine learning model for real-time video surveillance systems10.1007/s00034-019-01234-7 ↗
11. A. Bochkovskiy, C. Wang and H. M. Liao, “YOLOv4: Optimal speed and accuracy of object detection,” arXiv preprint arXiv:2004.10934, 2020.
12. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
13. Liu · Computer Vision–ECCV 2016 · 2016 · 9905 · 2110.1007/978-3-319-46448-0_2 ↗
14. Focal loss for dense object detection
15. Feature pyramid networks for object detection
16. A study on pagoda image search using artificial intelligence(AI) technology for restoration of cultural properties
17. A hierarchical deep model for food classification from photographs
18. Obstacle detection and distance estimation for autonomous electric vehicle using stereo vision and DNN
19. A monocular vision obstacle avoidance method applied to indoor tracking robot
20. Waterline and obstacle detection in images from low-cost autonomous boats for environmental monitoring10.1016/j.robot.2019.103346 ↗
21. Mask R-CNN
22. FD-stackGAN: Face de-occlusion using stacked generative adversarial networks
23. S. Lei, Y. Kailun, H. Xinxin, H. Weijian and W. Kaiwei, “Real-time fusion network for RGB-D semantic segmentation incorporating unexpected obstacle detection for road-driving images,” arXiv preprint arXiv:2002.10570, 2020.
24. Combining convolutional side-outputs for road image segmentation
25. Road damage detection based on unsupervised disparity map segmentation10.1109/TITS.2019.2947206 ↗
26. Global context based automatic road segmentation via dilated convolutional neural network10.1016/j.ins.2020.05.062 ↗
27. DA-Res2net: A novel densely connected residual attention network for image semantic segmentation
28. Road detection through CRF based lidar-camera fusion
29. The obstacle detection method of UAV based on 2D lidar10.1109/ACCESS.2019.2952173 ↗
30. Obstacle detection using ultrasonic sensor for a mobile robot
31. Self-supervised person detection in 2D range data using a calibrated camera
32. 2D lidar and camera fusion for object detection and object distance measurement of ADAS using robotic operating system (ROS)10.30630/joiv.4.4.466 ↗
33. Wang · IEEE Int. Conf. Computer Vision and Pattern Recognition (CVPR) · 2019 · 1
34. Real-time active SLAM and obstacle avoidance for an autonomous robot based on stereo vision10.1080/01969722.2018.1541599 ↗
35. Multi-objective path planning of an autonomous mobile robot using hybrid PSO-MFB optimization algorithm10.1016/j.asoc.2020.106076 ↗
36. ROS based autonomous mobile robot navigation using 2D lidar and RGB-D camera
37. Real-time obstacle avoidance for a swarm of autonomous mobile robots
38. Power transmission line inspection robots: A review, trends and challenges for future research10.1016/j.ijepes.2020.105862 ↗
39. An autonomous strawberry-harvesting robot: Design, development, integration, and field evaluation10.1002/rob.21889 ↗
40. Internet connected modern fire fighting robot
41. F. G. Hoffman, “The first firefighting robot in america is here--and it has already helped fight a major fire in Los Angeles,” CNN Business, GA, USA: BBC, 2020. [Online]. Available: https://edition.cnn.com/2020/10/21/business/first-firefighting-robot-in-america-lafd-trnd/index.html.
42. “OMOROBOT,” OMO R1. [Online]. Available: https://omorobot.com/docs/omo-r1/, 2021, Oct, 19.
43. LG, LG gram 15z980-ga50k. [Online]. Available: https://www.lge.co.kr/support/product-manuals, 2018.
44. YDLIDAR, YDLIDAR X4. [Online]. Available: https://www.ydlidar.com/products/view/5.html, 2021, Jul, 22.
45. ROS, ROS Melodic Morenia. [Online]. Available: http://wiki.ros.org/melodic, 2018, May, 23.
46. A computational approach to edge detection10.1109/TPAMI.1986.4767851 ↗
47. LSD: A line segment detector10.5201/ipol.2012.gjmr-lsd ↗
48. Image analysis using mathematical morphology10.1109/TPAMI.1987.4767941 ↗
49. Rescueme: An indoor mobile augmented-reality evacuation system by personalized pedometry
50. Common Objects in Context, COCO Dataset 2017 test images. [Online]. Available: http://images.cocodataset.org/zips/test2017.zip, 2017.