Semantic Mapping with Low-Density Point-Clouds for Service Robots in Indoor Environments
Source abstract
Abstract
The advancements in the robotic field have made it possible for service robots to increasingly become part of everyday indoor scenarios. Their ability to operate and reach defined goals depends on the perception and understanding of their surrounding environment. Detecting and positioning objects as well as people in an accurate semantic map are, therefore, essential tasks that a robot needs to carry out. In this work, we walk an alternative path to build semantic maps of indoor scenarios. Instead of relying on high-density sensory input, like the one provided by an RGB-D camera, and resource-intensive processing algorithms, like the ones based on deep learning, we investigate the use of low-density point-clouds provided by 3D LiDARs together with a set of practical segmentation methods for the detection of objects. By focusing on the physical structure of the objects of interest, it is possible to remove complex training phases and exploit sensors with lower resolution but wider Field of View (FoV). Our evaluation shows that our approach can achieve comparable (if not better) performance in object labeling and positioning with a significant decrease in processing time than established approaches based on deep learning methods. As a side-effect of using low-density point-clouds, we also better support people privacy as the lower resolution inherently prevents the use of techniques like face recognition.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotics and Sensor-Based Localization · Robotic Path Planning Algorithms · Video Surveillance and Tracking Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Networked Embedded Systems Group, University of Duisburg Essen, 45127 Essen, Germany
Robotics, Vision and Control Group, University of Seville, 41092 Seville, Spain
References (41)
Show source-provided references
1. Triebel, R., Arras, K., Alami, R., Beyer, L., Breuers, S., Chatila, R., Chetouani, M., Cremers, D., Evers, V., and Fiore, M. (2016). Spencer: A socially aware service robot for passenger guidance and help in busy airports. Field and Service Robotics, Springer.10.1007/978-3-319-27702-8_40 ↗
2. Perez-Higueras, N., Ramon-Vigo, R., Perez-Hurtado, I., Capitan, J., Caballero, F., and Merino, L. (2016, January 1–3). A social navigation system in telepresence robots for elderly. Proceedings of the Workshop on the International Conference on Social Robotics, Kansas City, MO, USA.
3. Belpaeme, T., Kennedy, J., Ramachandran, A., Scassellati, B., and Tanaka, F. (2018). Social robots for education: A review. Sci. Robot., 3.10.1126/scirobotics.aat5954 ↗
4. Messias, J., Ventura, R., Lima, P., Sequeira, J., Alvito, P., Marques, C., and Carriço, P. (2014, January 14–15). A robotic platform for edutainment activities in a pediatric hospital. Proceedings of the IEEE International Conference on Autonomous Robot Systems and Competitions (ICARSC), Espinho, Portugal.10.1109/ICARSC.2014.6849785 ↗
5. Localization and navigation of the cobots over long-term deployments10.1177/0278364913503892 ↗
6. Apple (2020, April 23). iPad Pro 2020 Datasheet. Available online: https://www.apple.com/ipad-pro/.
7. Velodyne Lidar (2020, April 23). Solid State LiDAR Velarray Datasheet. Available online: https://velodynelidar.com/products/velarray/.
8. ORBBEC (2020, April 23). Astra Camera. Available online: https://orbbec3d.com/product-astra-pro/.
9. HOKUYO (2020, April 23). Hokuyo UST-10LX. Available online: https://www.hokuyo-usa.com/application/files/2414/7196/1936/UST-10LX_Specifications.pdf.
10. Velodyne Lidar (2020, April 23). Velodyne VLP-16. Available online: https://velodynelidar.com/products/puck.
11. Blickfeld (2020, April 23). Solid State LiDAR Cube 1 Datasheet. Available online: https://www.blickfeld.com/products/.
12. Benewake (2020, September 23). CE30. Available online: http://en.benewake.com/product/detail/5c34571eadd0b639f4340ce5.html.
13. Sánchez, C.M., Capitan, J., Zella, M., and Marron, P.J. (2020, January 9–11). Point-Cloud Fast Filter for People Detection with Indoor Service Robots. Proceedings of the 2020 Fourth IEEE International Conference on Robotic Computing (IRC), Taichung, Taiwan. To be published.10.1109/IRC.2020.00032 ↗
14. A Survey on 3D Object Detection Methods for Autonomous Driving Applications10.1109/TITS.2019.2892405 ↗
15. ROS Components (2020, September 23). CE30 Price Information. Available online: https://www.roscomponents.com/es/lidar-escaner-laser/232-ce30-a.html.
16. Visual simultaneous localization and mapping: A survey10.1007/s10462-012-9365-8 ↗
17. Multisensor-Based Human Detection and Tracking for Mobile Service Robots10.1109/TSMCB.2008.2004050 ↗
18. Recurrent-OctoMap: Learning state-based map refinement for long-term semantic mapping with 3-D-Lidar data10.1109/LRA.2018.2856268 ↗
19. Chen, X., Milioto, A., Palazzolo, E., Giguere, P., Behley, J., and Stachniss, C. (2019, January 4–8). SuMa++: Efficient LiDAR-based Semantic SLAM. Proceedings of the 2019 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Macau, China.10.1109/IROS40897.2019.8967704 ↗
20. Droeschel, D., and Behnke, S. (2018, January 21–26). Efficient Continuous-Time SLAM for 3D Lidar-Based Online Mapping. Proceedings of the 2018 IEEE International Conference on Robotics and Automation (ICRA), Brisbane, Australia.10.1109/ICRA.2018.8461000 ↗
21. Pumarola, A., Vakhitov, A., Agudo, A., Sanfeliu, A., and Moreno-Noguer, F. (June, January 29). PL-SLAM: Real-time monocular visual SLAM with points and lines. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.10.1109/ICRA.2017.7989522 ↗
22. Sánchez, C.M., Zella, M., Capitan, J., and Marron, P.J. (2019, January 2–6). Efficient Traversability Mapping for Service Robots Using a Point-cloud Fast Filter. Proceedings of the 2019 19th International Conference on Advanced Robotics (ICAR), Belo Horizonte, Brazil.10.1109/ICAR46387.2019.8981625 ↗
23. (2020, September 23). Astra Body Tracker. Available online: https://github.com/KrisPiters/astra_body_tracker.
24. McCormac, J., Handa, A., Davison, A., and Leutenegger, S. (June, January 29). SemanticFusion: Dense 3D semantic mapping with convolutional neural networks. Proceedings of the 2017 IEEE International Conference on Robotics and Automation (ICRA), Singapore.10.1109/ICRA.2017.7989538 ↗
25. Meyer, A., Salscheider, N.O., Orzechowski, P.F., and Stiller, C. (2018, January 1–5). Deep Semantic Lane Segmentation for Mapless Driving. Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.10.1109/IROS.2018.8594450 ↗
26. Sünderhauf, N., Pham, T.T., Latif, Y., Milford, M., and Reid, I. (2017, January 24–28). Meaningful maps with object-oriented semantic mapping. Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.10.1109/IROS.2017.8206392 ↗
27. Nakajima, Y., Tateno, K., Tombari, F., and Saito, H. (2018, January 1–5). Fast and Accurate Semantic Mapping through Geometric-based Incremental Segmentation. Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.10.1109/IROS.2018.8593993 ↗
28. Ma, L., Stückler, J., Kerl, C., and Cremers, D. (2017, January 24–28). Multi-view deep learning for consistent semantic mapping with RGB-D cameras. Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.10.1109/IROS.2017.8202213 ↗
29. Dewan, A., Oliveira, G.L., and Burgard, W. (2017, January 24–28). Deep semantic classification for 3D LiDAR data. Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.10.1109/IROS.2017.8206198 ↗
30. Yin, H., Wang, Y., Ding, X., Tang, L., Huang, S., and Xiong, R. (2019). 3D LiDAR-Based Global Localization Using Siamese Neural Network. IEEE Trans. Intell. Transp. Syst., 1–13.10.1109/TITS.2019.2905046 ↗
31. Dewan, A., Caselitz, T., Tipaldi, G.D., and Burgard, W. (2016, January 16–21). Motion-based detection and tracking in 3D LiDAR scans. Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweeden.10.1109/ICRA.2016.7487649 ↗
32. Yan, Z., Duckett, T., and Bellotto, N. (2017, January 24–28). Online learning for human classification in 3D LiDAR-based tracking. Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.10.1109/IROS.2017.8202247 ↗
33. Fahn, C., Lee, C., and Yeh, Y. (2017, January 13–17). A real-time pedestrian legs detection and tracking system used for autonomous mobile robots. Proceedings of the 2017 International Conference on Applied System Innovation (ICASI), Sapporo, Japan.10.1109/ICASI.2017.7988208 ↗
34. Masi, I., Wu, Y., Hassner, T., and Natarajan, P. (November, January 29). Deep Face Recognition: A Survey. Proceedings of the 2018 31st SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), Parana, Brazil.10.1109/SIBGRAPI.2018.00067 ↗
35. Rafi, U. (2018). Efficient Deep Learning Methods for Human Pose Estimation. [Ph.D. Thesis, RWTH Aachen University].
36. (2020, September 23). CE30 SDK for RoS. Available online: https://github.com/CE30C/SDK-for-ROS.
37. ORBBEC (2020, September 23). Astra Camera SDK for ROS. Available online: https://github.com/orbbec/ros_astra_camera.
38. Labbé, M. (2020, April 23). Find-Object. Available online: http://introlab.github.io/find-object.
39. Xuan, Z., and David, F. (2020, April 23). Real-Time Voxel Based 3D Semantic Mapping with a Hand Held RGB-D Camera. Available online: https://github.com/floatlazer/semantic_slam.
40. Aubry, M., Maturana, D., Efros, A.A., Russell, B.C., and Sivic, J. (2014, January 23–28). Seeing 3D Chairs: Exemplar Part-Based 2D-3D Alignment Using a Large Dataset of CAD Models. Proceedings of the 2014 IEEE Conference on Computer Vision and Pattern Recognition, Columbus, OH, USA.10.1109/CVPR.2014.487 ↗
41. Zhou, B., Zhao, H., Puig, X., Fidler, S., Barriuso, A., and Torralba, A. (2016). Semantic understanding of scenes through the ade20k dataset. arXiv.10.1109/CVPR.2017.544 ↗