A Survey on Robot Semantic Navigation Systems for Indoor Environments
Source abstract
Abstract
Robot autonomous navigation has become a vital area in the industrial development of minimizing labor-intensive tasks. Most of the recently developed robot navigation systems are based on perceiving geometrical features of the environment, utilizing sensory devices such as laser scanners, range-finders, and microwave radars to construct an environment map. However, in robot navigation, scene understanding has become essential for comprehending the area of interest and achieving improved navigation results. The semantic model of the indoor environment provides the robot with a representation that is closer to human perception, thereby enhancing the navigation task and human–robot interaction. However, semantic navigation systems require the utilization of multiple components, including geometry-based and vision-based systems. This paper presents a comprehensive review and critical analysis of recently developed robot semantic navigation systems in the context of their applications for semantic robot navigation in indoor environments. Additionally, we propose a set of evaluation metrics that can be considered to assess the efficiency of any robot semantic navigation system.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotics and Sensor-Based Localization · Robotic Path Planning Algorithms · Robotics and Automated Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Computer Science Department, Faculty of Computers and Information Technology, University of Tabuk, Tabuk 71491, Saudi Arabia
Information Technology Department, Faculty of Computers and Information Technology, University of Tabuk, Tabuk 71491, Saudi Arabia
Artificial Intelligence and Sensing Technologies (AIST) Center, University of Tabuk, Tabuk 71491, Saudi Arabia
References (88)
Show source-provided references
1. Alhmiedat, T., and Alotaibi, M. (2022). Design and evaluation of a personal Robot playing a self-management for Children with obesity. Electronics, 11.10.3390/electronics11234000 ↗
2. A comprehensive study for robot navigation techniques10.1080/23311916.2019.1632046 ↗
3. A Systematic Approach for Exploring Underground Environment Using LiDAR-Based System
4. Environment perception based on LIDAR sensors for real road applications10.1017/S0263574711000270 ↗
5. Alhmiedat, T., Marei, A.M., Messoudi, W., Albelwi, S., Bushnag, A., Bassfar, Z., Alnajjar, F., and Elfaki, A.O. (2023). A SLAM-based localization and navigation system for social robots: The pepper robot case. Machines, 11.10.3390/machines11020158 ↗
6. Hierarchical SLAM: Real-time accurate mapping of large environments10.1109/TRO.2005.844673 ↗
7. Deep reinforcement learning based mobile robot navigation: A review10.26599/TST.2021.9010012 ↗
8. Dang, T.V., and Bui, N.T. (2023). Multi-scale fully convolutional network-based semantic segmentation for mobile robot navigation. Electronics, 12.10.3390/electronics12030533 ↗
9. Crespo, J., Castillo, J.C., Mozos, O.M., and Barber, R. (2020). Semantic information for robot navigation: A survey. Appl. Sci., 10.10.3390/app10020497 ↗
10. Alamri, S., Alamri, H., Alshehri, W., Alshehri, S., Alaklabi, A., and Alhmiedat, T. (2023). An Autonomous Maze-Solving Robotic System Based on an Enhanced Wall-Follower Approach. Machines, 11.10.3390/machines11020249 ↗
11. Alhmiedat, T. (2023). Fingerprint-Based Localization Approach for WSN Using Machine Learning Models. Appl. Sci., 13.10.3390/app13053037 ↗
12. Deep reinforcement learning for autonomous driving: A survey10.1109/TITS.2021.3054625 ↗
13. Achour, A., Al-Assaad, H., Dupuis, Y., and El Zaher, M. (2022). Collaborative Mobile Robotics for Semantic Mapping: A Survey. Appl. Sci., 12.10.3390/app122010316 ↗
14. Core challenges of social robot navigation: A survey10.1145/3583741 ↗
15. Semantic mapping for mobile robotics tasks: A survey10.1016/j.robot.2014.12.006 ↗
16. Han, X., Li, S., Wang, X., and Zhou, W. (2021). Semantic mapping for mobile robots in indoor scenes: A survey. Information, 12.10.3390/info12020092 ↗
17. Chen, K., Zhang, J., Liu, J., Tong, Q., Liu, R., and Chen, S. (2022). Semantic Visual Simultaneous Localization and Mapping: A Survey. arXiv.
18. Semantics for robotic mapping, perception and interaction: A survey10.1561/2300000059 ↗
19. Survey of simultaneous localization and mapping based on environmental semantic information
20. Autonomous maze solving robotics: Algorithms and systems10.18178/ijmerr.10.12.668-675 ↗
21. Navigation-oriented scene understanding for robotic autonomy: Learning to segment driveability in egocentric images10.1109/LRA.2022.3144491 ↗
22. Building type classification using spatial and landscape attributes derived from LiDAR remote sensing data10.1016/j.landurbplan.2014.07.005 ↗
23. Multisensor and multispectral lidar characterization and classification of a forest environment10.1080/07038992.2016.1196584 ↗
24. McDaniel, M.W., Nishihata, T., Brooks, C.A., and Iagnemma, K. (2010, January 3–8). Ground plane identification using LIDAR in forested environments. Proceedings of the 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, USA.10.1109/ROBOT.2010.5509963 ↗
25. Álvarez-Aparicio, C., Guerrero-Higueras, A.M., Rodríguez-Lera, F.J., Ginés Clavero, J., Martín Rico, F., and Matellán, V. (2019). People detection and tracking using LIDAR sensors. Robotics, 8.10.3390/robotics8030075 ↗
26. Dewan, A., Oliveira, G.L., and Burgard, W. (2017, January 24–28). Deep semantic classification for 3D LiDAR data. Proceedings of the 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada.10.1109/IROS.2017.8206198 ↗
27. Alenzi, Z., Alenzi, E., Alqasir, M., Alruwaili, M., Alhmiedat, T., and Alia, O.M. (2022). A Semantic Classification Approach for Indoor Robot Navigation. Electronics, 11.10.3390/electronics11132063 ↗
28. Xia, Y., Gladkova, M., Wang, R., Li, Q., Stilla, U., Henriques, J.F., and Cremers, D. (October, January 30). CASSP R: Cross Attention Single Scan Place Recognition. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.
29. VPC-Net: Completion of 3D vehicles from MLS point clouds10.1016/j.isprsjprs.2021.01.027 ↗
30. Teso-Fz-Betoño, D., Zulueta, E., Sánchez-Chica, A., Fernandez-Gamiz, U., and Saenz-Aguirre, A. (2020). Semantic segmentation to develop an indoor navigation system for an autonomous mobile robot. Mathematics, 8.10.3390/math8050855 ↗
31. Miyamoto, R., Nakamura, Y., Adachi, M., Nakajima, T., Ishida, H., Kojima, K., Aoki, R., Oki, T., and Kobayashi, S. (2019, January 8–11). Vision-based road-following using results of semantic segmentation for autonomous navigation. Proceedings of the 2019 IEEE 9th International Conference on Consumer Electronics (ICCE-Berlin), Berlin, Germany.10.1109/ICCE-Berlin47944.2019.8966198 ↗
32. Yeboah, Y., Yanguang, C., Wu, W., and Farisi, Z. (2018, January 11–13). Semantic scene segmentation for indoor robot navigation via deep learning. Proceedings of the 3rd International Conference on Robotics, Control and Automation, Chengdu, China.10.1145/3265639.3265671 ↗
33. Mousavian, A., Toshev, A., Fišer, M., Košecká, J., Wahid, A., and Davidson, J. (2019, January 20–24). Visual representations for semantic target driven navigation. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.10.1109/ICRA.2019.8793493 ↗
34. Robot task planning using semantic maps10.1016/j.robot.2008.08.007 ↗
35. Navigation and self-semantic location of drones in indoor environments by combining the visual bug algorithm and entropy-based vision10.3389/fnbot.2017.00046 ↗
36. Visual SLAM for robot navigation in healthcare facility10.1016/j.patcog.2021.107822 ↗
37. Hernández, A.C., Gómez, C., Crespo, J., and Barber, R. (2016, January 4–6). Object classification in natural environments for mobile robot navigation. Proceedings of the IEEE 2016 International Conference on Autonomous Robot Systems and Competitions (ICARSC), Bragança, Portugal.10.1109/ICARSC.2016.55 ↗
38. Lin, J., Wang, W.J., Huang, S.K., and Chen, H.C. (2017, January 27–30). Learning based semantic segmentation for robot navigation in outdoor environment. Proceedings of the 2017 Joint 17th World Congress of International Fuzzy Systems Association and 9th International Conference on Soft Computing and Intelligent Systems (IFSA-SCIS), Otsu, Japan.10.1109/IFSA-SCIS.2017.8023347 ↗
39. Context-aware robot navigation using interactively built semantic maps10.1515/pjbr-2018-0020 ↗
40. Visual semantic navigation based on deep learning for indoor mobile robots10.1155/2018/1627185 ↗
41. Kästner, L., Marx, C., and Lambrecht, J. (2020, January 20–21). Deep-reinforcement-learning-based semantic navigation of mobile robots in dynamic environments. Proceedings of the 2020 IEEE 16th International Conference on Automation Science and Engineering (CASE), Hong Kong, China.10.1109/CASE48305.2020.9216798 ↗
42. Object detection techniques applied on mobile robot semantic navigation10.3390/s140406734 ↗
43. A semantic map for indoor robot navigation based on predicate logic10.4018/IJKSS.2020010101 ↗
44. Miyamoto, R., Adachi, M., Nakamura, Y., Nakajima, T., Ishida, H., and Kobayashi, S. (2019, January 23–26). Accuracy improvement of semantic segmentation using appropriate datasets for robot navigation. Proceedings of the 2019 6th International Conference on Control, Decision and Information Technologies (CoDIT), Paris, France.10.1109/CoDIT.2019.8820616 ↗
45. Uhl, K., Roennau, A., and Dillmann, R. (2023, December 10). From structure to actions: Semantic navigation planning in office environments. In Proceedings of the IROS 2011 Workshop on Perception and Navigation for Autonomous Vehicles in Human Environment (Cited on Page 24). Available online: https://www.researchgate.net/profile/Arne-Roennau/publication/256198760_From_Structure_to_Actions_Semantic_Navigation_Planning_in_Office_Environments/links/6038f20ea6fdcc37a85449ad/From-Structure-to-Actions-Semantic-Navigation-Planning-in-Office-Environments.pdf.
46. Sun, H., Meng, Z., and Ang, M.H. (2017, January 19–21). Semantic mapping and semantics-boosted navigation with path creation on a mobile robot. Proceedings of the 2017 IEEE International Conference on Cybernetics and Intelligent Systems (CIS) and IEEE Conference on Robotics, Automation and Mechatronics (RAM), Ningbo, China.10.1109/ICCIS.2017.8274775 ↗
47. Rossmann, J., Jochmann, G., and Bluemel, F. (2013, January 15–17). Semantic navigation maps for mobile robot localization on planetary surfaces. Proceedings of the 12th Symposium on Advanced Space Technologies in Robotics and Automation (ASTRA 2013), Noordwijk, The Netherlands.
48. Joo, S.H., Manzoor, S., Rocha, Y.G., Bae, S.H., Lee, K.H., Kuc, T.Y., and Kim, M. (2020). Autonomous navigation framework for intelligent robots based on a semantic environment modeling. Appl. Sci., 10.10.3390/app10093219 ↗
49. RoboEarth semantic mapping: A cloud enabled knowledge-based approach10.1109/TASE.2014.2377791 ↗
50. Relational model for robotic semantic navigation in indoor environments10.1007/s10846-017-0469-x ↗
51. Adachi, M., Shatari, S., and Miyamoto, R. (2019, January 26–29). Visual navigation using a webcam based on semantic segmentation for indoor robots. Proceedings of the IEEE 2019 15th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS), Sorrento, Italy.10.1109/SITIS.2019.00015 ↗
52. Posada, L.F., Hoffmann, F., and Bertram, T. (2014, January 2–3). Visual semantic robot navigation in indoor environments. Proceedings of the ISR/Robotik 2014; 41st International Symposium on Robotics, Munich, Germany.
53. Naik, L., Blumenthal, S., Huebel, N., Bruyninckx, H., and Prassler, E. (2019, January 20–24). Semantic mapping extension for OpenStreetMap applied to indoor robot navigation. Proceedings of the IEEE 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.10.1109/ICRA.2019.8793641 ↗
54. Zhang, C., Hou, H., Sangaiah, A.K., Li, D., Cao, F., and Wang, B. (2023). International Conference on Neural Information Processing, Springer Nature.
55. Xia, Y., Xu, Y., Li, S., Wang, R., Du, J., Cremers, D., and Stilla, U. (2021, January 20–25). SOE-Net: A self-attention and orientation encoding network for point cloud based place recognition. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01119 ↗
56. Asadi, K., Chen, P., Han, K., Wu, T., and Lobaton, E. (2019, January 17–19). Real-time scene segmentation using a light deep neural network architecture for autonomous robot navigation on construction sites. Proceedings of the ASCE International Conference on Computing in Civil Engineering, Atlanta, GA, USA.10.1061/9780784482438.041 ↗
57. Mininet: An efficient semantic segmentation convnet for real-time robotic applications10.1109/TRO.2020.2974099 ↗
58. Kim, W., and Seok, J. (2018, January 3–6). Indoor semantic segmentation for robot navigating on mobile. Proceedings of the 2018 Tenth International Conference on Ubiquitous and Future Networks (ICUFN), Prague, Czech Republic.10.1109/ICUFN.2018.8436956 ↗
59. Panda, S.K., Lee, Y., and Jawed, M.K. (2023, January 18–22). Agronav: Autonomous Navigation Framework for Agricultural Robots and Vehicles using Semantic Segmentation and Semantic Line Detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPRW59228.2023.00667 ↗
60. Segmentation and detection of contrast objects and their application in robot navigation10.1134/S1054661815020145 ↗
61. Furuta, Y., Wada, K., Murooka, M., Nozawa, S., Kakiuchi, Y., Okada, K., and Inaba, M. (2016, January 15–17). Transformable semantic map based navigation using autonomous deep learning object segmentation. Proceedings of the 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids), Cancun, Mexico.10.1109/HUMANOIDS.2016.7803338 ↗
62. Dang, T.V., Tran, D.M.C., and Tan, P.X. (2023). IRDC-Net: Lightweight Semantic Segmentation Network Based on Monocular Camera for Mobile Robot Navigation. Sensors, 23.10.3390/s23156907 ↗
63. Drouilly, R., Rives, P., and Morisset, B. (2015, January 26–30). Semantic representation for navigation in large-scale environments. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.10.1109/ICRA.2015.7139314 ↗
64. Gao, C., Rabindran, D., and Mohareri, O. (2022). RGB-D Semantic SLAM for Surgical Robot Navigation in the Operating Room. arXiv.
65. Navigation algorithm based on semantic segmentation in wheat fields using an RGB-D camera
66. Aghi, D., Cerrato, S., Mazzia, V., and Chiaberge, M. (October, January 27). Deep semantic segmentation at the edge for autonomous navigation in vineyard rows. Proceedings of the 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Prague, Czech Republic.10.1109/IROS51168.2021.9635969 ↗
67. A visual navigation method of mobile robot using a sketched semantic map10.5772/52501 ↗
68. Semantic RGB-D SLAM for rescue robot navigation10.1109/ACCESS.2020.3031867 ↗
69. Boularias, A., Duvallet, F., Oh, J., and Stentz, A. (2015, January 26–30). Grounding spatial relations for outdoor robot navigation. Proceedings of the 2015 IEEE International Conference on Robotics and Automation (ICRA), Seattle, WA, USA.10.1109/ICRA.2015.7139457 ↗
70. Building semantic grid maps for domestic robot navigation10.1177/1729881419900066 ↗
71. Qi, X., Wang, W., Liao, Z., Zhang, X., Yang, D., and Wei, R. (2020). Object semantic grid mapping with 2D LiDAR and RGB-D camera for domestic robot navigation. Appl. Sci., 10.10.3390/app10175782 ↗
72. Object goal navigation using goal-oriented semantic exploration
73. Wang, Y., Hussain, B., and Yue, C.P. (2022). VLP Landmark and SLAM-Assisted Automatic Map Calibration for Robot Navigation with Semantic Information. Robotics, 11.10.3390/robotics11040084 ↗
74. Robot navigation in unseen spaces using an abstract map10.1109/TCDS.2020.2993855 ↗
75. Borkowski, A., Siemiatkowska, B., and Szklarski, J. (2010). Graph Transformations and Model-Driven Engineering: Essays Dedicated to Manfred Nagl on the Occasion of His 65th Birthday, Springer.
76. Visualization in architecture, engineering and construction (AEC)10.1016/j.autcon.2004.08.012 ↗
77. Bersan, D., Martins, R., Campos, M., and Nascimento, E.R. (2018, January 6–10). Semantic map augmentation for robot navigation: A learning approach based on visual and depth data. Proceedings of the 2018 Latin American Robotic Symposium, 2018 Brazilian Symposium on Robotics (SBR) and 2018 Workshop on Robotics in Education (WRE), Joȧo Pessoa, Brazil.10.1109/LARS/SBR/WRE.2018.00018 ↗
78. Extending maps with semantic and contextual object information for robot navigation: A learning-based framework using visual and depth cues10.1007/s10846-019-01136-5 ↗
79. Buckeridge, S., Carreno-Medrano, P., Cousgun, A., Croft, E., and Chan, W.P. (2022). Autonomous social robot navigation in unknown urban environments using semantic segmentation. arXiv.
80. Building a grid-semantic map for the navigation of service robots through human–robot interaction10.1016/j.dcan.2015.09.002 ↗
81. Joo, S.H., Manzoor, S., Rocha, Y.G., Lee, H.U., and Kuc, T.Y. (2019). A realtime autonomous robot navigation framework for human like high-level interaction and task planning in global dynamic environment. arXiv.
82. Safe robot navigation via multi-modal anomaly detection10.1109/LRA.2020.2967706 ↗
83. Visual navigation based on semantic segmentation using only a monocular camera as an external sensor10.20965/jrm.2020.p1137 ↗
84. A survey of public datasets for computer vision tasks in precision agriculture10.1016/j.compag.2020.105760 ↗
85. Employing Social Robots for Managing Diabetes Among Children: SARA10.1007/s11277-023-10293-8 ↗
86. Mobile robot navigation using an object recognition software with RGBD images and the YOLO algorithm10.1080/08839514.2019.1684778 ↗
87. A prototype navigation system for guiding blind people indoors using NXT Mindstorms10.3991/ijoe.v9i5.2848 ↗
88. Aftf, M., Ayachi, R., Said, Y., Pissaloux, E., and Atri, M. (2019, January 8–10). Indoor object c1assification for autonomous navigation assistance based on deep CNN model. Proceedings of the 2019 IEEE International Symposium on Measurements & Networking (M&N), Catania, Italy.10.1109/IWMN.2019.8805042 ↗