journal article·2022-08-27Open access

On Managing Knowledge for MAPE-K Loops in Self-Adaptive Robotics Using a Graph-Based Runtime Model

Adrián Romero-Garcés, Alejandro Hidalgo-Paniagua, Martín González-García, Antonio Bandera

Applied Sciences· Volume 12· Issue 17

Abstract

Service robotics involves the design of robots that work in a dynamic and very open environment, usually shared with people. In this scenario, it is very difficult for decision-making processes to be completely closed at design time, and it is necessary to define a certain variability that will be closed at runtime. MAPE-K (Monitor–Analyze–Plan–Execute over a shared Knowledge) loops are a very popular scheme to address this real-time self-adaptation. As stated in their own definition, they include monitoring, analysis, planning, and execution modules, which interact through a knowledge model. As the problems to be solved by the robot can be very complex, it may be necessary for several MAPE loops to coexist simultaneously in the robotic software architecture endowed in the robot. The loops will then need to be coordinated, for which they can use the knowledge model, a representation that will include information about the environment and the robot, but also about the actions being executed. This paper describes the use of a graph-based representation, the Deep State Representation (DSR), as the knowledge component of the MAPE-K scheme applied in robotics. The DSR manages perceptions and actions, and allows for inter- and intra-coordination of MAPE-K loops. The graph is updated at runtime, representing symbolic and geometric information. The scheme has been successfully applied in a retail intralogistics scenario, where a pallet truck robot has to manage roll containers for satisfying requests from human pickers working in the warehouse.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Software Engineering Methodologies · Modular Robots and Swarm Intelligence · Service-Oriented Architecture and Web Services

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Departamento Tecnologia Electronica, ETSI Telecomunicacion, University of Málaga, 29010 Málaga, Spain

Center for Excellence of C++, SCALIAN, 29007 Málaga, Spain

Funding

EU H2020 ESMERA Project · Gobierno de España and FEDER funds · University of Málaga

References (30)

Show source-provided references
1. The vision of autonomic computing10.1109/MC.2003.1160055 ↗
2. Fui-Hoon Nah, F., and Tan, C.H. (2015). The Knowledge Gap: Providing Situation-Aware Information Assistance on the Shop Floor. Proceedings of the HCI in Business, Springer International Publishing.
3. Vromant, P., Weyns, D., Malek, S., and Andersson, J. (2011, January 23–24). On interacting control loops in self-adaptive systems. Proceedings of the 6th International Symposium on Software Engineering for Adaptive and Self-Managing Systems, Honolulu, HI, USA.10.1145/1988008.1988037 ↗
4. Bencomo, N., France, R., Cheng, B.H.C., and Aßmann, U. (2014). Living with Uncertainty in the Age of Runtime Models. Models@run.time: Foundations, Applications, and Roadmaps, Springer International Publishing.10.1007/978-3-319-08915-7 ↗
5. The CORTEX cognitive robotics architecture: Use cases10.1016/j.cogsys.2019.01.003 ↗
6. Perceptions or Actions? Grounding How Agents Interact Within a Software Architecture for Cognitive Robotics10.1007/s12559-019-09685-5 ↗
7. A Survey of Knowledge Representation in Service Robotics10.1016/j.robot.2019.03.005 ↗
8. Hochgeschwender, N., Schneider, S., Voos, H., Bruyninckx, H., and Kraetzschmar, G.K. (2016, January 13–16). Graph-based software knowledge: Storage and semantic querying of domain models for run-time adaptation. Proceedings of the 2016 IEEE International Conference on Simulation, Modeling, and Programming for Autonomous Robots (SIMPAR), San Francisco, CA, USA.10.1109/SIMPAR.2016.7862379 ↗
9. Semantic grasping: Planning task-specific stable robotic grasps10.1007/s10514-014-9391-2 ↗
10. Robot task planning using semantic maps10.1016/j.robot.2008.08.007 ↗
11. Pangercic, D., Pitzer, B., Tenorth, M., and Beetz, M. (2012, January 7–12). Semantic Object Maps for robotic housework - representation, acquisition and use. Proceedings of the 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems, Vilamoura-Algarve, Portugal.10.1109/IROS.2012.6385603 ↗
12. Singh Chaplot, D., Salakhutdinov, R., Gupta, A., and Gupta, S. (2020, January 13–19). Neural Topological SLAM for Visual Navigation. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01289 ↗
13. Chen, C., Majumder, S., Al-Halah, Z., Gao, R., Ramakrishnan, S.K., and Grauman, K. (2020). Audio-Visual Waypoints for Navigation. arXiv.
14. TSM: Topological Scene Map for Representation in Indoor Environment Understanding10.1109/ACCESS.2020.3029324 ↗
15. Armeni, I., He, Z.Y., Zamir, A., Gwak, J., Malik, J., Fischer, M., and Savarese, S. (November, January 27). 3D Scene Graph: A Structure for Unified Semantics, 3D Space, and Camera. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Korea.10.1109/ICCV.2019.00576 ↗
16. Kimera: From SLAM to spatial perception with 3D dynamic scene graphs10.1177/02783649211056674 ↗
17. Wu, S.C., Wald, J., Tateno, K., Navab, N., and Tombari, F. (2021, January 2). SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequences. Proceedings of the 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.00743 ↗
18. Hughes, N., Chang, Y., and Carlone, L. (2022). Hydra: A Real-time Spatial Perception System for 3D Scene Graph Construction and Optimization. arXiv.10.15607/RSS.2022.XVIII.050 ↗
19. Bavle, H., Sanchez-Lopez, J.L., Shaheer, M., Civera, J., and Voos, H. (2022). Situational Graphs for Robot Navigation in Structured Indoor Environments. arXiv.10.1109/LRA.2022.3189785 ↗
20. Topological Semantic Mapping by Consolidation of Deep Visual Features10.1109/LRA.2022.3149572 ↗
21. Tsai, C., and Su, M. (2021). VSGM - Enhance robot task understanding ability through visual semantic graph. arXiv.
22. Automatic semantic maps generation from lexical annotations10.1007/s10514-018-9723-8 ↗
23. Topological Semantic Mapping and Localization in Urban Road Scenarios10.1007/s10846-017-0744-x ↗
24. Roddick, T., and Cipolla, R. (2020, January 13–19). Predicting Semantic Map Representations From Images Using Pyramid Occupancy Networks. Proceedings of the 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01115 ↗
25. The Role of Models and Megamodels at Runtime
26. QoS metrics-in-the-loop for endowing runtime self-adaptation to robotic software architectures10.1007/s11042-021-11603-7 ↗
27. Rada-Vilela, J. (2022, August 23). The FuzzyLite Libraries for Fuzzy Logic Control 2018. Available online: https://fuzzylite.com/.
28. Faconti, D. (2022, August 23). BehaviorTree.CPP. Available online: https://github.com/BehaviorTree/BehaviorTree.CPP.
29. (2022, August 23). MIRA—Middleware for Robotic Applications. Available online: http://www.mira-project.org/joomla-mira/.
30. Chella, A., Pipitone, A., Morin, A., and Racy, F. (2020). Developing Self-Awareness in Robots via Inner Speech. Front. Robot. AI, 7.10.3389/frobt.2020.00016 ↗