Causal Correction and Compensation Network for Robotics: Applications and Validation in Continuous Control
Source abstract
Abstract
Deep Reinforcement Learning (DRL) has achieved remarkable success in robotic control, autonomous driving, and game-playing agents. However, its decision-making process often remains a black box, lacking both interpretability and verifiability. In robotic control tasks, developers cannot pinpoint decision errors or precisely adjust control strategies based solely on observed robot behaviors. To address this challenge, this work proposes an interpretable DRL framework based on a Causal Correction and Compensation Network (C2-Net), which systematically captures the causal relationships underlying decision-making and enhances policy robustness. C2-Net integrates a Graph Neural Network-based Neural Causal Model (GNN-NCM) to compute causal influence weights for each action. These weights are then dynamically applied to correct and compensate the raw policy outputs, thereby balancing performance optimization and transparency. This work validates the approach on OpenAI Gym’s Hopper, Walker2d, and Humanoid environments, as well as the multi-agent AzureLoong platform built on Isaac Gym. In terms of convergence speed, final return, and policy robustness, experimental results show that C2-Net achieves higher performance over both non-causal baselines and conventional attention-based models. Moreover, it provides rich causal explanations for its decisions. The framework represents a principled shift from correlation to causation and offers a practical solution for the safe and reliable deployment of multi-robot systems.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Fault Detection and Control Systems · Advanced Control Systems Optimization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information Science and Technology, Beijing University of Technology, Beijing 100039, China
Nuclear Industry X Intelligence Laboratory, Beijing University of Technology, Beijing 100124, China
CNNC Hexin Information Technology (Beijing) Co., Ltd., Beijing 100091, China
Funding
National Natural Science Foundation of China · Natural Science Foundation of Beijing Municipality
References (30)
Show source-provided references
1. Antoniadi, A.M., Du, Y., Guendouz, Y., Wei, L., Mazo, C., Becker, B.A., and Mooney, C. (2021). Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review. Appl. Sci., 11.10.3390/app11115088 ↗
2. DARPA’s Explainable Artificial Intelligence (XAI) Program
3. Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., and Samek, W. (2015). On Pixel-Wise Explanations for Non-Linear Classifier Decisions by Layer-Wise Relevance Propagation. PLoS ONE, 10.10.1371/journal.pone.0130140 ↗
4. Paleja, R., Chen, L., Niu, Y., Silva, A., Li, Z., Zhang, S., Ritchie, C., Choi, S., Chang, K.C., and Tseng, H.E. (2023). Interpretable Reinforcement Learning for Robotics and Continuous Control. arXiv.
5. Nikulin, D., Ianina, A., Aliev, V., and Nikolenko, S. (2019). Free-Lunch Saliency via Attention in Atari Agents. arXiv.10.1109/ICCVW.2019.00522 ↗
6. Self-Supervised Discovering of Interpretable Features for Reinforcement Learning
7. Provably Efficient Causal Reinforcement Learning with Confounded Observational Data
8. Training a Resilient Q-network against Observational Interference
9. Causal Influence Detection for Improving Efficiency in Reinforcement Learning
10. Wang, Z., Xiao, X., Xu, Z., Zhu, Y., and Stone, P. (2022). Causal Dynamics Learning for Task-Independent State Abstraction. arXiv.
11. Generalizing Goal-Conditioned Reinforcement Learning with Variational Causal Reasoning
12. Madumal, P., Miller, T., Sonenberg, L., and Vetere, F. (2020). Distal Explanations for Model-free Explainable Reinforcement Learning. arXiv.
13. Explainable Reinforcement Learning through a Causal Lens
14. Volodin, S. (2021). CauseOccam: Learning Interpretable Abstract Representations in Reinforcement Learning Environments via Model Sparsity. [Ph.D. Thesis, Ecole Polytechnique Fédérale de Lausanne]. Available online: https://infoscience.epfl.ch/handle/20.500.14299/180168.
15. What Did You Think Would Happen? Explaining Agent Behaviour through Intended Outcomes
16. The rational use of causal inference to guide reinforcement learning strengthens with age10.1038/s41539-020-00075-3 ↗
17. Deep Reinforcement Learning for Robotics: A Survey of Real-World Successes
18. Wang, Y., Hayashibe, M., and Owaki, D. (2024). Data-Driven Policy Learning Methods from Biological Behavior: A Systematic Review. Appl. Sci., 14.10.3390/app14104038 ↗
19. Li, D., Lu, Y., Wu, J., Zhou, W., and Zeng, G. (2024). Causal Reinforcement Learning for Knowledge Graph Reasoning. Appl. Sci., 14.10.3390/app14062498 ↗
20. Zhu, W., Yu, C., and Zhang, Q. (2023). Causal Deep Reinforcement Learning Using Observational Data. arXiv.10.24963/ijcai.2023/524 ↗
21. Causal deconfounding deep reinforcement learning for mobile robot motion planning10.1016/j.knosys.2024.112406 ↗
22. Causal Feature Selection With Dual Correction10.1109/TNNLS.2022.3178075 ↗
23. A causal-based approach to explain, predict and prevent failures in robotic tasks10.1016/j.robot.2023.104376 ↗
24. Why Did I Fail? A Causal-Based Method to Find Explanations for Robot Failures10.1109/LRA.2022.3188889 ↗
25. Causality: Models, reasoning, and inference, by Judea Pearl, Cambridge University Press, 200010.1017/S0266466603004109 ↗
26. Survey on Graph Neural Networks10.1109/ACCESS.2024.3456913 ↗
27. Graph Convolutional Neural Network for Human Action Recognition: A Comprehensive Survey10.1109/TAI.2021.3076974 ↗
28. Jiang, J., Dun, C., Huang, T., and Lu, Z. (2020). Graph Convolutional Reinforcement Learning. arXiv.
29. Leonardis, A., Ricci, E., Roth, S., Russakovsky, O., Sattler, T., and Varol, G. (October, January 9). Graph Neural Network Causal Explanation via Neural Causal Models. Proceedings of the Computer Vision—ECCV 2024, Milan, Italy.10.1007/978-3-031-72980-5 ↗
30. Yu, Z., Ruan, J., and Xing, D. (2024). Explainable Reinforcement Learning via a Causal World Model. arXiv.10.24963/ijcai.2023/505 ↗