A Generative Neuro-Cognitive Architecture Using Quantum Algorithms for the Autonomous Behavior of a Smart Agent in a Simulation Environment
Source abstract
Abstract
This study aims to develop a quantum computing-based neurocognitive architecture that allows an agent to perform autonomous behaviors. Therefore, we present a brain-inspired cognitive architecture for autonomous agents that integrates a prefrontal cortex–inspired model with modern deep learning (a transformer-based reinforcement learning module) and quantum algorithms. In particular, our framework incorporates quantum computational routines (Deutsch–Jozsa, Bernstein–Vazirani, and Grover’s search) to enhance decision-making efficiency. As a novelty of this research, this comprehensive computational structure is empowered by quantum computing operations so that superiority in speed and robustness of learning compared to classical methods can be demonstrated. Another main contribution is that the proposed architecture offers some features, such as meta-cognition and situation awareness. The meta-cognition aspect is responsible for hierarchically learning sub-tasks, enabling the agent to achieve the master goal. The situation-awareness property identifies how spatial-temporal reasoning activities related to the world model of the agent can be extracted in a dynamic simulation environment with unstructured uncertainties by quantum computation-based machine learning algorithms with the explainable artificial intelligence paradigm. In this research, the Minecraft game-based simulation environment is utilized for the experimental evaluation of performance and verification tests within complex, multi-objective tasks related to the autonomous behaviors of a smart agent. By implementing several interaction scenarios, the results of the system performance and comparative superiority over alternative solutions are presented, and it is discussed how these autonomous behaviors and cognitive skills of a smart agent can be improved in further studies. Results show that the quantum-enhanced agent achieves 2× faster convergence to an 80% task success rate in exploration tasks and approximately 15% higher cumulative rewards compared to a classical deep RL baseline. These findings demonstrate the potential of quantum algorithms to significantly improve learning and performance in cognitive agent architectures. However, advantages are task-specific and less pronounced under high-uncertainty, reactive scenarios. Limitations of the simulation environment are acknowledged, and a structured future research roadmap is proposed involving high-fidelity simulation validation, hardware-in-the-loop robotic testing, and integration of advanced hybrid quantum-classical architectures.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Quantum Computing Algorithms and Architecture · Computability, Logic, AI Algorithms
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (44)
Show source-provided references
1. Autonomous navigation system of indoor mobile robots using 2D lidar10.3390/math11061455 ↗
2. Obstacle avoidance and path planning schemes for autonomous navigation of a mobile robot: a review
3. Vasques · Machine learning theory and applications: hands-on use cases with python on classical and quantum machines · 2024 · 521
4. Dynamic optimization based on quantum computation—a comprehensive review10.1016/j.compstruc.2023.107255 ↗
5. The rational status of quantum cognition10.1037/xge0000312 ↗
6. Neural implementation of operations used in quantum cognition10.1016/j.pbiomolbio.2017.04.007 ↗
7. Advanced tools and concepts for quantum cognition: a tutorial10.1016/j.jmp.2016.07.005 ↗
8. Implementation of embodied cognition in multi-agent neurocognitive architecture
9. Modeling valuation and core affect in a cognitive architecture: the impact of valence and arousal on memory and decision-making10.1016/j.cogsys.2017.06.002 ↗
10. Improving human-robot interaction based on joint attention10.1007/s10489-016-0876-x ↗
11. Quantum reinforcement learning during human decision-making10.1038/s41562-019-0804-2 ↗
12. Quantum reinforcement learning10.1109/TSMCB.2008.925743 ↗
13. Dong · Advances in natural computation · 2005 · 68610.1007/11539117_97 ↗
14. Robust quantum-inspired reinforcement learning for robot navigation10.1109/TMECH.2010.2090896 ↗
15. Chen · Reinforcement learning: theory and applications · 2008
16. Quantum-like Bayesian networks for modeling decision making10.3389/fpsyg.2016.00011 ↗
17. Moreira C, Fell L, Dehdashti S, Bruza P, Wichert A. Towards a quantum-like cognitive architecture for decision-making. arXiv:1905.05176. 2019.10.1017/S0140525X19001687 ↗
18. Quantum multiple Q-learning
19. Hierarchical deep Q-network from imperfect demonstrations in minecraft10.1016/j.cogsys.2020.08.012 ↗
20. Quantum deep reinforcement learning for robot navigation tasks10.1109/ACCESS.2024.3417808 ↗
21. A multiagent quantum deep reinforcement learning method for distributed frequency control of islanded microgrids10.1109/TCNS.2022.3140702 ↗
22. Quantum multi-agent meta reinforcement learning
23. Deep learning10.1038/nature14539 ↗
24. Goodfellow · Deep learning · 2016 · 800
25. Zhang · Dive into deep learning · 2023 · 574
26. Convolutional, long short-term memory, fully connected deep neural networks
27. Human-level control through deep reinforcement learning10.1038/nature14236 ↗
28. Mnih V, Kavukcuoglu K, Silver D, Graves A, Antonoglou I, Wierstra D, et al. Playing atari with deep reinforcement learning. arXiv:1312.5602. 2013.
29. Hausknecht M, Stone P. Deep recurrent Q-learning for partially observable MDPs. arXiv:1507.06527. 2015.
30. Chen L, Lu K, Rajeswaran A, Lee K, Grover A, Laskin M, et al. Decision transformer: reinforcement learning via sequence modeling. arXiv:2106.01345v2. 2021.
31. Upadhyay U, Shah N, Ravikanti S, Medhe M. Transformer based reinforcement learning for games. arXiv:1912.03918. 2019.
32. Elastic decision transformer
33. Khang · Applications and principles of quantum computing · 2024 · 491
34. Bertels K, Sarkar A, Krol A, Budhrani R, Samadi J, Geoffroy E, et al. Quantum accelerator stack: a research roadmap. arXiv:2102.02035. 2021.
35. Oliveira AN, de Oliveira EVB, Santos AC, Villas-Bôas CJ. Quantum algorithms in IBMQ experience: deutsch-jozsa algorithm. arXiv:2109.07910. 2021.
36. Entanglement and coherence in the Bernstein-vazirani algorithm10.1103/PhysRevA.106.062429 ↗
37. Gilliam A, Pistoia M, Gonciulea C. Optimizing quantum search using a generalized version of Grover’s algorithm. arXiv:2005.06468. 2020.
38. Computational modeling of prefrontal cortex for meta-cognition of a humanoid robot10.1109/ACCESS.2020.2998396 ↗
39. Guss WH, Codel C, Hofmann K, Houghton B, Kuno N, Milani S, et al. Neurips 2019 competition: the MineRL competition on sample efficient reinforcement learning using human priors. arXiv:1904.10079. 2019.
40. Guss WH, Houghton B, Topin N, Wang P, Codel C, Veloso M, et al. MineRL: a large-scale dataset of minecraft demonstrations. arXiv:1907.13440. 2019.10.24963/ijcai.2019/339 ↗
41. Open-world multi-task control through goal-aware representation learning and adaptive horizon prediction
42. Yuan H, Zhang C, Wang H, Xie F, Cai P, Dong H, et al. Skill reinforcement learning and planning for open-world long-horizon tasks. arXiv:2303.16563. 2023.
43. Madge C, Poesio M. Large language models as minecraft agents. arXiv:2402.08392. 2024.
44. Zhao Z, Chen K, Guo D, Chai W, Ye T, Zhang Y, et al. Hierarchical auto-organizing system for open-ended multi-agent navigation. arXiv:2403.08282. 2024.