journal article·2026-07-23

Robustness-Aware Physical AI for Multi-Functional Humanoid Robot Team Concurrency Control Under Imperfect Digital Twin Information

Rubab Anwar, Won-Tae Kim

Applied Sciences· Volume 16· Issue 15
Publisher page

Abstract

Humanoid robots are emerging as flexible robotic resources for autonomous manufacturing systems, where different types of tasks must be assigned to suitable robots while shared production resources are coordinated effectively. However, realistic manufacturing environments involve dynamic task arrivals, event-driven priority changes, heterogeneous robot capabilities, and shared-resource contention. In addition, digital twin-based scheduling may rely on state information that is delayed or uncertain, which can reduce the reliability of scheduling decisions. To address this issue, this paper extends the previously proposed deep reinforcement learning-based concurrency control (DRLCC) framework for robustness-aware scheduling and shared-resource control of a multi-functional humanoid robot team. The extended framework integrates capability-aware task assignment, feasibility-based action masking, and priority ceiling protocol (PCP)-based shared-resource coordination under delayed and uncertain digital twin observations. The framework is evaluated in a humanoid-based autonomous manufacturing scenario using performance indicators including task completion, urgent-task delay, resource contention, humanoid utilization, and robustness degradation under imperfect state feedback. Compared with the greedy ceiling-based baseline, DRLCC reduces high-priority task delay by approximately 10.9%, priority inversions by 42.1%, average waiting time by 73.8%, average block count by 74.0%, and temporary infeasible events by 73.5%, while maintaining comparable humanoid utilization. The robustness analysis further shows that overall task-completion performance remains stable under imperfect digital twin feedback, although coordination-level metrics are more sensitive to observation uncertainty and delay. These results suggest that the extended DRLCC framework can support robustness-aware humanoid robot team scheduling in autonomous manufacturing environments where digital twin observations are delayed or uncertain.
Source: crossref · Quality: baseline

Research context

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Computer Science and Engineering, Computer Science Department, Korea University of Technology and Education, Cheonan 31253, Republic of Korea

Funding

National Research Foundation of Korea · Korea Evaluation Institute of Industrial Technology

References (22)

Show source-provided references
1. Malik, A.A., Masood, T., and Brem, A. (2024, January 11–14). Intelligent Humanoid Robots in Manufacturing: Addressing the Worker Shortage and Skill Gaps in Assembly Cells. Proceedings of the Companion of the 2024 ACM/IEEE International Conference on Human-Robot Interaction, Boulder, CO, USA.10.1145/3610978.3640765 ↗
2. Reviewing human-robot collaboration in manufacturing: Opportunities and challenges in the context of Industry 5.010.1016/j.rcim.2024.102937 ↗
3. Reinforcement learning in dynamic job shop scheduling: A comprehensive review of AI-driven approaches in modern manufacturing10.1007/s10845-025-02585-6 ↗
4. Heterogeneous multi-robot task allocation and scheduling via reinforcement learning10.1109/LRA.2025.3534682 ↗
5. Digital Twin in manufacturing: A categorical literature review and classification
6. Digital Twin Shop-Floor: A New Shop-Floor Paradigm Towards Smart Manufacturing10.1109/ACCESS.2017.2756069 ↗
7. Field-synchronized Digital Twin framework for production scheduling with uncertainty10.1007/s10845-020-01685-9 ↗
8. Digital twin driven dynamic scheduling of discrete manufacturing workshop with transportation resource constraint using multi-agent deep reinforcement learning10.1016/j.rcim.2025.103042 ↗
9. Huang, S., and Ontañón, S. (2022, January 15–18). A closer look at invalid action masking in policy gradient algorithms. Proceedings of the Thirty-Fifth International Florida Artificial Intelligence Research Society Conference, Jensen Beach, FL, USA.10.32473/flairs.v35i.130584 ↗
10. Anwar, R., Kwon, J.-W., and Kim, W.-T. (2025). A Deep Reinforcement Learning-Based Concurrency Control of Federated Digital Twin for Software-Defined Manufacturing Systems. Appl. Sci., 15.10.3390/app15158245 ↗
11. Schulman, J., Wolski, F., Dhariwal, P., Radford, A., and Klimov, O. (2017). Proximal Policy Optimization Algorithms. arXiv.
12. Priority Inheritance Protocols: An Approach to Real-Time Synchronization10.1109/12.57058 ↗
13. Exploring the synergies between collaborative robotics, digital twins, augmentation, and Industry 5.0 for smart manufacturing: A state-of-the-art review10.1016/j.rcim.2024.102769 ↗
14. A capability-aware role allocation approach to industrial assembly tasks10.1109/LRA.2019.2926963 ↗
15. A resilient and energy-aware task allocation framework for heterogeneous multi-robot systems10.1109/TRO.2021.3102379 ↗
16. Dynamic and prioritized task scheduling of heterogeneous multi-robot systems using deep reinforcement learning10.1016/j.neucom.2025.130184 ↗
17. Learning to dispatch for job shop scheduling via deep reinforcement learning
18. Dynamic scheduling for flexible job shop with new job insertions by deep reinforcement learning10.1016/j.asoc.2020.106208 ↗
19. Dynamic job-shop scheduling in smart manufacturing using deep reinforcement learning10.1016/j.comnet.2021.107969 ↗
20. A conceptual framework for Digital Twins in production scheduling and control
21. Hou, Y., Liu, Z., Zhang, X., Zhang, Y., and Chen, X. (2023). Exploring the Use of Invalid Action Masking in Reinforcement Learning: A Comparative Study of On-Policy and Off-Policy Algorithms. Appl. Sci., 13.10.3390/app13148283 ↗
22. Impedance Learning for Human-Guided Robots in Contact With Unknown Environments10.1109/TRO.2023.3281483 ↗