VR-Based Teleoperation of UAV–Manipulator Systems: From Single-UAV Control to Dual-UAV Cooperative Manipulation

In this paper, we present a VR-based control framework for multi-UAV (rotorcraft-type) aerial manipulation that enables simultaneous control of each UAV and its onboard five-degree-of-freedom (5-DoF) manipulator using virtual-reality controllers. Instead of relying on dense button mappings or predefined gestures, the framework maps natural VR-controller motions in real time to vehicle pose and arm joint commands. The UAVs respond smoothly to translational and rotational inputs, while the manipulators accurately replicate dexterous hand motions for precise grasping. Beyond single-platform operation, we extend the framework to cooperative dual-UAV manipulation, leveraging two-hand poses captured via VR controllers to coordinate two UAV-arm systems for payload transportation and obstacle traversal. Simulation experiments demonstrate accurate trajectory tracking and the potential for successful cooperative transport in cluttered environments, indicating the framework’s suitability for telemanipulation, search-and-rescue, and industrial tasks.