Generating coordinated bounding locomotion for a small-scale quadrupedal robot with thoracic-pelvic articulation via reinforcement learning
Source abstract
Abstract
Abstract Small-scale cursorial quadrupedal animals coordinate their spines and limbs for rapid and agile locomotion. Although small-scale quadruped robots have demonstrated impressive mobility in various unstructured environments, they rarely fully leverage the coordination between their spines and limbs, which limits the boundaries of their physical capabilities. Here, we present a hybrid adaptive control framework systematically integrating biological kinematics with reinforcement learning (RL), utilizing pika-inspired morphology as a functional template and contextual motivation for dynamic bounding gaits via coordinated pelvic–thoracic articulation. Inspired by biological locomotion, we developed a parameterized expert model of joint angles in the pika ( Ochotonidae ), a small-scale cursorial animal, and employed it to generate optimized foot-end trajectories. We further explored the optimal gaits using RL to maximize the motor performance of the generated reference trajectories on the robotic quadruped. Notably, the policy achieves coordinated motion highly correlated with biological data and exhibits stable limit-cycle dynamics. The experimental results demonstrate a substantial speed improvement over baseline RL. This study provides valuable insights for developing more coordinated and rapid quadrupedal gaits, potentially bridging the performance gap between small-scale robotic and biological quadrupeds.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robotic Locomotion and Control · Biomimetic flight and propulsion mechanisms · Zebrafish Biomedical Research Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (34)
Show source-provided references
1. The stanford littledog: a learning and rapid replanning approach to quadruped locomotion10.1177/0278364910390537 ↗
2. Small-sized reconfigurable quadruped robot with multiple sensory feedback for studying adaptive and versatile behaviors10.3389/fnbot.2020.00014 ↗
3. Robust autonomous navigation of a small-scale quadruped robot in real-world environments
4. Miniaq-ii: a miniature foldable quadruped with an improved leg mechanism
5. The evolution of micro-cursoriality in mammals10.1242/jeb.095737 ↗
6. Sagittal spine movements of small therian mammals during asymmetrical gaits10.1242/jeb.02400 ↗
7. Benefits of an active spine supported bounding locomotion with a small compliant quadruped robot
8. Spine morphology and energetics: how principles from nature apply to robotics10.1088/1748-3190/aaaa9e ↗
9. Study on effects of spinal joint for running quadruped robots10.1007/s11370-019-00297-4 ↗
10. Spinal joint compliance and actuation in a simulated bounding quadruped robot10.1007/s10514-015-9540-2 ↗
11. Multi-constraint spatial coupling for the body joint quadruped robot and the CPG control method on rough terrain10.1088/1748-3190/acf357 ↗
12. Decentralized control with cross-coupled sensory feedback between body and limbs in sprawling locomotion10.1088/1748-3190/ab3ef6 ↗
13. Quadrupedal galloping control for a wide range of speed via vertical impulse scaling10.1088/1748-3190/10/2/025003 ↗
14. On the energetics of quadrupedal running: predicting the metabolic cost of transport via a flexible-torso model10.1088/1748-3190/10/5/056008 ↗
15. The effect of spine on the bounding dynamic performance of legged system10.1080/01691864.2015.1015442 ↗
16. Bionic control of cheetah bounding with a segmented spine10.1155/2016/5031586 ↗
17. The effect of head movement on the bounding gait of a quadruped robot with an active spine10.1177/1687814019876184 ↗
18. Development of a small-sized quadruped robotic rat capable of multimodal motions10.1109/TRO.2022.3159188 ↗
19. Bioinspired soft spine enables small-scale robotic rat to conquer challenging environments10.1089/soro.2022.0220 ↗
20. An efficient closed-loop adaptive controller for a small-sized quadruped robotic rat10.34133/cbsystems.0096 ↗
21. Learning robust perceptive locomotion for quadrupedal robots in the wild10.1126/scirobotics.abk2822 ↗
22. Identifying important sensory feedback for learning locomotion skills10.1038/s42256-023-00701-w ↗
23. Robust quadruped jumping via deep reinforcement learning10.1016/j.robot.2024.104799 ↗
24. Reinforcement learning-based stable jump control method for asteroid-exploration quadruped robots10.1016/j.ast.2023.108689 ↗
25. Controlling the solo12 quadruped robot with deep reinforcement learning10.1038/s41598-023-38259-7 ↗
26. Rapid locomotion via reinforcement learning10.1177/02783649231224053 ↗
27. Learning quadrupedal locomotion on deformable terrain10.1126/scirobotics.ade2256 ↗
28. High-speed quadrupedal locomotion by imitation-relaxation reinforcement learning10.1038/s42256-022-00576-3 ↗
29. Anymal parkour: learning agile navigation for quadrupedal robots10.1126/scirobotics.adi7566 ↗
30. Basic limb kinematics of small therian mammals10.1242/jeb.205.9.1315 ↗
31. Quadrupedal mammals as paragons for walking machines
32. Proximal policy optimization algorithms
33. Design principles for energy-efficient legged locomotion and implementation on the mit cheetah robot10.1109/TMECH.2014.2339013 ↗
34. A locust-inspired robot capable of continuous crawl-jump-gliding locomotion with optimized transitional control10.1109/TRO.2024.3502192 ↗