Active Balance Control of Humanoid Locomotion Based on Foot Position Compensation
Source abstract
Abstract
A foot positioning compensator is developed in this paper for a full-body humanoid to retrieve its balance during continuous walking. An online Foot Position Compensator (FPC) is designed to improve the robustness of biped walking, which can modify predefined step position and step duration online with sensory feedback. Foot placement parameters are learned by the FPC based on the Policy Gradient Reinforcement Learning (PGRL) method. Moreover, the FPC assists the humanoid robot in rejecting external disturbances and recovering the walking position by re-planning the trajectories of walking pattern and the Center of Mass (CoM). An upper body pose control strategy is also presented to further enhance the performance of humanoid robots to overcome strong external disturbances. The advantages of this proposed method are that it neither requires prior information about the walking terrain conditions, nor relies on range sensor information for surface topology measurement. The effectiveness of the proposed method is verified via Webots simulation and real experiments on a full-body humanoid NAO robot.
Source: openaire · Quality: candidate unverified · Source record ↗
Research context
OpenAlex topics: Robotic Locomotion and Control · Prosthetics and Rehabilitation Robotics · Muscle Physiology and Disorders
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (41)
Show source-provided references
1. Zhang J Q, Gao F, Han X L, Chen X B, Han X Y. Trot gait design and CPG method for a quadruped robot. Journal of Bionic Engineering, 2014, 11, 18–25.10.1016/S1672-6529(14)60016-0 ↗
2. Liu C J, Xia L, Zhang C Z, Chen Q J. Multi-layered CPG for adaptive walking of quadruped robots. Journal of Bionic Engineering, 2018, 15, 341–355.10.1007/s42235-018-0026-8 ↗
3. Bai K Q, Luo M Z, Li T, Wu J. The impulse excitation joint servo drive design and adaptive backstepping control of humanoid robots. Journal of Bionic Engineering, 2018, 15, 114–125.10.1007/s42235-017-0009-1 ↗
4. Huang Q, Yokoi K, Kajita S, Kaneko K, Arai H, Koyachi N, Tanie K. Planning walking patterns for a biped robot. IEEE Transactions on Robotics and Automation, 2001, 17, 280–289.10.1109/70.938385 ↗
5. Seven U, Akbas T, Fidan K C, Erbatur K. Bipedal robot walking control on inclined planes by fuzzy reference trajectory modification. Soft Computing, 2012, 16, 1959–1976.10.1007/s00500-012-0868-7 ↗
6. Kajita S, Kanehiro F, Kaneko K, Yokoi K, Hirukawa H. The 3D Linear Inverted Pendulum Mode: A simple modeling for a biped walking pattern generation. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Maui, HI, USA, 2001, 239–246.
7. Kajita S, Morisawa M, Mura K, Nakaoka S I, Harada K, Kaneko K, Yokoi K. Biped walking stabilization based on linear inverted pendulum tracking. Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Taipei, Taiwan, 2010, 4489–4496.
8. Graf C, Rofer T. A center of mass observing 3D-LIPM gait for the RoboCup standard platform league humanoid. Robot Soccer World Cup, 2011, 102–113.
9. Graf C, Rofer T T. A closed-loop 3D-LIPM gait for the RoboCup standard platform league humanoid. Proceedings of 5th Workshop Humanoid Soccer Robot & Humanoids, Nashville, USA, 2010, 18–22.
10. Kajita S, Kanehiro F, Kaneko K, Fujiwara K, Harada K, Yokoi K, Hirukawa H. Biped walking pattern generation by using preview control of zero-moment point. Proceedings of IEEE International Conference on Robotics and Automation (ICRA), Taipei, Taiwan, 2003, 1620–1626.
11. Motoi N, Suzuki T, Ohnishi K. A bipedal locomotion planning based on virtual linear inverted pendulum mode. IEEE Transactions on Industrial Electronics, 2008, 56, 54–61.10.1109/TIE.2008.2004663 ↗
12. Yu Z G, Chen X C, Huang Q, Zhang W, Meng L B, Zhang W M, Gao J Y. Gait planning of omnidirectional walk on inclined ground for biped robots. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2015, 46, 888–897.10.1109/TSMC.2015.2487240 ↗
13. Kim M, Collins S H. Once-per-step control of ankle push-off work improves balance in a three-dimensional simulation of bipedal walking. IEEE Transactions on Robotics, 2017, 33, 406–418.10.1109/TRO.2016.2636297 ↗
14. Yu Z G, Zhou Q Q, Chen X C, Li Q Q, Meng L B, Zhang W M, Huang Q. Disturbance rejection for biped walking using zero-moment point variation based on body acceleration. IEEE Transactions on Industrial Informatics, 2018, 15, 2265–2276.10.1109/TII.2018.2890195 ↗
15. Castano J A, Li Z, Zhou C, Tsagarakis N, Caldwell D. Dynamic and reactive walking for humanoid robots based on foot placement control. International Journal of Humanoid Robotics, 2016, 13, 1550041.10.1142/S0219843615500413 ↗
16. Hu K, Ott C, Lee D. Learning and generalization of compensative zero-moment point trajectory for biped walking. IEEE Transactions on Robotics, 2016, 32, 717–725.10.1109/TRO.2016.2553677 ↗
17. Mason S, Rotella N, Schaal S, Righetti L. An MPC walking framework with external contact forces. Proceedings of International Conference on Robotics and Automation (ICRA), Brisbance, Australia, 2018, 1785–1790.
18. Chen X C, Yu Z G, Zhang W M, Zheng Y, Huang Q, Ming A G. Bioinspired control of walking with toe-off, heel-strike, and disturbance rejection for a biped robot. IEEE Transactions on Industrial Electronics, 2017, 64, 7962–7971.10.1109/TIE.2017.2698361 ↗
19. Liu C J, Wang D W, Chen Q J. Central pattern generator inspired control for adaptive walking of biped robots. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2013, 43, 1206–1215.10.1109/TSMC.2012.2235426 ↗
20. Liu C J, Wang D W, Goodman E D, Chen Q J. Adaptive walking control of biped robots using online trajectory generation method based on neural oscillators. Journal of Bionic Engineering, 2016, 13, 572–584.10.1016/S1672-6529(16)60329-3 ↗
21. Saputra A A, Botzheim J, Sulistijono I A, Kubota N. Biologically inspired control system for 3-D locomotion of a humanoid biped robot. IEEE Transactions on Systems, Man, and Cybernetics: Systems, 2015, 46, 898–911.10.1109/TSMC.2015.2497250 ↗
22. Wang Y, Xue X H, Chen B F. Matsuoka's CPG with desired rhythmic signals for adaptive walking of humanoid robots. IEEE Transactions on Cybernetics, 2018, 50, 613–626.10.1109/TCYB.2018.2870145 ↗
23. Wieber P B. Trajectory free linear model predictive control for stable walking in the presence of strong perturbations. Proceedings of 6th IEEE-RAS International Conference on Humanoid Robots, Genova, Italy, 2006, 137–142.
24. Diedam H, Dimitrov D, Wieber P B, Mombaur K, Diehl M. Online walking gait generation with adaptive foot positioning through linear model predictive control. Proceedings of IEEEIRSJ International Conference on Intelligent Robots and Systems (IROS), Nice, France, 2008, 1121–1126.
25. Herdt A, Diedam H, Wieber P B, Dimitrov D, Mombaur K, Diehl M. Online walking motion generation with automatic footstep placement. Advanced Robotics, 2010, 24, 719–737.10.1163/016918610X493552 ↗
26. Nishiwaki K, Kagami S. Strategies for adjusting the ZMP reference trajectory for maintaining balance in humanoid walking. Proceedings of IEEE International Conference on Robotics and Automation, Alaska, USA, 2010, 4230–4236.
27. Feng S, Xinjilefu X, Atkeson C G, Kim J. Robust dynamic walking using online foot step optimization. Proceedings of IEEEIRSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea, 2016, 5373–5378.
28. Kryczka P, Kormushev P, Tsagarakis N G, Caldwell D G. Online regeneration of bipedal walking gait pattern optimizing footstep placement and timing. Proceedings of IEEEIRSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany, 2015, 3352–3357.
29. Missura M, Behnke S. Online learning of foot placement for balanced bipedal walking. Proceedings of IEEE-RAS International Conference on Humanoid Robot, Madrid, Spain, 2014, 322–328.
30. Mssura M, Behnke S. Gradient-driven online learning of bipedal push recovery. Proceedings of IEEEIRSJ International Conference on Intelligent Robots and Systems (IROS), Hamburg, Germany, 2015, 387–392.
31. Xu T, Chen Q J, Cai Z Q. Rebalance strategies for huma-noids walking by foot positioning compensator based on adaptive heteroscedastic SpGPs. Proceedings of International Conference on Robotics and Automation (ICRA), Shanghai, China, 2011, 563–568.
32. Liu C J, Xu T, Wang D W, Chen Q J. Active balance of humanoids with foot positioning compensation and non-parametric adaptation. Robotics and Autonomous Systems, 2016, 75, 297–309.10.1016/j.robot.2015.09.016 ↗
33. Kohl N, Stone P. Policy gradient reinforcement learning for fast quadrupedal locomotion. Proceedings of International Conference on Robotics and Automation (ICRA), LA, USA, 2004, 3, 2619–2624.
34. Cherubini A, Giannone F, Iocchi L, Lombardo M, Oriolo G. Policy gradient learning for a humanoid soccer robot. Robotics and Autonomous Systems, 2009, 57, 808–818.10.1016/j.robot.2009.03.006 ↗
35. Kajita S, Hirukawa H. Humanoid Robot, Ohmsha Ltd, Tokyo, Japan, 2005.
36. Katayama T, Ohki T, Inoue T, Kato T. Design of an optimal controller for a discrete-time system subject to previewable demand. International Journal of Control, 1985, 41, 677–699.10.1080/0020718508961156 ↗
37. Liao F C, Chen P. Optimal preview control based on state observers for linear discrete-time systems. Journal of University of Science and Technology, 2014, 36, 390–398. (in Chinese)
38. Jadidi M G, Hashemi E. Optimal preview control of the nao biped robot using a ukf-based state observer. Proceedings of IEEE International Conference on Advanced Intelligent Mechatronics (AIM). Banff, Alberta, Canada, 2016, 52–57.
39. Shimmyo S, Sato T, Ohnishi K. Biped walking pattern generation by using preview control based on three-mass model. IEEE Transactions on Industrial Electronics, 2012, 60, 5137–5147.10.1109/TIE.2012.2221111 ↗
40. Zhou C X, Li Z B, Wang X, Tsagarakis N, Caldwell D. Stabilization of bipedal walking based on compliance control. Autonomous Robots, 2016, 40, 1041–1057.
41. Urbann O, Hofmann M. A reactive stepping algorithm based on preview controller with observer for biped robots. Proceedings of IEEEIRSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, Korea, 2016, 5324–5331.