Robust Learning from Demonstration Based on GANs and Affine Transformation
Source abstract
Abstract
Collaborative robots face barriers to widespread adoption due to the complexity of programming them to achieve human-like movement. Learning from demonstration (LfD) has emerged as a crucial solution, allowing robots to learn tasks directly from expert demonstrations, offering versatility and an intuitive programming approach. However, many existing LfD methods encounter issues such as convergence failure and lack of generalization ability. In this paper, we propose: (1) a generative adversarial network (GAN)-based model with multilayer perceptron (MLP) architecture, coupled with a novel loss function designed to mitigate convergence issues; (2) an affine transformation-based generalization method aimed at enhancing LfD tasks by improving their generalization performance; (3) a data preprocessing method tailored to facilitate deployment on robotics platforms. We conduct experiments on a UR5 robotic platform tasked with handwritten digit recognition. Our results demonstrate that our proposed method significantly accelerates generation speed, achieving a remarkable processing time of 23 ms, which is five times faster than movement primitives (MPs), while preserving key features from demonstrations. This leads to outstanding convergence and generalization performance.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robot Manipulation and Learning · Machine Learning and Algorithms · AI-based Problem Solving and Planning
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
The College of Information, Mechanical and Electrical Engineering, Shanghai Normal University, Shanghai 201418, China
Funding
National Natural Science Foundation of China
References (32)
Show source-provided references
1. Working Together: A Review on Safe Human-Robot Collaboration in Industrial Environments10.1109/ACCESS.2017.2773127 ↗
2. Robot Skills for Manufacturing: From Concept to Industrial Deployment10.1016/j.rcim.2015.04.002 ↗
3. From Industry 4.0 to Robotics 4.0—A Conceptual Framework for Collaborative and Intelligent Robotic Systems10.1016/j.promfg.2020.03.085 ↗
4. Collaborative Manufacturing with Physical Human-Robot Interaction10.1016/j.rcim.2015.12.007 ↗
5. Active Collision Avoidance for Human–Robot Collaboration Driven by Vision Sensors10.1080/0951192X.2016.1268269 ↗
6. Human-Robot Collaboration: A Survey10.1142/S0219843608001303 ↗
7. Recent Advances in Robot Learning from Demonstration10.1146/annurev-control-100819-063206 ↗
8. Human-like Coordination Motion Learning for a Redundant Dual-Arm Robot10.1016/j.rcim.2018.12.017 ↗
9. Overcoming Some Drawbacks of Dynamic Movement Primitives10.1016/j.robot.2021.103844 ↗
10. Dynamic Movement Primitives Based Robot Skills Learning10.1007/s11633-022-1346-z ↗
11. Design of an Intelligent Robotic Precise Assembly System for Rapid Teaching and Admittance Control10.1016/j.rcim.2020.101946 ↗
12. Sung, H.G. (2004). Gaussian Mixture Regression and Classification. [Doctoral Thesis, Rice University].
13. Learning Stable Nonlinear Dynamical Systems with Gaussian Mixture Models10.1109/TRO.2011.2159412 ↗
14. Kernelized Movement Primitives10.1177/0278364919846363 ↗
15. Ziebart, B.D., Maas, A., Bagnell, J.A., and Dey, A.K. (2008, January 7–14). Maximum Entropy Inverse Reinforcement Learning. Proceedings of the 23rd AAAI Conference on Artificial Intelligence, AAAI 2008, Washington, DC, USA.
16. Peng, X.B., Kanazawa, A., Toyer, S., Abbeel, P., and Levine, S. (2019, January 6–9). Variational Discriminator Bottleneck: Improving Imitation Learning, Inverse RL, and GANs by Constraining Information Flow. Proceedings of the 7th International Conference on Learning Representations, ICLR 2019, New Orleans, LA, USA.
17. Fei, C., Wang, B., Zhuang, Y., Zhang, Z., Hao, J., Zhang, H., Ji, X., and Liu, W. (2020, January 11–17). Triple-GAIL: A Multi-Modal Imitation Learning Framework with Generative Adversarial Nets. Proceedings of the IJCAI International Joint Conference on Artificial Intelligence, Yokohama, Japan.10.24963/ijcai.2020/405 ↗
18. Deterministic Generative Adversarial Imitation Learning10.1016/j.neucom.2020.01.016 ↗
19. Joint Entity and Event Extraction with Generative Adversarial Imitation Learning10.1162/dint_a_00014 ↗
20. Jiang, H., Yamanoi, Y., Kuroda, Y., Chen, P., Togo, S., Jiang, Y., and Yokoi, H. (2023, January 14–16). Conditional Generative Adversarial Network-Based Finger Position Estimation for Controlling Multi-Degrees-of-Freedom Myoelectric Prosthetic Hands. Proceedings of the 2022 IEEE International Conference on Cyborg and Bionic Systems, CBS 2022, Wuhan, China.10.1109/CBS55922.2023.10115366 ↗
21. Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., and Courville, A. (2017, January 4–9). Improved Training of Wasserstein GANs. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA.
22. On Imitation Learning of Robot Movement Trajectories: A Survey
23. Le Guen, V., and Thome, N. (2019, January 8–14). Shape and Time Distortion Loss for Training Deep Time Series Forecasting Models. Proceedings of the Advances in Neural Information Processing Systems, Vancouver, BC, Canada.
24. Shadmehr, R., and Wise, S.P. (2005). Supplementary Documents for “Computational Neurobiology of Reaching and Pointing”, The MIT Press.
25. Adaptation and Robust Learning of Probabilistic Movement Primitives10.1109/TRO.2019.2937010 ↗
26. ProDMP: A Unified Perspective on Dynamic and Probabilistic Movement Primitives10.1109/LRA.2023.3248443 ↗
27. GAN-Based Editable Movement Primitive from High-Variance Demonstrations10.1109/LRA.2023.3285473 ↗
28. Trajectory Generation with Spatio-Temporal Templates Learned from Demonstrations10.1109/TIE.2016.2613843 ↗
29. Generative Adversarial Networks10.1145/3422622 ↗
30. Cuturi, M., and Blondel, M. (2017, January 6–11). Soft-DTW: A Differentiable Loss Function for Time-Series. Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, Australia.
31. Ketkar, N., and Moolayil, J. (2021). Deep Learning with Python, CreateSpace Independent Publishing Platform.10.1007/978-1-4842-5364-9 ↗
32. Cowley, B.R., Semedo, J.D., Zandvakili, A., Smith, M.A., Kohn, A., and Yu, B.M. (2017, January 20–22). Distance Covariance Analysis. Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, AISTATS 2017, Lauderdale, FL, USA.