Dual-Arm Peg-in-Hole Assembly Using DNN with Double Force/Torque Sensor
Source abstract
Abstract
Assembly tasks executed by a robot have been studied broadly. Robot assembly applications in industry are achievable by a well-structured environment, where the parts to be assembled are located in the working space by fixtures. Recent changes in manufacturing requirements, due to unpredictable demanded products, push the factories to seek new smart solutions that can autonomously recover from failure conditions. In this way, new dual arm robot systems have been studied to design and explore applications based on its dexterity. It promises the possibility to get rid of fixtures in assembly tasks, but using less fixtures increases the uncertainty on the location of the components in the working space. It also increases the possibility of collisions during the assembly sequence. Under these considerations, adding perception such as force/torque sensors have been done to produce useful data to perform control actions. Unfortunately, the interaction forces between mating parts produced non-linear behavior. Consequently, machine learning algorithms have been considered an alternative tool to avoid the non-linearity. In this work we introduce an assembly strategy for an industrial dual arm robot based on the combination of a discrete event controller and Deep Neural Networks (DNN) to solve the peg-in-hole assembly. Our results show the difference between the use of DNN with one and with two force/torque sensors during the assembly task and demonstrate a 30% increase in the assembly success ratio when using a double force/torque sensor.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robot Manipulation and Learning · Manufacturing Process and Optimization · Innovations in Concrete and Construction Materials
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Centro de Ingenieria y Desarrollo Industrial (CIDESI), Apodaca 66628, Mexico
Faculty of Science, Concordia University of Edmonton, Information Technology, Edmonton, AB T5B 4E4, Canada
Centre for Research and Advanced Studies (CINVESTAV), Ramos Arizpe 25900, Mexico
References (38)
Show source-provided references
1. Robotic assembly of threaded fasteners in a non-structured environment10.1007/s00170-018-2363-5 ↗
2. Dual arm manipulation—A survey10.1016/j.robot.2012.07.005 ↗
3. Staff, I. (2017). Towards learning contact states during peg-in-hole assembly with a dual-arm robot. 2017 CHILEAN Conference on Electrical, Electronics Engineering, Information and Communication Technologies (CHILECON), IEEE.
4. A Survey of Dual-Arm Robotic Issues on Assembly Tasks10.1007/978-3-319-78963-7_59 ↗
5. Robotized Assembly Process Using Dual Arm Robot10.1016/j.procir.2014.10.078 ↗
6. Rojas, J., Guan, T., Luo, W., and Harada, K. (2014, January 5–10). Strategies, controllers, and coordination: Bi-manual snap assembly automation. Proceedings of the 2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014, Bali, Indonesia.10.1109/ROBIO.2014.7090507 ↗
7. Zhang, X., Zheng, Y., Ota, J., and Huang, Y. (2017). Peg-in-hole assembly based on two-phase scheme and F/T sensor for dual-arm robot. Sensors, 17.10.3390/s17092004 ↗
8. Polverini, M.P., Zanchettin, A.M., Castello, S., and Rocco, P. (2016, January 16–21). Sensorless and constraint based peg-in-hole task execution with a dual-arm robot. Proceedings of the IEEE International Conference on Robotics and Automation, Stockholm, Sweden.10.1109/ICRA.2016.7487161 ↗
9. A Sensor-Based Dual-Arm Tele-Robotic System10.1109/TASE.2014.2333754 ↗
10. Levine, S., and Abbeel, P. (2014). Learning Neural Network Policies with Guided Policy Search under Unknown Dynamics, MIT Press.
11. Intuitive dual arm robot programming for assembly operations10.1016/j.cirp.2014.03.017 ↗
12. Dual arm robot for flexible and cooperative assembly10.1016/j.cirp.2011.03.017 ↗
13. Almeida, D., and Karayiannidis, Y. (2016, January 16–21). Folding assembly by means of dual-arm robotic manipulation. Proceedings of the 2016 IEEE International Conference on Robotics and Automation (ICRA), Stockholm, Sweden.10.1109/ICRA.2016.7487588 ↗
14. Xu, J., Hou, Z., Liu, Z., and Qiao, H. (2019). Compare Contact Model-Based Control and Contact Model-Free Learning: A Survey of Robotic Peg-in-Hole Assembly Strategies). arXiv.
15. Ren, T., Dong, Y., Wu, D., and Chen, K. (2018). Learning-Based Variable Compliance Control for Robotic Assembly. J. Mech. Robot., 10.10.1115/1.4041331 ↗
16. Inoue, T., Magistris, G.D., Munawar, A., Yokoya, T., and Tachibana, R. (2017, January 24–28). Deep reinforcement learning for high precision assembly tasks. Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2017), Vancouver, BC, Canada.10.1109/IROS.2017.8202244 ↗
17. Peg-in-hole assembly based on master-slave coordination for a compliant dual-arm robot10.1108/AA-10-2018-0164 ↗
18. Interpretation of force and moment signals for compliant peg-in-hole assembly
19. Perception-based learning for motion in contact in task planning10.1007/BF00339665 ↗
20. Gullapalli, V., Grupen, R.A., and Barto, A.G. (1992). Learning reactive admittance control. 1992 IEEE International Conference on Robotics and Automation, IEEE Computer Society Press.10.1109/ROBOT.1992.220143 ↗
21. Task primitives for the discrete event modeling and control of 6-DOF assembly tasks10.1109/70.488947 ↗
22. Learning Force Control for Contact-Rich Manipulation Tasks With Rigid Position-Controlled Robots10.1109/LRA.2020.3010739 ↗
23. An Approach for Peg-in-Hole Assembling using Intuitive Search Algorithm based on Human Behavior and Carried by Sensors Guided Industrial Robot10.1016/j.ifacol.2015.06.295 ↗
24. Chung, S.Y., and Doo Yong, L. (2001, January 25–27). Discrete event systems approach to fixtureless peg-in-hole assembly. Proceedings of the 2001 American Control Conference (Cat. No.01CH37148), Arlington, VA, USA.
25. Hwang, M.J., Lee, D.Y., and Chung, S.Y. (2007, January 7–10). Motion planning of bimanual robot for assembly. Proceedings of the IEEE International Conference on Systems, Man and Cybernetics, Montreal, QC, Canada.
26. Model accelerated reinforcement learning for high precision robotic assembly10.1007/s41315-020-00138-z ↗
27. Symbolic-Based Recognition of Contact States for Learning Assembly Skills10.3389/frobt.2019.00099 ↗
28. Contact-state monitoring of force-guided robotic assembly tasks using expectation maximization-based Gaussian mixtures models10.1007/s00170-014-5803-x ↗
29. Compliance-Based Robotic Peg-in-Hole Assembly Strategy without Force Feedback10.1109/TIE.2017.2682002 ↗
30. Robotic Assembly of Rounded Parts With and Without Threads10.1109/LRA.2020.2972878 ↗
31. An augmented Petri net for modelling and control of assembly tasks with uncertainties10.1080/0951192052000288198 ↗
32. Tang, T., Lin, H.C., and Tomizuka, M. (2015). A Learning-Based Framework for Robot Peg-Hole-Insertion. Volume 2: Diagnostics and Detection; Drilling; Dynamics and Control of Wind Energy Systems; Energy Harvesting; Estimation and Identification; Flexible and Smart Structure Control; Fuels Cells/Energy Storage; Human Robot Interaction; HVAC Building Energy Management; Industrial Applications; Intelligent Transportation Systems; Manufacturing; Mechatronics; Modelling and Validation; Motion and Vibration Control Applications, American Society of Mechanical Engineers.10.1115/DSCC2015-9703 ↗
33. Dietrich, F., Buchholz, D., Wobbe, F., Sowinski, F., Raatz, A., Schumacher, W., and Wahl, F.M. (2010, January 18–22). On contact models for assembly tasks: Experimental investigation beyond the peg-in-hole problem on the example of force-torque maps. Proceedings of the IEEE/RSJ 2010 International Conference on Intelligent Robots and Systems, IROS 2010 - Conference Proceedings, Taipei, Taiwan.10.1109/IROS.2010.5652704 ↗
34. Compliant Peg-in-Hole Assembly Using Partial Spiral Force Trajectory with Tilted Peg Posture10.1109/LRA.2020.3000428 ↗
35. Visualizing Data using t-SNE
36. A literature survey on algorithms for multi-label learning
37. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2021, March 13). TensorFlow: Large-Scale Machine Learning on Heterogeneous Systems, 2015. Available online: tensorflow.org.
38. Scikit-learn: Machine Learning in Python