Grasp Planning Pipeline for Robust Manipulation of 3D Deformable Objects with Industrial Robotic Hand + Arm Systems
Source abstract
Abstract
In the grasping and manipulation of 3D deformable objects by robotic hands, the physical contact constraints between the fingers and the object have to be considered in order to validate the robustness of the task. Nevertheless, previous works rarely establish contact interaction models based on these constraints that enable the precise control of forces and deformations during the grasping process. This paper considers all steps of the grasping process of deformable objects in order to implement a complete grasp planning pipeline by computing the initial contact points (pregrasp strategy), and later, the contact forces and local deformations of the contact regions while the fingers close over the grasped object (grasp strategy). The deformable object behavior is modeled using a nonlinear isotropic mass-spring system, which is able to produce potential deformation. By combining both models (the contact interaction and the object deformation) in a simulation process, a new grasp planning method is proposed in order to guarantee the stability of the 3D grasped deformable object. Experimental grasping experiments of several 3D deformable objects with a Barrett hand (3-fingered) and a 6-DOF industrial robotic arm are executed. Not only will the final stable grasp configuration of the hand + object system be obtained, but an arm + hand approaching strategy (pregrasp) will also be computed.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Robot Manipulation and Learning · Soft Robotics and Applications · Robotic Mechanisms and Dynamics
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
LINEACT Laboratory, EA 7527, CESI ROUEN, 76800 Saint-Étienne-du-Rouvray, France
CNRS, SIGMA Clermont, Institut Pascal, Université Clermont Auvergne, F-63000 Clermont-Ferrand, France
Funding
H2020 Industrial Leadership
References (56)
Show source-provided references
1. An overview of 3D object grasp synthesis algorithms10.1016/j.robot.2011.07.016 ↗
2. Finger readjustment algorithm for object manipulation based on tactile information10.5772/53561 ↗
3. Adjigble, M., Marturi, N., Ortenzi, V., Rajasekaran, V., Corke, P., and Stolkin, R. (2018, January 1–5). Model-free and learning-free grasping by local contact moment matching. Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.10.1109/IROS.2018.8594226 ↗
4. Estimation and exploitation of objects’ inertial parameters in robotic grasping and manipulation: A survey10.1016/j.robot.2019.103374 ↗
5. Wang, C., Zhang, X., Zang, X., Liu, Y., Ding, G., Yin, W., and Zhao, J. (2020). Feature Sensing and Robotic Grasping of Objects with Uncertain Information: A Review. Sensors, 20.10.3390/s20133707 ↗
6. Deng, Z., Jonetzko, Y., Zhang, L., and Zhang, J. (2020). Grasping Force Control of Multi-Fingered Robotic Hands through Tactile Sensing for Object Stabilization. Sensors, 20.10.3390/s20041050 ↗
7. Clamping Fixture Design Methodology for the Proper Workpiece Insertion
8. Xiong, C., Liu, H., Huang, Y., and Xiong, Y. (2008). Clamping Fixtures for Intelligent Cell Manufacturing. Intelligent Robotics and Applications, Springer.10.1007/978-3-540-88518-4 ↗
9. Faure, F., Duriez, C., Delingette, H., Allard, J., Gilles, B., Marchesseau, S., Talbot, H., Courtecuisse, H., Bousquet, G., and Peterlik, I. (2012). Sofa: A multi-model framework for interactive physical simulation. Soft Tissue Biomechanical Modeling for Computer Assisted Surgery, Springer.10.1007/8415_2012_125 ↗
10. Long, P., Khalil, W., and Martinet, P. (2014, January 14–18). Force/vision control for robotic cutting of soft materials. Proceedings of the 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA.10.1109/IROS.2014.6943233 ↗
11. Soft material modeling for robotic task formulation and control in the muscle separation process10.1016/j.rcim.2014.09.003 ↗
12. Nadon, F., Valencia, A.J., and Payeur, P. (2018). Multi-modal sensing and robotic manipulation of non-rigid objects: A survey. Robotics, 7.10.3390/robotics7040074 ↗
13. Janech, J., Kostolny, J., and Gratkowski, T. (2017). Integration of Inertial Sensor Data into Control of the Mobile Platform. Advances in Intelligent Systems and Computing, Proceedings of the 2015 Federated Conference on Software Development and Object Technologies, Žilina, Slovakia, 19–20 November 2017, Springer International Publishing.10.1007/978-3-319-46535-7 ↗
14. Utilization of Strategies to Generate and Optimize Machining Sequences in CAD/CAM10.1016/j.proeng.2017.06.020 ↗
15. Robotic manipulation and sensing of deformable objects in domestic and industrial applications: A survey10.1177/0278364918779698 ↗
16. Visual quality measures for characterizing planar robot grasps10.1109/TSMCC.2004.840061 ↗
17. Grasp quality measures: Review and performance10.1007/s10514-014-9402-3 ↗
18. On grasp quality measures: Grasp robustness and contact force distribution in underactuated and compliant robotic hands10.1109/LRA.2016.2612304 ↗
19. Soler, F., Rojas-de Silva, A., and Suárez, R. (2017). Grasp quality measures for transferring objects. Advances in Intelligent Systems and Computing, Proceedings of the Iberian Robotics Conference, Seville, Spain, 22–24 November 2017, Springer.10.1007/978-3-319-70836-2_3 ↗
20. Wakamatsu, H., Hirai, S., and Iwata, K. (1996, January 22–28). Static analysis of deformable object grasping based on bounded force closure. Proceedings of the EEE International Conference on Robotics and Automation, Minneapolis, MN, USA.
21. Mira, D., Delgado, A., Mateo, C., Puente, S., Candelas, F., and Torres, F. (2015, January 16–19). Study of dexterous robotic grasping for deformable objects manipulation. Proceedings of the 2015 23rd Mediterranean Conference on Control and Automation (MED), Torremolinos, Spain.10.1109/MED.2015.7158760 ↗
22. Xu, J., Danielczuk, M., Ichnowski, J., Mahler, J., Steinbach, E., and Goldberg, K. (August, January 31). Minimal Work: A Grasp Quality Metric for Deformable Hollow Objects. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.10.1109/ICRA40945.2020.9197062 ↗
23. An adaptive robotic system for doing pick and place operations with deformable objects10.1007/s10846-018-0958-6 ↗
24. On the closure properties of robotic grasping10.1177/027836499501400402 ↗
25. Lei, Q., and Wisse, M. (2016, January 13–15). Object grasping by combining caging and force closure. Proceedings of the 2016 14th International Conference on Control, Automation, Robotics and Vision (ICARCV), Phuket, Thailand.10.1109/ICARCV.2016.7838638 ↗
26. Optimizing force closure grasps on 3D objects using a modified genetic algorithm10.1007/s00500-016-2377-6 ↗
27. Kaboli, M., Yao, K., and Cheng, G. (2016, January 15–17). Tactile-based manipulation of deformable objects with dynamic center of mass. Proceedings of the 2016 IEEE-RAS 16th International Conference on Humanoid Robots (Humanoids), Cancun, Mexico.10.1109/HUMANOIDS.2016.7803358 ↗
28. Video-based slip sensor for multidimensional information detecting in deformable object grasp10.1016/j.robot.2017.01.001 ↗
29. A regularized contact model with asymmetric damping and dwell-time dependent friction10.1023/B:MUBO.0000029392.21648.bc ↗
30. Dealing with multiple contacts in a human-in-the-loop application10.1007/s11044-010-9230-y ↗
31. Mohammadi, M., Baldi, T.L., Scheggi, S., and Prattichizzo, D. (2016, January 8–11). Fingertip force estimation via inertial and magnetic sensors in deformable object manipulation. Proceedings of the 2016 IEEE Haptics Symposium (HAPTICS), Philadelphia, PA, USA.10.1109/HAPTICS.2016.7463191 ↗
32. High-gain nonlinear observer-based impedance control for deformable object cooperative teleoperation with nonlinear contact model10.1002/rnc.4880 ↗
33. Model-based strategy for grasping 3D deformable objects using a multi-fingered robotic hand10.1016/j.robot.2017.06.011 ↗
34. Modeling of Deformable Objects for Robotic Manipulation: A Tutorial and Review10.3389/frobt.2020.00082 ↗
35. Mass-spring model for simulation of heart valve tissue mechanical behavior10.1007/s10439-011-0278-5 ↗
36. Jarrousse, O. (2014). Modified Mass-Spring System for Physically Based Deformation Modeling, KIT Scientific Publishing.
37. Grasping and manipulation of deformable objects based on internal force requirements10.5772/5747 ↗
38. Han, L., Hipwell, J., Taylor, Z., Tanner, C., Ourselin, S., and Hawkes, D.J. (2010). Fast deformation simulation of breasts using GPU-based dynamic explicit finite element method. Digital Mammography, Springer.10.1007/978-3-642-13666-5_98 ↗
39. Tagawa, K., Hirota, K., and Hirose, M. (2010). Manipulation of Dynamically Deformable Object Using Impulse-Based Approach, INTECH Open Access Publisher.10.5772/8707 ↗
40. Zaidi, L., Bouzgarrou, B.C., Sabourin, L., and Mezouar, Y. (2014, January 3–5). Modeling and analysis of 3D deformable object grasping. Proceedings of the 2014 23rd International Conference on Robotics in Alpe-Adria-Danube Region (RAAD), Smolenice, Slovakia.
41. Berenson, D. (2013, January 3–7). Manipulation of deformable objects without modeling and simulating deformation. Proceedings of the 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, Tokyo, Japan.10.1109/IROS.2013.6697007 ↗
42. Nadon, F., and Payeur, P. (2019, January 17–18). Automatic Selection of Grasping Points for Shape Control of Non-Rigid Objects. Proceedings of the 2019 IEEE International Symposium on Robotic and Sensors Environments (ROSE), Ottawa, ON, Canada.10.1109/ROSE.2019.8790383 ↗
43. Grasping deformable planar objects: Squeeze, stick/slip analysis, and energy-based optimalities10.1177/0278364913512170 ↗
44. Blind Manipulation of Deformable Objects Based on Force Sensing and Finite Element Modeling10.3389/frobt.2020.00073 ↗
45. Picking up a soft 3D object by feeling the grip10.1177/0278364914564232 ↗
46. Jorgensen, T.B., Holm, P.H.S., Petersen, H.G., and Krüger, N. (2015). Optimizing Pick and Place Operations in a Simulated Work Cell For Deformable 3D Objects. Lecture Notes in Computer Science, Proceedings of the International Conference on Intelligent Robotics and Applications, Portsmouth, UK, 24–27 August 2015, Springer.10.1007/978-3-319-22876-1_37 ↗
47. Three-Dimensional Deformable Object Manipulation Using Fast Online Gaussian Process Regression10.1109/LRA.2018.2793339 ↗
48. Verleysen, A., Holvoet, T., Proesmans, R., Den Haese, C., and Wyffels, F. (2020). Simpler Learning of Robotic Manipulation of Clothing by Utilizing DIY Smart Textile Technology. Appl. Sci., 10.10.3390/app10124088 ↗
49. Caporali, A., and Palli, G. (2020, January 8–11). Pointcloud-based Identification of Optimal Grasping Poses for Cloth-like Deformable Objects. Proceedings of the 2020 25th IEEE International Conference on Emerging Technologies and Factory Automation (ETFA), Vienna, Austria.10.1109/ETFA46521.2020.9211879 ↗
50. Hasan, M.R., Vepa, R., Shaheed, H., and Huijberts, H. (2013, January 10–12). Modelling and Control of the Barrett Hand for Grasping. Proceedings of the 2013 UKSim 15th International Conference on Computer Modelling and Simulation, Cambridge, UK.10.1109/UKSim.2013.142 ↗
51. Measurement and modeling of normal contact stiffness and contact damping at the meso scale10.1115/1.1857920 ↗
52. Johnson, K.L., and Johnson, K.L. (1987). Contact Mechanics, Cambridge University Press.
53. Silva, M.F., Luís Lima, J., Reis, L.P., Sanfeliu, A., and Tardioli, D. (2020). A Manipulation Control Strategy for Granular Materials Based on a Gaussian Mixture Model. Advances in Intelligent Systems and Computing, Proceedings of the Robot 2019: Fourth Iberian Robotics Conference, Porto, Portugal, 20–22 November 2019, Springer International Publishing.10.1007/978-3-030-35990-4_55 ↗
54. Sanchez, J., Mateo, C.M., Corrales, J.A., Bouzgarrou, B., and Mezouar, Y. (2018, January 1–5). Online Shape Estimation based on Tactile Sensing and Deformation Modeling for Robot Manipulation. Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.10.1109/IROS.2018.8594314 ↗
55. Aranda, M., Corrales, J.A., and Mezouar, Y. (2019, January 20–24). Deformation-based shape control with a multirobot system. Proceedings of the 2019 International Conference on Robotics and Automation (ICRA), Montreal, QC, Canada.10.1109/ICRA.2019.8793811 ↗
56. Corrales Ramón, J.A., Perdereau, V., and Torres Medina, F. (2013, January 6–10). Multi-fingered robotic hand planner for object reconfiguration through a rolling contact evolution model. Proceedings of the 2013 IEEE International Conference on Robotics and Automation, Karlsruhe, Germany.10.1109/ICRA.2013.6630638 ↗