Improving the Manipulability of a Redundant Arm Using Decoupled Hybrid Visual Servoing
Source abstract
Abstract
This study proposes a hybrid visual servoing technique that is optimised to tackle the shortcomings of classical 2D, 3D and hybrid visual servoing approaches. These shortcomings are mostly the convergence issues, image and robot singularities, and unreachable trajectories for the robot. To address these deficiencies, 3D estimation of the visual features was used to control the translations in Z-axis as well as all rotations. To speed up the visual servoing (VS) operation, adaptive gains were used. Damped Least Square (DLS) approach was used to reduce the robot singularities and smooth out the discontinuities. Finally, manipulability was established as a secondary task, and the redundancy of the robot was resolved using the classical projection operator. The proposed approach is compared with the classical 2D, 3D and hybrid visual servoing methods in both simulation and real-world. The approach offers more efficient trajectories for the robot, with shorter camera paths than 2D image-based and classical hybrid VS methods. In comparison with the traditional position-based approach, the proposed method is less likely to lose the object from the camera scene, and it is more robust to the camera calibrations. Moreover, the proposed approach offers greater robot controllability (higher manipulability) than other approaches.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Vision and Imaging · Image Processing Techniques and Applications · Robotics and Sensor-Based Localization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Metallurgy & Materials Science, University of Birmingham, Birmingham B15 2TT, UK
The Faraday Institution, Quad One, Harwell Science and Innovation Campus, Didcot OX11 0RA, UK
Funding
The Faraday Institution
References (38)
Show source-provided references
1. Servoing, V. (1993). Real Time Control of Robot Manipulators Based on Visual Sensory Feedback, World Scientific.
2. Mansard, N., and Chaumette, F. (2005, January 2–6). A new redundancy formalism for avoidance in visual servoing. Proceedings of the 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems, Edmonton, AB, Canada.10.1109/IROS.2005.1545222 ↗
3. Chaumette, F., Hutchinson, S., and Corke, P. (2016). Visual servoing. Springer Handbook of Robotics, Springer.10.1007/978-3-319-32552-1_34 ↗
4. Towards robotizing the processes of testing lithium-ion batteries
5. Vicentini, F., Pedrocchi, N., Beschi, M., Giussani, M., Iannacci, N., Magnoni, P., Pellegrinelli, S., Roveda, L., Villagrossi, E., and Askarpour, M. (2020). PIROS: Cooperative, safe and reconfigurable robotic companion for CNC pallets load/unload stations. Bringing Innovative Robotic Technologies from Research Labs to Industrial End-Users, Springer.10.1007/978-3-030-34507-5_4 ↗
6. Rastegarpanah, A., Aflakian, A., and Stolkin, R. (2021). Optimized hybrid decoupled visual servoing with supervised learning. Proc. Inst. Mech. Eng. Part I J. Syst. Control. Eng.10.1177/09596518211028379 ↗
7. Interlinked visual tracking and robotic manipulation of articulated objects10.1109/LRA.2018.2835515 ↗
8. Roveda, L., Castaman, N., Ghidoni, S., Franceschi, P., Boscolo, N., Pagello, E., and Pedrocchi, N. (2018, January 7–10). Human-robot cooperative interaction control for the installation of heavy and bulky components. Proceedings of the 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC), Miyazaki, Japan.10.1109/SMC.2018.00067 ↗
9. Visual servo control Part I: Basic approaches10.1109/MRA.2006.250573 ↗
10. Stability and robustness of visual servoing methods10.1109/ROBOT.2002.1014772 ↗
11. Han, X.F., Laga, H., and Bennamoun, M. (2019). Image-based 3D Object Reconstruction: State-of-the-Art and Trends in the Deep Learning Era. arXiv.
12. Chaumette, F. (1998). Potential problems of stability and convergence in image-based and position-based visual servoing. The Confluence of Vision and Control, Springer.10.1007/BFb0109663 ↗
13. A new partitioned approach to image-based visual servo control10.1109/70.954764 ↗
14. A comparison between position-based and image-based dynamic visual servoings in the control of a translating parallel manipulator
15. Towards manipulability of interactive Lagrangian systems10.1016/j.automatica.2020.108913 ↗
16. Corke, P. (2017). Robotics, Vision and Control: Fundamental Algorithms in MATLAB® Second, Completely Revised, Springer.
17. Stable visual servoing through hybrid switched-system control10.1109/TRO.2007.895067 ↗
18. Kumar, D.S., and Jawahar, C. (2006). Robust homography-based control for camera positioning in piecewise planar environments. Computer Vision, Graphics and Image Processing, Springer.10.1007/11949619_81 ↗
19. Keeping features in the field of view in eye-in-hand visual servoing: A switching approach10.1109/TRO.2004.829456 ↗
20. Improving image-based visual servoing with three-dimensional features10.1177/027836490302210003 ↗
21. 2 1/2 D visual servoing10.1109/70.760345 ↗
22. Quaternion-based visual servo control in the presence of camera calibration error10.1002/rnc.1438 ↗
23. Marey, M., and Chaumette, F. (2010, January 3–7). A new large projection operator for the redundancy framework. Proceedings of the 2010 IEEE International Conference on Robotics and Automation, Anchorage, AK, USA.10.1109/ROBOT.2010.5509189 ↗
24. Directional redundancy for robot control10.1109/TAC.2009.2019790 ↗
25. Basic optimization methods of redundant manipulators10.1002/(SICI)1098-2728(1996)8:1<49::AID-LRA6>3.0.CO;2-X ↗
26. A redundancy-based iterative approach for avoiding joint limits: Application to visual servoing10.1109/70.964671 ↗
27. Strategies for increasing the tracking region of an eye-in-hand system by singularity and joint limit avoidance10.1177/027836499501400304 ↗
28. Automatic supervisory control of the configuration and behavior of multibody mechanisms10.1109/TSMC.1977.4309644 ↗
29. Hu, G., Gans, N.R., and Dixon, W.E. (2009). Adaptive Visual Servo Control, Springer.10.1007/978-0-387-30440-3_3 ↗
30. Dealing with constraints in sensor-based robot control10.1109/TRO.2013.2281560 ↗
31. Spong, M. (2006). Hutchinso, n. Seth, and MV Vidyasagar, “Robot Modeling and Control”, John Wiley& Sons.
32. Task-priority formulations for the kinematic control of highly redundant articulated structures
33. Numerical filtering for the operation of robotic manipulators through kinematically singular configurations10.1002/rob.4620050603 ↗
34. A framework for the control of nonholonomic mobile manipulators10.1177/0278364906068374 ↗
35. Vahrenkamp, N., Asfour, T., Metta, G., Sandini, G., and Dillmann, R. (December, January 29). Manipulability analysis. Proceedings of the 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012), Osaka, Japan.10.1109/HUMANOIDS.2012.6651576 ↗
36. Disassembly of electric vehicle batteries using the example of the Audi Q5 hybrid system10.1016/j.procir.2014.10.098 ↗
37. Techno-economic and environmental disassembly planning of lithium-ion electric vehicle battery packs for remanufacturing10.1016/j.resconrec.2019.104461 ↗
38. Pistoia, G., and Liaw, B. (2018). Behaviour of Lithium-Ion Batteries in Electric Vehicles: Battery Health, Performance, Safety, and Cost, Springer.10.1007/978-3-319-69950-9 ↗