journal article·2020-10-05Open access

Improved Uncalibrated Visual Servo Strategy for Hyper-Redundant Manipulators in On-Orbit Automatic Assembly

Jinlin Gu, Mingchao Zhu, Lihua Cao, Ang Li, Wenrui Wang, Zhenbang Xu

Applied Sciences· Volume 10· Issue 19

Abstract

Aiming at on-orbit automatic assembly, an improved uncalibrated visual servo strategy for hyper-redundant manipulators based on projective homography is proposed. This strategy uses an improved homography-based task function with lower dimensions while maintaining its robustness to image defects and noise. This not only improves the real-time performance but also makes the joint space of hyper-redundant manipulator redundant to the homography-based task function. Considering that the kinematic parameters of the manipulator are easily changed in a space environment, the total Jacobian between the task function and manipulator joints is estimated online and used to construct a controller to directly control the manipulator joints without a kinematics model. When designing the controller, the above-mentioned redundancy is exploited to solve the problem of the over-limiting of the joint angles of the manipulator. The KF-SVSF method, which combines the optimality of the Kalman filter (KF) and the robustness of the smooth variable structure filter (SVSF), is introduced to the field of uncalibrated visual servos for the first time to perform the online estimation of the total Jacobian. In addition, the singular value filtering (SVF) method is adopted for the first time to avoid the interference caused by the unstable condition number of the estimated total Jacobian. Finally, simulations and experiments verify the superiority of this strategy in terms of its real-time performance and precision.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Space Satellite Systems and Control · Robotics and Sensor-Based Localization · Advanced Vision and Imaging

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

CAS Key Laboratory of On-orbit Manufacturing and Integration for Space Optics System, Changchun Institute of Optics, Fine Mechanics and Physics, Chinese Academy of Sciences, Changchun 130000, China

University of Chinese Academy of Sciences, Beijing 100049, China

Center of Materials Science and Optoelectronics Engineering, University of Chinese Academy of Sciences, Beijing 100049, China

Funding

National Natural Science Foundation of China · Science and Technology Development Plan of Jilin province · Jilin Province and the Chinese Academy of Sciences Cooperation in Science and Technology High-Tech Industrialization Special Funds Project

References (49)

Show source-provided references
1. Adaptive Optics for Extremely Large Telescopes10.1142/S2251171719500016 ↗
2. A Deep Learning Strategy for On-Orbit Servicing Via Space Robotic Manipulator10.1007/s42496-019-00028-z ↗
3. Failure Tolerance Strategy of Space Manipulator for Large Load Carrying Tasks10.1016/j.actaastro.2018.04.052 ↗
4. On-Orbit Service (OOS) of Spacecraft: A Review of Engineering Developments10.1016/j.paerosci.2019.01.004 ↗
5. A Review of Space Robotics Technologies for on-Orbit Servicing10.1016/j.paerosci.2014.03.002 ↗
6. Survey of Modeling, Planning, and Ground Verification of Space Robotic Systems10.1016/j.actaastro.2010.12.004 ↗
7. Issues and Solutions for Testing Free-Flying Robots10.1016/j.actaastro.2006.11.014 ↗
8. A Parametric Analysis of a Controlled Deployable Space Manipulator for Capturing a Non-Cooperative Flexible Satellite10.1016/j.actaastro.2018.04.028 ↗
9. Time Delay Prediction for Space Telerobot System with a Modified Sparse Multivariate Linear Regression Method10.1016/j.actaastro.2019.10.027 ↗
10. Autonomous Robotic Capture of Non-Cooperative Target Using Visual Servoing and Motion Predictive Control10.1007/s10514-014-9383-2 ↗
11. Predictive Visual Servo Kinematic Control for Autonomous Robotic Capture of Non-Cooperative Space Target10.1016/j.actaastro.2018.06.015 ↗
12. GNC & Robotics for on Orbit Servicing With Simulated Vision in the Loop10.1016/j.actaastro.2019.06.005 ↗
13. Position-Based Visual Servo Control of Autonomous Robotic Manipulators10.1016/j.actaastro.2015.05.036 ↗
14. Bottin, M., Cocuzza, S., Comand, N., and Doria, A. (2020). Modeling and Identification of an Industrial Robot with a Selective Modal Approach. Appl. Sci., 10.10.3390/app10134619 ↗
15. Adaptive Homography-Based Visual Servo for Micro Unmanned Surface Vehicles10.1007/s00170-019-03994-7 ↗
16. Virtual Visual Servoing for Multicamera Pose Estimation10.1109/TMECH.2014.2305916 ↗
17. A Visual Servoing Strategy Under Limited Frame Rates for Planar Parallel Kinematic Machines10.1007/s10846-019-00982-7 ↗
18. Li, S., Li, D., Zhang, C., Wan, J., and Xie, M. (2020). RGB-D Image Processing Algorithm for Target Recognition and Pose Estimation of Visual Servo System. Sensors, 20.10.3390/s20020430 ↗
19. Cai, C., Somani, N., Nair, S., Mendoza, D., and Knoll, A. (2014, January 10–12). Uncalibrated Stereo Visual Servoing for Manipulators Using Virtual Impedance Control. Proceedings of the 13th International Conference on Control Automation Robotics & Vision (ICARCV), Singapore.10.1109/ICARCV.2014.7064604 ↗
20. A Unified Design Method for Adaptive Visual Tracking Control of Robots with Eye-in-Hand/Fixed Camera Configuration10.1016/j.automatica.2015.06.018 ↗
21. Shademan, A., and Jägersand, M. (2010, January 18–22). Three-View Uncalibrated Visual Servoing. Proceedings of the 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan.10.1109/IROS.2010.5649988 ↗
22. A Universal State-Space Approach to Uncalibrated Model-Free Visual Servoing10.1109/TMECH.2011.2131149 ↗
23. An Uncalibrated Visual Servo Method Based on Projective Homography10.1109/TASE.2017.2702195 ↗
24. Visual Homing from Scale with an Uncalibrated Omnidirectional Camera10.1109/TRO.2013.2272251 ↗
25. Robust Uncalibrated Visual Servoing Control Based on Disturbance Observer10.1016/j.isatra.2015.07.003 ↗
26. Trajectory Planning with Shortest Path for Modified Uncalibrated Visual Servoing Based on Projective Homography10.1109/TASE.2019.2954598 ↗
27. Robust Adaptive Visual Tracking Control for Uncertain Robotic Systems With Unknown Dead-Zone Inputs10.1016/j.jfranklin.2019.05.040 ↗
28. Calibration-Free and Model-Independent Method for High-DOF Image-Based Visual Servoing10.1007/s11768-013-0271-7 ↗
29. Comparison of Uncalibrated Model-Free Visual Servoing Methods for Small-Amplitude Movements: A Simulation Study10.5772/58822 ↗
30. Adaptive Image-Based Visual Servoing with Temporary Loss of the Visual Signal10.1109/TII.2018.2865004 ↗
31. Xiaolin, R., Hongwen, L., and Yuanchun, L. (2017, January 16–18). Online Image Jacobian Identification Using Optimal Adaptive Robust Kalman Filter for Uncalibrated Visual Servoing. Proceedings of the 2017 2nd Asia-Pacific Conference on Intelligent Robot Systems (ACIRS), Wuhan, China.10.1109/ACIRS.2017.7986064 ↗
32. Lv, X., and Huang, X. (2006, January 9–15). Fuzzy Adaptive Kalman Filtering based Estimation of Image Jacobian for Uncalibrated Visual Servoing. Proceedings of the 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems, Beijing, China.10.1109/IROS.2006.282555 ↗
33. Unscented Particle Filter for Online Total Image Jacobian Matrix Estimation in Robot Visual Servoing10.1109/ACCESS.2019.2927413 ↗
34. Robots Visual Servo Control with Features Constraint Employing Kalman-Neural-Network Filtering Scheme10.1016/j.neucom.2014.09.043 ↗
35. RETRACTED: Uncalibrated Dynamic Visual Servoing via Multivariate Adaptive Regression Splines and Improved Incremental Extreme Learning Machine10.1016/j.isatra.2019.02.029 ↗
36. Gu, J., Wang, W., Zhu, M., Lv, Y., Huo, Q., and Xu, Z. (2018, January 5–8). Research on A Technology of Automatic Assembly Based on Uncalibrated Visual Servo System. Proceedings of the 2018 IEEE International Conference on Mechatronics and Automation (ICMA), Changchun, China.10.1109/ICMA.2018.8484693 ↗
37. A Dynamic Quasi-Newton Method for Uncalibrated Visual Servoing10.1109/ROBOT.1999.772587 ↗
38. Zhao, Q., Zhang, L., and Chen, Y. (2008, January 3–5). Online Estimation Technique for Jacobian Matrix in Robot Visual Servo Systems. Proceedings of the 2008 3rd IEEE Conference on Industrial Electronics and Applications, Singapore.
39. Hartley, R., and Zisserman, A. (2004). Multiple View Geometry in Computer Vision, Cambridge University Press (CUP).10.1017/CBO9780511811685 ↗
40. A Novel Adaptive Kalman Filter With Inaccurate Process and Measurement Noise Covariance Matrices10.1109/TAC.2017.2730480 ↗
41. Dynamic Feedforward Control of Spatial Cable-Driven Hyper-Redundant Manipulators for on-Orbit Servicing10.1017/S026357471800084X ↗
42. A Weighted Least-Norm Solution Based Scheme for Avoiding Joint Limits for Redundant Joint Manipulators10.1109/70.370511 ↗
43. Least-Squares-Based Reaction Control of Space Manipulators10.2514/1.45874 ↗
44. Tringali, A., and Cocuzza, S. (2020). Globally Optimal Inverse Kinematics Method for a Redundant Robot Manipulator with Linear and Nonlinear Constraints. Robots, 9.10.3390/robotics9030061 ↗
45. Closed-Loop Inverse Kinematics for Redundant Robots: Comparative Assessment and Two Enhancements10.1109/TMECH.2014.2326304 ↗
46. A New Robust Filtering Strategy for Linear Systems10.1115/1.4006628 ↗
47. Kalman and Smooth Variable Structure Filters for Robust Estimation10.1109/TAES.2014.110768 ↗
48. A Multiple Model Adaptive SVSF-KF Estimation Strategy
49. Homography Propagation and Optimization for Wide-Baseline Street Image Interpolation10.1109/TVCG.2016.2618878 ↗