journal article·2024-10-09Open access

Energy-Aware Camera Location Search Algorithm for Increasing Precision of Observation in Automated Manufacturing

Rongfei Li, Francis F. Assadian

Applied Sciences· Volume 14· Issue 19

Abstract

Visual servoing technology is well developed and applied in many automated manufacturing tasks, especially in tools’ pose alignment. To access a full global view of tools, most applications adopt an eye-to-hand configuration or an eye-to-hand/eye-in-hand cooperation configuration in an automated manufacturing environment. Most research papers mainly put efforts into developing control and observation architectures in various scenarios, but few have discussed the importance of the camera’s location in the eye-to-hand configuration. In a manufacturing environment, the quality of camera estimations may vary significantly from one observation location to another, as the combined effects of environmental conditions result in different noise levels of a single image shot in different locations. In this paper, we propose an algorithm for the camera’s moving policy so that it explores the camera workspace and searches for the optimal location where the image’s noise level is minimized. Also, this algorithm ensures the camera ends up at a suboptimal (if the optimal one is unreachable) location among the locations already searched with the limited energy available for moving the camera. Unlike a simple brute-force approach, the algorithm enables the camera to explore space more efficiently by adapting the search policy by learning the environment. With the aid of an image-averaging technique, this algorithm, in the use of a solo camera, achieves observation accuracy in eye-to-hand configurations to a desirable extent without filtering out high-frequency information in the original image. An automated manufacturing application was simulated, and the results show the success of this algorithm’s improvement in observation precision with limited energy.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Vision and Imaging · Industrial Vision Systems and Defect Detection · Image and Object Detection Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Mechanical and Aerospace Engineering, University of California, Davis, CA 95616, USA

References (38)

Show source-provided references
1. Chang, W.-C., and Wu, C.-H. (2017, January 22–24). Automated USB peg-in-hole assembly employing visual servoing. Proceedings of the 3rd International Conference on Control, Automation and Robotics (ICCAR), Nagoya, Japan.10.1109/ICCAR.2017.7942717 ↗
2. A noncontact control strategy for circular peg-in-hole assembly guided by the 6-DOF robot based on hybrid vision
3. Sensor-based control using an image point and distance features for rivet-in-hole insertion10.1109/TIE.2019.2927186 ↗
4. Automated Hooking of Biomedical Microelectrode Guided by Intelligent Microscopic Vision10.1109/TMECH.2023.3248112 ↗
5. Huang, Z., and Wang, J. (2013). Automatic Alignment Welding Device and Alignment Method Thereof. (No. CN103785950A), Patent.
6. A contour-guided pose alignment method based on Gaussian mixture model for precision assembly10.1108/AA-08-2020-0103 ↗
7. Visual servo control Part I: Basic approaches10.1109/MRA.2006.250573 ↗
8. Robotic grasping and alignment for small size components assembly based on visual servoing10.1007/s00170-019-04800-0 ↗
9. Image-Based Visual Servoing for Position Alignment with Orthogonal Binocular Vision10.1109/TIM.2023.3289560 ↗
10. Flandin, G., Chaumette, F., and Marchand, E. (2000, January 24–28). Eye-in-hand/eye-to-hand cooperation for visual servoing. Proceedings of the 2000 ICRA Millennium Conference, IEEE International Conference on Robotics and Automation, Symposia Proceedings (Cat. No.00CH37065), San Francisco, CA, USA.
11. Muis, A., and Ohnishi, K. (2004, January 25–28). Eye-to-hand approach on eye-in-hand configuration within real-time visual servoing. Proceedings of the 8th IEEE International Workshop on Advanced Motion Control, 2004, AMC ’04, Kawasaki, Japan.
12. Ruf, A., Tonko, M., Horaud, R., and Nagel, H.H. (1997, January 11). Visual Tracking of An End-Effector by Adaptive Kinematic Prediction. Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems, Innovative Robotics for Real-World Applications, IROS’97, Grenoble, France.10.1109/IROS.1997.655115 ↗
13. de Mena, J.L. (2002). Virtual Environment for Development of Visual Servoing Control Algorithms. [Master’s Thesis, Lund Institute Technology].
14. Position-based visual servoing in industrial multirobot cells using a hybrid camera configuration10.1109/TRO.2006.886832 ↗
15. Measurement error analysis and accuracy enhancement of 2D vision system for robotic drilling10.1016/j.rcim.2013.09.014 ↗
16. Pose alignment of aircraft structures with distance sensors and CCD cameras10.1016/j.rcim.2017.02.003 ↗
17. An adaptive ball-head positioning visual servoing method for aircraft digital assembly10.1108/AA-05-2018-066 ↗
18. Visual servoing of continuum robots: Methods, challenges, and prospects
19. Irie, K., Woodhead, I.M., McKinnon, A.E., and Unsworth, K. (2009, January 23–25). Measured effects of temperature on illumination-independent camera noise. Proceedings of the 2009 24th International Conference Image and Vision Computing New Zealand, Wellington, New Zealand.10.1109/IVCNZ.2009.5378403 ↗
20. Wu, K., Wu, L., and Ren, H. (2014, January 5–10). An image based targeting method to guide a tentacle-like curvilinear concentric tube robot. Proceedings of the IEEE International Conference on Robotics and Biomimetics, Bali, Indonesia.10.1109/ROBIO.2014.7090361 ↗
21. Autonomous flexible endoscope for minimally invasive surgery with enhanced safety10.1109/LRA.2019.2895273 ↗
22. Autonomous data-driven manipulation of unknown anisotropic deformable tissues using unmodelled continuum manipulators10.1109/LRA.2018.2888896 ↗
23. Model predictive control of a robotically actuated delivery sheath for beating heart compensation10.1177/0278364917691113 ↗
24. Image De-noising by Various Filters for Different Noise
25. A comparative study of different noise filtering techniques in digital images
26. Zhao, R.M., and Cui, H.M. (2015, January 8–20). Improved threshold denoising method based on wavelet transform. Proceedings of the 2015 7th International Conference on Modelling, Identification and Control (ICMIC), Sousse, Tunisia.10.1109/ICMIC.2015.7409352 ↗
27. Goldberger, J., and Ng, J. (2010). Signal Averaging for Noise Reduction. Practical Signal and Image Processing in Clinical Cardiology, Springer.10.1007/978-1-84882-515-4 ↗
28. Neuromorphic eye-in-hand visual servoing10.1109/ACCESS.2021.3071261 ↗
29. Cormen, T.H., Leiserson, C.E., and Ronald, L. (2009). Rivest, and Clifford Stein. Introduction to Algorithms, MIT Press. [3rd ed.].
30. Chen, G., Zhu, F., and Heng, P.A. (2015, January 7–13). An Efficient Statistical Method for Image Noise Level Estimation. Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV), Santiago, Chile.10.1109/ICCV.2015.62 ↗
31. Spong, M.W., and Vidyasagar, M. (1989). Robot Dynamics and Control, John Wiley & Sons, Inc.
32. Modelling, Analysis and Simulation for A 6 Axis Arm Robot by PID Controller
33. Majid, T., Pengzhong, L., and Liang, L. (2022). Role of Uncertainty in Model Development and Control Design for a Manufacturing Process. Production Engineering and Robust Control, IntechOpen.
34. (2024, July 17). ABB IRB 4600-40/2.55 Product Manual [Internet]. Available online: https://www.manualslib.com/manual/1449302/Abb-Irb-4600-40-2-55.html#manual.
35. (2024, July 18). Stereolabs Docs: API Reference, Tutorials, and Integration. Available online: https://www.stereolabs.com/docs.
36. Where physically is the optical center?10.1016/j.patrec.2005.12.007 ↗
37. A comparative study of ideal elbow and dual-elbow robot manipulators10.1016/0094-114X(93)90076-8 ↗
38. MRI-guided robot intervention—Current state-of-the-art and new challenges10.1007/s44258-023-00003-1 ↗