journal article·2018-05-16Open access

Design of Demonstration-Driven Assembling Manipulator

Qianxiao Wei, Canjun Yang, Wu Fan, Yibing Zhao

Applied Sciences· Volume 8· Issue 5

Abstract

Currently, a mechanical arm or manipulator needs to be programmed by humans in advance to define its motion trajectory before practical use. However, the programming is tedious and high-cost, which renders such manipulators unable to perform various different tasks easily and quickly. This article focuses on the design of a vision-guided manipulator without explicit human programming. The proposed demonstration-driven system mainly consists of a manipulator, control box, and camera. Instead of programming of the detailed motion trajectory, one only needs to show the system how to perform a given task manually. Based on internal object recognition and motion detection algorithms, the camera can capture the information of the task to be performed and generate the motion trajectories for the manipulator to make it copy the human demonstration. The movement of the joints of the manipulator is given by a trajectory planner in the control box. Experimental results show that the system can imitate humans easily, quickly, and accurately for common tasks such as sorting and assembling objects. Teaching the manipulator how to complete the desired motion can help eliminate the complexity of programming for motion control.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Robotic Path Planning Algorithms · Image and Object Detection Techniques · Video Surveillance and Tracking Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

State Key Laboratory of Fluid Power and Mechatronic Systems, Zhejiang University, Hangzhou 310027, China

References (24)

Show source-provided references
1. Present and future robot control development—An industrial perspective10.1016/j.arcontrol.2007.01.002 ↗
2. Luo, Y., Wei, W., and Wang, X. (2010, January 26–28). Research for Hole-Peg Assembly Based on Machine Vision and Flexible Mechanism. Proceedings of the 2010 International Conference on Mechanic Automation and Control Engineering, Wuhan, China.
3. Song, H.C., Kim, Y.L., and Song, J.B. (2014, January 14–18). Automated Guidance of Peg-in-Hole Assembly Tasks for Complex-Shaped Parts. Proceedings of the 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, Chicago, IL, USA.10.1109/IROS.2014.6943202 ↗
4. The Concept of “Attractive Region in Environment” and its Application in High-Precision Tasks With Low-Precision Systems10.1109/TMECH.2014.2375638 ↗
5. Automotive assembly technologies review: Challenges and outlook for a flexible and adaptive approach10.1016/j.cirpj.2009.12.001 ↗
6. Vision-Based 3-D Grasping of 3-D Objects With a Simple 2-D Gripper10.1109/TSMC.2013.2264935 ↗
7. Determination of the base position and working area for mobile manipulators10.1108/AA-11-2015-101 ↗
8. Yamataka, M., Kuga, T., Takayama, T., Furukawa, M., and Ishida, J. (, 2008). Robot Assembly System for LCD TV Using Cooperative Force Control. Proceedings of the 2008 34th Annual Conference of IEEE Industrial Electronics, Orlando, FL, USA.10.1109/IECON.2008.4758514 ↗
9. Automated tracking and grasping of a moving object with a robotic hand-eye system10.1109/70.238279 ↗
10. Vision-Based Robust Path Reconstruction for Robot Control10.1109/TIM.2013.2289091 ↗
11. Improving Object Detection with Boosted Histograms10.1016/j.imavis.2008.08.010 ↗
12. Aivaliotis, P., Zampetis, A., Michalos, G., and Makris, S. (2017, January 27–30). A Machine Learning Approach for Visual Recognition of Complex Parts in Robotic Manipulation. Proceedings of the 27th International Conference on Flexible Automation and Intelligent Manufacturing (FAIM 2017), Modena, Italy.
13. Boosted random contextual semantic space based representation for visual recognition10.1016/j.ins.2016.06.029 ↗
14. A method for detection of randomly placed objects for robotic handling10.1016/j.cirpj.2016.04.005 ↗
15. Balabantaray, B.K., and Biswal, B.B. (2013, January 16–17). Part Identification in Robotic Assembly Using Vision System. Proceedings of the Sixth International Conference on Machine Vision (ICMV 2013), London, UK.10.1117/12.2051309 ↗
16. Sahu, O.P., Balabantaray, B.K., Patle, B., and Biswal, B.B. (2015, January 13–14). Part Recognition Using Vision and Ultrasonic Sensor for Robotic Assembly System. Proceedings of the 2015 IEEE Student Conference on Research and Development (SCOReD), Kuala Lumpur, Malaysia.10.1109/SCORED.2015.7449312 ↗
17. Vision-based Assembly and Inspection System for Golf Club Heads10.1016/j.rcim.2014.10.004 ↗
18. Precise Robotic Assembly for Large-Scale Objects Based on Automatic Guidance and Alignment10.1109/TIM.2016.2526738 ↗
19. Simultaneous detection and classification of breast masses in digital mammograms via a deep learning YOLO-based CAD system10.1016/j.cmpb.2018.01.017 ↗
20. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You Only Look Once: Unified, Real-Time Object Detection. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.91 ↗
21. Extension of D-H parameter method to hybrid manipulators used in robot-assisted surgery10.1177/0954411915602289 ↗
22. Kinematics analysis and numerical simulation of a manipulator based on virtual prototyping10.1007/s00170-013-5496-6 ↗
23. Visual orientation inhomogeneity based scale-invariant feature transform10.1016/j.eswa.2015.01.012 ↗
24. Spectral-Spatial Scale Invariant Feature Transform for Hyperspectral Images10.1109/TIP.2017.2749145 ↗