Programming of Industrial Robots Using Virtual Reality and Digital Twins
Source abstract
Abstract
The article presents a method of programming robots using virtual reality and digital twins. The virtual environment is a digital twin of a robotic station, built based on CAD models of existing station elements. The virtual reality system is used to record human movements in a virtual environment, which are then reproduced by a real robot. The method developed is dedicated mainly to such situations in which it is necessary for the robot to reproduce the movements of a human performing a process that is complicated from the point of view of robotization. An example of using the method for programming a robot implementing the process of cleaning ceramic casting moulds is presented.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Engineering Technology and Methodologies · Engineering and Environmental Studies · Digital Transformation in Industry
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Applied Mechanics and Robotics, Faculty of Mechanical Engineering and Aeronautics, Rzeszow University of Technology, 35-959 Rzeszów, Poland
Consolidated Precision Products Poland sp. z o.o., 35-078 Rzeszów, Poland
Funding
Ministerstwo Nauki i Szkolnictwa Wyższego
References (37)
Show source-provided references
1. Glaessgen, E., and Stargel, D. (2012, January 23–26). The Digital Twin Paradigm for Future NASA and U.S. Air Force Vehicles. Proceedings of the 53rd AIAA/ASME/ASCE/AHS/ASC Structures, Structural Dynamics and Materials Conference, 20th AIAA/ASME/AHS Adaptive Structures Conference, 14th AIAA, American Institute of Aeronautics and Astronautics, Honolulu, Hawaii, HI, USA.10.2514/6.2012-1818 ↗
2. Digital Twin in Services and Industrial Product Service Systems: Review and Analysis10.1016/j.procir.2019.02.131 ↗
3. Application of Virtual Reality in the Training of Operators and Servicing of Robotic Stations10.1007/978-3-030-28464-0_52 ↗
4. Digital twin-driven product design, manufacturing and service with big data10.1007/s00170-017-0233-1 ↗
5. Digital Twin-driven smart manufacturing: Connotation, reference model, applications and research issues10.1016/j.rcim.2019.101837 ↗
6. A digital twin-based approach for dynamic clamping and positioning of the flexible tooling system10.1016/j.procir.2019.01.063 ↗
7. Industry 4.0. Part I. Selected applications in processing of polymer materials10.14314/polimery.2018.7.7 ↗
8. Development and operation of Digital Twins for technical systems and services10.1016/j.cirp.2019.04.024 ↗
9. Digital Twins and Cyber–Physical Systems toward Smart Manufacturing and Industry 4.0: Correlation and Comparison10.1016/j.eng.2019.01.014 ↗
10. Vachalek, J., Bartalsky, L., Rovny, O., Sismisova, D., Morhac, M., and Loksik, M. (2017, January 6–9). The digital twin of an industrial production line within the industry 4.0 concept. Proceedings of the 2017 21st International Conference on Process Control (PC), Strbske Pleso, Slovakia.10.1109/PC.2017.7976223 ↗
11. A data- and knowledge-driven framework for digital twin manufacturing cell10.1016/j.procir.2019.04.084 ↗
12. Digital Human and Robot Simulation in Automotive Assembly using Siemens Process Simulate: A Feasibility Study10.1016/j.promfg.2019.06.097 ↗
13. Digital twin driven human-robot collaborative assembly10.1016/j.cirp.2019.04.011 ↗
14. Digital twins of human robot collaboration in a production setting10.1016/j.promfg.2018.10.047 ↗
15. Digital twin for adaptation of robots’ behavior in flexible robotic assembly lines10.1016/j.promfg.2018.12.020 ↗
16. A Machine Learning-Enhanced Digital Twin Approach for Human-Robot-Collaboration10.1016/j.procir.2018.02.010 ↗
17. Methodology for enabling Digital Twin using advanced physics-based modelling in predictive maintenance10.1016/j.procir.2019.03.072 ↗
18. Burdea, G., and Coiffet, P. (2003). Virtual Reality Technology, J. Wiley-Interscience. [2nd ed.].10.1162/105474603322955950 ↗
19. Mihelj, M., Novak, D., and Beguš, S. (2014). Intelligent systems, control and automation: Science and engineering. Virtual Reality Technology and Applications, Springer.10.1007/978-94-007-6910-6 ↗
20. Virtual Reality Simulation for the Operating Room: Proficiency-Based Training as a Paradigm Shift in Surgical Skills Training10.1097/01.sla.0000151982.85062.80 ↗
21. Virtual Training for Industrial Automation Processes Through Pneumatic Controls10.1007/978-3-319-95282-6_37 ↗
22. Industrial robot control and operator training using virtual reality interfaces10.1016/j.compind.2019.05.001 ↗
23. Virtual Reality Application for Simulation and Off-line Programming of the Mitsubishi Movemaster RV-M1 Robot Integrated with the Oculus Rift to Improve Students Training10.1016/j.procs.2015.12.226 ↗
24. Application of Virtual Reality in Designing and Programming of Robotic Stations10.1007/978-3-030-28464-0_51 ↗
25. The effectiveness of virtual environments in developing collaborative strategies between industrial robots and humans10.1016/j.rcim.2018.07.006 ↗
26. Design of a virtual reality training system for human–robot collaboration in manufacturing tasks10.1007/s12008-015-0259-2 ↗
27. Optimizing the Robot Arm Movement Time Using Virtual Reality Robotic Teaching System10.2507/IJSIMM14(1)3.273 ↗
28. Yap, H.J., Taha, Z., Md Dawal, S.Z., and Chang, S.W. (2014). Virtual Reality Based Support System for Layout Planning and Programming of an Industrial Robotic Work Cell. PLoS ONE, 9.10.1371/journal.pone.0109692 ↗
29. Survey on Human-Robot Interaction for Robot Programming in Industrial Applications10.1016/j.ifacol.2018.08.236 ↗
30. Recent progress on programming methods for industrial robots10.1016/j.rcim.2011.08.004 ↗
31. Direct off-line robot programming via a common CAD package10.1016/j.robot.2013.02.005 ↗
32. Pettersen, T., Pretlove, J., Skourup, C., Engedal, T., and Lokstad, T. (2003, January 10). Augmented reality for programming industrial robots. Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality, Tokyo, Japan.
33. Augmented reality-assisted robot programming system for industrial applications10.1016/j.rcim.2019.101820 ↗
34. Intuitive Welding Robot Programming via Motion Capture and Augmented Reality10.1016/j.ifacol.2019.10.045 ↗
35. Araiza-Illan, D., De San Bernabe, A., Hongchao, F., and Shin, L.Y. (2019, January 11–14). Augmented Reality for Quick and Intuitive Robotic Packing Re-Programming. Proceedings of the 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Daegu, Korea.10.1109/HRI.2019.8673327 ↗
36. Quintero, C.P., Li, S., Pan, M.K., Chan, W.P., Van der Loos, H.F.M., and Croft, E. (2018, January 1–5). Robot Programming Through Augmented Trajectories in Augmented Reality. Proceedings of the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Madrid, Spain.10.1109/IROS.2018.8593700 ↗
37. Jost, T.A., Nelson, B., and Rylander, J. (2019). Quantitative analysis of the Oculus Rift S in controlled movement. Disabil. Rehabil. Assist. Technol., 1–5.