Augmented Reality Applications in Industry 4.0 Environment
Source abstract
Abstract
New technologies, such as cloud computing, the Internet of Things, wireless communications, etc., have already become part of our daily lives. This paper provides an insight into one of the new technologies, i.e., augmented reality (AR), as part of the manufacturing paradigm Industry 4.0 (I4.0). The aim of this paper is to contribute to the current state in the field of AR by assessing the main areas of the application of AR, the used devices and the tracking methods in support of the digitalization of the industry. Searches via Science Direct, Google Scholar and the Internet in general have resulted in the collection of a large number of papers. The examined works are classified according to several criteria and the most important data resulting from them are presented here. A comprehensive analysis of the literature has indicated the main areas of application of AR in I4.0 and, among these, those that stand out are maintenance, assembly and human robot collaboration. Finally, a roadmap for the application of AR in companies is proposed and the most promising future areas of research are listed.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Augmented Reality Applications · IoT and Edge/Fog Computing · Virtual Reality Applications and Impacts
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Technical Sciences, University of Novi Sad, Trg D. Obradovića 6, 21000 Novi Sad, Serbia
Continental Automotive Serbia, Narodnih heroja 3, 21000 Novi Sad, Serbia
References (100+)
Show source-provided references
1. Roblek, V., Meško, M., and Krapež, A. (2016). A complex view of industry 4.0. SAGE Open, 6.10.1177/2158244016653987 ↗
2. A review of the meanings and the implications of the Industry 4.0 concept10.1016/j.promfg.2017.09.032 ↗
3. Intelligent Manufacturing in the Context of Industry 4.0: A Review10.1016/J.ENG.2017.05.015 ↗
4. Industry 4.0: A review on industrial automation and robotic
5. Visual computing technologies to support the Operator 4.010.1016/j.cie.2018.11.060 ↗
6. Assembly system design in the Industry 4.0 era: A general framework10.1016/j.ifacol.2017.08.1121 ↗
7. Sustainable Industry 4.0 framework: A systematic literature review identifying the current trends and future perspectives10.1016/j.psep.2018.05.009 ↗
8. Kagermann, H., Wahlster, W., and Helbig, J. (2013). Recommendations for Implementing the Strategic Initiative INDUSTRIE 4.0—Securing the Future of German Manufacturing Industry, National Academy of Science and Engineering.
9. A Cyber-Physical Systems architecture for Industry 4.0-based manufacturing systems10.1016/j.mfglet.2014.12.001 ↗
10. Visual Computing as a Key Enabling technology for Industrie 4.0 and industrial internet10.1109/MCG.2015.45 ↗
11. Langfinger, M., Schneider, M., Stricker, D., and Schotten, H.D. (2017, January 24–26). Addressing security challenges in industrial augmented reality systems. Proceedings of the IEEE 15th International Conference on Industrial Informatics (INDIN), Emden, Germany.10.1109/INDIN.2017.8104789 ↗
12. Mitsuishi, M., Ueda, K., and Kimura, F. (2008). Smart factory—A step towards the next generation of manufacturing. Manufacturing Systems and Technologies for the New Frontier, Springer.10.1007/978-1-84800-267-8 ↗
13. Intelligent assistant system as a context-aware decision-making support for the workers of the future10.1016/j.cie.2019.02.046 ↗
14. Lean automation enabled by Industry 4.0 technologies10.1016/j.ifacol.2015.06.359 ↗
15. Smart operators in industry 4.0: A human-centered approach to enhance operators’ capabilities and competencies within the new smart factory context10.1016/j.cie.2017.09.016 ↗
16. Cardoso, L.F.D.S., Mariano, F.C.M.Q., and Zorzal, E.R. (2020). A survey of industrial augmented reality. Comput. Ind. Eng., 139.10.1016/j.cie.2019.106159 ↗
17. Paszkiel, S. (2020). Analysis and Classification of EEG Signals for Brain Computer Interfaces, Springer.10.1007/978-3-030-30581-9 ↗
18. Research trends and opportunities of augmented reality applications in architecture, engineering, and construction10.1016/j.autcon.2012.12.017 ↗
19. The application of augmented reality technologies for the improvement of occupational safety in an industrial environment10.1016/j.compind.2016.11.004 ↗
20. A review on industrial augmented reality systems for the Industry 4.0 shipyard10.1109/ACCESS.2018.2808326 ↗
21. Augmented Reality in education—cases, places and potentials10.1080/09523987.2014.889400 ↗
22. Affordances of augmented reality in science learning: Suggestions for future research10.1007/s10956-012-9405-9 ↗
23. Augmented reality for the improvement of remote laboratories: An augmented remote laboratory10.1109/TE.2010.2085047 ↗
24. Augmented reality in education: Current technologies and the potential for education10.1016/j.sbspro.2012.06.654 ↗
25. Bloem, J., van Doorn, M., Duivestein, S., Excoffier, D., Mass, R., and van Ommeren, E. (2021, April 09). The Fourth Industrial Revolution—Things to Tighten the Link between IT and OT. Sogeti VINT. Available online: https://www.sogeti.com/globalassets/global/special/sogeti-things3en.pdf.
26. Placing the operator at the centre of Industry 4.0 design: Modelling and assessing human activities within cyber-physical systems10.1016/j.cie.2018.01.025 ↗
27. Smit, J., Kreutzer, S., Moeller, C., and Carlberg, M. (2016). Industry 4.0, Study for the ITRE Comittee, Policy Department A.
28. Support systems on the industrial shop-floors of the future—operators’ perspective on augmented reality10.1016/j.procir.2016.02.017 ↗
29. Masood, T., and Egger, J. (2020). Adopting augmented reality in the age of industrial digitalisation. Comput. Ind., 115.10.1016/j.compind.2019.07.002 ↗
30. Augmented reality technologies, systems and applications10.1007/s11042-010-0660-6 ↗
31. Recent advances in augmented reality10.1109/38.963459 ↗
32. Research trends in the use of augmented reality in science education: Content and bibliometric mapping analysis10.1016/j.compedu.2019.103647 ↗
33. 20 years of research on virtual reality and augmented reality in tourism context: A text-mining approach10.1016/j.tourman.2019.104028 ↗
34. Augmented reality in medicine: Systematic and bibliographic review10.2196/10967 ↗
35. A comprehensive survey of augmented reality assembly research10.1007/s40436-015-0131-4 ↗
36. De Paolis, L., and Bourdot, P. (2020). Augmented reality smart glasses in the workplace: Safety and security in the fourth industrial revolution era. Augmented Reality, Virtual Reality, and Computer Graphics, Springer.10.1007/978-3-030-58465-8 ↗
37. Auer, M., and Langmann, R. (2018). Demonstration: Using remotely controlled one-way flow control valve for speed regulation of pneumatic cylinder. Smart Industry & Smart Education. REV 2018. Lecture Notes in Networks and Systems, Springer.
38. Application of augmented reality techniques in through-life engineering services10.1016/j.procir.2015.07.044 ↗
39. Funk, M., Kosch, T., Kettner, R., Korn, O., and Schmidt, A. (2016, January 18–19). motionEAP: An overview of 4 years of combining industrial assembly with augmented reality for Industry 4.0. Proceedings of the 16th International Conference on Knowledge Technologies and Data-driven Business (I-Know 2016), Graz, Austria.
40. Jung, T., and tom Dieck, C. (2017). Augmented reality smart glasses: Definition, concepts and impact on firm value creation. Augmented Reality and Virtual Reality, Empowering Human, Place and Business, Springer.10.1007/978-3-319-64027-3 ↗
41. Integrated production and maintenance scheduling through machine monitoring and augmented reality: An industry 4.0 approach
42. Kerpen, D., Lohrer, M., Saggiomo, M., Kemper, M., Lemm, J., and Gloy, Y.S. (2016, January 14–17). Effects of cyber-physical production systems on human factors in a weaving mill: Implementation of digital working environments based on augmented reality. Proceedings of the IEEE International Conference on Industrial Technology (ICIT), Taipei, Taiwan.10.1109/ICIT.2016.7475092 ↗
43. Converting maintenance actions into standard symbols for augmented reality applications in Industry 4.010.1016/j.compind.2018.02.001 ↗
44. Augmented reality for photovoltaic pumping systems maintenance tasks10.1016/j.renene.2012.12.043 ↗
45. Augmented reality on large screen for interactive maintenance instructions10.1016/j.compind.2013.11.004 ↗
46. Exploring the benefits of augmented reality documentation for maintenance and repair10.1109/TVCG.2010.245 ↗
47. Hincapié, M., Caponio, A., Rios, H., and González Mendívil, E. (2011, January 26–30). An introduction to Augmented Reality with applications in aeronautical maintenance. Proceedings of the 13th International Conference on Transparent Optical Networks, Stockholm, Sweden.10.1109/ICTON.2011.5970856 ↗
48. Design guidelines for the development of virtual reality and augmented reality training systems for maintenance and assembly tasks10.1051/bioconf/20110100029 ↗
49. Context-aware maintenance support for augmented reality assistance and synchronous multi-user collaboration10.1016/j.procir.2016.09.042 ↗
50. An augmented reality training platform for assembly and maintenance skills10.1016/j.robot.2012.09.013 ↗
51. A practical augmented reality-assisted maintenance system framework for adaptive user support10.1016/j.rcim.2019.03.010 ↗
52. Augmented reality application to support remote maintenance as a service in the robotics industry10.1016/j.procir.2017.03.154 ↗
53. Supporting remote maintenance in Industry 4.0 through augmented reality10.1016/j.promfg.2017.07.257 ↗
54. Bottecchia, S., Cieutat, J.M., and Jessel, J.P. (2010). T.A.C: Augmented reality system for collaborative tele-assistance in the field of maintenance through internet. ACM Int. Conf. Proceeding Ser.10.1145/1785455.1785469 ↗
55. Supporting the diagnostics and the maintenance of technical devices with augmented reality
56. Flatt, H., Koch, N., Rocker, C., Gunter, A., and Jasperneite, J. (2015, January 8–11). A context-aware assistance system for maintenance applications in smart factories based on augmented reality and indoor localization. Proceedings of the 2015 IEEE 20th Conference on Emerging Technologies and Factory Automation (ETFA 2015), Luxembourg.10.1109/ETFA.2015.7301586 ↗
57. Engelke, T., Keil, J., Rojtberg, P., Wientapper, F., Schmitt, M., and Bockholt, U. (2015, January 18–20). Content first—A concept for industrial augmented reality maintenance applications using mobile devices. Proceedings of the 6th ACM Multimedia Systems Conference (MMSys ’15), Portland, OR, USA.10.1145/2713168.2713169 ↗
58. Quint, F., and Loch, F. (2015). Using smart glasses to document maintenance processes. Mensch und Comput. Workshopband, 203–208.10.1515/9783110443905-030 ↗
59. Integration of I4.0 technologies with maintenance processes: What are the effects on sustainable manufacturing?10.1016/j.ifacol.2020.11.001 ↗
60. Loch, F., Quint, F., and Brishtel, I. (2016, January 14–16). Comparing video and augmented reality assistance in manual assembly. Proceedings of the 12th International Conference on Intelligent Environments (IE), London, UK.10.1109/IE.2016.31 ↗
61. Paelke, V. (2014, January 16–19). Augmented reality in the smart factory: Supporting workers in an industry 4.0. environment. Proceedings of the 2014 IEEE Emerging Technology and Factory Automation (ETFA), Barcelona, Spain.10.1109/ETFA.2014.7005252 ↗
62. Using augmented reality to facilitate piping assembly: An experiment-based evaluation10.1061/(ASCE)CP.1943-5487.0000344 ↗
63. Using animated augmented reality to cognitively guide assembly10.1061/(ASCE)CP.1943-5487.0000184 ↗
64. Mobile augmented reality to support fuselage assembly10.1016/j.cie.2020.106712 ↗
65. Mechanical assembly assistance using marker-less augmented reality system10.1108/AA-11-2016-152 ↗
66. Augmented reality application to support the assembly of highly customized products and to adapt to production re-scheduling10.1007/s00170-019-03941-6 ↗
67. Assessing instructions in augmented reality for human-robot collaborative assembly by using demonstrators10.1016/j.procir.2017.02.038 ↗
68. Augmented reality system for virtual training of parts assembly10.1016/j.proeng.2015.01.422 ↗
69. Matteucci, M., Raponi, D., Mengoni, M., and Peruzzini, M. (2017, January 6–9). Tangible augmented reality model to support manual assembly. Proceedings of the ASME 2017 International Design Engineering Technical Conferences and Computers and Information in Engineering Conference (IDETC/CIE 2017), Cleveland, OH, USA.10.1115/DETC2017-67742 ↗
70. Büttner, S., Sand, O., and Röcker, C. (2015, January 24–27). Extending the design space in industrial manufacturing through mobile projection. Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI 2015), Copenhagen, Denmark.10.1145/2786567.2794342 ↗
71. An integrated environment based on augmented reality and sensing device for manual assembly workstations10.1016/j.procir.2015.12.128 ↗
72. Augmented Reality-Based Manual Assembly Support With Visual Features for Different Degrees of Difficulty10.1080/10447318.2014.994194 ↗
73. Assembly work instruction deployment using augmented reality10.4028/www.scientific.net/KEM.502.25 ↗
74. Intelligent augmented reality training for motherboard assembly10.1007/s40593-014-0032-x ↗
75. Smart augmented reality instructional system for mechanical assembly towards worker-centered intelligent manufacturing10.1016/j.jmsy.2020.02.010 ↗
76. Intuitive welding robot programming via motion capture and augmented reality10.1016/j.ifacol.2019.10.045 ↗
77. Malý, I., Sedláček, D., and Leitão, P. (2016, January 19–21). Augmented reality experiments with industrial robot in industry 4.0 environment. Proceedings of the 2016 IEEE 14th International Conference on Industrial Informatics (INDIN), Poitiers, France.10.1109/INDIN.2016.7819154 ↗
78. Augmented reality (AR) applications for supporting human-robot interactive cooperation10.1016/j.procir.2015.12.005 ↗
79. Ng, C.L., Ng, T.C., Nguyen, T.A.N., Yang, G., and Chen, W. (2010, January 7–10). Intuitive robot tool path teaching using laser and camera in augmented reality environment. Proceedings of the 11th International Conference on Control, Automation, Robotics and Vision (ICARCV 2010), Singapore.10.1109/ICARCV.2010.5707399 ↗
80. Gaschler, A., Springer, M., Rickert, M., and Knoll, A. (June, January 31). Intuitive robot tasks with augmented reality and virtual obstacles. Proceedings of the 2014 IEEE International Conference on Robotics & Automation (ICRA), Hong Kong, China.10.1109/ICRA.2014.6907747 ↗
81. Leutert, F., Herrmann, C., and Schilling, K. (2013, January 3–6). A spatial augmented reality system for intuitive display of robotic data. Proceedings of the 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI), Tokyo, Japan.10.1109/HRI.2013.6483560 ↗
82. ARTool Zero: Programming trajectory of touching probes using augmented reality10.1016/j.cie.2018.07.026 ↗
83. Intuitive robot programming through environment perception, augmented reality simulation and automated program verification10.1016/j.procir.2018.01.036 ↗
84. Spatial augmented reality as a method for a mobile robot to communicate intended movement10.1016/j.chb.2014.02.001 ↗
85. Interactive robot trajectory planning and simulation using augmented reality10.1016/j.rcim.2011.09.003 ↗
86. A novel augmented reality-based interface for robot path planning10.1007/s12008-013-0191-2 ↗
87. 3D augmented reality teleoperated robot system based on dual vision10.1016/S1005-8885(10)60035-0 ↗
88. Abbas, S.M., Hassan, S., and Yun, J. (2012, January 17–21). Augmented reality based teaching pendant for industrial robot. Proceedings of the 12th International Conference on Control, Automation and Systems, Jeju Island, Korea.
89. Augmented reality system for operator support in human–robot collaborative assembly10.1016/j.cirp.2016.04.038 ↗
90. Hashimoto, S., Ishida, A., Inami, M., and Igarashi, T. (2011, January 28–30). TouchMe: An augmented reality based remote robot manipulation. Proceedings of the The 21st International Conference on Artificial Reality and Telexistence (ICAT), Osaka, Japan.
91. Akan, B., Ameri, A., Cürüklü, B., and Asplund, L. (2011, January 9–13). Intuitive industrial robot programming through incremental multimodal language and augmented reality. Proceedings of the 2011 IEEE International Conference on Robotics and Automation (ICRA), Shanghai, China.10.1109/ICRA.2011.5979887 ↗
92. AR-based interaction for human-robot collaborative manufacturing10.1016/j.rcim.2019.101891 ↗
93. Use of projector based augmented reality to improve manual spot-welding precision and accuracy for automotive manufacturing10.1007/s00170-016-9164-5 ↗
94. Automation in Construction Collaborative Welding System using BIM for Robotic Reprogramming and Spatial Augmented Reality10.1016/j.autcon.2019.04.020 ↗
95. Khuong, B.M., Kiyokawa, K., Miller, A., La Viola, J.J., Mashita, T., and Takemura, H. (April, January 29). The effectiveness of an AR-based context-aware assembly support system in object assembly. Proceedings of the 2014 IEEE Virtual Reality (VR), Minneapolis, MN, USA.10.1109/VR.2014.6802051 ↗
96. Rentzos, L., Papanastasiou, S., Papakostas, N., and Chryssolouris, G. (2013, January 11–15). Augmented reality for human-based assembly: Using product and process semantics. Proceedings of the IFAC Proceedings Volumes (IFAC-PapersOnline), Las Vegas, NV, USA.10.3182/20130811-5-US-2037.00053 ↗
97. Augmented reality based approach for on-line quality assessment of polished surfaces10.1016/j.rcim.2019.04.007 ↗
98. Besbes, B., Collette, S.N., Tamaazousti, M., Bourgeois, S., and Gay-Bellile, V. (2012, January 5–8). An interactive augmented reality system: A prototype for industrial maintenance training applications. Proceedings of the IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2012), Atlanta, GA, USA.10.1109/ISMAR.2012.6402568 ↗
99. A self-aware and active-guiding training & assistant system for worker-centered intelligent manufacturing10.1016/j.mfglet.2019.08.003 ↗
100. Developing augmented reality capabilities for industry 4.0 small enterprises: Lessons learnt from a content authoring case study10.1016/j.compind.2020.103208 ↗