Effect of Augmented Reality Support on Quality Inspection of Welded Structures
Source abstract
Abstract
With the increasing complexity of production systems and manufactured products, operators face high demands for professional expertise and long-term concentration. Augmented reality (AR) can support users in their work by displaying relevant virtual data in their field of view. In contrast to the extensive research on AR assistance in assembly, maintenance, and training, AR support in quality inspection has received less attention in the industrial context. Quality inspection is an essential part of industrial processes; thus, it is important to verify whether AR assistance can support users in these tasks. This work proposes an AR-based approach for quality inspection. For this, pilot AR software was designed and developed. The proposed AR approach was tested with end users. The task efficiency, the error rate, the perceived mental workload, and the usability of the AR approach were analysed and compared to the conventional paper-based support. The field research confirmed the positive effect on user efficiency during quality inspection while decreasing the perceived mental workload. This work extends the research on the potential of AR assistance in industrial applications and provides experimental validation to confirm the benefits of AR support on user performance during quality inspection tasks.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Augmented Reality Applications · Manufacturing Process and Optimization · Digital Transformation in Industry
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Industrial Engineering and Management, University of West Bohemia, Univerzitni 2732/8, 30 614 Plzen, Czech Republic
Funding
Internal Science Foundation of the University of West Bohemia
References (87)
Show source-provided references
1. The impact of Industry 4.0 on the reconciliation of dynamic capabilities: Evidence from the European manufacturing industries10.1080/09537287.2020.1810765 ↗
2. Smart manufacturing process and system automation—A critical review of the standards and envisioned scenarios10.1016/j.jmsy.2020.06.010 ↗
3. A review on quality control in additive manufacturing10.1108/RPJ-03-2017-0048 ↗
4. (2023, August 07). Toyota Production System: An Integrated Approach to Just-in-Time—Monden Yasuhiro (9781439820971) | ENbook.cz. Available online: https://www.enbook.cz/catalog/product/view/id/152463?gclid=CjwKCAiA6seQBhAfEiwAvPqu1z8bGhBTjQgAl9Yn6lj9K_Ua9ktOLKG4dkDRZRWzkFYTb8TmPBtO0BoCCXkQAvD_BwE.
5. Metallurgical characterization of a failed A106 Gr-B carbon steel welded condensate pipeline in a pe-troleum refinery10.1016/j.ijpvp.2022.104843 ↗
6. Failure analysis and simulation model of pinhole corrosion of the refined oil pipeline10.1016/j.engfailanal.2019.104177 ↗
7. Reconfigurable manufacturing systems: Principles, design, and future trends10.1007/s11465-018-0483-0 ↗
8. Digital Real-time Feedback of Quality-related Information to Inspection and Installation Areas of Vehicle Assembly10.1016/j.procir.2017.12.242 ↗
9. Towards the Resilient Operator 5.0: The Future of Work in Smart Resilient Manufacturing Systems10.1016/j.procir.2021.11.183 ↗
10. Autonomation policy to control work-in-process inventory in a smart production system10.1080/00207543.2020.1722325 ↗
11. Aust, J., and Pons, D. (2022). Comparative Analysis of Human Operators and Advanced Technologies in the Visual Inspection of Aero Engine Blades. Appl. Sci., 12.10.3390/app12042250 ↗
12. The Role of Automation in Complexities of High-Mix in Low-Volume Production—A Literature Review10.1016/j.procir.2021.11.245 ↗
13. Significance of Quality 4.0 towards comprehensive enhancement in manufacturing sector10.1016/j.sintl.2021.100109 ↗
14. Development of automation and artificial intelligence technology for welding and inspection process in aircraft industry10.1007/s40194-021-01210-3 ↗
15. Automation, Algorithms, and Beyond: Why Work Design Matters More Than Ever in a Digital World10.1111/apps.12241 ↗
16. Augmented reality in support of intelligent manufacturing—A systematic literature review10.1016/j.cie.2019.106195 ↗
17. Augmented reality aided inspection of gears
18. Displaying product manufacturing information in augmented reality for inspection10.1016/j.procir.2019.03.208 ↗
19. An Augmented Reality inspection tool to support workers in Industry 4.0 environments10.1016/j.compind.2021.103412 ↗
20. Digitally Enhanced Quality Management for Zero Defect Manufacturing10.1016/j.procir.2021.11.227 ↗
21. Xian, W., Yu, K., Han, F., Fang, L., He, D., and Han, Q.L. (2023). Advanced Manufacturing in Industry 5.0: A Survey of Key Enabling Technologies and Future Trends. IEEE Trans. Ind. Inform., 1–15.10.1109/TII.2023.3274224 ↗
22. Smart factory performance and Industry 4.010.1016/j.techfore.2019.119790 ↗
23. The Operator 4.0: Towards socially sustainable factories of the future10.1016/j.cie.2019.106128 ↗
24. On-machine and in-process surface metrology for precision manufacturing10.1016/j.cirp.2019.05.005 ↗
25. Smart manufacturing systems for Industry 4.0: Conceptual framework, scenarios, and future perspectives10.1007/s11465-018-0499-5 ↗
26. A review of industrial big data for decision making in intelligent manufacturing
27. The industrial management of SMEs in the era of Industry 4.010.1080/00207543.2017.1372647 ↗
28. Smart technology-driven aspects for human-in-the-loop smart manufacturing10.1007/s00170-021-06977-9 ↗
29. Determinants of information and digital technology implementation for smart manufacturing10.1080/00207543.2019.1630775 ↗
30. Preliminary study of Augmented Reality based manufacturing for further integration of Quality Control 4.0 supported by metrology10.1088/1757-899X/1193/1/012105 ↗
31. Empowering and engaging industrial workers with Operator 4.0 solutions10.1016/j.cie.2019.01.052 ↗
32. Marino, E., Barbieri, L., Colacino, B., and Bruno, F. (2022, January 9–10). User-Centered Design of an Augmented Reality Tool for Smart Operator in Production Environment. Proceedings of the International Conference on Design, Simulation, Manufacturing: The Innovation Exchange, Rome, Italy.10.1007/978-3-030-91234-5_12 ↗
33. The effects of augmented reality on improving spatial problem solving for object assembly10.1016/j.aei.2018.10.004 ↗
34. Ojer, M., Alvarez, H., Serrano, I., Saiz, F.A., Barandiaran, I., Aguinaga, D., Querejeta, L., and Alejandro, D. (2020). Projection-Based Augmented Reality Assistance for Manual Electronic Component Assembly Processes. Appl. Sci., 10.10.3390/app10030796 ↗
35. A comprehensive review of augmented reality-based instruction in manual assembly, training and repair10.1016/j.rcim.2022.102407 ↗
36. Botto, C., Cannavo, A., Cappuccio, D., Morat, G., Sarvestani, A.N., Ricci, P., Demarchi, V., and Saturnino, A. (2020, January 22–26). Augmented Reality for the Manufacturing Industry: The Case of an Assembly Assistant. Proceedings of the 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), Atlanta, GA, USA.10.1109/VRW50115.2020.00068 ↗
37. Agati, S.S., Bauer, R.D., Hounsell, M.D.S., and Paterno, A.S. (2020, January 7–10). Augmented Reality for Manual Assembly in Industry 4.0: Gathering Guidelines. Proceedings of the 2020 22nd Symposium on Virtual and Augmented Reality, SVR, Porto de Galinhas, Brazil.10.1109/SVR51698.2020.00039 ↗
38. Systematic Literature Review on Augmented Reality-Based Maintenance Applications in Manufacturing Centered on Operator Needs10.1007/s40684-022-00444-w ↗
39. Lorenz, M., Knopp, S., Kim, J., and Klimant, P. (2020, January 9–13). Industrial Augmented Reality: 3D-Content Editor for Augmented Reality Maintenance Worker Support System. Proceedings of the 2020 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct, Recife, Brazil.10.1109/ISMAR-Adjunct51615.2020.00060 ↗
40. Mourtzis, D., Siatras, V., and Angelopoulos, J. (2020). Real-time remote maintenance support based on augmented reality (AR). Appl. Sci., 10.10.3390/app10051855 ↗
41. Kim, J., Lorenz, M., Knopp, S., and Klimant, P. (2020, January 9–13). Industrial Augmented Reality: Concepts and User Interface Designs for Augmented Reality Maintenance Worker Support Systems. Proceedings of the 2020 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct, Recife, Brazil.10.1109/ISMAR-Adjunct51615.2020.00032 ↗
42. Konstantinidis, F.K., Kansizoglou, I., Santavas, N., Mouroutsos, S.G., and Gasteratos, A. (2020). Marma: A mobile augmented reality maintenance assistant for fast-track repair procedures in the context of industry 4.0. Machines, 8.10.3390/machines8040088 ↗
43. Butaslac, I.M., Fujimoto, Y., Sawabe, T., Kanbara, M., and Kato, H. (2022). Systematic Review of Augmented Reality Training Systems. IEEE Trans. Vis. Comput. Graph., 1–20.10.1109/TVCG.2022.3201120 ↗
44. Potentials of Augmented Reality in Training10.1016/j.promfg.2019.03.014 ↗
45. Learning manual assembly through real-time motion capture for operator training with augmented reality10.1016/j.promfg.2020.04.093 ↗
46. Büttner, S., Prilla, M., and Röcker, C. (2020, January 25–30). Augmented Reality Training for Industrial Assembly Work—Are Projection-based AR Assistive Systems an Appropriate Tool for Assembly Training?. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA.10.1145/3313831.3376720 ↗
47. Vidal-Balea, A., Blanco-Novoa, O., Fraga-Lamas, P., Vilar-Montesinos, M., and Fernández-Caramés, T.M. (2020). Creating collaborative augmented reality experiences for industry 4.0 training and assistance applications: Performance evaluation in the shipyard of the future. Appl. Sci., 10.10.3390/app10249073 ↗
48. Using augmented reality for industrial quality assurance: A shop floor user study10.1007/s00170-021-07049-8 ↗
49. Mixed reality-based user interface for quality control inspection of car body surfaces10.1016/j.jmsy.2019.08.004 ↗
50. Challenges and trends in manufacturing measurement technology—The industrie 4.0 concept10.5194/jsss-5-325-2016 ↗
51. Augmented product information: Crafting physical-digital transparency strategies in the materials supply chain10.1007/s00170-020-06446-9 ↗
52. Wearable and interactive mixed reality solutions for fault diagnosis and assistance in manufacturing systems: Implementation and testing in an aseptic bottling line10.1016/j.compind.2021.103429 ↗
53. Enabling human–infrastructure interfaces for inspection using augmented reality10.1177/1475921720977017 ↗
54. General Requirements for Industrial Augmented Reality Applications10.1016/j.procir.2018.03.061 ↗
55. Augmented reality technology in the manufacturing industry: A review of the last decade10.1080/24725854.2018.1493244 ↗
56. Ruppert, T., Jaskó, S., Holczinger, T., and Abonyi, J. (2018). Enabling Technologies for Operator 4.0: A Survey. Appl. Sci., 8.10.3390/app8091650 ↗
57. Developing augmented reality capabilities for industry 4.0 small enterprises: Lessons learnt from a content authoring case study10.1016/j.compind.2020.103208 ↗
58. Augmented reality tools for industrial applications: What are potential key performance indicators and who benefits?10.1016/j.chb.2018.04.054 ↗
59. Augmented Reality for telemaintenance and -inspection in force-sensitive industrial robot applications10.1016/j.ifacol.2015.08.124 ↗
60. Towards the use of augmented reality techniques for assisted acceptance sampling10.1177/0954405415624360 ↗
61. Sauer, S., Berndt, D., Schnee, J., and Teutsch, C. (September, January 31). Worker Assistance and Quality Inspection—Application of Optical 3D Metrology and Augmented Reality Technologies. Proceedings of the 14th Joint International IMEKO TC1, TC7, TC13 Symposium on Intelligent Quality Measurements-Theory, Jena, Germany.
62. Jayaweera, M., Wijesooriya, I., Wijewardana, D., De Silva, T., and Gamage, C. (2017, January 18–21). Demo abstract: Enhanced real-time machine inspection with mobile augmented reality for maintenance and repair. Proceedings of the 2017 IEEE/ACM 2nd International Conference on Internet-of-Things Design and Implementation, IoTDI 2017 (part of CPS Week), Pittsburgh, PA, USA.10.1145/3054977.3057302 ↗
63. Augmented Reality as a Tool for Production and Quality Monitoring10.1016/j.procs.2015.12.250 ↗
64. Enhancing the quality of manual spot welding through augmented reality assisted guidance10.1016/j.procir.2015.06.076 ↗
65. Weld quality monitoring research in small scale resistance spot welding by dynamic resistance and neural network10.1016/j.measurement.2016.12.010 ↗
66. Impact of Mobile Augmented Reality System on Cognitive Behavior and Performance during Rebar Inspection Tasks10.1061/(ASCE)CP.1943-5487.0000931 ↗
67. Implementation of augmented reality for segment displacement inspection during tunneling construction10.1016/j.autcon.2017.02.007 ↗
68. Zhang, X., Cheng, Y., Hu, L., Wei, S., and Wu, F. (2020, January 27–29). Machine Vision On-line Detection System: Applications and Standardization Requirements. Proceedings of the 2020 IEEE International Conference on Artificial Intelligence and Computer Applications, ICAICA 2020, Dalian, China.10.1109/ICAICA50127.2020.9181902 ↗
69. Xu, F., Yang, F., Wu, X., Guo, Q., and Zhao, C. (2019, January 20–24). Application and experiments of 5g technology powered industrial internet. Proceedings of the 2019 IEEE International Conference on Communications Workshops, ICC Workshops, Shanghai, China.10.1109/ICCW.2019.8757129 ↗
70. ANOVA simultaneous component analysis: A tutorial review
71. Optimum utilization of waste foundry sand and fly ash for geopolymer concrete synthesis using D-optimal mixture design of experiments10.1016/j.resconrec.2019.05.008 ↗
72. Multiple comparison test by Tukey’s honestly significant difference (HSD): Do the confident level control type I error10.22271/maths.2021.v6.i1a.636 ↗
73. Research on the factorial effect of science and technology innovation (STI) policy mix using multifactor analysis of variance (ANOVA)10.1016/j.jik.2022.100249 ↗
74. Modeling and Optimization of the Yield Strength and Tensile Strength of Al7075 Butt Joint Produced by FSW and SFSW Using RSM and Desirability Function Method10.1007/s12666-020-02075-8 ↗
75. Optimization of Thermal Drilling Parameters of 6082 Al-Alloy Based on Response Surface Methodology10.1007/s13369-023-07628-9 ↗
76. Sudha, S., Keshav Kolla, V., Sanchez, A., and Plapper, P. (July, January 31). Comparing effectiveness of paper based and Augmented Reality instructions for manual assembly and training tasks. Proceedings of the Conference on Learning Factories (CLF), Graz, Austria.
77. Obermair, F., Althaler, J., Seiler, U., Zeilinger, P., Lechner, A., Pfaffeneder, L., Richter, M., and Wolfartsberger, J. (2020, January 16–21). Maintenance with Augmented Reality Remote Support in Comparison to Paper-Based Instructions: Experiment and Analysis. Proceedings of the 2020 IEEE 7th International Conference on Industrial Engineering and Applications, ICIEA 2020, Bangkok, Thailand.10.1109/ICIEA49774.2020.9102078 ↗
78. Bode, M. (2023, July 10). Evaluation of an Augmented Reality Assisted Manufacturing System for Assembly Guidance. Available online: http://essay.utwente.nl/80200/.
79. Augmented reality on industrial assembly line: Impact on effectiveness and mental workload10.1016/j.apergo.2022.103793 ↗
80. Funk, M., Kosch, T., and Schmidt, A. (2016, January 12–16). Interactive worker assistance: Comparing the effects of in-situ projection, head-mounted displays, tablet, and paper instructions. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, Heidelberg, Germany.10.1145/2971648.2971706 ↗
81. Loch, F., Quint, F., and Brishtel, I. (2016, January 14–16). Comparing Video and Augmented Reality Assistance in Manual Assembly. Proceedings of the 2016 12th International Conference on Intelligent Environments (IE), London, UK.10.1109/IE.2016.31 ↗
82. Blattgerste, J., Renner, P., Strenge, B., and Pfeiffer, T. (2018, January 26–29). In-situ instructions exceed side-by-side instructions in augmented reality assisted assembly. Proceedings of the 11th PErvasive Technologies Related to Assistive Environments Conference, Corfu, Greece.10.1145/3197768.3197778 ↗
83. Using Augmented Reality to Facilitate Piping Assembly: An Experiment-Based Evaluation10.1061/(ASCE)CP.1943-5487.0000344 ↗
84. A review of augmented reality systems and their effects on mental workload and task performance10.1016/j.heliyon.2021.e06277 ↗
85. The impact of augmented reality on cognitive load and performance: A systematic review10.1111/jcal.12617 ↗
86. SUS: A retrospective
87. Determining What Individual SUS Scores Mean: Adding an Adjective Rating Scale