Three-Dimensional Coordinate Calibration Models for Augmented Reality Applications in Indoor Industrial Environments
Source abstract
Abstract
The calibration of three-dimensional (3D) coordinates in augmented reality systems is a complex activity. It involves the recognition of environmental characteristics and technology that models the 3D space of the device, determining its position and orientation. Single markers suffer from numerical instability, particularly when they are small within the camera image. In the industrial environment, it is common for augmented reality applications to cover large spaces, making it difficult to maintain attributes such as precision and accuracy. To address this issue, our study proposes a two-step calibration model that leverages multiple markers for accurate localization in a larger indoor environment. We developed the calibration model using Unity3D, Mixed Reality ToolKit, and Vuforia and evaluated it in terms of precision and accuracy in a proof of concept using the MS Hololens device. Our findings reveal that employing two markers significantly reduces angular discrepancies between points in the real and augmented environments. Moreover, our results underscore that registration accuracy improves as the number of calibration points increases. The results show improvements in determining the axes that define the 3D space, with a direct influence on the position of the points observed in the experiment.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Augmented Reality Applications · 3D Surveying and Cultural Heritage · Robotics and Sensor-Based Localization
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
PPGMCTI—Graduate Program in Modeling Computing and Industrial Technology, University Center SENAI CIMATEC, Salvador 41650-010, Brazil
Software Development Department, SENAI CIMATEC, Salvador 41650-010, Brazil
Computing Modeling Department, University Center SENAI CIMATEC, Salvador 41650-010, Brazil
Institute for Science, Innovation and Technology in Industry 4.0/INCITE INDUSTRIA 4.0, Salvador 41650-010, Brazil
Funding
National Council for Scientific and Technological Development (CNPq)
References (21)
Show source-provided references
1. A survey of augmented reality10.1162/pres.1997.6.4.355 ↗
2. Augmented Reality Technology in the Manufacturing Industry: A Review of the Last Decade10.1080/24725854.2018.1493244 ↗
3. Sanna, A., Manuri, F., Lamberti, F., Paravati, G., and Pezzolla, P. (2015, January 9–12). Using handheld devices to support augmented reality-based maintenance and assembly tasks. Proceedings of the 2015 IEEE International Conference on Consumer Electronics, ICCE 2015, Las Vegas, NV, USA. Available online: www.scopus.com.10.1109/ICCE.2015.7066370 ↗
4. Funk, M., Kosch, T., and Schmidt, A. (2016, January 12–16). Interactive Worker Assistance: Comparing the Effects of In-Situ Projection, Head-Mounted Displays, Tablet, and Paper Instructions. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing, ser. UbiComp ’16, Heidelberg, Germany. Available online: http://doi.acm.org/10.1145/2971648.2971706.10.1145/2971648.2971706 ↗
5. Augmented Reality in Support of Industry 4.0Implementation Challenges and Success Factors10.1016/j.rcim.2019.02.003 ↗
6. Towards augmented reality manuals for industry 4.0: A methodology10.1016/j.rcim.2018.10.001 ↗
7. Combining visual natural markers and imu for improved ar based indoor navigation10.1016/j.aei.2015.10.005 ↗
8. BIS Research (2018). Global Augmented Reality and Mixed Reality Market-Analysis and Forecast (2018–2025), BIS Research. Available online: https://bisresearch.com/industry-report/global-augmented-reality-mixed-reality-market-2025.html.
9. Martinetti, A., Marques, H.C., Singh, S., and van Dongen, L. (2019). Reflections on the Limited Pervasiveness of Augmented Reality in Industrial Sectors. Appl. Sci., 9, Available online: https://www.mdpi.com/2076-3417/9/16/3382.10.3390/app9163382 ↗
10. Support Systems on the Industrial Shop-Floors of the Future Operators Perspective on Augmented Reality
11. Knopp, S., Klimant, P., and Allmacher, C. (2019, January 10–18). Industrial Use Case—AR Guidance using Hololens for Assembly and Disassembly of a Modular Mold, with Live Streaming for Collaborative Support. Proceedings of the 2019 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Beijing, China.10.1109/ISMAR-Adjunct.2019.00-63 ↗
12. Preparing the HoloLens for user Studies: An Augmented Reality Interface for the Spatial Adjustment of Holographic Objects in 3D Indoor Environments10.1007/s42489-019-00025-z ↗
13. Technical evaluation of hololens for multimedia: A first look10.1109/MMUL.2018.2873473 ↗
14. (2023, November 01). Spatial Mapping—Mixed Reality. Available online: https://learn.microsoft.com/en-us/windows/mixed-reality/design/spatial-mapping.
15. Vassallo, R., Rankin, A., Chen, E.C., and Peters, T.M. (2017). Medical Imaging 2017: Image Perception, Observer Performance, and Technology Assessment, SPIE. Proc. SPIE 10136.
16. Augmented Reality System Calibration for Assembly Support with the Microsoft HoloLens
17. Positioning and presenting design science research for maximum impact10.25300/MISQ/2013/37.2.01 ↗
18. (2023, November 01). PTC. Vuforia. Available online: https://developer.vuforia.com/.
19. (2023). Accuracy (Trueness and Precision) of Measurement Methods and Results-Part 1: General Principles and Definitions. Standard No. ISO 5725-1: 2023.
20. On the Use of Persistent Spatial Points for Deploying Path Navigation in Augmented Reality: An Evaluation Study
21. Cooperation of Virtual Reality and Real Objects with HoloLens10.1007/978-3-030-17798-0_10 ↗