Assessment of 3D Models Placement Methods in Augmented Reality
Source abstract
Abstract
Augmented reality (AR) is a relevant technology, which has demonstrated to be efficient for several applications, especially in the architecture, engineering, construction and operation (AECO) domain, where the integration of building information modeling (BIM) and AR has proved to be optimal in handling construction projects. However, the main challenge when integrating a virtual 3D model in an AR environment is the lack of precision and accuracy of placement that can occur between the real and the virtual environments. Although methods for placement via AR have been reported in the literature, there is a lack of investigations addressing their evaluation. Therefore, this paper proposes a methodology to perform a quantitative and qualitative assessment of several AR placement methods and a discussion about their usability in the specific context of AECO. We adopt root mean square error (RMSE) to quantify the placement accuracy of a 3D model and standard deviation to examine its stability (jittering). The results revealed that the AR placement error range is extremely wide (from a few centimeters up to meters). In marker-based methods, the results showed centimeter-range in both indoor and outdoor environments, compared to other methods (Inertial, Marker-less, etc.), while marker-less methods have widely varying error range from centimeters to a few meters. Other commercial solutions based on placement-sensors (GNSS and IMU), such as Trimble SiteVision, have proven placement performance in manual mode with centimeter order, while for the automatic mode, the order of placement and stability is metric, due to the low coverage of RTX (real time extended) in the study area.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Augmented Reality Applications · Robotics and Sensor-Based Localization · 3D Surveying and Cultural Heritage
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Geomatic Sciences and Surveying Engineering, Hassan II Institute of Agronomy and Veterinary Medicine, Rabat 10101, Morocco
Geomatics Unit, University of Liège, 4000 Liège, Belgium
References (67)
Show source-provided references
1. Ratajczak, J., Riedl, M., and Matt, D.T. (2019). BIM-based and AR application combined with location-based management system for the improvement of the construction performance. Buildings, 9.10.3390/buildings9050118 ↗
2. Unlocking digital technologies for waste recycling in Industry 4.0 era: A transformation towards a digitalization-based circular economy in Indonesia10.1016/j.jclepro.2022.131911 ↗
3. A framework for Exploring Iraqi tourism sites by Augmented Reality application
4. Bademosi, F., and Issa, R.R. (2019). Implementation of Augmented Reality throughout the Lifecycle of Construction Projects. Advances in Informatics and Computing in Civil and Construction Engineering, Springer.10.1007/978-3-030-00220-6_37 ↗
5. Conceptual framework for integrating BIM and augmented reality in construction management10.3846/jcem.2020.11803 ↗
6. Hajirasouli, A., Banihashemi, S., Drogemuller, R., Fazeli, A., and Mohandes, S.R. (2022). Augmented reality in design and construction: Thematic analysis and conceptual frameworks. Constr. Innov., 22, ahead-of-print.10.1108/CI-01-2022-0007 ↗
7. Using BIM and MR to improve the process of job site construction and inspection10.2495/BIM190031 ↗
8. A framework for an automated and integrated project scheduling and management system10.1016/j.autcon.2013.04.002 ↗
9. Building information modeling (BIM)-based modular integrated construction risk management–Critical survey and future needs10.1016/j.compind.2020.103327 ↗
10. Estimation of 3D Reconstruction Errors in a Stereo-Vision System
11. Depth from motion for smartphone AR10.1145/3272127.3275041 ↗
12. Assessing the Accuracy of an Outdoor Augmented Reality Solution for Mapping Underground Utilities10.1061/(ASCE)PS.1949-1204.0000474 ↗
13. Quantitative evaluation of overlaying discrepancies in mobile augmented reality applications for AEC/FM
14. Image overlay surgery based on augmented reality: A systematic review
15. Azuma, R., and Furmanski, C. (2003, January 10). Evaluating Label Placement for Augmented Reality View Management. Proceedings of the Second IEEE and ACM International Symposium on Mixed and Augmented Reality, Tokyo, Japan.
16. Interactive Occlusion and Automatic Object Placement for Augmented Reality10.1111/1467-8659.1530011 ↗
17. The utility of virtual reality and augmented reality in spine surgery10.21037/atm.2019.06.38 ↗
18. A survey of augmented reality10.1162/pres.1997.6.4.355 ↗
19. Fenais, A. (2020). Developing an Augmented Reality Solution for Mapping Underground Infrastructure. [Doctoral Dissertation, Arizona State University].
20. Bellarbi, A. (2017). Vers L’immersion Mobile en Réalité Augmentée: Une Approche Basée sur le Suivi Robuste de Cibles Naturelles et Sur L’interaction 3D. [Doctoral Dissertation, Université d’Evry–Université Paris Saclay].
21. Marker-less mobile augmented reality application for massive 3D point clouds and semantics10.5194/isprs-archives-XLIII-B2-2020-255-2020 ↗
22. Kermen, A., Aydin, T., Ercan, A.O., and Erdem, T. (2015, January 8–10). A Multi-Sensor Integrated Head-Mounted Display Setup for Augmented Reality Applications. Proceedings of the 2015 3DTV-Conference: The True Vision-Capture, Transmission and Display of 3D Video (3DTV-CON), Lisbon, Portugal.10.1109/3DTV.2015.7169357 ↗
23. Chamzas, D., and Moustakas, K. (2020). 3D Augmented Reality Tangible User Interface using Commodity Hardware. arXiv.10.5220/0009173303840391 ↗
24. A Survey of Marker-Less Tracking and Registration Methods for Health & Environmental Applications to Augmented Reality and Ubiquitous Geospatial Information Systems10.3390/s20102997 ↗
25. A survey on augmented reality challenges and tracking
26. Valencia-Jimenez, N., Leal-Junior, A., Avellar, L., Vargas-Valencia, L., Caicedo-Rodríguez, P., Ramírez-Duque, A.A., Lyra, M., Marques, C., Bastos, T., and Frizera, A. (2019). A Comparative Study of Markerless Systems Based on Color-Depth Cameras, Polymer Optical Fiber Curvature Sensors, and Inertial Measurement Units: Towards Increasing the Accuracy in Joint Angle Estimation. Electronics, 8.10.3390/electronics8020173 ↗
27. Webizing mobile augmented reality content10.1080/13614568.2013.857727 ↗
28. Self-organization of unattended wireless acoustic sensor networks for ground target tracking10.1016/j.pmcj.2008.05.003 ↗
29. Understanding digital transformation in advanced manufacturing and engineering: A bibliometric analysis, topic modeling and research trend discovery10.1016/j.aei.2021.101428 ↗
30. Chen, W., Yu, C., Tu, C., Lyu, Z., Tang, J., Ou, S., Fu, Y., and Xue, Z. (2020). A Survey on Hand Pose Estimation with Wearable Sensors and Computer-Vision-Based Methods. Sensors, 20.10.3390/s20041074 ↗
31. Augmented reality technology for preoperative planning and intraoperative navigation during hepatobiliary surgery: A review of current methods10.1016/j.hbpd.2018.02.002 ↗
32. A Model-Based 3D Template Matching Technique for Pose Acquisition of an Uncooperative Space Object10.3390/s150306360 ↗
33. Bimber, O., and Raskar, R. (2005). Spatial Augmented Reality: Merging Real and Virtual Worlds, CRC Press.10.1201/b10624 ↗
34. Moun, C., and Netramai, C. (2014, January 6–8). Localization and Building Identification in Outdoor Environment for Smartphone Using Integrated GPS and Camera. Proceedings of the 2014 Fourth International Conference on Digital Information and Communication Technology and Its Applications (DICTAP), Bangkok, Thailand.10.1109/DICTAP.2014.6821705 ↗
35. Research on Improved Image Registration Algorithm Based on PROSAC Algorithm
36. Reitmayr, G., and Drummond, T. (2006, January 22–25). Going Out: Robust Model-Based Tracking for Outdoor Augmented Reality. Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality, Santa Barbara, CA, USA.10.1109/ISMAR.2006.297801 ↗
37. High-precision vision-based mobile augmented reality system for context-aware architectural, engineering, construction and facility management (aec/fm) applications10.1186/2213-7459-1-3 ↗
38. Liu, F., Jonsson, T., and Seipel, S. (2020). Evaluation of Augmented Reality-Based Building Diagnostics Using Third Person Perspective. ISPRS Int. J. Geo. Inf., 9.10.3390/ijgi9010053 ↗
39. Lothe, P., Bourgeois, S., Dekeyser, F., Royer, E., and Dhome, M. (2009, January 20–25). Towards Geographical Referencing of Monocular Slam Reconstruction Using 3d City Models: Application to Real-Time Accurate Vision. Proceedings of the 2009 IEEE Conference on Computer Vision and Pattern Recognition, Miami, FL, USA.10.1109/CVPR.2009.5206662 ↗
40. A survey of industrial augmented reality10.1016/j.cie.2019.106159 ↗
41. Santana, J.M., Wendel, J., Trujillo, A., Suárez, J.P., Simons, A., and Koch, A. (2017). Multimodal Location Based Services—Semantic 3D City Data as Virtual and Augmented Reality. Progress in Location-Based Services 2016, Springer.10.1007/978-3-319-47289-8_17 ↗
42. Rokhsaritalemi, S., Sadeghi-Niaraki, A., and Choi, S.M. (2020). A review on mixed reality: Current trends, challenges and prospects. Appl. Sci., 10.10.3390/app10020636 ↗
43. Visual SLAM and structure from motion in dynamic environments: A survey10.1145/3177853 ↗
44. Xie, W., Liang, Y., Johnson, J., Mower, A., Burns, S., Chelini, C., Alessandro, P.D., Weibel, N., and Schulze, J.P. (2020). Interactive multi-user 3D visual analytics in augmented reality. arXiv.10.2352/ISSN.2470-1173.2020.13.ERVR-363 ↗
45. Real-time markerless tumour tracking with patient-specific deep learning using a personalised data generation strategy: Proof of concept by phantom study10.1259/bjr.20190420 ↗
46. Simon, G., Fitzgibbon, A.W., and Zisserman, A. (2000, January 5–6). Markerless Tracking Using Planar Structures in the Scene. Proceedings of the International Symposium on Augmented Reality (ISAR), Munich, Germany.
47. Un guide hybride de réalité augmentée pour les sites du patrimoine culturel subaquatique
48. Simon, R., Fröhlich, P., and Anegg, H. (2006). Beyond Location Based–the Spatially Aware Mobile Phone. International Symposium on Web and Wireless Geographical Information Systems, Springer.10.1007/11935148_2 ↗
49. Using DeepLabCut for 3D markerless pose estimation across species and behaviors10.1038/s41596-019-0176-0 ↗
50. Implementation of Object Tracking Augmented Reality Markerless Using FAST Corner Detection on User Defined-Extended Target Tracking in Multivarious Intensities
51. Shah, K. (2020, February 19). Uhyperlink: An Organized Method to Collect, Manage and Store Object Hyperlinks Using Rfid. Available online: https://dalspace.library.dal.ca/handle/10222/15076.
52. Development of a network rtk positioning and gravity-surveying application with gravity correction using a smartphone10.3390/s130708879 ↗
53. A survey of Petri net methods for controlled discrete event systems10.1023/A:1008271916548 ↗
54. Gomez, J.F., Simon, G., and Berger, M.O. (2005, January 5–8). Calibration Errors in Augmented Reality: A Practical Study. Proceedings of the Fourth IEEE and ACM International Symposium on Mixed and Augmented Reality (ISMAR’05), Vienna, Austria.10.1109/ISMAR.2005.23 ↗
55. A review of augmented reality applied to underground construction
56. Fenais, A., Ariaratnam, S.T., Ayer, S.K., and Smilovsky, N. (2019). Integrating Geographic Information Systems and Augmented Reality for Mapping Underground Utilities. Infrastructures, 4.10.3390/infrastructures4040060 ↗
57. Extended kalman filter-based methods for pose estimation using visual, inertial and magnetic sensors: Comparative analysis and performance evaluation10.3390/s130201919 ↗
58. May, K.W., Kc, C., Ochoa, J.J., Gu, N., Walsh, J., Smith, R.T., and Thomas, B.H. (2022). The Identification, Development, and Evaluation of BIM-ARDM: A BIM-Based AR Defect Management System for Construction Inspections. Buildings, 12.10.3390/buildings12020140 ↗
59. Technology development needs for advancing Augmented Reality-based inspection10.1016/j.autcon.2009.11.001 ↗
60. Cheng, J.C., Chen, K., and Chen, W. (2017, January 4–7). Comparison of Marker-Based AR and Markerless AR: A case study on Indoor Decoration System. Proceedings of the Lean and Computing in Construction Congress (LC3): Proceedings of the Joint Conference on Computing in Construction (JC3), Heraklion, Greece.
61. Parents’ user experiences of augmented reality book reading: Perceptions, expectations, and intentions10.1007/s11423-018-9611-0 ↗
62. 2D Drawing Visualization Framework for Applying Projection-Based Augmented Reality in a Panelized Construction Manufacturing Facility: Proof of Concept10.1061/(ASCE)CP.1943-5487.0000843 ↗
63. Pepe, M., Costantino, D., and Garofalo, A.R. (2020). An efficient pipeline to obtain 3D model for HBIM and structural analysis purposes from 3D point clouds. Appl. Sci., 10.10.3390/app10041235 ↗
64. Augmented Reality for Construction Site Monitoring and Documentation10.1109/JPROC.2013.2294314 ↗
65. Al-Adhami, M., Wu, S., and Ma, L. (2019). Extended Reality Approach for Construction Quality Control, International Council for Research and Innovation in Building and Construction (CIB).
66. Augmented reality visualization: A review of civil infrastructure system applications10.1016/j.aei.2015.03.005 ↗
67. Yalcinkaya, B., Aguizo, J., Couceiro, M., and Figueiredo, A. (2021, January 27–28). A Multimodal Tracking Approach for Augmented Reality Applications. Proceedings of the 12th Augmented Human International Conference, Geneva, Switzerland.10.1145/3460881.3460929 ↗