AR in the Architecture Domain: State of the Art
Source abstract
Abstract
Augmented reality (AR) allows the real and digital worlds to converge and overlap in a new way of observation and understanding. The architectural field can significantly benefit from AR applications, due to their systemic complexity in terms of knowledge and process management. Global interest and many research challenges are focused on this field, thanks to the conjunction of technological and algorithmic developments from one side, and the massive digitization of built data. A significant quantity of research in the AEC and educational fields describes this state of the art. Moreover, it is a very fragmented domain, in which specific advances or case studies are often described without considering the complexity of the whole development process. The article illustrates the entire AR pipeline development in architecture, from the conceptual phase to its application, highlighting each step’s specific aspects. This storytelling aims to provide a general overview to a non-expert, deepening the topic and stimulating a democratization process. The aware and extended use of AR in multiple areas of application can lead a new way forward for environmental understanding, bridging the gap between real and virtual space in an innovative perception of architecture.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Augmented Reality Applications · 3D Surveying and Cultural Heritage · Virtual Reality Applications and Impacts
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of History, Representation and Restoration of Architecture, Sapienza University of Rome, Via del Castro Laurenziano, 7/a, 00161 Rome, Italy
References (100+)
Show source-provided references
1. A Survey on Augmented Reality Challenges and Tracking
2. A survey of augmented reality technologies, applications and limitations10.20870/IJVR.2010.9.2.2767 ↗
3. Augmented reality technologies, systems and applications10.1007/s11042-010-0660-6 ↗
4. A survey of augmented reality10.1561/1100000049 ↗
5. Buhmann, E., Ervin, S.M., and Pietsch, M. (2015, January 4–6). ARchitecture: Augmented Reality in Architecture and Urban Planning. Proceedings of the Digital Landscape Architecture 2015, Dessau, Germany.
6. Application of mixed reality for improving architectural design comprehension effectiveness10.1016/j.autcon.2021.103677 ↗
7. A Survey of Augmented, Virtual, and Mixed Reality for Cultural Heritage10.1145/3145534 ↗
8. Is culture computable?
9. Virtual and augmented reality for cultural computing and heritage: A case study of virtual exploration of underwater archaeological sites (preprint)10.1007/s10055-010-0176-4 ↗
10. Zhou, F., Been-Lirn Duh, H., and Billinghurst, M. (2008, January 15–18). Trends in augmented reality tracking, interaction and display: A review of ten years of ISMAR. Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, Cambridge, UK.
11. Mixed reality: A Survey10.1007/978-3-642-00437-7_3 ↗
12. A survey on applications of augmented reality
13. Çağdaş, G., Özkar, M., Gül, L.F., and Gürer, E. (2017, January 12). Virtual and Augmented Reality in Architectural Design and Education: An Immersive Multimodal Platform to Support Architectural Pedagogy. Proceedings of the 17th International Conference, CAAD Futures 2017, Istanbul, Turkey. HAL Archives-Ouvertes.
14. Ippolito, A., and Cigola, M. (2017). Real/Not Real: Pseudo-Holography and Augmented Reality Applications for Cultural Heritage. Handbook of Research on Emerging Technologies for Digital Preservation and Information Modeling, IGIGLOBAL.10.4018/978-1-5225-0680-5 ↗
15. A systematic review of Augmented Reality content-related techniques for knowledge transfer in maintenance applications10.1016/j.compind.2018.08.007 ↗
16. A taxonomy of mixed reality visual displays
17. Das, H. (November, January 31). Augmented reality: A class of displays on the reality-virtuality continuum. Proceedings of the SPIE 2351, Telemanipulator and Telepresence Technologies, Photonics for Industrial Applications, Boston, MA, USA.
18. Parametric surfaces for augmented architecture representation10.5194/isprs-archives-XLII-2-W9-671-2019 ↗
19. A survey of augmented reality10.1162/pres.1997.6.4.355 ↗
20. Costa, C.J., and Aparicio, M. (2013, January 11). Augmented heritage: Situating augmented reality mobile apps in Cultural Heritage communication. Proceedings of the 2013 International Conference on Information Systems and Design of Communication, Lisboa, Portugal.
21. Revisiting Milgram and Kishino’s Reality-Virtuality Continuum10.3389/frvir.2021.647997 ↗
22. Recent advances in augmented reality10.1109/38.963459 ↗
23. A survey on virtual reality10.1007/s11432-009-0066-0 ↗
24. Richir, S., and Shirai, A. (2010, January 7–9). Augmented Virtual Studio for Architectural Exploration. Proceedings of the Virtual Reality International Conference (VRIC 2010), Laval, France. Laval Virtual.
25. Wang, X., and Schnabel, M.A. (2009). Mixed Reality in Architecture, Design, And Construction, Springer.10.1007/978-1-4020-9088-2 ↗
26. A Mixed-reality Learning Environment10.1016/j.procs.2015.12.199 ↗
27. Economou, D., Klippel, A., Dodds, H., Peña-Rios, A., Lee, M., Beck, M.J.W., Pirker, J., Dengel, A., Peres, T.M., and Richter, J. (2020, January 21–25). Different types of interaction with augmented reality learning material. Proceedings of the 6th International Conference of the Immersive Learning Research Network (iLRN 2020), San Luis Obispo, CA, USA.
28. Recent Tools and Techniques of BIM-Based Augmented Reality: A Systematic Review10.1016/j.jobe.2021.102500 ↗
29. The Architecture of Complexity10.1080/14759550302804 ↗
30. Carnevali, L., and Russo, M. (2020, January 21–23). CH representation between Monge’s projections and Augmented Reality. Proceedings of the Art Collections: Cultural Heritage, Safety & Digital Innovation (ARCO), Firenze, Italy. Pending Publication.
31. Yuan, Q., Cong, G., Ma, Z., Sun, A., and Magnenat-Thalmann, N. (August, January 28). Time-aware point-of-interest recommendation. Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval (SIGIR ‘13), Dublin, Ireland.
32. Bryan, A. (2017). The New Digital Storytelling: Creating Narratives with New Media: Creating Narratives with New Media—Revised and Updated Edition, Praeger Pub.
33. Brunnett, G., Coquillart, S., and Welch, G. (2011). Augmented Reality 2.0. Virtual Realities, Springer.10.1007/978-3-211-99178-7 ↗
34. How to improve knowledge transfer strategies and practices in education? Answers from a systematic literature review
35. Cultural Learning10.1017/S0140525X0003123X ↗
36. Sheehy, K., Ferguson, R., and Clough, G. (2014). Augmented Education: Bringing Real and Virtual Learning Together, Palgrave Macmillan Editor.10.1057/9781137335814 ↗
37. A survey of mobile and wireless technologies for augmented reality systems10.1002/cav.221 ↗
38. Kiyokawa, K., Billinghurst, M., Hayes, S.E., Gupta, A., Sannohe, Y., and Kato, H. (2002, January 1). Communication behaviors of co-located users in collaborative AR interfaces. Proceedings of the International Symposium on Mixed and Augmented Reality, Darmstadt, Germany.
39. AR/MR Remote Collaboration on Physical Tasks: A Review10.1016/j.rcim.2020.102071 ↗
40. Arnold, D., Chalmers, A., and Fellner, D. (2001, January 28–30). Archeoguide: First results of an augmented reality, mobile computing system in Cultural Heritage sites. Proceedings of the 2001 Conference on Virtual Reality, Archeology, and Cultural Heritage (VAST ‘01), Glyfada, Greece.
41. Sablatnig, R., and Kampe, M. (2009, January 9–12). Cultural Heritage layers: Integrating historic media in augmented reality. Proceedings of the 15th International Conference on Virtual Systems and Multimedia, 2009 (VSMM’09), Vienna, Austria.
42. Magnenat-Thalmann, N., and Chen, J. (2010, January 12–13). A tracking framework for augmented reality tours on Cultural Heritage sites. Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry (VRCAI’10), Seoul, Korea.
43. Mobile augmented reality for Cultural Heritage
44. Oomen, J., Aroyo, L., Marchand-Maillet, S., and Douglass, J. (2012, January 2). Mobile augmented reality for interpretation of archaeological sites. Proceedings of the 2nd International ACM Workshop on Personalized Access to Cultural Heritage, Nara, Japan.10.1145/2393347.2396547 ↗
45. AR teleport: Digital reconstruction of historical and cultural-heritage sites for mobile phones via movement-based interactions10.1007/s11277-012-0758-4 ↗
46. Cultural Heritage sites visualization system based on outdoor augmented reality10.1016/j.aasri.2013.10.011 ↗
47. 3D Outdoor Augmented Reality for Architecture and Urban Planning10.1016/j.procs.2013.11.009 ↗
48. Natural interaction and wearable augmented reality for the enjoyment of the Cultural Heritage in outdoor conditions10.1007/978-3-319-13969-2_20 ↗
49. Panou, C., Ragia, L., Dimelli, D., and Mania, K. (2018). An Architecture for Mobile Outdoors Augmented Reality for Cultural Heritage. ISPRS Int. J. Geo-Inf., 7.10.3390/ijgi7120463 ↗
50. Spencer, S.N. (2009, January 14–15). Augmented reality tour system for immersive experience of Cultural Heritage. Proceedings of the 8th ACM SIGGRAPH Conference on Virtual-Reality Continuum and Its Applications in Industry (VRCAI’09), Yokohama, Japan.
51. Augmented-Reality-Based Indoor Navigation: A Comparative Analysis of Handheld Devices Versus Google Glass
52. Gao, W., Rui, Y., and Hanjalic, A. (2009, January 19–24). MARCH: Mobile augmented reality for Cultural Heritage. Proceedings of the 17th ACM International Conference on Multimedia (MM ‘09), Beijing, China.
53. The revealing flashlight: Interactive spatial augmented reality for detail exploration of Cultural Heritage artifacts10.1145/2611376 ↗
54. Li, Y., Zhang, Y., and Zhong, N. (2012, January 4–7). CAViAR: Context Aware Visual Indoor Augmented Reality for a University Campus. Proceedings of the 2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology, Macau, China.
55. Natural markers for augmented reality-based indoor navigation and facility maintenance10.1016/j.autcon.2014.08.009 ↗
56. Augmented reality applications for Cultural Heritage using Kinect10.1186/s13673-015-0040-3 ↗
57. Moles, A. (1969). Teoria Dell’informazione e Percezione Estetica, Lerici.
58. Cavallo, M., Rhodes, G.A., and Forbes, A.G. (2016, January 19–23). Riverwalk: Incorporating Historical Photographs in Public Outdoor Augmented Reality Experiences. Proceedings of the 2016 IEEE International Symposium on Mixed and Augmented Reality (ISMAR-Adjunct), Merida, Mexico.10.1109/ISMAR-Adjunct.2016.0068 ↗
59. Time and Space in the History of Cities
60. Reality-based and reconstructive models: Digital media for Cultural Heritage valorization
61. Addison, A.C., and Thwaites, H. (2018, January 26–30). Massive 3D acquisition of CH. Proceedings of the Digital Heritage 2018: New Realities: Authenticity & Automation in the Digital Age, San Francisco, CA, USA.
62. Digital Cultural Heritage meets Digital Humanities10.5194/isprs-archives-XLII-2-W15-813-2019 ↗
63. Beraldin, J.-A., Blais, F., Cournoyer, L., Rioux, M., El-Hakim, S.H., Rodella, R., Bernier, F., and Harrison, N. (1999, January 8). Digital 3D imaging system for rapid response on remote sites. Proceedings of the Second International Conference on 3-D Digital Imaging and Modeling (3DIMM), Ottawa, ON, Canada.
64. Reshaping the Coliseum in Rome: An integrated data capture and modeling method at heritage sites10.1111/1467-8659.00429 ↗
65. Brown, J.R., and Akeley, K. (2000, January 1). The Digital Michelangelo Project: 3D scanning of large statues. Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ‘00), New York, NY, USA.
66. The 3D Model Acquisition Pipeline10.1111/1467-8659.00574 ↗
67. Low cost characterization of TOF range sensors resolution
68. A multi-resolution methodology for the 3D modeling of large and complex archeological areas
69. 3D reality-based artefact models for the management of archaeological sites using 3D Gis: A framework starting from the case study of the Pompeii Archaeological area10.1016/j.jas.2011.12.034 ↗
70. 3D Survey and virtual reconstruction of archaeological sites
71. Stylianidis, E., and Remondino, F. (2016). 3D Recording, Documentation and Management of Cultural Heritage, Whittles Publishing.
72. Image-based 3D Recording for Archaeological Field Work10.1109/MCG.2003.1198259 ↗
73. Image-based 3D Modelling: A Review10.1111/j.1477-9730.2006.00383.x ↗
74. Velios, A., and Harrison, J.P. (2001, January 12–16). Laser Scanning and digital close range photogrammetry for capturing 3D archeological objects: A comparison of quality and practicality. Proceedings of the Conference in Computer Applications & Quantitative Methods in Archaeology, Beijing, China.
75. Dense image matching: Comparisons and analyses
76. Multi-scalar 3D digitization of Cultural Heritage using a low-cost integrated approach
77. Oblique photogrammetry supporting 3D urban reconstruction of complex scenarios10.5194/isprs-archives-XLII-1-W1-519-2017 ↗
78. Image-based modelling from unmanned aerial vehicle (UAV) photogrammetry: An effective, low-cost tool for archaeological applications10.1111/arcm.12078 ↗
79. Reverse modeling of Cultural Heritage: Pipeline and bottlenecks10.5194/isprs-archives-XLII-2-W9-197-2019 ↗
80. Teruggi, S., Grilli, E., Russo, M., Fassi, F., and Remondino, F. (2020). A Hierarchical Machine Learning Approach for Multi-Level and Multi-Resolution 3D Point Cloud Classification. Remote Sens., 12.10.3390/rs12162598 ↗
81. Marschner, S., and Shirley, P. (2016). Fundamentals of Computer Graphics, A K Peters/CRC Press. [4th ed.].
82. Smith, D.K., and Tardif, M. (2009). Building Information Modeling: A Strategic Implementation Guide for Architects, Engineers, Constructors, and Real Estate Asset Managers, Wiley.10.1002/9780470432846 ↗
83. X3D/X3DOM, blender game engine and OSG4WEB: Open source visualisation for Cultural Heritage environments
84. Rizzi, C., Andrisano, A., Leali, F., Gherardini, F., Pini, F., and Vergnano, A. (2020). Multisensory Augmented Reality Experiences for Cultural Heritage Exhibitions. Design Tools and Methods in Industrial Engineering, Springer. ADM 2019. Lecture Notes in Mechanical Engineering.10.1007/978-3-030-31154-4 ↗
85. Rolland, J., and Hua, H. (2005). Head-Mounted Display Systems. Encyclopedia of Optical Engineering, Taylor & Francis.
86. Optical versus video see-through head-mounted displays in medical visualization10.1162/105474600566808 ↗
87. Evaluating the Potential of Augmented Reality Interfaces for Exploring Underwater Historical Sites10.1109/ACCESS.2021.3059978 ↗
88. Spatial Augmented Reality for Architecture—Designing and Planning with and within Existing Buildings
89. Pointing in Spatial Augmented Reality from 2D Pointing Devices10.1007/978-3-319-22723-8_30 ↗
90. Walkable Mixed Reality Map as interaction interface for Virtual Heritage
91. Improvements and implementations of the spatial augmented reality applied on scale models of cultural goods for visual and communicative purpose10.1007/978-3-319-95282-6_23 ↗
92. Jin, Y., Seo, J., Lee, J.G., Ahn, S., and Han, S. (2020). BIM-Based Spatial Augmented Reality (SAR) for Architectural Design Collaboration: A Proof of Concept. Appl. Sci., 10.10.3390/app10175915 ↗
93. HySAR: Hybrid Material Rendering by an Optical See-Through Head-Mounted Display with Spatial Augmented Reality Projection10.1109/TVCG.2018.2793659 ↗
94. Stanco, F., Battiato, S., and Gallo, G. (2017). Digital Imaging for Cultural Heritage Preservation: Analysis, Restoration, and Reconstruction of Ancient Artworks, CRC Press.10.1201/b11049 ↗
95. Point Cloud accuracy of Smartphone Images: Applications in Cultural Heritage Environment10.30534/ijatcse/2020/3059420 ↗
96. Geometric Evaluation of Mobile-Phone Camera Images for 3D Information10.1155/2019/8561380 ↗
97. Turcanu-Carutiu, D., and Ion, R.-M. (2018). Cultural Heritage in Marker-Less Augmented Reality: A Survey. Advanced Methods and New Materials for Cultural Heritage Preservation, Intechopen.10.5772/intechopen.77505 ↗
98. Arth, C., Grasset, R., Gruber, L., Langlotz, T., Mulloni, A., and Wagner, D. (2015). The history of mobile augmented reality. arXiv.
99. Mobile Augmented Reality Survey: From Where We are to Where We Go10.1109/ACCESS.2017.2698164 ↗
100. Chiabrando, F., Sammartano, G., Spanò, A., and Spreafico, A. (2019). Hybrid 3D Models: When Geomatics Innovations Meet Extensive Built Heritage Complexes. ISPRS Int. J. Geo-Inf., 8.10.20944/preprints201901.0236.v1 ↗