journal article·2020-08-26Open access

BIM-Based Spatial Augmented Reality (SAR) for Architectural Design Collaboration: A Proof of Concept

Yixuan Jin, JoonOh Seo, Jin Gang Lee, Seungjun Ahn, SangUk Han

Applied Sciences· Volume 10· Issue 17

Abstract

Three-dimensional (3D) visualization technology, such as augmented reality (AR), has served as the display for building information modeling (BIM)-based architectural design collaboration to provide more effective design observation and communication for stakeholders. That said, AR has several technical limitations in terms of personal device issues, user experience, and visualization quality. A new form of AR called spatial augmented reality (SAR) has been introduced to address these issues, which uses a digital projector to present graphics on physical objects for augmenting real-world objects. Therefore, SAR has great benefits and potentials to combine with BIM for design collaboration. This paper introduces a BIM-based SAR operational framework, where 3D building models generated from BIM software are imported to projection mapping tools to display building surface textures on physical white building models. A case study using Revit and 3ds Max as the BIM software, and MadMapper as the projection mapping tool, was conducted to demonstrate the feasibility of the proposed framework and to evaluate the projection performance of SAR. The case study showed that the texture of BIM models could be projected on the objects clearly and realistically. Additionally, the proposed SAR method potentially offers intuitive observation of building models and comfortable wear-free experience for collaborative design, and the qualitative analysis by changing the parameters was conducted to test the different projection conditions. Since it is expected that the use of SAR can be promoted by overcoming the discussed technical limitations and possible solution application, this study aims to traceability provide the whole process of BIM-based SAR for architectural design collaboration.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Augmented Reality Applications · 3D Surveying and Cultural Heritage · Virtual Reality Applications and Impacts

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Building and Real Estate, The Hong Kong Polytechnic University, Kowloon, Hong Kong

School of Natural and Built Environments, University of South Australia, Adelaide, SA 5000, Australia

Department of Civil and Environmental Engineering, Hanyang University, Seoul 04763, Korea

References (52)

Show source-provided references
1. Collaboration and coordination in architectural design: Approaches to computer mediated team work10.1016/S0926-5805(98)00055-7 ↗
2. Kalay, Y.E. (2004). Architecture’s New Media: Principles, Theories, and Methods of Computer-Aided Design, MIT Press.
3. BIM-based collaborative design and socio-technical analytics of green buildings10.1016/j.autcon.2017.06.004 ↗
4. Integrating Augmented Reality with Building Information Modeling: Onsite construction process controlling for liquefied natural gas industry10.1016/j.autcon.2013.12.003 ↗
5. Real-time visualization of building information models (BIM)10.1016/j.autcon.2015.03.018 ↗
6. Integrated system for BIM-based collaborative design10.1016/j.autcon.2015.07.015 ↗
7. Component based engineering of a mobile BIM-based augmented reality system10.1016/j.autcon.2014.02.011 ↗
8. Augmented reality: A review10.1080/02763869.2012.670604 ↗
9. Ahlers, K.H., Kramer, A., Breen, D.E., Chevalier, P.Y., Crampton, C., Rose, E., Tuceryan, M., Whitaker, R.T., and Greer, D. (2002, January 24–28). Distributed augmented reality for collaborative design applications. Proceedings of the Computer Graphics Forum, Orlando, FL, USA.
10. Collaborative problem solving through creativity in problem definition: Expanding the pie10.1111/1467-8691.00157 ↗
11. Enablers and barriers of the multi-user virtual environment for exploratory creativity in architectural design collaboration10.1080/15710882.2015.1081239 ↗
12. Evaluation and student perception of augmented reality based design collaboration
13. Lean, BIM and Augmented Reality Applied in the Design and Construction Phase: A Literature Review
14. Recent advances in augmented reality10.1109/38.963459 ↗
15. Chen, H., Lee, A.S., Swift, M., and Tang, J.C. (2015, January 26). 3D collaboration method over HoloLens™ and Skype™ end points. Proceedings of the 3rd International Workshop on Immersive Media Experiences, New York, NY, USA.10.1145/2814347.2814350 ↗
16. Augmented reality applications in design and manufacturing10.1016/j.cirp.2012.05.010 ↗
17. Kruijff, E., Swan, J.E., and Feiner, S. (2010, January 13–16). Perceptual issues in augmented reality revisited. Proceedings of the 2010 IEEE International Symposium on Mixed and Augmented Reality, Seoul, Korea.10.1109/ISMAR.2010.5643530 ↗
18. Augmented reality: Applications, challenges and future trends
19. Defining requirements for an Augmented Reality system to overcome the challenges of creating and using design representations in co-design sessions10.1080/15710882.2018.1546319 ↗
20. Design evaluation of information appliances using augmented reality-based tangible interaction10.1016/j.compind.2013.05.006 ↗
21. Bimber, O., and Raskar, R. (2005). Spatial Augmented Reality: Merging Real and Virtual Worlds, CRC Press.10.1201/b10624 ↗
22. A survey of augmented reality technologies, applications and limitations10.20870/IJVR.2010.9.2.2767 ↗
23. Integration of CFD, VR, AR and BIM for Design Feedback in a Design Process
24. Auto AR–In Situ Visualization for Building Information Modelling
25. Billinghurst, M., Kato, H., and Myojin, S. (2009, January 19). Advanced Interaction Techniques for Augmented Reality Applications. Proceedings of the International Conference on Virtual and Mixed Reality, Berlin/Heidelberg, Germany.10.1007/978-3-642-02771-0_2 ↗
26. Kato, H., Billinghurst, M., Morinaga, K., and Tachibana, K. (2001). The Effect of Spatial Cues in Augmented Reality Video Conferencing, Hiroshima City University. Research Paper.
27. Augmented reality in architecture and design: Potentials and challenges for application
28. Benko, H., Wilson, A.D., and Zannier, F. (2014, January 5). Dyadic projected spatial augmented reality. Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology, New York, NY, USA.10.1145/2642918.2647402 ↗
29. Thomas, B.H., Marner, M., Smith, R.T., Elsayed, N.A.M., Von Itzstein, S., Klein, K., Adcock, M., Eades, P., Irlitti, A., and Zucco, J. (2014, January 9). Spatial Augmented Reality—A tool for 3D data visualization. Proceedings of the 2014 IEEE VIS International Workshop on 3DVis (3DVis), Paris, France.10.1109/3DVis.2014.7160099 ↗
30. Spatial augmented reality for product appearance design evaluation
31. Raskar, R., Welch, G., and Fuchs, H. (1999, January 10). Spatially Augmented Reality. Proceedings of the International Workshop on Augmented Reality: Placing Artificial Objects in Real Scenes, Natick, MA, USA.
32. Siegl, C. (2018). Dynamic Multi-Projection Mapping, Verlag Dr.Hut.
33. Koizumi, R., Kobayashi, D., and Hashimoto, N. (2015, January 7–9). Acceleration of Dynamic Spatial Augmented Reality System with a Depth Camera. Proceedings of the 2015 International Conference on Cyberworlds (CW), Visby, Sweden.10.1109/CW.2015.42 ↗
34. Visualisation techniques for using spatial augmented reality in the design process of a car10.1111/j.1467-8659.2011.02066.x ↗
35. Development of a flexible augmented prototyping system
36. Porter, S.R., Smith, R., and Thomas, B. (2010, January 1–3). Supporting the Industrial Design Process with Spatial Augmented Reality. Proceedings of the 20th International Conference on Artificial Reality and Telexistence, Adelaide, Australia.
37. Von Itzstein, S., Thomas, B.H., Smith, R.T., and Walker, S. (2011, January 21–25). Using Spatial Augmented Reality for Appliance Design. Proceedings of the 2011 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops), Seattle, WA, USA.10.1109/PERCOMW.2011.5766893 ↗
38. (2020, May 13). The UV Map as the Content Template. Available online: https://help.disguise.one/Content/3D-Workflow/UV-Mapping/The-UV-map-as-content-template.html.
39. (2020, May 15). Apply a Material to the Face of an Element. Available online: https://knowledge.autodesk.com/support/revit-products/learn-explore/caas/CloudHelp/cloudhelp/2018/ENU/Revit-Model/files/GUID-8BAA7C07-D174-4F02-AA81-239FD33BE363-htm.html.
40. (2020, May 13). What is UV Mapping?. Available online: https://3dcoat.com/articles/what-is-uv-mapping/.
41. Hassan, M. (2016). Proposed Workflow for UV Mapping and Texture Painting. [Bachelor’s Thesis, Blekinge Institute of Technology].
42. Mullen, T. (2011). Mastering Blender, John Wiley & Sons.
43. Fujii, K., Grossberg, M.D., and Nayar, S.K. (2005, January 20–25). A Projector-Camera System with Real-Time Photometric Adaptation for Dynamic Environments. Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’05), San Diego, CA, USA.10.1109/CVPR.2005.41 ↗
44. Simultaneous projector-camera self-calibration for three-dimensional reconstruction and projection mapping10.1109/TCI.2017.2652844 ↗
45. Audet, S., and Okutomi, M. (2009, January 20–25). A User-Friendly Method to Geometrically Calibrate Projector-Camera Systems. Proceedings of the 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, Miami, FL, USA.10.1109/CVPRW.2009.5204319 ↗
46. Sukthankar, R., and Mullin, M.D. (2000, January 14–16). Automatic Keystone Correction for Camera-Assisted Presentation Interfaces. Proceedings of the International Conference on Multimodal Interfaces, Beijing, China.10.1007/3-540-40063-X_79 ↗
47. Chen, H., Sukthankar, R., Wallace, G., and Li, K. (November, January 27). Scalable Alignment of Large-Format Multi-Projector Displays Using Camera Homography Trees. Proceedings of the IEEE Visualization, 2002, VIS 2002, Boston, MA, USA.
48. Sukthankar, R., Stockton, R.G., and Mullin, M.D. (2001, January 7–14). Smarter Presentations: Exploiting Homography in Camera-Projector Systems. Proceedings of the Eighth IEEE International Conference on Computer Vision, ICCV 2001, Vancouver, BC, Canada.
49. Projection Mapping and Automatic Calibration: Beyond a Technique10.1002/9781119706847.ch6 ↗
50. Ren, Z., Meng, J., and Yuan, J. (2011, January 13–16). Depth Camera Based Hand Gesture Recognition and Its Applications in Human-Computer-Interaction. Proceedings of the 2011 8th International Conference on Information, Communications & Signal Processing, Singapore.
51. Lapointe, J.-F., and Godin, G. (2005, January 1). On-Screen Laser Spot Detection for Large Display Interaction. Proceedings of the IEEE International Workshop on Haptic Audio Visual Environments and their Applications, Ottawa, ON, Canada.
52. Iannizzotto, G., and La Rosa, F. (2007, January 4–5). A Simple, Usable and Robust Solution for Pen-Based Interaction on Projection Displays. Proceedings of the First International Workshop on Pen-Based Learning Technologies (PLT 2007), Catania, Italy.10.1109/PLT.2007.3 ↗