Longitudinal Usability and UX Analysis of a Multiplatform House Design Pipeline: Insights from Extended Use Across Web, VR, and Mobile AR
Source abstract
Abstract
Computer-Aided Design (CAD) software has long served as a foundation for planning and modeling in Architecture, Engineering, and Construction (AEC). In recent years, the introduction of Augmented Reality (AR) and Virtual Reality (VR) has significantly reshaped the CAD landscape, offering novel interaction paradigms that bridge the gap between digital prototypes and real-world spatial understanding. These technologies have enabled users to engage with 3D architectural content in more immersive and intuitive ways, facilitating improved decision making and communication throughout design workflows. As digital design services grow more complex and span multiple media platforms—from desktop-based modeling to immersive AR/VR environments—evaluating usability and User Experience (UX) becomes increasingly challenging. This paper presents a longitudinal usability and UX study of a multiplatform house design pipeline (i.e., structured workflow for creating, adapting, and delivering house designs so they can be used seamlessly across multiple platforms) comprising a web-based application for initial house creation, a mobile AR tool for contextual exterior visualization, and VR applications that allow full-scale interior exploration and configuration. Together, these components form a unified yet heterogeneous service experience across different devices and modalities. We describe the iterative design and development of this system over three distinct phases (lasting two years), each followed by user studies which evaluated UX and usability and targeted different participant profiles and design maturity levels. The paper outlines our approach to cross-platform UX evaluation, including methods such as the Think-Aloud Protocol (TAP), standardized usability metrics, and structured interviews. The results from the studies provide insight into user preferences, interaction patterns, and system coherence across platforms. From both participant and evaluator perspectives, the iterative methodology contributed to improvements in system usability and a clearer mental model of the design process. The main research question we address is how iterative design and development affects the UX of the heterogeneous service. Our findings highlight important considerations for future research and practice in the design of integrated, multiplatform XR services for AEC, with potential relevance to other domains.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Augmented Reality Applications · Virtual Reality Applications and Impacts · Spatial Cognition and Navigation
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Faculty of Electrical Engineering and Computing, University of Zagreb, 10000 Zagreb, Croatia
Funding
Croatian National Recovery and Resilience Plan
References (31)
Show source-provided references
1. Manzoor, B., Othman, I., and Pomares, J.C. (2021). Digital Technologies in the Architecture, Engineering and Construction (AEC) Industry—A Bibliometric—Qualitative Literature Review of Research Activities. Int. J. Environ. Res. Public Health, 18.10.3390/ijerph18116135 ↗
2. Inclusive Immersion: A Review of Efforts to Improve Accessibility in Virtual Reality, Augmented Reality and the Metaverse10.1007/s10055-023-00850-8 ↗
3. Lach, E., Benek, I., Zalewski, K., Skurowski, P., Kocur, A., Kotula, A., Macura, M., Pamuła, Z., Stankiewicz, M., and Wyrobek, T. (2019, January 2–3). Immersive Virtual Reality for Assisting in Inclusive Architectural Design. Proceedings of the International Conference on Man–Machine Interactions, Cracow, Poland.10.1007/978-3-030-31964-9_3 ↗
4. Augmented Reality in Design and Construction: Thematic Analysis and Conceptual Frameworks10.1108/CI-01-2022-0007 ↗
5. Virtual and Augmented Reality: Human Sensory-perceptual Requirements and Trends for Immersive Spatial Computing Experiences10.1002/jsid.2001 ↗
6. Vlahović, S., Moslavac, M., Mišura, K., Boban, L., Jović, A., and Sužnjević, M. (2025, January 2–6). Usability and User Experience Evaluation of a Multiplatform House Design Pipeline: Navigating Web, VR, and Mobile AR Workflows. Proceedings of the 2025 MIPRO 48th ICT and Electronics Convention, Opatija, Croatia.10.1109/MIPRO65660.2025.11132042 ↗
7. A Conceptual Framework for Integrating Building Information Modeling with Augmented Reality10.1016/j.autcon.2012.10.012 ↗
8. Immersive virtual reality in AECO/FM to enhance education: Systematic literature review and future directions10.1002/cae.22631 ↗
9. Using Virtual Reality to Facilitate Communication in the AEC Domain: A Systematic Review10.1108/CI-11-2019-0122 ↗
10. From BIM to Extended Reality in AEC Industry10.1016/j.autcon.2020.103254 ↗
11. Extended Reality in AEC10.1016/j.autcon.2023.105018 ↗
12. What Is XR? Towards a Framework for Augmented and Virtual Reality10.1016/j.chb.2022.107289 ↗
13. Integration of immersive approaches for collaborative processes with building information modeling (BIM) methodology for the AEC industry: An analysis of the current state and future challenges10.3390/virtualworlds2040022 ↗
14. A Design Review Session Protocol for the Implementation of Immersive Virtual Reality in Usability-Focused Analysis
15. Paes, D., and Irizarry, J. (2018). A Usability Study of an Immersive Virtual Reality Platform for Building Design Review: Considerations on Human Factors and User Interface. Proceedings of the Construction Research Congress 2018, American Society of Civil Engineers.10.1061/9780784481264.041 ↗
16. Evaluating the Effectiveness of BIM-Based Virtual Reality for Coordinating the Design Disciplines in a Building Renovation Project10.1088/1755-1315/1101/3/032019 ↗
17. Evaluation Framework for BIM-Based VR Applications in Design Phase
18. Discernible Impact of Augmented Reality on Retail Customer’s Experience, Satisfaction and Willingness to Buy10.1016/j.jretconser.2016.10.005 ↗
19. Lee, J.G., Seo, J., Abbas, A., and Choi, M. (2020). End-Users’ Augmented Reality Utilization for Architectural Design Review. Appl. Sci., 10.10.3390/app10155363 ↗
20. An iterative design methodology for user-friendly natural language office information applications10.1145/357417.357420 ↗
21. Salkind, N.J. (2010). Encyclopedia of Research Design, SAGE Publications.10.4135/9781412961288 ↗
22. Verbal Reports as Data10.1037/0033-295X.87.3.215 ↗
23. A Personal Resource for Technology Interaction: Development and Validation of the Affinity for Technology Interaction (ATI) Scale10.1080/10447318.2018.1456150 ↗
24. SUS—A Quick and Dirty Usability Scale
25. Vorderer, P., Wirth, W., Gouveia, F.R., Biocca, F., Saari, T., Jäncke, L., Böcking, S., Schramm, H., Gysbers, A., and Hartmann, T. (2025, September 28). MEC Spatial Presence Questionnaire (MEC-SPQ): Short Documentation and Instructions for Application. Report to the European Community, Project Presence: MEC (IS T-2001-37661). Available online: https://www.researchgate.net/publication/318531435_MEC_spatial_presence_questionnaire_MEC-SPQ_English_and_German_version_Short_documentation_and_instructions_for_application.
26. Davis, F.D. (1985). A Technology Acceptance Model for Empirically Testing New End-User Information Systems: Theory and Results. [Ph.D. Thesis, Massachusetts Institute of Technology].
27. Using the Technology Acceptance Model in Understanding Academics’ Behavioural Intention to Use Learning Management Systems
28. Barnum, C.M. (2020). Usability Testing Essentials: Ready, Set… Test!. Morgan Kaufmann.
29. (2025, June 28). Why You Only Need to Test with 5 Users. Available online: https://www.nngroup.com/articles/why-you-only-need-to-test-with-5-users/.
30. An integrated VR/AR framework for user-centric interactive experience of cultural heritage: The ArkaeVision project
31. Sinthya, F.F. (2025). A Systematic Literature Review on UX and Usability Assessment Methods Used in 2020s for Emerging Technologies. [Master’s Thesis, Lahti University of Technology].