journal article·2025-07-11Open access

An Interface Design Method Based on Situation Awareness and Immersive Analytics for Augmented and Mixed Reality Decision Support Systems in Construction

Ernesto Pillajo, Claudio Mourgues, Andrés Neyem, Vicente A. González

Applied Sciences· Volume 15· Issue 14

Abstract

Research on augmented reality (AR) and mixed reality (MR) demonstrated their potential to support decision-making in construction. However, most efforts emphasized technological advancements, often overlooking how to present and interact with information to effectively support decision-making in AR/MR environments. This study proposes an interface design method that integrates situation awareness (SA) and immersive analytics (IA), two complementary frameworks that address user information needs and immersive interaction design. The method guides the design of AR/MR interfaces by aligning information content, presentation, and interaction with SA requirements and IA design principles. To evaluate its effectiveness, the method was applied to develop AR and MR interface prototypes for a simulated decision-making task involving field managers during indoor construction activities of high-rise construction projects. Results show high levels of SA achieved by participants, with no statistically significant differences between AR and MR interfaces, demonstrating the method’s effectiveness to support SA in both environments. The proposed method provides a structured approach for designing immersive interfaces that enable better perception, comprehension, and projection in dynamic construction scenarios. Moreover, it provides designers with practical guidance for interface development and allows practitioners to assess existing AR/MR solutions based on their capacity to enhance SA through IA.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Human-Automation Interaction and Safety · Augmented Reality Applications · Virtual Reality Applications and Impacts

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Construction Engineering and Management, School of Engineering, Pontificia Universidad Católica de Chile, Vicuña Mackenna 4860, Santiago 7820436, Chile

Department of Computer Science, School of Engineering, Pontificia Universidad Católica de Chile, Vicuña Mackenna 4860, Santiago 7820436, Chile

National Center for Artificial Intelligence (CENIA), National Research and Development Agency (ANID), Vicuña Mackenna 4860, Santiago 7820436, Chile

Infrastructure Human Tech (IHT) Lab, Department of Civil and Environmental Engineering, University of Alberta, 9211 116 Street NW, Edmonton, AB T6G 2R3, Canada

Funding

Agencia Nacional de Investigación y Desarrollo (ANID) · FONDECYT · Secretaría de Educación Superior, Ciencia, Tecnología e Innovación (SENESCYT), Ecuador

References (63)

Show source-provided references
1. Adekunle, P., Aigbavboa, C., Akinradewo, O., Oke, A., and Aghimien, D. (2022). Construction Information Management: Benefits to the Construction Industry. Sustainability, 14.10.3390/su141811366 ↗
2. Marriott, K., Schreiber, F., Dwyer, T., Klein, K., Henry, N., Itoh, T., Stuerzlinger, W., and Thomas, B. (2018). Immersive Analytics, Springer International Publishing. Lecture Notes in Computer Science.10.1007/978-3-030-01388-2 ↗
3. Reality Check: Basics of Augmented, Virtual, and Mixed Reality10.1080/02763869.2017.1293987 ↗
4. Speicher, M., Hall, B.D., and Nebeling, M. (2019, January 4–9). What Is Mixed Reality?. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems, Scotland, UK.10.1145/3290605.3300767 ↗
5. The Impact of Virtual, Augmented and Mixed Reality Technologies on the Customer Experience10.1016/j.jbusres.2018.10.050 ↗
6. Enabling Human–Machine Collaboration in Infrastructure Inspections through Mixed Reality10.1016/j.aei.2022.101709 ↗
7. Kazemzadeh, D., Nazari, A., and Rokooei, S. (2021). Application of Augmented Reality in the Life Cycle of Construction Projects. Industry 4.0 Applications for Full Lifecycle Integration of Buildings, Southfield Rd.
8. The Renaissance of Augmented Reality in Construction: History, Present Status and Future Directions10.1108/SASBE-08-2020-0124 ↗
9. BIM-Based Mixed-Reality Application for Bridge Inspection and Maintenance10.1108/CI-04-2021-0069 ↗
10. Katika, T., Konstantinidis, F.K., Papaioannou, T., Dadoukis, A., Bolierakis, S.N., Tsimiklis, G., and Amditis, A. (2022, January 21–23). Exploiting Mixed Reality in a Next-Generation IoT Ecosystem of a Construction Site. Proceedings of the 2022 IEEE International Conference on Imaging Systems and Techniques (IST), Kaohsiung, Taiwan.10.1109/IST55454.2022.9827726 ↗
11. Mutis, I., and Hartmann, T. (2019). Augmented Reality Combined with Location-Based Management System to Improve the Construction Process, Quality Control and Information Flow. Advances in Informatics and Computing in Civil and Construction Engineering, Springer.10.1007/978-3-030-00220-6 ↗
12. Kunic, A., and Naboni, R. (2023, January 16–20). Collaborative Design and Construction of Reconfigurable Wood Structures in a Mixed Reality Environment. Proceedings of the Blucher Design Proceedings, São Paulo, Brazil.10.5151/sigradi2022-sigradi2022_193 ↗
13. Analytic Review of Using Augmented Reality for Situational Awareness10.1109/TVCG.2022.3141585 ↗
14. A Novel Mixed Reality Remote Collaboration System with Adaptive Generation of Instructions10.1016/j.cie.2024.110353 ↗
15. Endsley, M.R., Bolté, B., and Jones, D.G. (2003). Designing for Situation Awareness: An Approach to User-Centered Design, CRC Press. [1st ed.].
16. Investigating Facility Manager’s Decision Making Process through a Situation Awareness Approach
17. Woodward, J., Smith, J., Wang, I., Cuenca, S., and Ruiz, J. (October, January 28). Examining the Presentation of Information in Augmented Reality Headsets for Situational Awareness. Proceedings of the International Conference on Advanced Visual Interfaces, Salerno, Italy.
18. Chandler, T., Cordeil, M., Czauderna, T., Dwyer, T., Glowacki, J., Goncu, C., Klapperstueck, M., Klein, K., Marriott, K., and Schreiber, F. (2015, January 22–25). Immersive Analytics. Proceedings of the 2015 Big Data Visual Analytics (BDVA), Hobart, Australia.10.1109/BDVA.2015.7314296 ↗
19. Cid Martins, N., Marques, B., Dias, P., and Sousa Santos, B. (2023, January 15–28). Extending the Egocentric Viewpoint in Situated Visualization Using Augmented Reality. Proceedings of the 2023 27th International Conference Information Visualisation (IV), Tampere, Finland.10.1109/IV60283.2023.00024 ↗
20. Schwajda, D., Friedl, J., Pointecker, F., Jetter, H.-C., and Anthes, C. (2023). Transforming Graph Data Visualisations from 2D Displays into Augmented Reality 3D Space: A Quantitative Study. Front. Virtual Real., 4.10.3389/frvir.2023.1155628 ↗
21. Augmented Reality Situated Visualization in Decision-Making10.1007/s11042-021-10971-4 ↗
22. Augmented Reality in Built Environment: Classification and Implications for Future Research10.1016/j.autcon.2012.11.021 ↗
23. Mondragon Solis, F.A., and O’Brien, W. (2012). Cognitive Analysis of Field Managers. Construction Research Congress 2012: Construction Challenges in a Flat World, American Society of Civil Engineers.10.1061/9780784412329.065 ↗
24. Formalizing the Information Requirements for Decision-Making of Field Managers during Indoor Construction Activities10.1108/ECAM-07-2022-0674 ↗
25. Design and Evaluation for Situation Awareness Enhancement10.1177/154193128803200221 ↗
26. Situation Awareness Oriented Design: From User’s Cognitive Requirements to Creating Effective Supporting Technologies10.1177/154193120304700304 ↗
27. Using Multiple Cognitive Task Analysis Methods for Supervisory Control Interface Design in High-Throughput Biological Screening Processes10.1007/s10111-006-0029-9 ↗
28. Assessing the Situation Awareness of Operators Using Maritime Augmented Reality System (MARS)
29. Marriott, K., Schreiber, F., Dwyer, T., Klein, K., Riche, N.H., Itoh, T., Stuerzlinger, W., and Thomas, B.H. (2018). Immersive Analytics Applications in Life and Health Sciences. Immersive Analytics, Springer International Publishing.10.1007/978-3-030-01388-2 ↗
30. Sermarini, J., Michlowitz, R.A., LaViola, J.J., Walters, L.C., Azevedo, R., and Kider, J.T. (2022, January 1–2). BIM Driven Retrofitting Design Evaluation of Building Facades. Proceedings of the 2022 ACM Symposium on Spatial User Interaction, Online.10.1145/3565970.3567688 ↗
31. Augmented Reality Based—Decision Making (AR-DM) to Support Multi-Criteria Analysis in Constructions10.1016/j.autcon.2021.103567 ↗
32. Situation Awareness (SA), a Qualitative User-Centered Information Needs Assessment Approach
33. Dennis, A., Wixom, B., and Roth, R.M. (2012). Systems Analysis and Design, Wiley Publishing. [5th ed.].
34. Marriott, K., Schreiber, F., Dwyer, T., Klein, K., Riche, N.H., Itoh, T., Stuerzlinger, W., and Thomas, B.H. (2018). Situated Analytics. Immersive Analytics, Springer International Publishing.10.1007/978-3-030-01388-2 ↗
35. Marriott, K., Schreiber, F., Dwyer, T., Klein, K., Riche, N.H., Itoh, T., Stuerzlinger, W., and Thomas, B.H. (2018). Interaction for Immersive Analytics. Immersive Analytics, Springer International Publishing.10.1007/978-3-030-01388-2 ↗
36. Fluid Interaction for Information Visualization10.1177/1473871611413180 ↗
37. Marriott, K., Schreiber, F., Dwyer, T., Klein, K., Riche, N.H., Itoh, T., Stuerzlinger, W., and Thomas, B.H. (2018). Immersive Analytics: Time to Reconsider the Value of 3D for Information Visualisation. Immersive Analytics, Springer International Publishing.10.1007/978-3-030-01388-2 ↗
38. Ries, E. (2011). The Lean Startup: How Constant Innovation Creates Radically Successful Businesses, Crown Publishing Group. [14th ed.].
39. Núñez, D., Ferrada, X., Neyem, A., Serpell, A., and Sepúlveda, M. (2018). A User-Centered Mobile Cloud Computing Platform for Improving Knowledge Management in Small-to-Medium Enterprises in the Chilean Construction Industry. Appl. Sci., 8.10.3390/app8040516 ↗
40. Anatomicis Network: Una Plataforma de Software Educativa Basada En La Nube Para Mejorar La Enseñanza de La Anatomía En La Educación Médica10.4067/S0717-95022017000300056 ↗
41. Endsley, M.R., and Garland, D.J. (2000). Direct Measurement of Situation Awareness: Validity and Use of SAGAT. Situation Awareness Analysis and Measurement, CRC Press.10.1201/b12461 ↗
42. Harris, D. (2018). Augmented Reality in a Remote Tower Environment Based on VS/IR Fusion and Optical Tracking. Engineering Psychology and Cognitive Ergonomics, Springer International Publishing.10.1007/978-3-319-91122-9 ↗
43. Examining the Relationship between Construction Workers’ Visual Attention and Situation Awareness under Fall and Tripping Hazard Conditions: Using Mobile Eye Tracking10.1061/(ASCE)CO.1943-7862.0001516 ↗
44. Measurement of Situation Awareness in Dynamic Systems10.1518/001872095779049499 ↗
45. Interactive Dynamics for Visual Analysis10.1145/2133806.2133821 ↗
46. (2022, August 24). Apple Developer Augmented Reality Design. Available online: https://developer.apple.com/design/human-interface-guidelines/technologies/augmented-reality/.
47. (2022, September 08). Microsoft Learn Mixed Reality—Design. Available online: https://learn.microsoft.com/en-us/windows/mixed-reality/design/app-patterns-landingpage.
48. Soegaard, M. (2018). The Basics of User Experience Design, Interaction Design Foundation.
49. Prototyping Virtual Reality Serious Games for Building Earthquake Preparedness: The Auckland City Hospital Case Study10.1016/j.aei.2018.08.018 ↗
50. Newman, S. (2015). Building Microservices, O’Reilly Media, Inc.. [1st ed.].
51. Endsley, M.R., Mogford, R., Allendoerfer, K., Snyder, M., and Stein, E. (1997). Effect of Free Flight Conditions on Controller Performance, Workload, and Situation Awareness, FAA William J. Hughes Technical Center.
52. Use of Human Patient Simulation and the Situation Awareness Global Assessment Technique in Practical Trauma Skills Assessment10.1097/01.ta.0000238687.23622.89 ↗
53. Comparison between Simulation-Based Training and Lecture-Based Education in Teaching Situation Awareness. A Randomized Controlled Study10.1513/AnnalsATS.201612-950OC ↗
54. Vasileiou, K., Barnett, J., Thorpe, S., and Young, T. (2018). Characterising and Justifying Sample Size Sufficiency in Interview-Based Studies: Systematic Analysis of Qualitative Health Research over a 15-Year Period. BMC Med. Res. Methodol., 18.10.1186/s12874-018-0594-7 ↗
55. Exploratory Research and Its Impact on Problem Identification
56. The Theory of the Estimation of Test Reliability10.1007/BF02288391 ↗
57. Integrating the Last Planner System and Immersive Virtual Reality: Exploring the Social Mechanisms Produced by Using LPS in Projects
58. Being There Again—Presence in Real and Virtual Environments and Its Relation to Usability and User Experience Using a Mobile Navigation Task10.1016/j.ijhcs.2017.01.004 ↗
59. Statistical Notes for Clinical Researchers: Sample Size Calculation 2. Comparison of Two Independent Proportions10.5395/rde.2016.41.2.154 ↗
60. Nasser-Dine, A. (2021). A Systematic Method to Perform Goal Directed Task Analysis with Application to Enterprise Architecture. [Ph.D. Thesis, Université du Québec].
61. A New Dynamic Spatial Information Design Framework for AR-HUD to Evoke Drivers’ Instinctive Responses and Improve Accident Prevention10.1016/j.ijhcs.2023.103194 ↗
62. Design Patterns for Situated Visualization in Augmented Reality
63. Kotian, A.L., Nandipi, R., Ushag, M., and Veena, G.T. (2024, January 4–6). A Systematic Review on Human and Computer Interaction. Proceedings of the 2024 2nd International Conference on Intelligent Data Communication Technologies and Internet of Things (IDCIoT), Bengaluru, India.10.1109/IDCIoT59759.2024.10467622 ↗