journal article·2025-08-15Open access

Remote Visualization and Optimization of Fluid Dynamics Using Mixed Reality

Sakshi Sandeep More, Brandon Antron, David Paeres, Guillermo Araya

Applied Sciences· Volume 15· Issue 16

Abstract

This study presents an innovative pipeline for processing, compressing, and remotely visualizing large-scale numerical simulations of fluid dynamics in a virtual wind tunnel (VWT), leveraging virtual and augmented reality (VR/AR) for enhanced analysis and high-end visualization. The workflow addresses the challenges of handling massive databases generated using Direct Numerical Simulation (DNS) while maintaining visual fidelity and ensuring efficient rendering for user interaction. Fully immersive visualization of supersonic (Mach number 2.86) spatially developing turbulent boundary layers (SDTBLs) over strong concave and convex curvatures was achieved. The comprehensive DNS data provides insights on the transport phenomena inside turbulent boundary layers under strong deceleration or an Adverse Pressure Gradient (APG) caused by concave walls as well as strong acceleration or a Favorable Pressure Gradient (FPG) caused by convex walls under different wall thermal conditions (i.e., Cold, Adiabatic, and Hot walls). The process begins with a .vts file input from a DNS, which is visualized using ParaView software. These visualizations, representing different fluid behaviors based on a DNS with a high spatial/temporal resolution and employing millions of “numerical sensors”, are treated as individual time frames and exported in GL Transmission Format (GLTF), which is a widely used open-source file format designed for efficient transmission and loading of 3D scenes. To support the workflow, optimized Extract–Transform–Load (ETL) techniques were implemented for high-throughput data handling. Conversion of exported Graphics Library Transmission Format (GLTF) files into Graphics Library Transmission Format Binary files (typically referred to as GLB) reduced the storage by 25% and improved the load latency by 60%. This research uses Unity’s Profile Analyzer and Memory Profiler to identify performance limitations during contour rendering, focusing on the GPU and CPU efficiency. Further, immersive VR/AR analytics are achieved by connecting the processed outputs to Unity engine software and Microsoft HoloLens Gen 2 via Azure Remote Rendering cloud services, enabling real-time exploration of fluid behavior in mixed-reality environments. This pipeline constitutes a significant advancement in the scientific visualization of fluid dynamics, particularly when applied to datasets comprising hundreds of high-resolution frames. Moreover, the methodologies and insights gleaned from this approach are highly transferable, offering potential applications across various other scientific and engineering disciplines.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Virtual Reality Applications and Impacts · Augmented Reality Applications · Teleoperation and Haptic Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Computational Turbulence and Visualization Laboratory, Department of Mechanical Engineering, University of Texas at San Antonio, San Antonio, TX 78249, USA

Funding

National Science Foundation · Air Force Office of Scientific Research (AFOSR) · DoD High-Performance Computing Modernization Program (HPCMP)

References (43)

Show source-provided references
1. Craig, A.B., Sherman, W.R., and Will, J.D. (2009). Developing Virtual Reality Applications: Foundations Of Effective Design, Morgan Kaufmann.10.1016/B978-0-12-374943-7.00002-1 ↗
2. Tucker, A.B. (1997). Scientific visualization. The Computer Science and Engineering Handbook, CRC Press. Chapter 35.
3. Friendly, M., and Denis, D.J. (2025, August 12). Milestones in the History of Thematic Cartography, Statistical Graphics, and Data Visualization. Available online: http://www.datavis.ca/milestones/.
4. Hansen, C.D., and Johnson, C.R. (2011). Visualization Handbook, Elsevier.
5. Hollister, B.E., and Pang, A. (2022). A Concise Introduction to Scientific Visualization: Past, Present, and Future, Springer Nature.10.1007/978-3-030-86419-4 ↗
6. Bednarz, T., Tobia, M., Nguyen, H., and Branchaud, D. (2019, January 14–16). Immersive Analytics using Augmented Reality for Computational Fluid Dynamics Simulations. Proceedings of the 17th International Conference on Virtual-Reality Continuum and Its Applications in Industry, Brisbane, Australia.10.1145/3359997.3365735 ↗
7. Mendoza-Ramírez, C.E., Tudon-Martinez, J.C., Félix-Herrán, L.C., Lozoya-Santos, J.d.J., and Vargas-Martínez, A. (2023). Augmented Reality: Survey. Appl. Sci., 13.10.3390/app131810491 ↗
8. Teutscher, D., Weckerle, T., Öz, Ö.F., and Krause, M.J. (2022). Interactive Scientific Visualization of Fluid Flow Simulation Data Using AR Technology-Open-Source Library OpenVisFlow. Multimodal Technol. Interact., 6.10.3390/mti6090081 ↗
9. Automated integration of extract-based CFD results with AR/VR in engineering education for practitioners10.1007/s11042-021-10621-9 ↗
10. An immersive virtual reality learning environment with CFD simulations: Unveiling the Virtual Garage concept10.1007/s10639-023-11747-z ↗
11. Kim, M., Yi, S., Jung, D., Park, S., and Seo, D. (2018). Augmented-reality visualization of aerodynamics simulation in sustainable cloud computing. Sustainability, 10.10.3390/su10051362 ↗
12. Baheri Islami, S., and Wesolowski, M.R.W.C.X. (2021). Virtual Reality Visualization of CFD Simulated Blood Flow in Cerebral Aneurysms Treated with Flow Diverter Stents. Appl. Sci., 11.10.3390/app11178082 ↗
13. Studying Computational Fluid Dynamics in a New Dimension with Virtual Reality10.1016/B978-0-12-823377-1.50341-4 ↗
14. Determination of local flow ratios and velocities in a femoral venous cannula with computational fluid dynamics and 4D flow-sensitive magnetic resonance imaging: A method validation10.1111/aor.13859 ↗
15. Yan, J., Kensek, K., Konis, K., and Noble, D. (2020). CFD Visualization in a Virtual Reality Environment Using Building Information Modeling Tools. Buildings, 10.10.3390/buildings10120229 ↗
16. Chivers, T. (2023). Estimating Particle Velocity from Dual-Camera Mixed Reality Video Images Using 3D Particle Tracking Velocimetry. [Ph.D. Thesis, The University of Vermont].10.1007/s12650-024-01028-3 ↗
17. Unity Technologies (2025). Unity User Manual (2023.3), Unity Technologies. Version 2023.3.
18. Hunt, J.C.R., Wray, A.A., and Moin, P. (2025, August 12). Eddies, streams, and convergence zones in turbulent flows, Studying Turbulence Using Numerical Simulation Databases, 2. Proceedings of the 1988 Summer Program, Available online: https://ntrs.nasa.gov/api/citations/19890015184/downloads/19890015184.pdf.
19. Visualization of indoor thermal environment on mobile devices based on augmented reality and computational fluid dynamics10.1016/j.autcon.2019.02.007 ↗
20. Enhancing visualization and interaction of complex spatial data through augmented reality10.1007/s00170-024-14481-z ↗
21. Pareja-Corcho, J., Moreno, A., Simoes, B., Pedrera-Busselo, A., San-Jose, E., Ruiz-Salguero, O., and Posada, J. (2021). A Virtual Prototype for Fast Design and Visualization of Gerotor Pumps. Appl. Sci., 11.10.3390/app11031190 ↗
22. Visualization of turbulent events via Virtual/Augmented Reality
23. Bhatia, N., and Matar, O.K. (2022, January 17–21). Learning and Teaching Fluid Dynamics using Augmented and Mixed Reality. Proceedings of the 2022 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Singapore.10.1109/ISMAR-Adjunct57072.2022.00186 ↗
24. Gan, V.J.L., Liu, T., and Li, K. (2022). Integrated BIM and VR for Interactive Aerodynamic Design and Wind Comfort Analysis of Modular Buildings. Buildings, 12.10.3390/buildings12030333 ↗
25. Soliman, M., Pesyridis, A., Dalaymani-Zad, D., Gronfula, M., and Kourmpetis, M. (2021). The Application of Virtual Reality in Engineering Education. Appl. Sci., 11.10.3390/app11062879 ↗
26. A Review on Virtual Reality and Augmented Reality in Architecture, Engineering and Construction Industry
27. A Review of Collaborative Virtual Reality Systems for the Architecture, Engineering, and Construction Industry10.3390/architecture2030027 ↗
28. A systematic review of immersive virtual reality applications for higher education: Design elements, lessons learned, and research agenda10.1016/j.compedu.2019.103778 ↗
29. A Systematic Review on Extended Reality Applications for Sustainable Manufacturing Across the Product Lifecycle10.1007/s40684-023-00567-8 ↗
30. Nee, A.Y.C., and Ong, S.K. (2023). An Augmented Reality Platform for Interactive Finite Element Analysis. Springer Handbook of Augmented Reality, Springer. Springer Handbooks.10.1007/978-3-030-67822-7 ↗
31. A taxonomy of virtual reality sports applications10.1007/s10055-024-01090-0 ↗
32. Current applications of virtual reality in basketball training: A systematic review10.1007/s12283-024-00469-1 ↗
33. From digital imagination to real-world exploration: A study on the influence factors of VR-based reconstruction of historical districts on tourists’ travel intention in the field10.1007/s10055-025-01158-5 ↗
34. Araya, G., and Lagares, C. (2022). Implicit subgrid-scale modeling of a Mach-2.5 spatially-developing turbulent boundary layer. Entropy, 24.10.3390/e24040555 ↗
35. Lagares, C., Rivera, W., and Araya, G. (2022). Scalable Post-Processing of Large-Scale Numerical Simulations of Turbulent Fluid Flows. Symmetry, 14.10.3390/sym14040823 ↗
36. A dynamic multi-scale approach for turbulent inflow boundary conditions in spatially evolving flows10.1017/S0022112010005616 ↗
37. Reynolds shear stress modeling in turbulent boundary layers subject to very strong favorable pressure gradient10.1016/j.compfluid.2020.104494 ↗
38. Araya, G., Lagares, C., and Jansen, K. (2022, January 18–22). AFOSR 2022: Effects of wall curvature on hypersonic turbulent spatially-developing boundary layers. Proceedings of the 2022 AFOSR/ONR/HVSI Annual High-Speed Aerodynamics Portfolio Review, Pasadena, CA, USA.
39. The HDF Group (2000). Hierarchical Data Format Version 5, The HDF Group.
40. Intel® Threading Building Blocks
41. Malakhov, A., Liu, D., Gorshkov, A., and Wilmarth, T. (2018, January 9–15). Composable Multi-Threading and Multi-Processing for Numeric Libraries. Proceedings of the 17th Python in Science Conference, Austin, TX, USA.10.25080/Majora-4af1f417-003 ↗
42. Schroeder, W., Martin, K., and Lorensen, B. (2006). The Visualization Toolkit, Kitware.10.1016/B978-012387582-2/50032-0 ↗
43. Henderson, A. (2007). ParaView Guide, A Parallel Visualization Application, Kitware Inc.