Performance Evaluation and Optimization of 3D Models from Low-Cost 3D Scanning Technologies for Virtual Reality and Metaverse E-Commerce
Source abstract
Abstract
Virtual Reality (VR) is and will be a key driver in the evolution of e-commerce, providing an immersive and gamified shopping experience. However, for VR shopping spaces to become a reality, retailers’ product catalogues must first be digitised into 3D models. While this may be a simple task for retail giants, it can be a major obstacle for small retailers, whose human and financial resources are often more limited, making them less competitive. Therefore, this paper presents an analysis of low-cost scanning technologies for small business owners to digitise their products and make them available on VR shopping platforms, with the aim of helping improve the competitiveness of small businesses through VR and Artificial Intelligence (AI). The technologies to be considered are photogrammetry, LiDAR sensors and NeRF.In addition to investigating which technology provides the best visual quality of 3D models based on metrics and quantitative results, these models must also offer good performance in commercial VR headsets. In this way, we also analyse the performance of such models when running on Meta Quest 2, Quest Pro and Quest 3 headsets (Reality Labs, Reality Labs, CA, USA) to determine their feasibility and provide use cases for each type of model from a scalability point of view. Finally, our work describes a model optimisation process that reduce the polygon count and texture size of high-poly models, converting them into more performance-friendly versions without significantly compromising visual quality.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Virtual Reality Applications and Impacts · 3D Surveying and Cultural Heritage · Advanced Vision and Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Information Technologies and Systems, University of Castilla-La Mancha, Paseo de la Universidad 4, 13071 Ciudad Real, Spain
Funding
Spanish Ministry of Science and Innovation · European Union (NextGenerationEU/PRTR)
References (39)
Show source-provided references
1. Garg, D., Narayana, V.A., Suganthan, P.N., Anguera, J., Koppula, V.K., and Gupta, S.K. (2023). Virtual Reality and Artificial Intelligence in e-Commerce. Advanced Computing, Springer.10.1007/978-3-031-35641-4 ↗
2. Saraswat, M., Sharma, H., Balachandran, K., Kim, J.H., and Bansal, J.C. (2022). Artificial Intelligence in E-commerce: A Literature Review. Congress on Intelligent Systems, Springer.10.1007/978-981-16-9113-3 ↗
3. How 3D Virtual Reality Stores Can Shape Consumer Purchase Decisions: The Roles of Informativeness and Playfulness10.1016/j.intmar.2019.07.002 ↗
4. Virtual reality, real reactions?: Comparing consumers’ perceptions and shopping orientation across physical and virtual-reality retail stores10.1016/j.chb.2019.02.008 ↗
5. Cortinas, M., Berne, C., Chocarro, R., Nilssen, F., and Rubio, N. (2021). Editorial: The Impact of AI-Enabled Technologies in E-commerce and Omnichannel Retailing. Front. Psychol., 12.10.3389/fpsyg.2021.718885 ↗
6. Miller, S.H., Hashemian, A., Gillihan, R., and Helms, E. (2022, January 5–7). A Comparison of Mobile Phone LiDAR Capture and Established Ground based 3D Scanning Methodologies. Proceedings of the WCX SAE World Congress Experience, Detroit, MI, USA.10.4271/2022-01-0832 ↗
7. Taratukhin, V., Matveev, M., Becker, J., and Kupriyanov, Y. (2022). The Use of Virtual Reality to Drive Innovations. VRE-IP Experiment. Information Systems and Design, Springer.
8. Mildenhall, B., Srinivasan, P.P., Tancik, M., Barron, J.T., Ramamoorthi, R., and Ng, R. (2020). NeRF: Representing Scenes as Neural Radiance Fields for View Synthesis. arXiv.10.1007/978-3-030-58452-8_24 ↗
9. Gao, K., Gao, Y., He, H., Lu, D., Xu, L., and Li, J. (2023). NeRF: Neural Radiance Field in 3D Vision, A Comprehensive Review. arXiv.
10. FoV-NeRF: Foveated Neural Radiance Fields for Virtual Reality10.1109/TVCG.2022.3203102 ↗
11. Dickson, A., Shanks, J., Ventura, J., Knott, A., and Zollmann, S. (2022). VRVideos: A Flexible Pipeline for Virtual Reality Video Creation, University of Otago.10.1109/AIVR56993.2022.00039 ↗
12. Li, K., Rolff, T., Schmidt, S., Bacher, R., Frintrop, S., Leemans, W., and Steinicke, F. (2022). Immersive Neural Graphics Primitives. arXiv.
13. Rolff, T., Li, K., Hertel, J., Schmidt, S., Frintrop, S., and Steinicke, F. (2023, January 13–15). Interactive VRS-NeRF: Lightning fast Neural Radiance Field Rendering for Virtual Reality. Proceedings of the SUI ’23: ACM Symposium on Spatial User Interaction, Sydney, Australia.10.1145/3607822.3618020 ↗
14. Obradović, M., Vasiljević, I., Durić, I., Kićanović, J., Stojaković, V., and Obradović, R. (2020). Virtual Reality Models Based on Photogrammetric Surveys—A Case Study of the Iconostasis of the Serbian Orthodox Cathedral Church of Saint Nicholas in Sremski Karlovci (Serbia). Appl. Sci., 10.10.3390/app10082743 ↗
15. Andree León Tejada, R., Alexander Jimenez Azabache, J., and Javier Berrú Beltrán, R. (2022, January 26–28). Proposal of virtual reality solution using Photogrammetry techniques to enhance the heritage promotion in a tourist center of Trujillo. Proceedings of the 2022 IEEE Engineering International Research Conference (EIRCON), Lima, Peru.10.1109/EIRCON56026.2022.9934099 ↗
16. Exploring gestural input for engineering surveys of real-life structures in virtual reality using photogrammetric 3D models10.1007/s11042-021-10520-z ↗
17. Raj, T., Hashim, F.H., Huddin, A.B., Ibrahim, M.F., and Hussain, A. (2020). A Survey on LiDAR Scanning Mechanisms. Electronics, 9.10.3390/electronics9050741 ↗
18. Mikita, T., Krausková, D., Hrůza, P., Cibulka, M., and Patočka, Z. (2022). Forest Road Wearing Course Damage Assessment Possibilities with Different Types of Laser Scanning Methods including New iPhone LiDAR Scanning Apps. Forests, 13.10.3390/f13111763 ↗
19. Vogt, M., Rips, A., and Emmelmann, C. (2021). Comparison of iPad Pro®’s LiDAR and TrueDepth Capabilities with an Industrial 3D Scanning Solution. Technologies, 9.10.3390/technologies9020025 ↗
20. Ferreira, V.S., Martins, S.G., Figueira, N.M., and Pochmann, P.G.C. (2021, January 9–10). The Use of a Digital Surface Model with Virtual Reality in the Amazonian Context. Proceedings of the 2021 International Conference on Electrical, Computer and Energy Technologies (ICECET), Cape Town, South Africa.10.1109/ICECET52533.2021.9698550 ↗
21. Immersive and desktop virtual reality in virtual fashion stores: A comparison between shopping experiences10.1007/s10055-023-00806-y ↗
22. Shopping in Virtual Reality Stores: The Influence of Immersion on System Adoption10.1080/07421222.2019.1628889 ↗
23. User-defined gesture interaction for immersive VR shopping applications10.1080/0144929X.2018.1552313 ↗
24. VRShop: A Mobile Interactive Virtual Reality Shopping Environment Combining the Benefits of On- and Offline Shopping10.1145/3130967 ↗
25. Speicher, M., Hell, P., Daiber, F., Simeone, A., and Krüger, A. (June, January 29). A virtual reality shopping experience using the apartment metaphor. Proceedings of the AVI’18 2018 International Conference on Advanced Visual Interfaces, New York, NY, USA.10.1145/3206505.3206518 ↗
26. Shravani, D., R, P.Y., Atreyas, P.V., and G, S. (2021, January 15–17). VR Supermarket: A Virtual Reality Online Shopping Platform with a Dynamic Recommendation System. Proceedings of the 2021 IEEE International Conference on Artificial Intelligence and Virtual Reality (AIVR), Taichung, Taiwan.10.1109/AIVR52153.2021.00028 ↗
27. Can a virtual supermarket bring realism into the lab? Comparing shopping behavior using virtual and pictorial store representations to behavior in a physical store10.1016/j.appet.2016.07.033 ↗
28. Frugal 3D scanning using smartphones provides an accessible framework for capturing the external ear10.1016/j.bjps.2021.03.131 ↗
29. Evaluation of the Apple iPhone 12 Pro LiDAR for an Application in Geosciences10.1038/s41598-021-01763-9 ↗
30. The Accuracy of Mobile Phone Camera Instead of High Resolution Camera in Digital Close Range Photogrammetry
31. Croce, V., Billi, D., Caroti, G., Piemonte, A., De Luca, L., and Véron, P. (2024). Comparative Assessment of Neural Radiance Fields and Photogrammetry in Digital Heritage: Impact of Varying Image Conditions on 3D Reconstruction. Remote Sens., 16.10.3390/rs16020301 ↗
32. Zhang, Z., Sun, W., Min, X., Wang, T., Lu, W., and Zhai, G. (2021). No-Reference Quality Assessment for 3D Colored Point Cloud and Mesh Models. arXiv.10.1109/TCSVT.2022.3186894 ↗
33. Perceptual Quality Assessment of Colored 3D Point Clouds10.1109/TVCG.2022.3167151 ↗
34. Zhang, Z., Sun, W., Min, X., Zhou, Q., He, J., Wang, Q., and Zhai, G. (2023). MM-PCQA: Multi-Modal Learning for No-reference Point Cloud Quality Assessment. arXiv.10.24963/ijcai.2023/195 ↗
35. Visual Quality of 3D Meshes With Diffuse Colors in Virtual Reality: Subjective and Objective Evaluation10.1109/TVCG.2020.3036153 ↗
36. A Multiscale Metric for 3D Mesh Visual Quality Assessment10.1111/j.1467-8659.2011.02017.x ↗
37. High poly to low poly workflows for real-time rendering10.1080/17453054.2017.1313682 ↗
38. Decimation of triangle meshes10.1145/142920.134010 ↗
39. Grande, R., Albusac, J., Castro-Schez, J., Vallejo, D., and Sánchez-Sobrino, S. (2023, January 16–20). A Virtual Reality Shopping platform for enhancing e-commerce activities of small businesses and local economies. Proceedings of the 2023 IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR-Adjunct), Sydney, Australia.10.1109/ISMAR-Adjunct60411.2023.00175 ↗