The Effects of the Complexity of 3D Virtual Objects on Visual Working Memory Capacity in AR Interface for Mobile Phones
Source abstract
Abstract
The current study aims to investigate the effects of 3D virtual object complexity on visual working memory capacity in mobile augmented reality (MAR) interfaces. With the popularity of augmented reality technology in mobile applications, 3D virtual elements play a key role in interaction. However, prior studies ignored the correlation between virtual object presentation and visual working memory (VWM). Given that visual working memory capacity is closely related to overall cognitive ability, the current study explored the relationship between the complexity of 3D virtual objects and VWM capacity in AR interfaces. Sixty volunteers participated in a 5-point Likert scale rating to eliminate the interference factors of familiarity, concreteness and similarity in 3D virtual material objects. Then, we further conducted an MAR change detection paradigm experiment and successfully manipulated the complexity of 3D virtual objects and the set size. Thirty-one subjects completed the formal experiment. Three measurements (reaction time, proportion correct, and Cowan’s K) were analyzed for nine experimental conditions (three object complexity levels and three object set sizes). The results confirmed that the visual working memory capacity in mobile AR interfaces is modulated by the complexity of the 3D virtual objects and set size, which decreases with the increase in complexity and set size of the displayed 3D virtual objects. As the complexity of the 3D virtual objects increases, the amount of resources allocated to each item decreases, resulting in a decrease in memory capacity and memory accuracy. This study highlights the effectiveness of VWM capacity in MAR interface design research and provides valuable insights into determining the best way to present 3D virtual objects.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Augmented Reality Applications · Interactive and Immersive Displays · Virtual Reality Applications and Impacts
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Furnishings and Industrial Design, Forestry University, Nanjing 210037, China
Dehua TB New Decoration Material Co., Ltd., Huzhou 313200, China
Funding
National Natural Science Foundation of China · China Postdoctoral Science Foundation · Collaborative Education Program of the Chinese Education Ministry
References (77)
Show source-provided references
1. A Survey of Museum Applied Research Based on Mobile Augmented Reality
2. A Combined Study of Art Works Preserved in the Archaeological Museums: 3D Survey, Spectroscopic Approach and Augmented Reality10.5194/isprs-archives-XLII-2-W11-201-2019 ↗
3. Augmented Reality in Retail: A Trade-off between User’s Control of Access to Personal Information and Augmentation Quality10.1016/j.jretconser.2017.12.010 ↗
4. Lu, F., Zhou, H., Guo, L., Chen, J., and Pei, L. (2021). An AR Core-Based Augmented Reality Campus Navigation System. Appl. Sci., 11.10.3390/app11167515 ↗
5. Applying Augmented Reality to Enhance Learning: A Study of Different Teaching Materials10.1111/jcal.12173 ↗
6. Investigating Search Among Physical and Virtual Objects Under Different Lighting Conditions10.1109/TVCG.2022.3203093 ↗
7. An Experimental Study of Consumers’ Impulse Buying Behaviour in Augmented Reality Mobile Shopping10.1080/0144929X.2021.1987523 ↗
8. Montemurro, N., Condino, S., Carbone, M., Cattari, N., D’Amato, R., Cutolo, F., and Ferrari, V. (2022). Brain Tumor and Augmented Reality: New Technologies for the Future. Int. J. Environ. Res. Public Health, 19.10.3390/ijerph19106347 ↗
9. Roesner, F., Denning, T., Newell, B.C., Kohno, T., and Calo, R. (2014, January 13–17). Augmented Reality: Hard Problems of Law and Policy. Proceedings of the 2014 Acm International Joint Conference on Pervasive and Ubiquitous Computing (Ubicomp’14 Adjunct), Seattle, WA, USA.10.1145/2638728.2641709 ↗
10. Do, T.D., LaViola, J.J., and McMahan, R.P. (2020, January 9–13). The Effects of Object Shape, Fidelity, Color, and Luminance on Depth Perception in Handheld Mobile Augmented Reality. Proceedings of the 2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), Porto de Galinhas, Brazil.10.1109/ISMAR50242.2020.00026 ↗
11. Kim, H., Ali, G., Pastor, A., Lee, M., Kim, G.J., and Hwang, J.I. (2021). Silhouettes from Real Objects Enable Realistic Interactions with a Virtual Human in Mobile Augmented Reality. Appl. Sci., 11.10.3390/app11062763 ↗
12. Extending the Technology Acceptance Model to Explain How Perceived Augmented Reality Affects Consumers’ Perceptions10.1016/j.chb.2021.107127 ↗
13. Kico, I., and Liarokapis, F. (2020). Investigating the Learning Process of Folk Dances Using Mobile Augmented Reality. Appl. Sci., 10.10.3390/app10020599 ↗
14. Imaging Technologies in Spine Surgery10.1016/j.nec.2019.08.011 ↗
15. Kim, H., Kim, T., Lee, M., Kim, G.J., and Hwang, J.I. (2021). CIRO: The Effects of Visually Diminished Real Objects on Human Perception in Handheld Augmented Reality. Electronics, 10.10.3390/electronics10080900 ↗
16. Shopping in the Digital World: Examining Customer Engagement through Augmented Reality Mobile Applications10.1016/j.chb.2019.07.002 ↗
17. Learning Anatomy via Mobile Augmented Reality: Effects on Achievement and Cognitive Load10.1002/ase.1603 ↗
18. An Adoption Framework for Mobile Augmented Reality Games: The Case of Pokemon Go10.1016/j.chb.2017.07.030 ↗
19. A Theoretical Model of Mobile Augmented Reality Acceptance in Urban Heritage Tourism10.1080/13683500.2015.1070801 ↗
20. A Systematic Review of Application Development in Augmented Reality Navigation Research10.1080/15230406.2023.2194032 ↗
21. Allocation of Resources in Working Memory: Theoretical and Empirical Implications for Visual Search10.3758/s13423-021-01881-5 ↗
22. The Allocation of Resources in Visual Working Memory and Multiple Attentional Templates10.1037/xhp0000637 ↗
23. Neumorphic or flat? Impact of icon depth on user attention and visual search efficiency10.1016/j.ergon.2022.103281 ↗
24. The Impact of Object Complexity on Visual Working Memory Capacity10.4236/psych.2017.86060 ↗
25. Representation and computation in visual working memory10.1038/s41562-024-01871-2 ↗
26. Discrete Fixed-Resolution Representations in Visual Working Memory10.1038/nature06860 ↗
27. The Number of Objects Determines Visual Working Memory Capacity Allocation for Complex Items10.1016/j.neuroimage.2015.06.051 ↗
28. A Resource-Rational Theory of Set Size Effects in Human Visual Working Memory10.7554/eLife.34963 ↗
29. The Number and Quality of Representations in Working Memory10.1177/0956797611417006 ↗
30. Set Size Effects on Working Memory Precision Are Not Due to An Averaging of Slots10.3758/s13414-019-01902-5 ↗
31. The Capacity of Visual Short-Term Memory Is Set Both by Visual Information Load and by Number of Objects10.1111/j.0963-7214.2004.01502006.x ↗
32. Comparing Memory Capacity across Stimuli Requires Maximally Dissimilar Foils: Using Deep Convolutional Neural Networks to Understand Visual Working Memory Capacity for Real-World Objects10.3758/s13421-023-01485-5 ↗
33. External Cues Improve Visual Working Memory Encoding in the Presence of Salient Distractors in Schizophrenia10.1017/S0033291724000059 ↗
34. Greater Visual Working Memory Capacity for Visually Matched Stimuli When They Are Perceived as Meaningful10.1162/jocn_a_01693 ↗
35. The nationality benefit: Long-term memory associations enhance visual working memory for color-shape conjunctions10.3758/s13423-021-01957-2 ↗
36. Augmenting the Eye of the Beholder: Exploring the Strategic Potential of Augmented Reality to Enhance Online Service Experiences10.1007/s11747-017-0541-x ↗
37. Adoption of Augmented Reality in Online Retailing and Consumers’ Product Attitude: A Cognitive Perspective10.1016/j.jretconser.2019.101986 ↗
38. Impact of AR Navigation Display Methods on Wayfinding Performance and Spatial Knowledge Acquisition
39. The impact of augmented reality on cognitive load and performance: A systematic review10.1111/jcal.12617 ↗
40. Advantages and challenges associated with augmented reality for education: A systematic review of the literature10.1016/j.edurev.2016.11.002 ↗
41. Augmented reality applications in education
42. Perception of perspective in augmented reality head-up displays10.1016/j.ijhcs.2021.102693 ↗
43. Augmented reality (AR) and spatial cognition: Effects of holographic grids on distance estimation and location memory in a 3D indoor scenario
44. Current status, opportunities and challenges of augmented reality in education10.1016/j.compedu.2012.10.024 ↗
45. Affordances of augmented reality in science learning: Suggestions for future research10.1007/s10956-012-9405-9 ↗
46. The Magical Number 4 in Short-Term Memory: A Reconsideration of Mental Storage Capacity10.1017/S0140525X01003922 ↗
47. Usage-Based Linguistics and the Magic Number Four10.1515/cog-2015-0112 ↗
48. Boundary Conditions for Observing Cognitive Load Effects in Visual Working Memory10.3758/s13421-022-01320-3 ↗
49. Familiarity increases the number of remembered Pokémon in visual short-term memory10.3758/s13421-016-0679-7 ↗
50. Does Dynamic Visual Noise Eliminate the Concreteness Effect in Working Memory?10.1016/j.jml.2018.05.009 ↗
51. Mixed-Effects Modeling with Crossed Random Effects for Subjects and Items10.1016/j.jml.2007.12.005 ↗
52. The Influence of Similarity on Visual Working Memory Representations10.1080/13506280701766313 ↗
53. Cohen, J. (2016). Methodological Issues and Strategies in Clinical Research, American Psychological Association. [4th ed.].
54. Zhang, N., Zhang, J., Jiang, S., and Ge, W. (2024). The Effects of Layout Order on Interface Complexity: An Eye-Tracking Study for Dashboard Design. Sensors, 24.10.3390/s24185966 ↗
55. Familiarity Acts as a Reduction in Objective Complexity10.3758/s13421-020-01055-z ↗
56. When “capacity” changes with set size: Ensemble representations support the detection of across-category changes in visual working memory10.1167/19.5.3 ↗
57. Visual Working Memory for Simple and Complex Visual Stimuli10.3758/BF03206454 ↗
58. Sahar, T., Sidi, Y., and Makovski, T. (2020). A Metacognitive Perspective of Visual Working Memory With Rich Complex Objects. Front. Psychol., 11.10.3389/fpsyg.2020.00179 ↗
59. Feature Binding in Visual Short Term Memory: A General Recognition Theory Analysis10.3758/s13423-017-1303-y ↗
60. Human Visual Short-Term Memory Precision Can Be Variedat Will When the Number of Retained Items Is Low10.1177/0956797611431988 ↗
61. Symmetry and Spatial Ability Enhance Change Detection in Visuospatial Structures10.3758/s13421-022-01332-z ↗
62. Shopping in Augmented Reality: The Effects of Spatial Presence, Personalization and Intrusiveness on App and Brand Responses10.1016/j.jbusres.2020.07.018 ↗
63. Using Augmented Reality to Reduce Cognitive Dissonance and Increase Purchase Intention10.1016/j.chb.2022.107564 ↗
64. Chunking in Visual Working Memory: Are Visual Features of Real-World Objects Stored in Chunks?10.1177/00315125221121228 ↗
65. Storage of Features, Conjunctions, and Objects in Visual Working Memory10.1037/0096-1523.27.1.92 ↗
66. Storage in Visual Working Memory Recruits a Content-Independent Pointer System10.1177/09567976221090923 ↗
67. Ye, C., Zhang, L., Liu, T., Li, H., and Liu, Q. (2014). Visual Working Memory Capacity for Color is Independent of Representation Resolution. PLoS ONE, 9.10.1371/journal.pone.0091681 ↗
68. What happens to an individual visual working memory representation when it is interrupted?10.1111/bjop.12339 ↗
69. Working Memory Capacity for Biological Motion: A Virtual Reality Examination10.1007/s12144-024-05682-6 ↗
70. Foresti, G.L., Fusiello, A., and Hancock, E. (2023). Detection and Localization of Changes in Immersive Virtual Reality, Springer. Image Analysis and Processing-ICIAP 2023 Workshops. ICIAP 2023. Lecture Notes in Computer Science.10.1007/978-3-031-43153-1 ↗
71. Behind the Scenes: Impact of Virtual Backgrounds in Educational Videos on Visual Processing and Learning Outcomes10.16910/jemr.16.3.4 ↗
72. Yu, S., and Chen, X. (2024). The Effect of Musical Environments on Designers’ Attention: Persistent Music Listening Interferes with Attention. Behav. Sci., 14.10.3390/bs14030216 ↗
73. Gao, W., Tian, Y., Shen, S., Ji, Y., Sun, N., Song, W., and Zhai, W. (2024). Exploring the Effects of Multi-Factors on User Emotions in Scenarios of Interaction Errors in Human–Robot Interaction. Appl. Sci., 14.10.3390/app14188164 ↗
74. Real-World Spatial Regularities Affect Visual Working Memory for Objects10.3758/s13423-015-0833-4 ↗
75. Working Memory Is Not Fixed-Capacity: More Active Storage Capacity for Real-World Objects than for Simple Stimuli10.1073/pnas.1520027113 ↗
76. Capacity and Selection in Immersive Visual Working Memory Following Naturalistic Object Disappearance10.1167/jov.23.8.9 ↗
77. Aging decreases the precision of visual working memory10.1080/13825585.2023.2262105 ↗