journal article·2022-10-08Open access

Research on the Influence of User and Graphic–Text Combined Icon Construal Level Fitting on Visual Cognition

Yanfei Zhu, Ying Li, Yun Lin, Mo Chen, Qi Guo, Zhisheng Zhang

Applied Sciences· Volume 12· Issue 19

Abstract

Based on the individual traits of the user’s construal level differences, this study examines the visual cognition differences of graphic–text combined icon concreteness in the interface between users with high and low construal levels. We classified four types of graphic–text combined icons, which are as follows: concrete graphic + concrete text (Ci + Ct), concrete graphic + abstract text (Ci + At), abstract graphic + concrete text (Ai + Ct), and abstract graphic + abstract text (Ai + At). According to the behavioral experiment results, there is no visual cognitive difference between the two types of traits users in Ci + Ct. In terms of Ci + At and Ai + Ct, the visual cognitive performance of high construal level users is slightly better than that of low construal level users. In Ai + At, there are obvious visual cognitive differences between the two types of users. Visual cognitive fluency plays a mediating role in response time and matching rates of the two types of users. Based on the construal level perspective, this study considers the visual cognitive differences based on the user’s stable traits. It provides a certain reference for the graphic–text combined icons’ design in the adaptive human–computer interaction interface.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Color perception and design · Technology Adoption and User Behaviour · Behavioral Health and Interventions

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Mechanical Engineering, Southeast University, Nanjing 211189, China

Department of Art and Design, Beijing University of Chemical Technology, Beijing 100029, China

School of Design Art and Media, Nanjing University of Science and Technology, Nanjing 210014, China

School of Art and Design, Nanjing University of Technology, Nanjing 210031, China

School of Art Design and Media, East China University of Science and Technology, Shanghai 200237, China

Funding

Natural Science Foundation of China · Jiangsu province graduate scientific research innovation project · Shanghai Pu jiang Program

References (60)

Show source-provided references
1. Shneiderman, B., and Plaisant, C. (2004). Designing the User Interface: Strategies for Effective Human-Computer Interaction, Pearson/Addison Wesley. [4th ed.].
2. The Role of Graphics in Item Selection from Menus10.1080/01449298608914502 ↗
3. Factors Affecting the Design of Computer Icons10.1016/S0169-8141(01)00064-6 ↗
4. The Importance of Mobile Interface Icons on User Interaction
5. Affordance, conventions, and design10.1145/301153.301168 ↗
6. Nielsen, J., and Molich, R. (1990, January 1–5). Heuristic evaluation of user interfaces. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Washington, DC, USA.10.1145/97243.97281 ↗
7. Nielsen, J. (1994, January 24–28). Enhancing the explanatory power of usability heuristics. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Boston, MA, USA.10.1145/259963.260333 ↗
8. Design and Evaluation of an Adaptive Icon Toolbar10.1007/BF00126652 ↗
9. Adaptive User Interfaces and Universal Usability through Plasticity of User Interface Design10.1016/j.cosrev.2021.100363 ↗
10. Rule Based Adaptive User Interface for Adaptive E-Learning System10.1007/s10639-018-9788-1 ↗
11. The Effects of Luminance Contrast and Color Combination on Icon Cognitive Performance10.1002/col.22720 ↗
12. A Study on the Relationships between Different Presentation Modes of Graphical Icons and Users’ Attention10.1016/j.chb.2016.05.008 ↗
13. The Effects of Color Combinations, Luminance Contrast, and Area Ratio on Icon Visual Search Performance10.1016/j.displa.2021.101999 ↗
14. Icon Flickering, Flicker Rate, and Color Combinations of an Icon’s Symbol/Background in Visual Search Performance10.2466/pms.106.1.117-127 ↗
15. The Effects of Icon Internal Characteristics on Complex Cognition10.1016/j.ergon.2020.102990 ↗
16. Ng, A.W.Y., and Chan, A.H.S. (2008, January 19–21). Visual and Cognitive Features on Icon Effectiveness. Proceedings of the International Multiconference of Engineers and Computer Scientists, Hong Kong, China.
17. Exploring the Effects of Icon Characteristics on User Performance: The Role of Icon Concreteness, Complexity, and Distinctiveness10.1037/1076-898X.6.4.291 ↗
18. The Usefulness of Icons on the Computer Interface: Effect of Graphical Abstraction and Functional Representation on Experienced and Novice Users10.1177/154193129804200502 ↗
19. Chajadi, F., Uddin, S., and Gutwin, C. (2022). Effects of Visual Distinctiveness on Learning and Retrieval in Icon Toolbars. [Ph.D. Thesis, University of Saskatchewan].
20. The Concreteness of Searching Module Icons and Their Effectiveness in Digital Library Applications10.1108/EL-10-2017-0227 ↗
21. Effects of Icon Concreteness and Complexity on Semantic Transparency: Younger vs. Older Users10.1007/978-3-540-70540-6_12 ↗
22. Transfer between Icon Sets and Ratings of Icon Concreteness and Appropriateness10.1177/154193129103500525 ↗
23. Learning Dual Semantic Relations with Graph Attention for Image-Text Matching10.1109/TCSVT.2020.3030656 ↗
24. Modality-Invariant Image-Text Embedding for Image-Sentence Matching
25. Matching Performance of Vehicle Icons in Graphical and Textual Formats10.1016/j.apergo.2013.11.009 ↗
26. How Do Older Adults Process Icons during a Navigation Task? Effects of Aging, Semantic Distance, and Text Label10.1080/03601277.2021.1886634 ↗
27. Graph-Based Text Representation and Matching: A Review of the State of the Art and Future Challenges10.1109/ACCESS.2020.2993191 ↗
28. Jin, W., Zhao, Z., Zhang, P., Zhu, J., He, X., and Zhuang, Y. (2021, January 11). Hierarchical Cross-Modal Graph Consistency Learning for Video-Text Retrieval. Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, Virtual Event Canada.10.1145/3404835.3462974 ↗
29. Semantic Incongruency Interferes with Endogenous Attention in Cross-Modal Integration of Semantically Congruent Objects10.3389/fnint.2019.00053 ↗
30. The In¯uence of Personality Traits on the Processing of Visual and Verbal Information10.1002/mar.20143 ↗
31. Towards Incorporating Personality into the Design of an Interface: A Method for Facilitating Users’ Interaction with the Display10.1007/s11257-018-9201-1 ↗
32. Color and Visual Complexity in Abstract Images10.1002/col.22266 ↗
33. Satcharoen, K. (2017, January 6–10). An Investigation of Computer Icon Design. Proceedings of the 21st Conference of Open Innovations FRUCT, Helsinki, Finland.
34. Temporal Construal10.1037/0033-295X.110.3.403 ↗
35. An objective evaluation of the beholder’s response to abstracts and figurative art based on construal level theory
36. Effects of Congruence between Individuals’ and Hotel Commercials’ Construal Levels on Purchase Intentions
37. The “Temporal-Processing-Fit Effect”: The Interplay between Regulatory State, Temporal Distance, and Construal Levels
38. Is Creative Description Always Effective in Purchase Intention? The Construal Level Theory as a Moderating Effect10.3389/fpsyg.2021.619340 ↗
39. The Secret Life of Fluency10.1016/j.tics.2008.02.014 ↗
40. The Feeling of Fluent Perception: A Single Experience from Multiple Asynchronous Sources10.1016/j.concog.2007.07.001 ↗
41. Exploring “Fringe” Consciousness: The Subjective Experience of Perceptual Fluency and Its Objective Bases10.1016/S1053-8100(03)00049-7 ↗
42. How Effective Are Concrete and Abstract Climate Change Images? The Moderating Role of Construal Level in Climate Change Visual Communication10.1177/10755470211008192 ↗
43. Abstract Mindsets Increase Believability of Spatially Distant Online Messages10.3389/fpsyg.2016.01056 ↗
44. Dissonance and Abstraction: Cognitive Conflict Leads to Higher Level of Construal: Dissonance and Abstraction10.1002/ejsp.2287 ↗
45. How Cognitive Conflict Affects Judgments of Learning: Evaluating the Contributions of Processing Fluency and Metamemory Beliefs10.3758/s13421-021-01143-8 ↗
46. Can Your Advertisement Go Abstract Without Affecting Willingness to Pay?: Product-Centered versus Lifestyle Content In Luxury Brand Print Advertisements10.2501/JAR-2019-005 ↗
47. Abstract Images and Words Can Convey the Same Meaning10.1038/s41598-018-25441-5 ↗
48. Warell, A. (2021). Design Syntactics: A Functional Approach to Visual Product form Theory, Model, and Methods. [Ph.D. Thesis, Chalmers University of Technology].
49. Measuring Symbol and Icon Characteristics: Norms for Concreteness, Complexity, Meaningfulness, Familiarity, and Semantic Distance for 239 Symbols10.3758/BF03200730 ↗
50. Icon Familiarity Affects the Performance of Complex Cognitive Tasks10.1177/2041669520910167 ↗
51. Semantic distance as a critical factor in icon design for in-car infotainment systems10.1016/j.apergo.2017.07.014 ↗
52. Bringing the frame into focus: The influence of regulatory fit on processing fluency and persuasion10.1037/0022-3514.86.2.205 ↗
53. The Influence of Concreteness of Concepts on the Integration of Novel Words into the Semantic Network10.3389/fpsyg.2017.02111 ↗
54. Concreteness and Imagery Effects in the Written Composition of Definitions10.1037/0022-0663.89.3.518 ↗
55. Visual imagery while reading concrete and abstract Japanese kanji words: An fMRI study10.1016/j.neures.2013.10.007 ↗
56. The neural correlates of abstract and concrete words10.1016/B978-0-12-823493-8.00018-3 ↗
57. Distinct Functional Network Connectivity for Abstract and Concrete Mental Imagery10.3389/fnhum.2018.00515 ↗
58. Imaginal, semantic, and surface-level processing of concrete and abstract words: An electrophysiological investigation10.1162/08989290051137558 ↗
59. Idiosyncratic Tower of Babel: Individual Differences in Word-Meaning Representation Increase as Word. Abstractness Increases10.1177/09567976211003877 ↗
60. Situational systematicity: A role for schema in understanding the differences between. abstract and concrete concepts10.1080/02643294.2019.1710124 ↗