Concept to Reality: An Integrated Approach to Testing Software User Interfaces
Source abstract
Abstract
This paper delves into the complex task of evaluating a website user interface (UI) and user experience (UX), a process complicated by gaps in research. To bridge this, we introduced an innovative human–computer interaction (HCI) framework that synergizes expert cognitive walkthroughs and user surveys for a comprehensive view. We transformed user responses into three key domains—control, engagement, and goal. Our work also generalized an extract of four context-level data metrics for a robust evaluation. The numerical evidence, such as a C1 score of 4.1, surpassing the expert usability benchmark, indicated our framework’s effectiveness. Our research not only addresses an essential gap by integrating assessments from both users and experts, but also offers actionable insights for UI/UX design. The findings extend beyond this specific context, providing a potent evaluation tool for website usability across various websites. Lastly, the research underscores the importance of prioritizing users’ needs and expert recommendations in design principles, significantly contributing to the broader domain of website usability and user experience.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Technology Adoption and User Behaviour · Cognitive Science and Mapping · Virtual Reality Applications and Impacts
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Information Systems, Queensland University of Technology, Brisbane 4000, Australia
Torrens University, Melbourne 3000, Australia
Department of Computer Science and Engineering, Bangladesh University of Business and Technology, Dhaka 1216, Bangladesh
Department of Software Engineering, Daffodil International University, Dhaka 1342, Bangladesh
School of Computer Science, Queensland University of Technology, Brisbane 4000, Australia
Funding
Australian Research Council
References (49)
Show source-provided references
1. Instrumental Usability and Effective User Experience: Interwoven Drivers and Outcomes of Human-Computer Interaction10.1080/10447318.2021.2016236 ↗
2. Why People Choose Apps: An Evaluation of the Ecology and User Experience of Mobile Applications10.1016/j.ijhcs.2022.102965 ↗
3. Fleury, S., and Chaniaud, N. (2023). Multi-User Centered Design: Acceptance, User Experience, User Research and User Testing. Theor. Issues Ergon., 1–16.10.1080/1463922X.2023.2166623 ↗
4. Cognitive and Usability Engineering Methods for the Evaluation of Clinical Information Systems10.1016/j.jbi.2004.01.003 ↗
5. Rieman, J., Franzke, M., and Redmiles, D. (1995). Conference Companion on Human Factors in Computing Systems, Association for Computing Machinery.
6. A Smart Factory Architecture Based on Industry 4.0 Technologies: Open-Source Software Implementation10.1109/ACCESS.2023.3316116 ↗
7. Data Acquisition and Monitoring System Framed in Industrial Internet of Things for PEM Hydrogen Generators10.1016/j.iot.2023.100795 ↗
8. Mourtzis, D., Angelopoulos, J., and Panopoulos, N. (2023). The Future of the Human–Machine Interface (HMI) in Society 5.0. Future Internet, 15.10.3390/fi15050162 ↗
9. Usability, User Experience and Accessibility: Towards an Integrative Model10.1080/00140139.2020.1774080 ↗
10. Towards User–Intuitive Web Interface Sign Design and Evaluation: A Semiotic Framework10.1016/j.ijhcs.2015.10.003 ↗
11. Kazemi, S., Liebchen, G., and Cetinkaya, D. (2022). HCI International 2022—Late Breaking Papers. Design, User Experience and Interaction, Springer International Publishing.
12. Effects of the Design of Mobile Security Notifications and Mobile App Usability on Users’ Security Perceptions and Continued Use Intention10.1016/j.im.2019.103235 ↗
13. Evaluating Web and Mobile User Interfaces with Semiotics: An Empirical Study10.1109/ACCESS.2020.2991840 ↗
14. Weichbroth, P., and Baj-Rogowska, A. (2019, January 1–4). Do Online Reviews Reveal Mobile Application Usability and User Experience? The Case of WhatsApp. Proceedings of the Federated Conference on Computer Science and Information Systems, Leipzig, Germany.10.15439/2019F289 ↗
15. Kocabalil, A.B., Laranjo, L., and Coiera, E. (2018, January 4–6). Measuring User Experience in Conversational Interfaces: A Comparison of Six Questionnaires. Proceedings of the 32nd International BCS Human Computer Interaction Conference, Belfast, UK.10.14236/ewic/HCI2018.21 ↗
16. A User Interface (UI) and User EXperience (UX) Evaluation Framework for Cyberlearning Environments in Computer Science and Software Engineering Education10.1016/j.heliyon.2020.e03917 ↗
17. Lewis, C., and Wharton, C. (1997). Handbook of Human-Computer Interaction, Elsevier.
18. State of the Art on the Cognitive Walkthrough Method, Its Variants and Evolutions10.1080/10447311003781409 ↗
19. A Web-Based Voice Interaction Framework Proposal for Enhancing Information Systems User Experience10.1016/j.procs.2021.12.010 ↗
20. Clauirton, T.B., Gouveia, J., Macedo, F.Q.D., Andre, L.M., Santos, W., Correia, M., Penha, M., and Anjos, F. (2017, January 5–7). Toward Accessibility with Usability: Understanding the Requirements of Impaired Uses in the Mobile Context. Proceedings of the 11th International Conference on Ubiquitous Information Management and Communication, Beppu, Japan.
21. Sahua, J., Moquillaza, A., and Paz, F. (2021). Design, User Experience, and Usability: Design for Contemporary Technological Environments, Springer International Publishing.
22. Nugraha, A.P., Syaifullah, D.H., and Puspasari, M.A. (2018, January 21–24). Usability Evaluation of Main Function on Three Mobile Banking Application. Proceedings of the International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS), Bangkok, Thailand.10.1109/ICIIBMS.2018.8549998 ↗
23. Analyzing Usability of Mobile Banking Applications in Pakistan
24. De Moura, P., Farias, D., Nunes Valença, M., Sobral, M.F.F., and Ribeiro, A.R.B. (2022). Hostelquality: A Methodology for Assessing the Quality of Hostels. Tour. Hosp. Res.10.1177/14673584221133668 ↗
25. Dong, J., Li, H., and Zhang, X. (2014). IFIP Advances in Information and Communication Technology, Springer.
26. Quality Assessment of Student Housing Facilities through Post-Occupancy Evaluation
27. Aesthetic Assessment of Website Design Based on Multimodal Fusion10.1016/j.future.2020.12.014 ↗
28. Sa, N., and Yuan, X. (2021). HCI 2021, Held as Part of the 23rd HCI International Conference, Springer International Publishing.
29. Web Site Accessibility, Quality and Vulnerability Assessment: A Survey of Government Web Sites in the Turkish Republic
30. Muhammad, A., Siddique, A., Naveed, Q.N., Khaliq, U., Aseere, A.M., Hasan, M.A., Qureshi, M.R.N., and Shahzad, B. (2021). Evaluating Usability of Academic Websites through a Fuzzy Analytical Hierarchical Process. Sustainability, 13.10.3390/su13042040 ↗
31. A Machine Learning-Based Model to Evaluate Readability and Assess Grade Level for the Web Pages10.1093/comjnl/bxaa113 ↗
32. Peer Assessment of Webpage Design: Behavioral Sequential Analysis Based on Eye Tracking Evidence
33. A Novel Model Usability Evaluation Framework (MUsE) for Explainable Artificial Intelligence10.1016/j.inffus.2021.11.017 ↗
34. Vermeeren, A.P., Law, E.L.-C., Roto, V., Obrist, M., Hoonhout, J., and Väänänen-Vainio-Mattila, K. (2010, January 21–26). User Experience Evaluation Methods: Current State and Development Needs. Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries, Reykjavik, Iceland.10.1145/1868914.1868973 ↗
35. Maia, C.L.B., and Furtado, E.S. (2016). Design, User Experience, and Usability: Design Thinking and Methods, Springer International Publishing.
36. Obrist, M., Roto, V., and Väänänen-Vainio-Mattila, K. (2009, January 4–9). User Experience Evaluation: Do You Know Which Method to Use?. Proceedings of the 27th International Conference on Human Factors in Computing Systems, CHI 2009, Extended Abstracts Volume, Boston, MA, USA.10.1145/1520340.1520401 ↗
37. Díaz-Oreiro, I., López, G., Quesada, L., and Guerrero, L.A. (2019). Standardized Questionnaires for User Experience Evaluation: A Systematic Literature Review. Proceedings, 31.10.3390/proceedings2019031014 ↗
38. (2022, October 16). Online: Assessing usability with Cognitive Walkthrough. Available online: https://uxdesign.cc/assessing-interfaces-with-cognitive-walkthrough-9f92eae4321f.
39. (2022, October 16). Online: Cognitive Mapping in User Research. Available online: https://www.nngroup.com/articles/cognitive-mapping-user-research/.
40. Mahi, M.J.N., Hossain, K.M., Biswas, M., and Whaiduzzaman, M. (2020). Lecture Notes in Electrical Engineering, Springer.
41. The Role of Aesthetics in Web Design
42. Farjana, N., Roy, S., Mahi, M.J.N., and Whaiduzzaman, M. (2020). Proceedings of International Joint Conference on Computational Intelligence, Springer.
43. Whaiduzzaman, M., Oliullah, K., Mahi, M.J.N., and Barros, A. (2020, January 3–5). AUASF: An Anonymous Users Authentication Scheme for Fog-IoT Environment. Proceedings of the 11th International Conference on Computing, Communication and Networking Technologies (ICCCNT), Kharagpur, India.10.1109/ICCCNT49239.2020.9225632 ↗
44. A Scheduling-Based Dynamic Fog Computing Framework for Augmenting Resource Utilization10.1016/j.simpat.2021.102336 ↗
45. HIBAF: A Data Security Scheme for Fog Computing10.3233/JHS-210673 ↗
46. A Review on VANET Research: Perspective of Recent Emerging Technologies10.1109/ACCESS.2022.3183605 ↗
47. Whaiduzzaman, M., Barros, A., Shovon, A.R., Hossain, M.R., and Fidge, C. (2021, January 5–10). A Resilient Fog-IoT Framework for Seamless Microservice Execution. Proceedings of the IEEE International Conference on Services Computing (SCC), Chicago, IL, USA.10.1109/SCC53864.2021.00034 ↗
48. Satu, M.S., Roy, S., Akhter, F., and Whaiduzzaman, M. (2018, January 27–28). IoLT: An IoT Based Collaborative Blended Learning Platform in Higher Education. Proceedings of the International Conference on Innovation in Engineering and Technology (ICIET), Dhaka, Bangladesh.10.1109/CIET.2018.8660931 ↗
49. MedAi: A Smartwatch-Based Application Framework for the Prediction of Common Diseases Using Machine Learning10.1109/ACCESS.2023.3236002 ↗