TraceUX: An Explainable Rule-Based Framework for Context-Aware Static UX Evaluation
Source abstract
Abstract
User experience (UX) evaluation is central to software quality, yet it remains difficult to integrate into software engineering workflows in a systematic, explainable, and early-stage manner. This paper presents TraceUX, a framework for operationalizing UX heuristics and design guidance into a rule-based static evaluation pipeline that combines machine-interpretable formalization, executability-aware assessment, context-sensitive scoring, and actionable reporting. The framework is instantiated using Apple Human Interface Guidelines, Swift abstract syntax trees, and mobile games, and implemented in a proof-of-concept tool named TraceHIG. Evaluation was conducted in four layers: analysis of the full rule repository, controlled synthetic validation with injected violations, baseline assessment of 12 public Swift game projects, and a case study on one project. The full repository contained 206 rules; after excluding non-iOS yet platform-specific rules, 193 rules were retained for the downstream experiments. In controlled validation, 216 injected violations yielded 99.2% precision, 61.6% recall, and an F1-score of 0.760. In baseline analysis, overall project scores ranged from 41.6 to 88.0, reflecting rule-conformance spread under the instantiated rule base rather than direct measures of UX quality. The case study demonstrated that profile-aware scoring can yield materially different UX assessments for the same codebase under different game configurations, highlighting the importance of app profiling in static UX evaluation. These findings show that a meaningful subset of UX knowledge can be operationalized into explainable, context-aware static analysis that provides structured and actionable decision support while complementing, rather than replacing, manual and empirical UX evaluation.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Software Engineering Research · Advanced Software Engineering Methodologies · Artificial Intelligence in Games
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Information Systems, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia
Funding
King Abdulaziz University
References (46)
Show source-provided references
1. Understanding user experience for mobile applications: A systematic literature review10.1007/s42452-025-07170-3 ↗
2. Yıldız Çetin, K. (2023). Usability of Mobile Applications: A Conceptualization and Instrument Development Study Based on Apple Human Interface Guidelines. [Master’s Thesis, Istanbul Technical University].
3. What factors affect the UX in mobile apps? A systematic mapping study on the analysis of app store reviews10.1016/j.jss.2022.111462 ↗
4. Usability Heuristics for Evaluating Arabic Mobile Games10.1155/2022/5641486 ↗
5. Carrión-Toro, M., Morales-Martínez, D., Santórum, M., Bernal, L., Galindo, J., Aguilar, J., and Acosta-Vargas, P. (2025). Rethinking Usability in Serious Games: Designing an Instrument That Evaluates What Really Matters in Learning Contexts. Appl. Sci., 15.10.3390/app151810084 ↗
6. Umar, M., Hussain, I., Mahmood, T., Mirza, H.T., and Faisal, C.M.N. (2024). Design Strategies to Minimize Mobile Usability Issues in Navigation Design Patterns. Information, 15.10.3390/info15110732 ↗
7. Charoenwet, W., Thongtanunam, P., Pham, V.T., and Treude, C. (2024, January 16–20). An Empirical Study of Static Analysis Tools for Secure Code Review. Proceedings of the 33rd ACM SIGSOFT International Symposium on Software Testing and Analysis, New York, NY, USA. ISSTA 2024.10.1145/3650212.3680313 ↗
8. Static Code Analysis for IoT Security: A Systematic Literature Review10.1145/3745019 ↗
9. How Developers Engage with Static Analysis Tools in Different Contexts10.1007/s10664-019-09750-5 ↗
10. Savanna, L., Pecorelli, F., Palomba, F., De Lucia, A., and Lenarduzzi, V. (2020). A Preliminary Study on the Adequacy of Static Analysis Warnings with Respect to Code Smell Prediction. Proceedings of the 4th ACM SIGSOFT International Workshop on Machine-Learning Techniques for Software-Quality Evaluation, Association for Computing Machinery.
11. Mathur, N., Karre, S.A., and Reddy, Y.R. (2018). Usability Evaluation Framework for Mobile Apps using Code Analysis. Proceedings of the 22nd International Conference on Evaluation and Assessment in Software Engineering 2018, Association for Computing Machinery. EASE ’18.10.1145/3210459.3210480 ↗
12. Heuristic Evaluation: Comparing Generic and Specific Usability Heuristics for Identification of Usability Problems in a Living Museum Mobile Guide App
13. Heuristics used for evaluating the usability of mobile health applications: A systematic literature review10.1177/20552076241253539 ↗
14. Marcus, A., Rosenzweig, E., and Soares, M.M. (2023). Comparing Two Sets of Usability Heuristics in a User Experience Evaluation: A Case Study in an E-Commerce Mobile Application. Proceedings of the Design, User Experience, and Usability, Springer.
15. Nugroho, A., Santosa, P.I., and Hartanto, R. (2022, January 27–28). Usability Evaluation Methods of Mobile Applications: A Systematic Literature Review. Proceedings of the 2022 International Symposium on Information Technology and Digital Innovation (ISITDI), Padang, Indonesia.10.1109/ISITDI55734.2022.9944401 ↗
16. Nasr, E., Alsaggaf, W., and Sinnari, D. (2023). Developing Usability Guidelines for mHealth Applications (UGmHA). Multimodal Technol. Interact., 7.10.3390/mti7030026 ↗
17. Playability heuristics for game interface design for children: K. Sungkaew et al10.1007/s42486-024-00176-7 ↗
18. Fang, T. (2025, January 26–28). Research on the Integration of Intelligent Human-Computer Interaction in Educational Game Design. Proceedings of the 2025 International Conference on Electrical Drives, Power Electronics & Engineering (EDPEE), Los Alamitos, CA, USA.10.1109/EDPEE65754.2025.00067 ↗
19. Badkook, N., Sinnari, D., and Almakky, A. (2025). Developing Comprehensive e-Game Design Guidelines to Support Children with Language Delay: A Step-by-Step Approach with Initial Validation. Multimodal Technol. Interact., 9.10.3390/mti9070068 ↗
20. Yasin, S.N.S., and Ibrahim, R. (2024, January 24–25). Exploring User Experience Evaluation in Mobile Educational Games: A Systematic Literature Review. Proceedings of the 2024 IEEE 14th Symposium on Computer Applications & Industrial Electronics (ISCAIE), Penang, Malaysia.10.1109/ISCAIE61308.2024.10576446 ↗
21. Feiz, S., Wu, J., Zhang, X., Swearngin, A., Barik, T., and Nichols, J. (2022). Understanding Screen Relationships from Screenshots of Smartphone Applications. Proceedings of the 2022 ACM International Conference on Intelligent User Interfaces, Association for Computing Machinery.10.1145/3490099.3511109 ↗
22. Baughan, A., August, T., Yamashita, N., and Reinecke, K. (2020). Keep it Simple: How Visual Complexity and Preferences Impact Search Efficiency on Websites. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, Association for Computing Machinery. CHI’20.10.1145/3313831.3376849 ↗
23. Mining user privacy concern topics from app reviews10.1016/j.jss.2025.112355 ↗
24. Android Source Code Smells: A Systematic Literature Review10.1002/spe.3401 ↗
25. Android Source Code Vulnerability Detection: A Systematic Literature Review10.1145/3556974 ↗
26. Apple Developer (2026, January 01). Human Interface Guidelines. Available online: https://developer.apple.com/design/human-interface-guidelines.
27. Domínguez-Álvarez, D., Gorla, A., and Caballero, J. (2022, January 3). On the Usage of Programming Languages in the iOS Ecosystem. Proceedings of the 2022 IEEE 22nd International Working Conference on Source Code Analysis and Manipulation (SCAM), Limassol, Cyprus.10.1109/SCAM55253.2022.00026 ↗
28. Research of possibilities of default refactoring actions in Swift language10.15587/2706-5448.2022.266061 ↗
29. Designing Engaging Games for Education: A Systematic Literature Review on Game Motivators and Design Principles10.1109/TLT.2020.3018503 ↗
30. Schaffer, N. (2022). Heuristic UX Evaluation of Games. Game Usability, CRC Press.10.1201/9781003109389-12 ↗
31. Alzhrani, F. (2026, May 23). TraceHIG: An Explainable AST-Based and Context-Aware Static UX Evaluator for iOS Apps. Available online: https://zenodo.org/records/20362360.
32. Alzhrani, F. (2026, May 24). SyntaxScanner: Abstract Syntax Tree Builder. Available online: https://github.com/alzhraniFouz/SyntaxScanner.
33. Scalzo, G. (2026, April 01). Flappy Swift. Available online: https://github.com/gscalzo/FlappySwift.
34. Jimenez, C. (2026, April 01). Snake Classic. Available online: https://github.com/PiXeL16/SnakeClassic.
35. Schroeder, M. (2026, April 01). Potato Game. Available online: https://github.com/mick-schroeder/PotatoGame.
36. Kudryashov, V. (2026, April 01). HyperSnake — iOS Edition. Available online: https://github.com/kv34dev/HyperSnake_iOS.
37. Soria, P.H. (2026, April 01). Swift4, iOS FlappyBird Clone App. Available online: https://github.com/pH-7/Flappy-Canary.
38. Eleev, A. (2026, April 01). Physics Vehicle. Available online: https://github.com/eleev/physics-vehicle.
39. Chan, A. (2026, April 01). Hoop. Available online: https://github.com/dscyrescotti/Hoop.
40. Zheng, A. (2026, April 01). Swift 2048. Available online: https://github.com/austinzheng/swift-2048.
41. Ozel, H. (2026, April 01). Rock Paper Scissors Game. Available online: https://github.com/halilozel1903/StonePaperScissorsGame.
42. Zhao, B. (2026, April 01). Spring Festival Crush—Match 3. Available online: https://github.com/banghuazhao/Spring-Festival-Crush.
43. (2026, April 01). Vintage Frozen Bubble for iOS Re-Implementation. Available online: https://github.com/ulritter/FrozenPengu.
44. Turner, P. (2026, April 01). Viper Memory Game. Available online: https://github.com/philipturner/ar-multipendulum.
45. Lafreniere, B., R. Jonker, T., Santosa, S., Parent, M., Glueck, M., Grossman, T., Benko, H., and Wigdor, D. (2021). False Positives vs. False Negatives: The Effects of Recovery Time and Cognitive Costs on Input Error Preference. Proceedings of the 34th Annual ACM Symposium on User Interface Software and Technology, Association for Computing Machinery. UIST ’21.10.1145/3472749.3474735 ↗
46. Apple Developer (2026, January 01). App Review. Available online: https://developer.apple.com/distribute/app-review.