A Methodology to Evaluate User Experience for People with Autism Spectrum Disorder
Source abstract
Abstract
People with Autism Spectrum Disorder (ASD) have an affinity for technology, which is why multiple studies have implemented different technological proposals focused on the development of skills in people with ASD. Studies have evaluated the user experience (UX) and/or usability of their technological proposals through different evaluation methods, so they can be friendly and usable for users with ASD. However, the evaluation methods and instruments used do not consider the specific characteristics and needs of people with ASD, and furthermore, details are lacking in their implementations. To formalize the UX evaluation process, we propose a three-stage methodology to evaluate the UX in systems, products and services used by adults with ASD. The methodology considers in its processes, evaluation methods and instruments the characteristics of people with ASD so that, through the UX evaluation, the satisfaction and perception of these users about the system, product or service evaluated is improved. This proposal has been validated through the opinions of experts with knowledge in UX/Usability and ASD in two instances, which have contributed to specify, restructure, and improve the methodology.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Autism Spectrum Disorder Research · Assistive Technology in Communication and Mobility · Digital Accessibility for Disabilities
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Escuela de Ingeniería Informática, Pontificia Universidad Católica de Valparaíso, Valparaíso 2340000, Chile
Instituto Universitario Centro de Investigación Operativa (CIO), Universidad Miguel Hernández de Elche, Avenida de la Universidad s/n, 03202 Elche, Spain
References (47)
Show source-provided references
1. American Psychatric Association (2013). Diagnostic and Statistical Manual of Mental Disorders, American Psychiatric Publishing. [5th ed.].10.1176/appi.books.9780890425596 ↗
2. Schopler, E., and Mesibov, G. (1992). Insider’s point of view. High-Functioning Individuals with Autism, Springer.10.1007/978-1-4899-2456-8 ↗
3. Sensori-Motor and Daily Living Skills of Preschool Children with Autism Spectrum Disorders10.1007/s10803-008-0617-z ↗
4. Generalization and Maintenance of Functional Living Skills for Individuals with Autism Spectrum Disorder: A Review and Meta-Analysis10.1007/s40489-015-0064-7 ↗
5. Comorbid Psychiatric Disorders in Children with Autism: Interview Development and Rates of Disorders10.1007/s10803-006-0123-0 ↗
6. Valencia, K., Rusu, C., Quiñones, D., and Jamet, E. (2019). The Impact of Technology on People with Autism Spectrum Disorder: A Systematic Literature Review. Sensors, 19.10.3390/s19204485 ↗
7. Usability evaluation methods for the web: A systematic mapping study10.1016/j.infsof.2011.02.007 ↗
8. Brooke, J. (1996). SUS: A “Quick Dirty” Usability Scale. Usability Evaluation in Industry, Taylor and Francis.
9. Nielsen, J., and Molich, R. (1990, January 1–5). Heuristic Evaluation of User Interfaces. Proceedings of the SIGCHI Conference on Human Factors in Computing System, Seattle, WA, USA.10.1145/97243.97281 ↗
10. Valencia, K., Rusu, C., and Botella, F. (2021). User Experience Factors for People with Autism Spectrum Disorder. Appl. Sci., 11.10.3390/app112110469 ↗
11. Valencia, K., Rusu, C., and Botella, F. (2021, January 24–29). Preliminary Methodology to Evaluate the User Experience for People with Autism Spectrum Disorder. Proceedings of the International Conference on Human-Computer Interaction, Online.
12. International Organization for Standardization (2019). Ergonomics of Human System Interaction—Part 210: Human-Centered Design for Interactive Systems, International Organization for Standardization.
13. International Organization for Standardization (2018). Ergonomics of Human-System Interaction—Part 11: Usability: Definitions and Concepts, International Organization for Standardization.
14. Vermeeren, A., Lai-Chong, E., Roto, V., Obrist, M., Hoonhout, J., and Väänänen-Vainio-Mattila, K. (2010, January 16–20). User experience evaluation methods: Current state and development needs. Proceedings of the 6th Nordic Conference on HumanComputer Interaction: Extending Boundaries, New York, NY, USA.10.1145/1868914.1868973 ↗
15. Valencia, K., Botella, F., and Rusu, C. (July, January 26). A Property Checklist to Evaluate the User Experience for People with Autism Spectrum Disorder. Proceedings of the International Conference on Human-Computer Interaction, Online.
16. Evaluation of a spherical video-based virtual reality intervention designed to teach adaptive skills for adults with autism: A preliminary report10.1080/10494820.2019.1579236 ↗
17. Gentile, V., Adjorlu, A., Serafin, S., Rocchesso, D., and Sorce, S. (2019, January 12–14). Touch or touchless? evaluating usability of interactive displays for persons with autistic spectrum disorders. Proceedings of the 8th ACM International Symposium on Pervasive Displays (PerDis’ 19), New York, NY, USA.10.1145/3321335.3324946 ↗
18. Francese, R., Guercio, A., Rossano, V., and Bhati, D. (2022, January 6–10). A Multimodal Conversational Interface to Support the creation of customized Social Stories for People with ASD. Proceedings of the 2022 International Conference on Advanced Visual Interfaces (AVI 2022), Rome, Italy.10.1145/3531073.3531118 ↗
19. Vallefuoco, E., Purpura, G., Gison, G., Bonifacio, A., Tagliabue, L., Broggi, F., Scuccimarra, G., Pepino, A., and Nacinovich, R. (2021). A Multidisciplinary Telerehabilitation Approach for Supporting Social Interaction in Autism Spectrum Disorder Families: An Italian Digital Platform in Response to COVID-19. Brain Sci., 11.10.3390/brainsci11111404 ↗
20. Nuske, H.J., Buck, J.E., Ramesh, B., Becker-Haimes, E.M., Zentgraf, K., and Mandell, D.S. (2022). Making Progress Monitoring Easier and More Motivating: Developing a Client Data Collection App Incorporating User-Centered Design and Behavioral Economics Insights. Soc. Sci., 11.10.3390/socsci11030106 ↗
21. Hernández, P., Molina, A.I., Lacave, C., Rusu, C., and Toledano-González, A. (2022). PlanTEA: Supporting Planning and Anticipation for Children with ASD Attending Medical Appointments. Appl. Sci., 12.10.3390/app12105237 ↗
22. Teaching Emotions in Children With Autism Spectrum Disorder Through a Computer Program With Tangible Interfaces
23. Nielsen, J. (2022, August 22). NN/g Nielsen Norman Group. Available online: https://www.nngroup.com/articles/how-to-conduct-a-heuristic-evaluation/.
24. Camargo, M.C., Carvalho, T.C.P., Barros, R.M., Barros, V.T.O., and Santana, M. (2019, January 26–31). Improving Usability of a Mobile Application for Children with Autism Spectrum Disorder Using Heuristic Evaluation. Proceedings of the International Conference on Human-Computer Interaction, Orlando, FL, USA.10.1007/978-3-030-23563-5_5 ↗
25. Towards user-intuitive web interface sign design and evaluation: A semiotic framework10.1016/j.ijhcs.2015.10.003 ↗
26. Susanti, F., Junaedi, D., and Effendy, V. (2019, January 24–26). Communication Learning User Interface Model for Children with Autism with the Goal-Directed Design Method. Proceedings of the 7th International Conference on Information and Communication Technology (ICoICT), Kuala Lumpur, Malaysia.10.1109/ICoICT.2019.8835395 ↗
27. Khan, S., Tahir, M.N., and Raza, A. (2013, January 16–18). Usability issues for smartphone users with special needs—Autism. Proceedings of the International Conference on Open Source Systems and Technologies, Lahore, Pakistan.10.1109/ICOSST.2013.6720615 ↗
28. Usability Evaluation and User Acceptance of Mobile Applications for Saudi Autistic Children10.3991/ijim.v15i07.19881 ↗
29. Usability of mobile applications: Literature review and rationale for a new usability model10.1186/2194-0827-1-1 ↗
30. User acceptance of information technology: Toward a unified view10.2307/30036540 ↗
31. Ahmed, S., Deneke, W., Mai, V., Veneruso, A., Stepita, M., Dawson, A., Hoefel, B., Claeys, G., Lam, N., and Sharmin, M. (2020, January 22). InterViewR: A Mixed-Reality Based Interview Training Simulation Platform for Individuals with Autism. Proceedings of the IEEE 44th Annual Computers, Software, and Applications Conference (COMPSAC), Madrid, Spain.10.1109/COMPSAC48688.2020.0-211 ↗
32. Adiani, D., Schmidt, M., Wade, J., Swanson, A.R., Weitlauf, A., Warren, Z., and Sarkar, N. (2019, January 26–31). InterViewR: Usability Enhancement and Functional Extension of a Digital Tool for Rapid Assessment of Risk for Autism Spectrum Disorders in Toddlers Based on Pilot Test and Interview Data. Proceedings of the International Conference on Human-Computer Interaction, Orlando, FL, USA.10.1007/978-3-030-23563-5_2 ↗
33. Sarkar, A., Wade, J., Swanson, A., Weitlauf, A., Warren, Z., and Sarkar, N. (2018, January 15–20). A Data-Driven Mobile Application for Efficient, Engaging, and Accurate Screening of ASD in Toddlers. Proceedings of the 12th International Conference on Universal Access in Human-Computer Interaction, Las Vegas, NV, USA.10.1007/978-3-319-92049-8_41 ↗
34. Kim, B., Lee, D., Min, A., Paik, S., Frey, G., Bellini, S., Han, K., and Shih, P.C. (2020). PuzzleWalk: A theory-driven iterative design inquiry of a mobile game for promoting physical activity in adults with autism spectrum disorder. PLoS ONE, 15.10.1371/journal.pone.0237966 ↗
35. A Description of Think Aloud Method and Protocol Analysis10.1177/104973239300300403 ↗
36. Cognitive walkthroughs: A method for theory-based evaluation of user interfaces10.1016/0020-7373(92)90039-N ↗
37. (2022, August 23). All about, UX. Information for User Experience Professionals. Available online: http://www.allaboutux.org/all-methods.
38. Nielsen, J., and Landauer, T.K. (1993, January 24–29). A mathematical model of the finding of usability problems. Proceedings of the INTERACT’ 93 and CHI’ 93 Conference on Human Factors in Computing Systems (CHI’ 93), Amsterdam, The Netherlands.10.1145/169059.169166 ↗
39. Jordan, P.W. (2000). Designing Pleasurable Products. An Introduction to the New Human Factors, Taylor & Francis.10.1201/9780203305683 ↗
40. Følstad, A. (2007, January 7). Group-based Expert Walkthrough. Proceedings of the 3rd COST294-MAUSE International Workshop, Athens, Greece.
41. Perspective-based Usability Inspection: An Empirical Validation of Efficacy10.1023/A:1009803214692 ↗
42. Khowaja, K., and Salim, S. (2015). Heuristics to evaluate interactive systems for children with Autism Spectrum Disorder (ASD). PLoS ONE, 10.10.1371/journal.pone.0136977 ↗
43. Nielsen, J. (2022, August 22). NN/g Nielsen Norman Group. Available online: https://www.nngroup.com/articles/ten-usability-heuristics/.
44. A Methodology to Develop Usability/User eXperience Heuristics10.1016/j.csi.2018.03.002 ↗
45. Creating and Testing a Sensory Well-Being Hub for Adolescents with Developmental Disabilities
46. What Physical Education Becomes when Pupils with Neurodevelopmental Disorders are Integrated: A Transactional Understanding10.1080/17408989.2020.1834525 ↗
47. TIBCO (2022, March 03). TIBCO—What Is a Radar Chart?. Available online: https://www.tibco.com/reference-center/what-is-a-radar-chart.