journal article·2022-09-07Open access

Home-Based Activities for Children with Speech Sound Disorders: Requirements for a Tangible User Interface for Internet of Things Artefacts

Joaquim Santos, Mário Vairinhos, Jonathan Rodriguez, Luis M. T. Jesus

Applied Sciences· Volume 12· Issue 18

Abstract

This paper presents the state of the art regarding the use of tangible user interfaces for internet of artefacts (IoA) targeting health applications, with a focus on speech and language therapy and related areas, targeting home-based interventions, including data security and privacy issues. Results from a systematic literature review, focus group, and a nationwide questionnaire have been used to determine the system requirements for an artefact prototype to be developed. The aim of this study was to understand what is the usual practice of clinicians and to contribute to a better intervention or post-intervention approach for children with Speech Sound Disorders (SSD). The literature review revealed that some studies proposed technological solutions while others used a social approach and/or gamified activities. We could conclude that more research is needed and that a unified method or framework to address SSD intervention or post-intervention tools is lacking. Clinicians need more and better tools to be able to quantify and qualitatively assess the activities developed at home.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Assistive Technology in Communication and Mobility · Autism Spectrum Disorder Research · Child Development and Digital Technology

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

DigiMedia, University of Aveiro, 3810-193 Aveiro, Portugal

Instituto de Telecomunicações, 3810-193 Aveiro, Portugal

Faculty of Computing, Engineering and Science, University of South Wales (USW), Pontypridd CF37 1DL, UK

School of Health Sciences (ESSUA), University of Aveiro, 3810-193 Aveiro, Portugal

Institute of Electronics and Informatics Engineering of Aveiro (IEETA), University of Aveiro, 3810-193 Aveiro, Portugal

Funding

Ph.D. Grant · Programa Operacional Potencial Humano (POPH) · FCT-Foundation for Science and Technology · Higher Education Funding Council for Wales (HEFCW)

References (100+)

Show source-provided references
1. ASHA (2022, April 23). Speech Sound Disorders: Articulation and Phonology. American Speech-Language-Hearing Association (ASHA).. Available online: https://www.asha.org/practice-portal/clinical-topics/articulation-and-phonology/.
2. Lancaster, G. (2008). Developing Speech and Language Skills: A Resource Book for Teachers, Teaching Assistants, and Speech and Language Therapists, Phoneme Factory, Routledge.10.4324/9780203935255 ↗
3. A Systematic Review of the Association between Childhood Speech Impairment and Participation across the Lifespan10.1080/17549500802676859 ↗
4. Language Disorders Are Learning Disabilities: Challenges on the Divergent and Diverse Paths to Language Learning Disability10.1097/TLD.0000000000000005 ↗
5. ASHA (2020). AnnualWorkforce Data: 2019 ASHA-Certified Audiologist- and Speech-Language Pathologist-to-Population Ratios, American Speech-Language-Hearing Association (ASHA). Technical Report.
6. Speech–Language Pathology Telehealth in Rural and Remote Schools: The Experience of School Executive and Therapy Assistants10.22605/RRH4225 ↗
7. ASHA (2022, February 02). Telepractice: Overview. American Speech-Language-Hearing Association (ASHA). Available online: https://www.asha.org/practice-portal/professional-issues/telepractice/.
8. PACT: Parents and Children Together in Phonological Therapy10.1080/14417040600826980 ↗
9. Parental Beliefs and Experiences Regarding Involvement in Intervention for Their Child with Speech Sound Disorder10.1177/0265659015615925 ↗
10. Addition of Contingency Management to Increase Home Practice in Young Children with a Speech Sound Disorder10.3109/13682820903026762 ↗
11. Bowen, C. (2015). Children’s Speech Sound Disorders, John Wiley & Sons, Inc. [2nd ed.].10.1002/9781119180418 ↗
12. Digital Storytelling in Education: A Systematic Review of the Literature10.5539/res.v13n2p13 ↗
13. Digital Transformation to Support Literacy Teaching to Deaf Children: From Storytelling to Digital Interactive Storytelling10.1016/j.tele.2018.09.002 ↗
14. Exploring the Role of Digital Storytelling in Student Motivation and Satisfaction in EFL Education10.1080/09588221.2019.1650071 ↗
15. Parental Involvement in Speech Intervention: A National Survey10.1080/02699200801919737 ↗
16. Involvement of Parents in Intervention for Childhood Speech Sound Disorders: A Review of the Evidence: Involvement of Parents in Intervention for SSD10.1111/1460-6984.12247 ↗
17. Bernthal, J.E., Bankson, N.W., and Flipsen, P. (2017). Articulation and Phonological Disorders: Speech Sound Disorders in Children, Pearson. [8th ed.].
18. Reed, V. (2018). An Introduction to Children with Language Disorders, Pearson Education. [5th ed.].
19. Treating Children with Speech Sound Disorders: Development of a Tangible Artefact Prototype10.2196/13861 ↗
20. Santos, J., Jesus, L.M.T., Vairinhos, M., and Rodriguez, J. (2019, January 19–22). Tangible User Interface for Homework for Children with Communication Disorders. Proceedings of the 2019 14th Iberian Conference on Information Systems and Technologies (CISTI), Coimbra, Portugal.10.23919/CISTI.2019.8760591 ↗
21. Phonological Development: A Normative Study of British English-speaking Children10.1080/0269920031000111348 ↗
22. Nature of Phonological Delay in Children with Specific Language Impairment10.1080/13682820119370 ↗
23. Phonological Processes as Predictors of Specific Reading Skills in Children at Risk for Reading Failure10.1007/BF00383373 ↗
24. The Effect of Maturation upon Defective Articulation in Grades Seven through Twelve10.1044/jshd.1403.202 ↗
25. The Prevalence of Stuttering, Voice, and Speech-Sound Disorders in Primary School Students in Australia10.1044/0161-1461(2007/002) ↗
26. Intervention Efficacy and Intensity for Children With Speech Sound Disorder10.1044/1092-4388(2012/11-0076) ↗
27. (2022, June 02). Merriam-Webster. Available online: https://www.merriam-webster.com/dictionary/home.
28. Rybczynski, W. (1987). Home: A Short History of an Idea, Penguin Books.
29. At Home with the Technology: An Ethnographic Study of a Set-Top-Box Trial10.1145/329693.329698 ↗
30. Wakkary, R., and Tanenbaum, K. (2009, January 4–9). A Sustainable Identity: The Creativity of an Everyday Designer. Proceedings of the Proceedings of the 27th International Conference on Human Factors in Computing Systems—CHI 09, Boston, MA, USA.10.1145/1518701.1518761 ↗
31. Chernovich, E. (2013). Technology and Pro-Environmental Behavior in Urban Households: How Technologies Mediate Domestic Routines. SSRN Electron. J.10.2139/ssrn.2337951 ↗
32. Situating Digital Interventions: Mixed Methods for HCI Research in the Home10.1093/iwc/iwu034 ↗
33. Trust in Invisible Agents10.1162/leon_e_01657 ↗
34. Flexiwatts and Seamless Technology: Public Perceptions of Demand Flexibility through Smart Home Technology10.1016/j.erss.2017.10.012 ↗
35. Strategies for Reflexive Ethnography in the Smart Home: Autoethnography of Silence and Emotion10.1177/0038038519855325 ↗
36. ‘Delete the Family’: Platform Families and the Colonisation of the Smart Home
37. Sailaja, N., Crabtree, A., Colley, J., Gradinar, A., Coulton, P., Forrester, I., Kerlin, L., and Stenton, P. (2019, January 5–7). The Living Room of the Future. Proceedings of the 2019 ACM International Conference on Interactive Experiences for TV and Online Video—TVX ’19, Salford, UK.10.1145/3317697.3323360 ↗
38. Assessing the Home Environment during Mid- and Late-Adolescence10.1080/10888691.2017.1284593 ↗
39. Judge, T.K., and Neustaedter, C. (2015). Studying and Designing Technology for Domestic Life: Lessons from Home, Elsevier.10.1016/B978-0-12-800555-2.00001-0 ↗
40. Teo, T. (2014). Ethnography. Encyclopedia of Critical Psychology, Springer New York.10.1007/978-1-4614-5583-7 ↗
41. McGranahan, C. (2018). Ethnography Beyond Method: The Importance of an Ethnographic Sensibility. Sites: J. Soc. Anthropol. Cult. Stud., 15.10.11157/sites-id373 ↗
42. Dourish, P. (2004). Where the Action Is: The Foundations of Embodied Interaction, MIT Press. MIT Press Paperback; A Bradford Book.
43. Shagrir, L. (2017). Journey to Ethnographic Research, Springer International Publishing. SpringerBriefs in Education.10.1007/978-3-319-47112-9 ↗
44. Ishii, H., and Ullmer, B. (1997, January 22–27). Tangible Bits: Towards Seamless Interfaces between People, Bits and Atoms. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems—CHI ’97, Atlanta, GA, USA.10.1145/258549.258715 ↗
45. The Use of Tangible User Interface in Interactive System to Learn about Countries10.3991/ijet.v14i04.9341 ↗
46. Ishii, H. (2008, January 18–20). Tangible Bits: Beyond Pixels. Proceedings of the 2nd International Conference on Tangible and Embedded Interaction—TEI ’08, Bonn, Germany.10.1145/1347390.1347392 ↗
47. The Tangible User Interface and Its Evolution10.1145/1349026.1349034 ↗
48. Antle, A.N. (2007, January 28). Tangibles: Five Properties to Consider for Children. Proceedings of the Workshop on Tangible User Interfaces in Context and Theory, a Workshop held in association with ACM Computer/Human Interaction (CHI) 2007 Conference, San Jose, CA, USA.
49. Hengeveld, B. (2011). Designing LinguaBytes: A Tangible Language Learning System for Non- or Hardly Speaking Toddlers. [Ph.D. Thesis, TU/e Technische Universiteit Eindhoven].
50. Zaman, B., Vanden Abeele, V., Markopoulos, P., and Marshall, P. (2009, January 4–9). Tangibles for Children: The Challenges. Proceedings of the 27th International Conference Extended Abstracts on Human Factors in Computing Systems—CHI EA ’09, Boston, MA, USA.10.1145/1520340.1520727 ↗
51. Raffle, H., Vaucelle, C., Wang, R., and Ishii, H. (2007, January 6–8). Jabberstamp: Embedding Sound and Voice in Traditional Drawings. Proceedings of the 6th International Conference on Interaction Design and Children—IDC ’07, Aalborg, Denmark.10.1145/1297277.1297306 ↗
52. Designing Interaction in Digital Tabletop Games to Support Collaborative Learning in Children10.1504/IJLT.2014.062446 ↗
53. Children with Special Needs: Comparing Tactile and Tangible Interaction10.1007/978-3-642-23768-3_66 ↗
54. Xie, L., Antle, A.N., and Motamedi, N. (2008, January 18–20). Are Tangibles More Fun?: Comparing Children’s Enjoyment and Engagement Using Physical, Graphical and Tangible User Interfaces. Proceedings of the 2nd International Conference on Tangible and Embedded Interaction—TEI ’08, Bonn, Germany.10.1145/1347390.1347433 ↗
55. Interactive System Supporting Children Pleasurable Learning10.1007/978-3-319-41661-8_7 ↗
56. Hengeveld, B., Hummels, C., Overbeeke, K., Voort, R., van Balkom, H., and de Moor, J. (2008, January 18–20). Let Me Actuate You. Proceedings of the 2nd International Conference on Tangible and Embedded Interaction—TEI ’08, Bonn, Germany.10.1145/1347390.1347426 ↗
57. Pangaro, G., Maynes-Aminzade, D., and Ishii, H. (2002, January 27–30). The Actuated Workbench: Computer-Controlled Actuation in Tabletop Tangible Interfaces. Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology—UIST ’02, Paris, France.10.1145/572010.572011 ↗
58. Poupyrev, I., Nashida, T., and Okabe, M. (2007, January 17–20). Actuation and Tangible User Interfaces: The Vaucanson Duck, Robots, and Shape Displays. Proceedings of the 1st International Conference on Tangible and Embedded Interaction—TEI ’07, Baton Rouge, LO, USA.10.1145/1226969.1227012 ↗
59. Tangible versus Graphical User Interfaces for Robot Programming: Exploring Cross-Age Children’s Preferences10.1007/s00779-013-0641-7 ↗
60. The Computer for the 21 St Century10.1038/scientificamerican0991-94 ↗
61. Internet of Things: Vision, Applications and Research Challenges10.1016/j.adhoc.2012.02.016 ↗
62. Hadzovic, S., Mrdovic, S., and Radonjic, M. (2021). Identification of IoT Actors. Sensors, 21.10.3390/s21062093 ↗
63. Internet of Things (IoT): A Vision, Architectural Elements, and Future Directions10.1016/j.future.2013.01.010 ↗
64. Evolving Privacy: From Sensors to the Internet of Things10.1016/j.future.2017.04.045 ↗
65. Cybersecurity in the Internet of Things: Legal Aspects10.1016/j.clsr.2016.07.002 ↗
66. Wójtowicz, A., and Cellary, W. (2019). New Challenges for User Privacy in Cyberspace. Human-Computer Interaction and Cybersecurity Handbook, Taylor & Francis Group. Human Factors and Ergonomics.10.1201/b22142-4 ↗
67. Fear of the Unknown with Healthcare IoT Devices: An Exploratory Study
68. (2016). Regulation (Eu) 2016/679 Of The European Parliament And Of The Council of 27 April 2016 on the Protection of Natural Persons with Regard to the Processing of Personal Data and on the Free Movement of Such Data, and Repealing Directive 95/46/EC (General Data Protection Regulation), EU.
69. (2020). Cyber Security for Consumer Internet of Things: Baseline Requirements ETSI EN 303 645 V2.1.1 (2020-06) (Standard No. ETSI. CYBER).
70. Cisco Systems, Inc. (2020). Cisco Annual Internet Report (2018–2023) White Paper, Cisco Systems Inc.. Technical Report.
71. Weber, R.H. (2019). Privacy and Security in the IoT — Legal Issues. Human-Computer Interaction and Cybersecurity Handbook, Taylor & Francis Group. Human Factors and Ergonomics.10.1201/b22142-16 ↗
72. Ziegler, S. (2019). Privacy and Security Threats on the Internet of Things. Internet of Things Security and Data Protection, Springer International Publishing. [1st ed.]. Internet of Things.10.1007/978-3-030-04984-3 ↗
73. The PRISMA 2020 Statement: An Updated Guideline for Reporting Systematic Reviews10.1136/bmj.n71 ↗
74. (2021, July 07). Scopus Preview—Scopus—Welcome to Scopus. Available online: https://www.scopus.com/home.uri.
75. (2021, July 07). Clarivate. Available online: https://access.clarivate.com/login?app=wos&alternative=true&shibShireURL=https:%2F%2Fwww.webofknowledge.com%2F%3Fauth%3DShibboleth&shibReturnURL=https:%2F%2Fwww.webofknowledge.com%2F&roaming=true.
76. (2021, July 07). PubMed, Available online: https://pubmed.ncbi.nlm.nih.gov/.
77. Smart City and IoT10.1016/j.future.2017.03.034 ↗
78. SmartSantander: IoT Experimentation over a Smart City Testbed10.1016/j.bjp.2013.12.020 ↗
79. Mourtzis, D., Angelopoulos, J., and Panopoulos, N. (2022). Digital ManufacturingDigital Manufacturing: The Evolution of Traditional Manufacturing toward an Automated and Interoperable Smart Manufacturing Ecosystem. The Digital Supply Chain, Elsevier.10.1016/B978-0-323-91614-1.00002-2 ↗
80. Fatima, Z., Tanveer, M.H., Zardari, S., Naz, L.F., Khadim, H., Ahmed, N., and Tahir, M. (2022). Production Plant and Warehouse Automation with IoT and Industry 5.0. Appl. Sci., 12.10.3390/app12042053 ↗
81. Internet of Things in Medicine: A Systematic Mapping Study10.1016/j.jbi.2020.103383 ↗
82. Ramírez, E.R., Petrie, R., Chan, K., and Signal, N. (2018, January 15–18). A Tangible Interface and Augmented Reality Game for Facilitating Sit-to-Stand Exercises for Stroke Rehabilitation. Proceedings of the 8th International Conference on the Internet of Things—IOT ’18, Santa Barbara, CA, USA.10.1145/3277593.3277635 ↗
83. Vonach, E., Ternek, M., Gerstweiler, G., and Kaufmann, H. (2016, January 21–24). Design of a Health Monitoring Toy for Children. Proceedings of the 15th International Conference on Interaction Design and Children—IDC ’16, Manchester, UK.10.1145/2930674.2930694 ↗
84. Krueger, R.A., and Casey, M.A. (2015). Focus Groups: A Practical Guide for Applied Research, SAGE. [5th ed.].
85. Bader, G.E. (2002). Focus Groups: A Step-by-Step Guide, Bader Group.
86. Puchta, C., and Potter, J. (2004). Focus Group Practice, SAGE.10.4135/9781849209168 ↗
87. Gray, D. (2009). Doing Research in the Real World, SAGE. [2nd ed.].
88. Coutinho, C.M.P. (2013). Metodologia de Investigaçao em Ciencias Sociais e Humanas: Teoria e Prática, Almedina.
89. Barbour, R.S. (2014). Introducing Qualitative Research: A Student’s Guide, SAGE. [2nd ed.].10.4135/9781526485045 ↗
90. Gengnagel, C., Nagy, E., and Stark, R. (2016). Rethink! Prototyping Transdisciplinary Concepts of Prototyping, Springer International Publishing.10.1007/978-3-319-24439-6 ↗
91. Hennink, M.M. (2014). Focus Group Discussions, Oxford University Press. Understanding Qualitative Research.
92. Barbour, R.S., and Morgan, D.L. (2017). Use of Focus Groups in Developing Behavioural mHealth Interventions: A Critical Review. A New Era in Focus Group Research, Palgrave Macmillan UK.10.1057/978-1-137-58614-8 ↗
93. Teddlie, C., and Tashakkori, A. (2009). Foundations of Mixed Methods Research: Integrating Quantitative and Qualitative Approaches in the Social and Behavioral Sciences, SAGE.
94. Gray, D. (2021). Doing Research in the Real World, SAGE Publications. [5th ed.].
95. Greenberg, S., Carpendale, S., Marquardt, N., and Buxton, W. (2012). Sketching User Experiences, Morgan Kaufmann.
96. Haddaway, N.R., McGuinness, L.A., and Pritchard, C.C. (2021). PRISMA2020: R Package and ShinyApp for Producing PRISMA 2020 Compliant Flow Diagrams. Zenodo. Version 0.0.2.
97. Deciphering Interdisciplinary and Transdisciplinary Contributions10.22545/2010/0003 ↗
98. Software Survey: VOSviewer, a Computer Program for Bibliometric Mapping10.1007/s11192-009-0146-3 ↗
99. Co-Occurrence and Antonymy10.1093/ijl/8.4.281 ↗
100. Development of a Remote Therapy Tool for Childhood Apraxia of Speech10.1145/2776895 ↗