journal article·2019-04-05Open access

Automatic Assessment of Prosodic Quality in Down Syndrome: Analysis of the Impact of Speaker Heterogeneity

Mario Corrales-Astorgano, Pastora Martínez-Castilla, David Escudero-Mancebo, Lourdes Aguilar, César González-Ferreras, Valentín Cardeñoso-Payo

Applied Sciences· Volume 9· Issue 7

Abstract

Prosody is a fundamental speech element responsible for communicative functions such as intonation, accent and phrasing, and prosodic impairments of individuals with intellectual disabilities reduce their communication skills. Yet, technological resources have paid little attention to prosody. This study aims to develop an automatic classifier to predict the prosodic quality of utterances produced by individuals with Down syndrome, and to analyse how inter-individual heterogeneity affects assessment results. A therapist and an expert in prosody judged the prosodic appropriateness of a corpus of Down syndrome’ utterances collected through a video game. The judgments of the expert were used to train an automatic classifier that predicts prosodic quality by using a set of fundamental frequency, duration and intensity features. The classifier accuracy was 79.3% and its true positive rate 89.9%. We analyzed how informative each of the features was for the assessment and studied relationships between participants’ developmental level and results: interspeaker variability conditioned the relative weight of prosodic features for automatic classification and participants’ developmental level was related to the prosodic quality of their productions. Therefore, since speaker variability is an intrinsic feature of individuals with Down syndrome, it should be considered to attain an effective automatic prosodic assessment system.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Language Development and Disorders · Assistive Technology in Communication and Mobility · Phonetics and Phonology Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science, University of Valladolid, 47002 Valladolid, Spain

Department of Developmental and Educational Psychology, UNED, 28040 Madrid, Spain

Department of Hispanic Philology, Universitat Autònoma de Barcelona, 08193 Bellaterra, Barcelona, Spain

Funding

Ministerio de Ciencia, Innovación y Universidades · Consejería de Educación, Junta de Castilla y León · Fundación BBVA

References (47)

Show source-provided references
1. Roach, P. (2010). English Phonetics and Phonology Fourth Edition: A Practical Course, Ernst Klett Sprachen.
2. Wells, B., Peppé, S., and Vance, M. (1995). Linguistic assessment of prosody. Linguistics in Clinical Practice, Whurr.
3. Education and children with Down syndrome: Neuroscience, development, and intervention10.1002/mrdd.20166 ↗
4. Down syndrome: Cognitive and behavioral functioning across the lifespan10.1002/ajmg.c.31439 ↗
5. Language characteristics of individuals with Down syndrome10.1097/TLD.0b013e3181a71fe1 ↗
6. Profiles of grammatical morphology and sentence imitation in children with specific language impairment and Down syndrome10.1044/1092-4388(2002/058) ↗
7. Assessing pragmatic communication in children with Down syndrome10.1016/j.jcomdis.2017.06.003 ↗
8. Verbal deficits in Down’s syndrome and specific language impairment: A comparison10.1080/13682820410001681207 ↗
9. Speech impairment in Down syndrome: A review10.1044/1092-4388(2012/12-0148) ↗
10. Juncture, rhythm and planning in the speech of an adult with Down’s syndrome10.3109/02699209508985328 ↗
11. Why is prosody in speech-language pathology so difficult?10.1080/17549500902906339 ↗
12. Prosodic abilities of Spanish-speaking adolescents and adults with Williams syndrome10.1080/01690965.2010.504058 ↗
13. Receptive and expressive prosodic ability in children with high-functioning autism10.1044/1092-4388(2007/071) ↗
14. Assessing intonation and prosody in children with atypical language development: The PEPS-C test and the revised version10.1080/0269920031000079994 ↗
15. Prosodic deficits in children with Down syndrome10.1016/j.jneuroling.2010.01.004 ↗
16. Tools and technologies for computer-aided speech and language therapy10.1016/j.specom.2009.04.006 ↗
17. A prelingual tool for the education of altered voices10.1016/j.specom.2011.05.006 ↗
18. Tabby Talks: An automated tool for the assessment of childhood apraxia of speech10.1016/j.specom.2015.04.002 ↗
19. Öster, A.M., House, D., Protopapas, A., and Hatzis, A. (2002, January 29–31). Presentation of a new EU project for speech therapy: OLP (Ortho-Logo-Paedia). Proceedings of the XV Swedish Phonetics Conference (Fonetik 2002), Stockholm, Sweden.
20. Tan, T.S., Ariff, A., Ting, C.M., and Salleh, S.H. (2007, January 25–28). Application of Malay speech technology in Malay speech therapy assistance tools. Proceedings of the IEEE 2007 International Conference on Intelligent and Advanced Systems, Kuala Lumpur, Malaysia.10.1109/ICIAS.2007.4658401 ↗
21. (2018, July 18). PRADIA, misterio en la ciudad. Available online: http://www.pradia.net.
22. Adell, F., Aguilar, L., Corrales-Astorgano, M., and Escudero-Mancebo, D. (2018, January 17–19). Proceso de innovación educativa en educación especial: Enseñanza de la prosodia con fines comunicativos con el apoyo de un videojuego educativo. Proceedings of the I Congreso Internacional en Humanidades Digitales, Valladolid, Spain.
23. Automatic assessment of speech intelligibility for individuals with aphasia10.1109/TASLP.2016.2598428 ↗
24. Qin, Y., Lee, T., Feng, S., and Kong, A.P.H. (2018, January 2–6). Automatic Speech Assessment for People with Aphasia Using TDNN-BLSTM with Multi-Task Learning. Proceedings of the Interspeech, Hyderabad, India.10.21437/Interspeech.2018-1630 ↗
25. PEAKS–A system for the automatic evaluation of voice and speech disorders10.1016/j.specom.2009.01.004 ↗
26. Automatic intelligibility classification of sentence-level pathological speech10.1016/j.csl.2014.02.001 ↗
27. Maier, A., Hönig, F., Hacker, C., Schuster, M., and Nöth, E. (2008, January 22–26). Automatic evaluation of characteristic speech disorders in children with cleft lip and palate. Proceedings of the Ninth Annual Conference of the International Speech Communication Association, Brisbane, Australia.10.21437/Interspeech.2008-484 ↗
28. Laaridh, I., Kheder, W.B., Fredouille, C., and Meunier, C. (2017, January 20–24). Automatic prediction of speech evaluation metrics for dysarthric speech. Proceedings of the Interspeech, Stockholm, Sweden.10.21437/Interspeech.2017-1363 ↗
29. Intelligibility assessment and speech recognizer word accuracy rate prediction for dysarthric speakers in a factor analysis subspace
30. Lee, H.Y., Hu, T.Y., Jing, H., Chang, Y.F., Tsao, Y., Kao, Y.C., and Pao, T.L. (2013, January 25–29). Ensemble of machine learning and acoustic segment model techniques for speech emotion and autism spectrum disorders recognition. Proceedings of the Interspeech, Lyon, France.10.21437/Interspeech.2013-70 ↗
31. Dunn, L., Dunn, L., and Arribas, D. (2006). Test de vocabulario en imágenes Peabody, TEA.
32. Corral, S., Arribas, D., Santamaría, P., Sueiro, M., and Pereña, J. (2005). Escala de Inteligencia de Wechsler para niños-IV, TEA Ediciones.
33. Raven, J., Raven, J.C., and Court, J. (1993). Test de matrices progresivas: Manual/Manual for Raven’s progessive matrices and vocabulary scalesTest de matrices progresivas, J C Raven Ltd.. Number 159.9. 072.
34. Developing a test of prosodic ability for speakers of Iberian Spanish10.1016/j.specom.2008.03.002 ↗
35. Engaging adolescents with Down syndrome in an educational video game10.1080/10447318.2017.1278895 ↗
36. Ladd, D.R. (2008). Intonational Phonology, Cambridge University Press.10.1017/CBO9780511808814 ↗
37. Eyben, F., Weninger, F., Gross, F., and Schuller, B. (2013, January 21–25). Recent developments in opensmile, the Munich open-source multimedia feature extractor. Proceedings of the 21st ACM International Conference on Multimedia, Barcelona, Spain.10.1145/2502081.2502224 ↗
38. The Geneva minimalistic acoustic parameter set (GeMAPS) for voice research and affective computing10.1109/TAFFC.2015.2457417 ↗
39. Acoustic characterization and perceptual analysis of the relative importance of prosody in speech of people with Down syndrome10.1016/j.specom.2018.03.006 ↗
40. Building predictive models in R using the caret package10.18637/jss.v028.i05 ↗
41. The use of the area under the ROC curve in the evaluation of machine learning algorithms10.1016/S0031-3203(96)00142-2 ↗
42. The WEKA data mining software: An update10.1145/1656274.1656278 ↗
43. Pardo, A., and Ruiz, M.Á. (2002). SPSS 11: Guia para el analisis de datos., Mc Graw Hill.
44. Le, D., and Provost, E.M. (2014, January 14–18). Modeling pronunciation, rhythm, and intonation for automatic assessment of speech quality in aphasia rehabilitation. Proceedings of the Fifteenth Annual Conference of the International Speech Communication Association, Singapore.10.21437/Interspeech.2014-373 ↗
45. Tu, M., Berisha, V., and Liss, J. (2017, January 20–24). Interpretable Objective Assessment of Dysarthric Speech Based on Deep Neural Networks. Proceedings of the Interspeech, Stockholm, Sweden.10.21437/Interspeech.2017-1222 ↗
46. Individual differences in voice quality perception10.1044/jshr.3503.512 ↗
47. An automated assessment framework for atypical prosody and stereotyped idiosyncratic phrases related to autism spectrum disorder10.1016/j.csl.2018.11.002 ↗