journal article·2023-12-28Open access

Prosodic Feature Analysis for Automatic Speech Assessment and Individual Report Generation in People with Down Syndrome

Mario Corrales-Astorgano, César González-Ferreras, David Escudero-Mancebo, Valentín Cardeñoso-Payo

Applied Sciences· Volume 14· Issue 1

Abstract

Evaluating prosodic quality poses unique challenges due to the intricate nature of prosody, which encompasses multiple form–function profiles. These challenges are more pronounced when analyzing the voices of individuals with Down syndrome (DS) due to increased variability. This paper introduces a procedure for selecting informative prosodic features based on both the disparity between human-rated DS productions and their divergence from the productions of typical users, utilizing a corpus constructed through a video game. Individual reports of five speakers with DS are created by comparing the selected features of each user with recordings of individuals without intellectual disabilities. The acquired features primarily relate to the temporal domain, reducing dependence on pitch detection algorithms, which encounter difficulties when dealing with pathological voices compared to typical ones. These individual reports can be instrumental in identifying specific issues for each speaker, assisting therapists in defining tailored training sessions based on the speaker’s profile.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Phonetics and Phonology Research · Language Development and Disorders · Speech and dialogue systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Research Group ECA-SIMM, Computer Science Department, University of Valladolid, 47002 Valladolid, Spain

Funding

MCIN/AEI/10.13039/501100011033/FEDER,EU

References (42)

Show source-provided references
1. Roach, P. (2010). English Phonetics and Phonology Fourth Edition: A Practical Course, Cambridge University Press.
2. Batliner, A., and Möbius, B. (2020). The Oxford Handbook of Language Prosody, Oxford University Press.
3. Wells, B., Peppé, S., and Vance, M. (1995). Linguistics in Clinical Practice, Taylor & Francis.
4. Language, cognition, and short-term memory in individuals with Down syndrome10.3104/reviews.108 ↗
5. Speech impairment in Down syndrome: A review10.1044/1092-4388(2012/12-0148) ↗
6. Prosodic deficits in children with Down syndrome10.1016/j.jneuroling.2010.01.004 ↗
7. Juncture, rhythm and planning in the speech of an adult with Down’s syndrome10.3109/02699209508985328 ↗
8. Perceptual and acoustic evaluation of speech production in Down syndrome: A case series10.1080/02699206.2019.1611925 ↗
9. Acoustic characterization and perceptual analysis of the relative importance of prosody in speech of people with Down syndrome10.1016/j.specom.2018.03.006 ↗
10. Game Analytics Evidence-Based Evaluation of a Learning Game for Intellectual Disabled Users10.1109/ACCESS.2019.2938365 ↗
11. Un videojuego para estimular habilidades matemáticas en personas con síndrome de Down
12. Parental perspectives on video game genre preferences and motivations of children with Down syndrome10.1108/JET-08-2017-0034 ↗
13. Del Rio Guerra, M.S., Martin-Gutierrez, J., Acevedo, R., and Salinas, S. (2019). Hand Gestures in Virtual and Augmented 3D Environments for Down Syndrome Users. Appl. Sci., 9.10.3390/app9132641 ↗
14. Boone, D.R., McFarlane, S.C., Von Berg, S.L., and Zraick, R.I. (2005). The Voice and Voice Therapy, Pearson/Allyn & Bacon.
15. A prelingual tool for the education of altered voices10.1016/j.specom.2011.05.006 ↗
16. Engaging adolescents with Down syndrome in an educational video game10.1080/10447318.2017.1278895 ↗
17. Attention deficit disorder with or without hyperactivity or impulsivity in children with Down’s syndrome10.1016/S2171-9748(11)70006-X ↗
18. Language development in children and adolescents with Down syndrome10.1002/(SICI)1098-2779(1997)3:4<307::AID-MRDD5>3.0.CO;2-K ↗
19. PRAUTOCAL corpus: A corpus for the study of Down syndrome prosodic aspects
20. Le, D., and Provost, E.M. (2014, January 14–18). Modeling pronunciation, rhythm, and intonation for automatic assessment of speech quality in aphasia rehabilitation. Proceedings of the INTERSPEECH, Singapore.10.21437/Interspeech.2014-373 ↗
21. Tu, M., Berisha, V., and Liss, J. (2017, January 20–24). Interpretable Objective Assessment of Dysarthric Speech Based on Deep Neural Networks. Proceedings of the INTERSPEECH, Stockholm, Sweden.10.21437/Interspeech.2017-1222 ↗
22. An automated assessment framework for atypical prosody and stereotyped idiosyncratic phrases related to autism spectrum disorder10.1016/j.csl.2018.11.002 ↗
23. Auditory-perceptual features of speech in children and adults with Down syndrome: A speech profile analysis10.1044/2021_JSLHR-20-00617 ↗
24. Corrales-Astorgano, M., Martínez-Castilla, P., Escudero-Mancebo, D., Aguilar, L., González-Ferreras, C., and Cardeñoso-Payo, V. (2019). Automatic Assessment of Prosodic Quality in Down Syndrome: Analysis of the Impact of Speaker Heterogeneity. Appl. Sci., 9.10.3390/app9071440 ↗
25. Developing a test of prosodic ability for speakers of Iberian Spanish10.1016/j.specom.2008.03.002 ↗
26. Auditory-perceptual evaluation of disordered voice quality: Pros, cons and future directions10.1159/000200768 ↗
27. When and why listeners disagree in voice quality assessment tasks10.1121/1.2770547 ↗
28. Yoon, T.J., Chavarria, S., Cole, J., and Hasegawa-Johnson, M. (2004, January 4–8). Intertranscriber reliability of prosodic labeling on telephone conversation using toBI. Proceedings of the Interspeech 2004, Jeju Island, Republic of Korea.10.21437/Interspeech.2004-659 ↗
29. Eyben, F., Weninger, F., Gross, F., and Schuller, B. (2013, January 21–25). Recent developments in opensmile, the munich open-source multimedia feature extractor. Proceedings of the 21st ACM International Conference on Multimedia, Barcelona, Spain.10.1145/2502081.2502224 ↗
30. The Geneva minimalistic acoustic parameter set (GeMAPS) for voice research and affective computing10.1109/TAFFC.2015.2457417 ↗
31. Ekberg, M., Stavrinos, G., Andin, J., Stenfelt, S., and Dahlström, Ö. (2023). Acoustic Features Distinguishing Emotions in Swedish Speech. J. Voice.10.1016/j.jvoice.2023.03.010 ↗
32. Boersma, P. (2023, September 15). Praat: Doing Phonetics by Computer. Amsterdam, The Netherlands. Available online: http://www.praat.org/.
33. The WEKA data mining software: An update10.1145/1656274.1656278 ↗
34. Hall, M.A. (1998). Correlation-Based Feature Subset Selection for Machine Learning. [Ph.D. Thesis, University of Waikato].
35. Matplotlib: A 2D graphics environment10.1109/MCSE.2007.55 ↗
36. NeuroSpeech: An open-source software for Parkinson’s speech analysis10.1016/j.dsp.2017.07.004 ↗
37. Finnegan, D. (2023, September 21). ReferenceIntervals: Reference Intervals. R package version 1.2.0. Available online: https://CRAN.R-project.org/package=referenceIntervals.
38. SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python10.1038/s41592-019-0686-2 ↗
39. Jang, S.J., Choi, S.H., Kim, H.M., Choi, H.S., and Yoon, Y.R. (2007, January 22–26). Evaluation of performance of several established pitch detection algorithms in pathological voices. Proceedings of the 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Lyon, France.10.1109/IEMBS.2007.4352366 ↗
40. Cluttering in Down syndrome10.1159/000170081 ↗
41. Speech dysfluency and manual specialization in Down’s syndrome10.1111/j.1365-2788.1990.tb01536.x ↗
42. Speech disfluencies in children with Down Syndrome10.1016/j.jcomdis.2017.11.001 ↗