journal article·2023-04-25Open access

Characterization of the Intelligibility of Vowel–Consonant–Vowel (VCV) Recordings in Five Languages for Application in Speech-in-Noise Screening in Multilingual Settings

Giulia Rocco, Giuliano Bernardi, Randall Ali, Toon van Waterschoot, Edoardo Maria Polo, Riccardo Barbieri, Alessia Paglialonga

Applied Sciences· Volume 13· Issue 9

Abstract

The purpose of this study is to characterize the intelligibility of a corpus of Vowel–Consonant–Vowel (VCV) stimuli recorded in five languages (English, French, German, Italian and Portuguese) in order to identify a subset of stimuli for screening individuals of unknown language during speech-in-noise tests. The intelligibility of VCV stimuli was estimated by combining the psychometric functions derived from the Short-Time Objective Intelligibility (STOI) measure with those derived from listening tests. To compensate for the potential increase in speech recognition effort in non-native listeners, stimuli were selected based on three criteria: (i) higher intelligibility; (ii) lower variability of intelligibility; and (iii) shallower psychometric function. The observed intelligibility estimates show that the three criteria for application in multilingual settings were fulfilled by the set of VCVs in English (average intelligibility from 1% to 8% higher; SRT from 4.01 to 2.04 dB SNR lower; average variability up to four times lower; slope from 0.35 to 0.68%/dB SNR lower). Further research is needed to characterize the intelligibility of these stimuli in a large sample of non-native listeners with varying degrees of hearing loss and to determine the possible effects of hearing loss and native language on VCV recognition.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Hearing Loss and Rehabilitation · Speech and Audio Processing · Acoustic Wave Phenomena Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Dipartimento di Elettronica, Informazione e Bioingegneria (DEIB), Politecnico di Milano, 20133 Milan, Italy

Department of Electrical Engineering (ESAT-STADIUS), KU Leuven, 3001 Leuven, Belgium

Dipartimento di Ingegneria Informatica Automatica e Gestionale Antonio Ruberti (DIAG), Università La Sapienza di Roma, 00185 Rome, Italy

Cnr-Istituto di Elettronica e di Ingegneria dell’Informazione e delle Telecomunicazioni (CNR-IEIIT), 20133 Milan, Italy

Funding

Capita Foundation with project WHISPER, “Widespread Hearing Impairment Screening and PrEvention of Risk”, funded by 2020 and 2022 Auditory Research Grants. Part of this research work was carried out at the ESAT Laboratory of KU Leuven, in the frame of IWT O&O Project · the ESAT Laboratory of KU Leuven, in the frame of IWT O&O Project · European Research Council under the European Union’s Horizon 2020 research and innovation program/ERC Consolidator Grant: SONORA

References (58)

Show source-provided references
1. Is Hearing Loss Associated with Poorer Health in Older Adults Who Might Benefit from Hearing Screening?10.1097/AUD.0000000000000267 ↗
2. Acceptability, Benefit and Costs of Early Screening for Hearing Disability: A Study of Potential Screening Tests and Models10.3310/hta11420 ↗
3. Adult Hearing Screening: Health Policy Issues—What Happens Next?10.1044/1059-0889(2013/12-0062) ↗
4. A Pragmatic Clinical Trial of Hearing Screening in Primary Care Clinics: Cost-Effectiveness of Hearing Screening10.1186/s12962-022-00360-5 ↗
5. An Automated Speech-in-Noise Test for Remote Testing: Development and Preliminary Evaluation10.1044/2020_AJA-19-00071 ↗
6. Adult Validation of a Self-Administered Tablet Audiometer10.1186/s40463-019-0385-0 ↗
7. Long-term cost-effectiveness of screening strategies for hearing loss10.1682/JRRD.2010.03.0041 ↗
8. A Novel Approach for Adult Hearing Screening
9. Understanding the Speech-Understanding Problems of Older Adults10.1044/1059-0889(2013/12-0066) ↗
10. Hearing Health Care Utilization Following Automated Hearing Screening10.1055/s-0041-1723041 ↗
11. What Can the Pure-Tone Audiogram Tell Us about a Patient’s SNR Loss?10.1097/00025572-200003000-00006 ↗
12. A User-Operated Test of Suprathreshold Acuity in Noise for Adult Hearing Screening: The SUN (Speech Understanding in Noise) Test10.1016/j.compbiomed.2014.06.012 ↗
13. Results from the Dutch Speech-in-Noise Screening Test by Telephone10.1097/00003446-200502000-00008 ↗
14. Speech-in-Noise Testing: Innovative Applications for Pediatric Patients, Underrepresented Populations, Fitness for Duty, Clinical Trials, and Remote Services10.1121/10.0014418 ↗
15. eHealth and the Hearing Aid Adult Patient Journey: A State-of-the-Art Review10.1186/s12938-018-0531-3 ↗
16. Clinical Comparison of Two Automated Audiometry Procedures10.3389/fnins.2022.1011016 ↗
17. How Much Does Language Proficiency by Non-Native Listeners Influence Speech Audiometric Tests in Noise?10.3109/14992027.2015.1063715 ↗
18. Effectiveness of a Teleaudiology Approach to Hearing Aid Fitting10.1177/1357633X15611568 ↗
19. Speech-in-Noise Screening Tests by Internet, Part 1: Test Evaluation for Noise-Induced Hearing Loss Identification10.3109/14992027.2011.595016 ↗
20. Speech-in-Noise Screening Tests by Internet, Part 2: Improving Test Sensitivity for Noise-Induced Hearing Loss10.3109/14992027.2011.595017 ↗
21. Using the Speech Understanding in Noise (SUN) Test for Adult Hearing Screening10.1044/1059-0889(2012/12-0055) ↗
22. Development of a Test of Suprathreshold Acuity in Noise in Brazilian Portuguese: A New Method for Hearing Screening and Surveillance10.1155/2014/652838 ↗
23. Zanet, M., Polo, E.M., Rocco, G., Paglialonga, A., and Barbieri, R. (2019, January 23–27). Development and Preliminary Evaluation of a Novel Adaptive Staircase Procedure for Automated Speech-in-Noise Testing. Proceedings of the 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEEE EMBC 2019), Berlin, Germany.10.1109/EMBC.2019.8857492 ↗
24. Evaluation of a Novel Speech-in-Noise Test for Hearing Screening: Classification Performance and Transducers’ Characteristics10.1109/JBHI.2021.3100368 ↗
25. Evaluation of Machine Learning Algorithms and Explainability Techniques to Detect Hearing Loss from a Speech-in-Noise Screening Test10.1044/2022_AJA-21-00194 ↗
26. Polo, E.M., Lenatti, M., Zanet, M., Barbieri, R., and Paglialonga, A. Development and Characterization of a Novel Adaptive Staircase for Speech Recognition Testing, Unpublished work.
27. Automated Speech Audiometry for Integrated Voice Over Internet Protocol Communication Services10.1044/2022_AJA-21-00217 ↗
28. Hearing Loss and Aging: New Research Findings and Clinical Implications10.1682/JRRD.2005.01.0006 ↗
29. Adaptive Procedures in Psychophysical Research10.3758/BF03194543 ↗
30. Evaluation of Hearing-Impaired Listeners Using a Nonsense-Syllable Test I. Test Reliability10.1044/jshr.2501.135 ↗
31. Recognizing Speech under a Processing Load: Dissociating Energetic from Informational Factors10.1016/j.cogpsych.2009.04.001 ↗
32. Language-Independent Processing in Speech Perception: Identification of English Intervocalic Consonants by Speakers of Eight European Languages10.1016/j.specom.2010.04.004 ↗
33. An Algorithm for Intelligibility Prediction of Time–Frequency Weighted Noisy Speech10.1109/TASL.2011.2114881 ↗
34. Polo, E.M., Mollura, M., Paglialonga, A., and Barbieri, R. (2022, January 4–7). Listening effort: Cardiovascular investigation through the point process framework. Proceedings of the 2022 Computing in Cardiology Conference (CinC 2022), Tampere, Finland.
35. Eberhard, D.M., Simons, G.F., and Fennig, C.D. (2023). Ethnologue: Languages of the World, SIL International. [26th ed.].
36. (2012). Acoustics Audiometric Test Methods Part 3: Speech Audiometry (Standard No. ISO8253-3:2012).
37. An International Comparison of Long-term Average Speech Spectra10.1121/1.410152 ↗
38. Speech Intelligibility Prediction Based on Mutual Information10.1109/TASLP.2013.2295914 ↗
39. Investigation of Objective Measures for Intelligibility Prediction of Noise-Reduced Speech for Chinese, Japanese, and English10.1121/1.4901079 ↗
40. Foreign Accent, Comprehensibility, and Intelligibility in the Speech of Second Language Learners10.1111/j.1467-1770.1995.tb00963.x ↗
41. Martin, M. (1997). Speech Audiometry, John Wiley & Sons. [2nd ed.].
42. Converting between Measures of Slope of the Psychometric Function10.3758/BF03194547 ↗
43. Objective Quality and Intelligibility Prediction for Users of Assistive Listening Devices: Advantages and Limitations of Existing Tools10.1109/MSP.2014.2358871 ↗
44. Subjective and Objective Sound-Quality Evaluation of Adaptive Feedback Cancellation Algorithms10.1109/TASLP.2018.2808042 ↗
45. The Hearing-Aid Speech Quality Index (HASQI) Version 210.17743/jaes.2014.0006 ↗
46. Manabe, Y., Tamagawa, K., and Sato, K. (2018, January 7–10). Speech Intelligibility in Environmental Sound Maskers and Prediction Based on Envelope-Power Based Models. Proceedings of the 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC) 2018, Miyazaki, Japan.10.1109/SMC.2018.00587 ↗
47. An Evaluation of Intrusive Instrumental Intelligibility Metrics10.1109/TASLP.2018.2856374 ↗
48. Speech Enhancement Using MMSE Estimation of Amplitude and Complex Speech Spectral Coefficients under Phase-Uncertainty10.1016/j.specom.2017.11.001 ↗
49. Intelligibility of Brazilian Portuguese-accented English Realization of Nasals in Word-final Position by Brazilian and Dutch EFL Learners
50. Perceptual Constraints and Phonological Change: A Study of Nasal Vowel Height10.1017/S0952675700000646 ↗
51. An Algorithm for Predicting the Intelligibility of Speech Masked by Modulated Noise Maskers10.1109/TASLP.2016.2585878 ↗
52. Automatic Evaluation of Song Intelligibility Using Singing Adapted STOI and Vocal-Specific Features10.1109/TASLP.2019.2955253 ↗
53. Nonintrusive Objective Measurement of Speech Intelligibility: A Review of Methodology10.1016/j.bspc.2021.103204 ↗
54. Coherence and the Speech Intelligibility Index10.1121/1.1862575 ↗
55. Analysis of Speech-Based Speech Transmission Index Methods with Implications for Nonlinear Operations10.1121/1.1804628 ↗
56. Evaluation of Objective Quality Measures for Speech Enhancement10.1109/TASL.2007.911054 ↗
57. Multivariate Classification of Mild and Moderate Hearing Loss Using a Speech-in-Noise Test for Hearing Screening at a Distance
58. Telephone Screening Tests for Functionally Impaired Hearing: Current Use in Seven Countries and Development of a US Version10.3766/jaaa.23.10.2 ↗