Using a Human Interviewer or an Automatic Interviewer in the Evaluation of Patients with AD from Speech
Source abstract
Abstract
Currently, there are more and more frequent studies focused on the evaluation of Alzheimer’s disease (AD) from the automatic analysis of the speech of patients, in order to detect the presence of the disease in an individual or for the evolutionary control of the disease. However, studies focused on analyzing the effect of the methodology used to generate the spontaneous speech of the speaker who undergoes this type of analysis are rare. The objective of this work is to study two different strategies to facilitate the generation of the spontaneous speech of a speaker for further analysis: the use of a human interviewer that promotes the generation of speech through an interview and the use of an automatic system (an automatic interviewer) that invites the speaker to describe certain visual stimuli. In this study, a database called Cross-Sectional Alzheimer Prognosis R2019 has been created, consisting of speech samples from speakers recorded using both methodologies. The speech recordings have been studied through a feature extraction based on five basic temporal measurements. This study demonstrates the discriminatory capacity between the speakers with AD and the control subjects independent of the strategy used in the generation of spontaneous speech. These results are promising and can serve as a basis for knowing the effectiveness and extension of automated interview processes, especially in telemedicine and telecare scenarios.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Speech and Audio Processing · Speech Recognition and Synthesis · Voice and Speech Disorders
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Instituto para el Desarrollo Tecnológico y la Innovación en Comunicaciones (IDeTIC), Universidad de Las Palmas de Gran Canaria, Despacho D-102, Pabellón B, Ed. de Electrónica y Comunicaciones, Campus de Tafira, 35017 Las Palmas, Spain
Funding
Ministerio de Ciencia e Innovación
References (100+)
Show source-provided references
1. Role of biomarkers in the early diagnosis of Alzheimer’s disease
2. Weller, J., and Budson, A. (2018). Current understanding of Alzheimer’s disease diagnosis and treatment. F1000Research, 7.10.12688/f1000research.14506.1 ↗
3. Ability to perform activities of daily living is the main factor affecting quality of life in patients with dementia10.1186/1477-7525-2-52 ↗
4. Innovative diagnostic tools for early detection of Alzheimer’s disease10.1016/j.jalz.2014.06.004 ↗
5. Recent Progress in Alzheimer’s Disease Research, Part 3: Diagnosis and Treatment10.3233/JAD-160907 ↗
6. Cognitive impairment in preclinical Alzheimer’s disease: A meta-analysis10.1037/0894-4105.19.4.520 ↗
7. Prediction of pathology in primary progressive language and speech disorders10.1212/WNL.0b013e3181c7198e ↗
8. Speaking in Alzheimer’s disease, is that an early sign? Importance of changes in language abilities in Alzheimer’s disease10.3389/fnagi.2015.00195 ↗
9. Voice Markers of Lexical Access in Mild Cognitive Impairment and Alzheimer’s Disease10.2174/1567205014666170829112439 ↗
10. Automatic and attentional mechanisms of semantic priming in alzheimer’s disease10.1080/01688638908400884 ↗
11. The diagnosis of dementia due to Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimer’s Dement
12. Alzheimer’s disease and automatic speech analysis: A review10.1016/j.eswa.2020.113213 ↗
13. Kim, Y., Lee, H., and Provost, E.M. (2013, January 26–31). Deep learning for robust feature generation in audiovisual emotion recognition. Proceedings of the Acoustics, Speech and Signal Processing (ICASSP), 2013 IEEE International Conference, Vancouver, BC, Canada.10.1109/ICASSP.2013.6638346 ↗
14. Deep learning10.1038/nature14539 ↗
15. Speech disorders in Parkinson’s disease: Early diagnostics and effects of medication and brain stimulation10.1007/s00702-017-1676-0 ↗
16. Evaluation of linguistic and prosodic features for detection of Alzheimer’s disease in Turkish conversational speech10.1186/s13636-015-0052-y ↗
17. Tanaka, H., Adachi, H., Ukita, N., Kudo, T., and Nakamura, S. (2016, January 12–16). Automatic detection of very early stage of dementia through multimodal interaction with computer avatars. Proceedings of the 18th ACM International Conference on Multimodal Interaction—ICMI 2016, Tokyo, Japan.10.1145/2993148.2993193 ↗
18. Rentoumi, V., Paliouras, G., Danasi, E., Arfani, D., Fragkopoulou, K., Varlokosta, S., and Papadatos, S. (2017, January 11–14). Automatic detection of linguistic indicators as a means of early detection of Alzheimer’s disease and of related dementias: A computational linguistics analysis. Proceedings of the Cognitive Infocommunications (CogInfoCom), 8th IEEE International Conference, Debrecen, Hungary.10.1109/CogInfoCom.2017.8268212 ↗
19. De Ipiña, K.L., Alonso, J.B., Solé-Casals, J., Barroso, N., Faúndez, M., Ecay, M., Travieso, C., Ezeiza, A., and Estanga, A. (2012, January 5–7). Alzheimer disease diagnosis based on automatic spontaneous speech analysis. Proceedings of the International Joint Conference on Computational Intelligence, IJCCI 2012, Barcelona, Spain.
20. Roy, D., and Pentland, A. (1996, January 14–16). Automatic spoken affect classification and analysis. Proceedings of the Second International Conference on Automatic Face and Gesture Recognition, Killington, VT, USA.
21. Lopez-De-Ipina, K., Alonso, J., Travieso, C., Egiraun, H., Ecay, M., Ezeiza, A., Barroso, N., and Martinez-Lage, P. (2013, January 19–21). Automatic analysis of emotional response based on non-linear speech modeling oriented to Alzheimer disease diagnosis. Proceedings of the INES 2013—IEEE 17th International Conference on Intelligent Engineering Systems, San Jose, Costarica.10.1109/INES.2013.6632783 ↗
22. New approach in quantification of emotional intensity from the speech signal: Emotional temperature10.1016/j.eswa.2015.07.062 ↗
23. On Automatic Diagnosis of Alzheimer’s Disease Based on Spontaneous Speech Analysis and Emotional Temperature
24. A statistical model-based voice activity detection10.1109/97.736233 ↗
25. Hernández-Domíngue, L., García-Canó, E., Ratt, S., and Sierra-Martínez, G. (2016, January 11). Detection of Alzheimer’s disease based on automatic analysis of common objects descriptions. Proceedings of the 7th Workshop on Cognitive Aspects of Computational Language Learning, Berlin, Germany.10.18653/v1/W16-1902 ↗
26. Vincze, V., Gosztolya, G., Tóth, L., Hoffmann, I., Szatlóczki, G., Bánréti, Z., Pákáski, M., Kálmán, J., Erk, K., and Smith, N.A. (2016, January 7–12). Detecting Mild Cognitive Impairment by Exploiting Linguistic Information from Transcripts. Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics, Berlin, Germany.10.18653/v1/P16-2030 ↗
27. Non-Invasive Detection of Alzheimer’s Disease-Multifractality of Emotional Speech10.21767/2171-6625.100084 ↗
28. Feature selection for spontaneous speech analysis to aid in Alzheimer’s disease diagnosis: A fractal dimension approach10.1016/j.csl.2014.08.002 ↗
29. Systematic meta-analyses of Alzheimer disease genetic association studies: The AlzGene database10.1038/ng1934 ↗
30. Metaanálisis del Sistema Olfatorio Como Diagnóstico Precoz en Parkinson y Alzheimer
31. Al-Hameed, S., Benaissa, M., and Christensen, H. (2016, January 13). Simple and robust audio-based detection of biomarkers for Alzheimer’s disease. Proceedings of the 7th Workshop on Speech and Language Processing for Assistive Technologies (SLPAT), San Francisco, CA, USA.10.21437/SLPAT.2016-6 ↗
32. Zhou, L., Fraser, K.C., and Rudzicz, F. (2016, January 12–18). Speech Recognition in Alzheimer’s Disease and in its Assessment. Proceedings of the Interspeech 2016, San Francisco, CA, USA.10.21437/Interspeech.2016-1228 ↗
33. Computer-based evaluation of Alzheimer’s disease and mild cognitive impairment patients during a picture description task
34. López-De-Ipiña, K., Martinez-De-Lizarduy, U., Barroso, N., Ecay-Torres, M., Martínez-Lage, P., Torres, F., and Faundez-Zanuy, M. (2015, January 10–12). Automatic analysis of Categorical Verbal Fluency for Mild Cognitive impartment detection: A non-linear language independent approach. Proceedings of the Bioinspired Intelligence (IWOBI), 4th International Work Conference IEEE, San Sebastian, Spain.10.1109/IWOBI.2015.7160151 ↗
35. (2018, May 26). AMI Corpus. Available online: http://groups.inf.ed.ac.uk/ami/corpus/.
36. The mini-mental state examination10.1001/archpsyc.1983.01790060110016 ↗
37. Goal setting and attainment in Alzheimer’s disease patients treated with donepezil10.1136/jnnp.73.5.500 ↗
38. Weiner, J., Frankenberg, C., and Telaar, D. (2016, January 23–28). Towards Automatic Transcription of ILSE―An Interdisciplinary Longitudinal Study of Adult Development and Aging. Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC’16), Portorož, Slovenia.
39. (2018, May 26). DementiaBank|TalkBank. Available online: https://dementia.talkbank.org/access/.
40. New Approaches for Alzheimer’s Disease Diagnosis Based on Automatic Spontaneous Speech Analysis and Emotional Temperature10.1007/978-3-642-35395-6_55 ↗
41. Spontaneous speech and emotional response modeling based on one-class classifier oriented to Alzheimer disease diagnosis10.1007/978-3-319-00846-2_141 ↗
42. On the Selection of Non-Invasive Methods Based on Speech Analysis Oriented to Automatic Alzheimer Disease Diagnosis10.3390/s130506730 ↗
43. Feature selection for automatic analysis of emotional response based on nonlinear speech modeling suitable for diagnosis of Alzheimer׳s disease10.1016/j.neucom.2014.05.083 ↗
44. Advances on Automatic Speech Analysis for Early Detection of Alzheimer Disease: A Non-linear Multi-task Approach10.2174/1567205014666171120143800 ↗
45. Alzumeric: A decision support system for diagnosis and monitoring of cognitive impairment10.3989/loquens.2017.037 ↗
46. (2018, May 26). Proyectos Fundación CITA Alzheimer. Available online: http://www.cita-alzheimer.org/investigacion/proyectos.
47. Satt, A., Sorrin, A., Toledo-Ronen, O., Barkan, O., Kompatsiaris, I., Kokonozi, A., and Tsolaki, M. (2013, January 25–29). Evaluation of Speech-Based Protocol for Detection of Early-Stage Dementia. Proceedings of the Interspeech 2013, Lyon, France.10.21437/Interspeech.2013-32 ↗
48. Tröger, J., Linz, N., Alexandersson, J., König, A., and Robert, P. (2017, January 23–26). Automated speech-based screening for alzheimer’s disease in a care service scenario. Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare, Barcelona, Spain.10.1145/3154862.3154915 ↗
49. Satt, A., Hoory, R., König, A., Aalten, P., and Robert, P.H. (2014, January 14–18). Speech-based automatic and robust detection of very early dementia. Proceedings of the Fifteenth Annual Conference of the International Speech Communication Association, INTERSPEECH-2014, Singapore.10.21437/Interspeech.2014-544 ↗
50. Automatic speech analysis for the assessment of patients with predementia and Alzheimer’s disease
51. Mirzaei, S., El Yacoubi, M., Garcia-Salicetti, S., Boudy, J., Muvingi, C.K.S., and Cristancho-Lacroix, V. (June, January 31). Automatic speech analysis for early Alzeimer’s disease diagnosis. Proceedings of the JETSAN 2017, 6e Journées d’Etudes sur la Télésant, Bourges, France.
52. Boyé, M., Tran, T.M., and Grabar, N. (2014, January 17–19). NLP-Oriented Contrastive Study of Linguistic Productions of Alzheimer’s and Control People. Proceedings of the International Conference on Natural Language Processing. Advances in Natural Language Processing, Warsaw, Poland.10.1007/978-3-319-10888-9_41 ↗
53. Luz, S. (2017, January 22–24). Longitudinal Monitoring and Detection of Alzheimer’s Type Dementia from Spontaneous Speech Data. Proceedings of the Computer-Based Medical Systems (CBMS), 2017 IEEE 30th International Symposium on IEEE, Thessaloniki, Greece.10.1109/CBMS.2017.41 ↗
54. Predicting mild cognitive impairment from spontaneous spoken utterances10.1016/j.trci.2017.01.006 ↗
55. Sadeghian, R., Schaffer, J.D., and Zahorian, S.A. (2017, January 20–24). Speech Processing Approach for Diagnosing Dementia in an Early Stage. Proceedings of the Interspeech 2017, Stockholm, Sweden.10.21437/Interspeech.2017-1712 ↗
56. Declines in Connected Language Are Associated with Very Early Mild Cognitive Impairment: Results from the Wisconsin Registry for Alzheimer’s Prevention10.3389/fnagi.2017.00437 ↗
57. Warnita, T., Inoue, N., and Shinoda, K. (2018). Detecting Alzheimer’s Disease Using Gated Convolutional Neural Network from Audio Data. arXiv, Available online: http://arxiv.org/abs/1803.11344.10.21437/Interspeech.2018-1713 ↗
58. Wankerl, S., Nöth, E., and Evert, S. (2017, January 20–24). An N-gram based approach to the automatic diagnosis of Alzheimer’s disease from spoken language. Proceedings of the Annual Conference of the International Speech Communication Association, Interspeech 2017, Stockholm, Sweden.10.21437/Interspeech.2017-1572 ↗
59. Yancheva, M. (2016). Automatic Assessment of Information Content in Speech for Detection of Dementia of the Alzheimer Type. [Master’s Thesis, University of Toronto].
60. Rhetorical structure and Alzheimer’s disease10.1080/02687038.2017.1355439 ↗
61. Sirts, K., Piguet, O., and Johnson, M. (2017). Idea density for predicting Alzheimer’s disease from transcribed speech. arXiv.10.18653/v1/K17-1033 ↗
62. Thomas, C., Kešelj, V., Cercone, N., Rockwood, K., and Asp, E. (August, January 21). Automatic detection and rating of dementia of Alzheimer type through lexical analysis of spontaneous speech. Proceedings of the IEEE International Conference Mechatronics and Automation, Niagara Falls, ON, Canada.
63. Carolinas Conversations Collection (2018, May 26). About Who We Are. Available online: http://carolinaconversations.musc.edu/about/who.
64. Weiner, J., Herff, C., and Schultz, T. (2016, January 12–18). Speech-Based Detection of Alzheimer’s Disease in Conversational German. Proceedings of the Interspeech 2016, San Francisco, CA, USA.10.21437/Interspeech.2016-100 ↗
65. Acoustic Markers Associated with Impairment in Language Processing in Alzheimer’s Disease10.5209/rev_SJOP.2012.v15.n2.38859 ↗
66. Speech rhythm alterations in Spanish-speaking individuals with Alzheimer’s disease
67. Peraita, H., and Grasso, L. (2010). Corpus lingüístico de definiciones de categorías semánticas de personas mayores sanas y con la enfermedad del alzheimer, Fundación BBVA. Technical Report.
68. Analysis of macrolinguistic aspects of narratives from individuals with Alzheimer’s disease, mild cognitive impairment, and no cognitive impairment
69. Beltrami, D., Calzà, L., Gagliardi, G., Ghidoni, E., Marcello, N., Favretti, R.R., and Tamburini, F. (2016, January 23–28). Automatic Identification of Mild Cognitive Impairment through the Analysis of Italian Spontaneous Speech Productions. Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC’16), Portorož, Slovenia.
70. A novel method for early diagnosis of Alzheimer’s disease based on higher-order spectral estimation of spontaneous speech signals10.1007/s11571-016-9406-0 ↗
71. Easy Screening for Mild Alzheimer’s Disease and Mild Cognitive Impairment from Elderly Speech10.2174/1567205014666171120144343 ↗
72. Graovac, J., Kovacevic, J., and Lazetic, G.P. (2016, January 20–24). Machine learning-based approach to help diagnosing Alzheimer’s disease through spontaneous speech analysis. Proceedings of the Belgrade BioInformatics Conference, Belgrade, Serbia.
73. Gosztolya, G., Tóth, L., Grósz, T., Vincze, V., Hoffmann, I., Szatlóczki, G., Pákáski, M., and Kálmán, J. (2016, January 12–18). Detecting Mild Cognitive Impairment from Spontaneous Speech by Correlation-Based Phonetic Feature Selection. Proceedings of the Interspeech 2016, San Francisco, CA, USA.10.21437/Interspeech.2016-384 ↗
74. A speech recognition-based solution for the automatic detection of mild cognitive impairment from spontaneous speech10.2174/1567205014666171121114930 ↗
75. Tóth, L., Gosztolya, G., Vincze, V., Hoffmann, I., Szatloczki, G., Biro, E., Zsura, F., Pakaski, M., and Kalman, J. (2015, January 6–10). Automatic Detection of Mild Cognitive Impairment from Spontaneous Speech Using ASR. Proceedings of the Sixteenth Annual Conference of the International Speech Communication Association, Interspeech-2015, Dresden, Germany.10.21437/Interspeech.2015-568 ↗
76. Lack of coherence in the narrative discourse of patients with dementia of the Alzheimer’s type10.1080/14769670500065984 ↗
77. A comparative study on the use of cohesion devices by normal age persian natives and those suffering from Alzheimer’s disease
78. The Comparison of Morpho-Syntactic Patterns Device Comprehension in Speech of Alzheimer and Normal Elderly People10.5812/zjrms.9535 ↗
79. Khodabakhsh, A., and Demiroglu, C. (2015). Analysis of Speech-Based Measures for Detecting and Monitoring Alzheimer’s Disease. Data Mining in Clinical Medicine, Humana Press.10.1007/978-1-4939-1985-7_11 ↗
80. O4-12-02: Innovative Voice Analytics for the Assessment and Monitoring of Cognitive Decline in People with Dementia and Mild Cognitive Impairment
81. Aluisio, S.M., Cunha, A., Toledo, C., and Scarton, C. (2016, January 13–16). A computational tool for automated language production analysis aimed at dementia diagnosis. Proceedings of the International Conference on Computational Processing of the Portuguese Language, XII, Demonstration Session, Tomar, Portugal.
82. Aluísio, S., Cunha, A., and Scarton, C. (2016, January 13–16). Evaluating Progression of Alzheimer’s Disease by Regression and Classification Methods in a Narrative Language Test in Portuguese. Proceedings of the International Conference on Computational Processing of the Portuguse Language, Tomar, Portugal.10.1007/978-3-319-41552-9_10 ↗
83. Analysis of mean square error surface and its corresponding contour plots of spontaneous speech signals in Alzheimer’s disease with adaptive wiener filter10.1016/j.chb.2016.03.031 ↗
84. Changes in Speech Chunking in Reading Aloud is a Marker of Mild Cognitive Impairment and Mild-to-Moderate Alzheimer’s Disease10.2174/1567205015666180404165017 ↗
85. The Natural History of Alzheimer’s Disease: Description of Study Cohort and Accuracy of Diagnosis10.1001/archneur.1994.00540180063015 ↗
86. DeVault, D., Artstein, R., Benn, G., Dey, T., Fast, E., Gainer, A., Georgila, K., Gratch, J., Hartholt, A., and Lhommet, M. (2014, January 5–9). SimSensei kiosk: A virtual human interviewer for healthcare decision support. Proceedings of the 13th International Conference on Autonomous Agents and Multiagent Systems, AAMAS 2014, Paris, France.
87. Huggins-Daines, D., Kumar, M., Chan, A., Black, A.W., Ravishankar, M., and Rudnicky, A.I. (2006, January 14–19). Pocketsphinx: A free, real-time continuous speech recognition system for hand-held devices. Proceedings of the IEEE International Conference on Acoustics Speech and Signal Processing, ICASSP 2006, Toulouse, France.
88. Littlewort, G., Whitehill, J., Wu, T., Fasel, I., Frank, M., Movellan, J., and Bartlett, M. (2011, January 21–25). The computer expression recognition toolbox (CERT). Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition and Workshops, FG, Santa Barbara, CA, USA.10.1109/FG.2011.5771414 ↗
89. Stone, M. (2003, January 24–26). Specifying Generation of Referring Expressions by Example. Proceedings of the AAAI Spring Symposium on Natural Language Generation in Spoken and Written Dialogue, Palo Alto, CA, USA.
90. (2021, April 01). Wiki—SAIBA—Mindmakers. Available online: http://mindmakers.com/projects/SAIBA.
91. Bickmore, T., Schulman, D., and Shaw, G. (2009, January 14–16). DTask and litebody: Open source, standards-based tools for building web-deployed embodied conversational agents. Proceedings of the IVA 2009, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Amsterdam, The Netherlands.10.1007/978-3-642-04380-2_46 ↗
92. Poggi, I., Pelachaud, C., de Rosis, F., Carofiglio, V., and de Carolis, B. (2005). Greta. A Believable Embodied Conversational Agent, Springer.10.1007/1-4020-3051-7_1 ↗
93. The Semaine Api: Towards a Standards-Based Framework for Building Emotion-Oriented Systems10.1155/2010/319406 ↗
94. All together now: Introducing the virtual human toolkit
95. IBM (2019, June 15). SimpleC Advancing Memory Care with IBM Watson and IBM Cloud Solutions. Available online: https://www.ibm.com/case-studies/w796019n50088s93.
96. Some rapid approximate statistical procedures10.1111/j.1749-6632.1950.tb53974.x ↗
97. Lazar, N.A. (2008). Basic Statistical Analysis. The Statistical Analysis of Functional MRI Data, Springer.10.1007/978-0-387-78191-4_5 ↗
98. Estimation of the Mean and Standard Deviation by Order Statistics10.1214/aoms/1177728788 ↗
99. Measuring Skewness and Kurtosis10.2307/2987742 ↗
100. Wonnacott, T.H., and Wonnacott, R.J. (1990). Introductory Statistics, John Wiley and Sons. [5th ed.]. Part I Basic Probability and Statistics 1 The Nature of Statistics.