Detection of Abnormal Symptoms Using Acoustic-Spectrogram-Based Deep Learning
Source abstract
Abstract
Acoustic data inherently contain a variety of information, including indicators of abnormal symptoms. In this study, we propose a method for detecting abnormal symptoms by converting acoustic data into spectrogram representations and applying a deep learning model. Spectrograms effectively capture the temporal and frequency characteristics of acoustic signals. In this work, we extract key features such as spectrograms, Mel-spectrograms, and MFCCs from raw acoustic data and use them as input for training a convolutional neural network. The proposed model is based on a custom ResNet architecture that incorporates Bottleneck Residual Blocks to improve training stability and computational efficiency. The experimental results show that the model trained with Mel-spectrogram data achieved the highest classification accuracy at 97.13%. The models trained with spectrogram and MFCC data achieved 95.22% and 93.78% accuracy, respectively. The superior performance of the Mel-spectrogram model is attributed to its ability to emphasize critical acoustic features through Mel-filter banks, which enhances learning performance. These findings demonstrate the effectiveness of spectrogram-based deep learning models in identifying latent patterns within acoustic data and detecting abnormal symptoms. Future research will focus on applying this approach to a wider range of acoustic domains and environments. The results of this study are expected to contribute to the development of disease surveillance systems by integrating acoustic data analysis with artificial intelligence techniques.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Anomaly Detection Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Medical IT Convergence Research Center, Korea Electronics Technology Institute, 25 Saenari-ro, Bundang-gu, Seongnam-si 13509, Gyeonggi-do, Republic of Korea
Department of Electronics and Electrical Engineering, Dankook University, 152, Jukjeon-ro, Suji-gu, Yongin-si 16890, Gyeonggi-do, Republic of Korea
Funding
Institute of Information & Communications Technology Planning & Evaluation (IITP)
References (23)
Show source-provided references
1. Mallegni, N., Molinari, G., Ricci, C., Lazzeri, A., La Rosa, D., Crivello, A., and Milazzo, M. (2022). Sensing Devices for Detecting and Processing Acoustic Signals in Healthcare. Biosensors, 12.10.3390/bios12100835 ↗
2. Boschi, V., Catricalà, E., Consonni, M., Chesi, C., Moro, A., and Cappa, S.F. (2017). Connected Speech in Neurodegenerative Language Disorders: A Review. Front. Psychol., 8.10.3389/fpsyg.2017.00269 ↗
3. Baur, S., Nabulsi, Z., Weng, W.-H., Garrison, J., Blankemeier, L., Fishman, S., Chen, C., Kakarmath, S., Maimbolwa, M., and Sanjase, N. (2024). HeAR--Health Acoustic Representations. arXiv.
4. Time-series analysis for online recognition and localization of sick pig (Sus scrofa) cough sounds10.1121/1.2998780 ↗
5. Stress detection and classification of laying hens by sound analysis10.5713/ajas.14.0654 ↗
6. A Novel Method for Broiler Abnormal Sound Detection Using WMFCC and HMM10.1155/2020/2985478 ↗
7. Craciun, A., Paulus, J., Sevkin, G., and Bäckström, T. (September, January 28). Modeling Formant Dynamics in Speech Spectral Envelopes. Proceedings of the 2017 25th European Signal Processing Conference (EUSIPCO), Kos, Greece.10.23919/EUSIPCO.2017.8081483 ↗
8. Objective recognition of cough sound as biomarker for aerial pollutants10.1046/j.1600-0668.2003.00195.x ↗
9. Isolated Speech Recognition and Its Transformation in Visual Signs10.1007/s42835-018-00071-z ↗
10. Ensemble Learning Model for Classification of Respiratory Anomalies10.1007/s42835-023-01425-y ↗
11. Şaşmaz, E., and Tek, F.B. (2018, January 20–23). Animal Sound Classification Using a Convolutional Neural Network. Proceedings of the 2018 3rd International Conference on Computer Science and Engineering (UBMK), Sarajevo, Bosnia and Herzegovina.10.1109/UBMK.2018.8566449 ↗
12. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
13. DNN transfer learning based non-linear feature extraction for acoustic event classification10.1587/transinf.2017EDL8048 ↗
14. An Overview on Sound Features in Time and Frequency Domain
15. Chanane, H., and Bahoura, M. (2021, January 9–11). Convolutional Neural Network-based Model for Lung Sounds Classification. Proceedings of the 2021 IEEE International Midwest Symposium on Circuits and Systems (MWSCAS), Lansing, MI, USA.10.1109/MWSCAS47672.2021.9531887 ↗
16. A Spectrogram Based Local Fluctuation Feature for Fault Diagnosis with Application to Rotating Machines10.1007/s42835-021-00704-w ↗
17. Mel Frequency Cepstral Coefficient and its Applications: A Review10.1109/ACCESS.2022.3223444 ↗
18. A comparative study of different features for isolated spoken word recognition using HMM with reference to Assamese language10.1007/s10772-015-9311-7 ↗
19. Lim, H., Kim, Y., Kim, Y., and Kim, H. (2017, January 12–15). CNN-based bottleneck feature for noise robust query-by-example spoken term detection. Proceedings of the 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC), Kuala Lumpur, Malaysia.10.1109/APSIPA.2017.8282220 ↗
20. Adaptive Beamforming Algorithm Based on Residual Neural Networks10.1007/s00034-024-02859-z ↗
21. Yu, Y., Khadivi, S., and Xu, J. (2022, January 12–17). Can data diversity enhance learning generalization?. Proceedings of the 29th International Conference on Computational Linguistics, COLING 2022, Gyeongju, Republic of Korea. Available online: https://aclanthology.org/2022.coling-1.437.
22. Piczak, K.J. (2015, January 26–30). 2015. ESC: Dataset for Environmental Sound Classification. In Proceedings of the 23rd ACM International Conference on Multimedia (MM’15), Brisbane, Australia.10.1145/2733373.2806390 ↗
23. Iqbal, T., Cao, Y., Bailey, A., Plumbley, M.D., and Wang, W. (2021). ARCA23K: An audio dataset for investigating open-set label noise. arXiv.