journal article·2022-02-11Open access

Classification of Respiratory States Using Spectrogram with Convolutional Neural Network

Cheolhyeong Park, Deokwoo Lee

Applied Sciences· Volume 12· Issue 4

Abstract

This paper proposes an approach to the classification of respiration states based on a neural network model by visualizing respiratory signals using a spectrogram. The analysis and processing of human biosignals are still considered some of the most crucial and fundamental research areas in both signal processing and medical applications. Recently, learning-based algorithms in signal and image processing for medical applications have shown significant improvement from both quantitative and qualitative perspectives. Human respiration is still considered an important factor for diagnosis, and it plays a key role in preventing fatal diseases in practice. This paper chiefly deals with a contactless-based approach for the acquisition of respiration data using an ultra-wideband (UWB) radar sensor because it is simple and easy for use in an experimental setup and shows high accuracy in distance estimation. This paper proposes the classification of respiratory states by using a feature visualization scheme, a spectrogram, and a neural network model. The proposed method shows competitive and promising results in the classification of respiratory states. The experimental results also show that the method provides better accuracy (precision: 0.86 and specificity: 0.90) than conventional methods that use expensive equipment for respiration measurement.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Non-Invasive Vital Sign Monitoring · ECG Monitoring and Analysis · Atomic and Subatomic Physics Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Engineering, Keimyung University, Daegu 42601, Korea

Funding

National Research Foundation of Korea

References (47)

Show source-provided references
1. Deep Learning Bio–Signal Analysis from a Wearable Device
2. Wearable Multiple Modality Bio-Signal Recording and Processing on Chip: A Review10.1109/JSEN.2020.3016115 ↗
3. Inflammatory biomakers and obstructive sleep apnea in resistant hypertension10.1097/01.hjh.0000571400.45600.f9 ↗
4. Kim, J.J., Kim, K.H., Park, C., Kim, H.B., Kim, M.K., and Kwon, T.K. (November, January 29). Study on the Development of Smart Health Monitoring System of the Handle Type. Proceedings of the KSPE Autumn Conference, Busan, Korea.
5. Oh, S., Lee, D., and Jo, D. (2018, January 7–9). Achieving Driver status via Face Detection Using Image Processing. Proceedings of the KSAE 2018 Annual Spring Conference, Busan, Korea.
6. Detection of Respiratory Infections Using RGB-Infrared Sensors on Portable Device10.1109/JSEN.2020.3004568 ↗
7. Development of Hybrid Temperature Measurement System for Bio-signal Application Device
8. Influence of the Inverter’s Modulation Technique on the Audible Noise of Electric Motors10.1109/TIA.2013.2268453 ↗
9. Unsupervised speech enhancement based on multichannel NMF-informed beamforming for noise-robust automatic speech recognition10.1109/TASLP.2019.2907015 ↗
10. Zaman, K., and Direkoğlu, C. (2019, January 22–24). Classification of Harmful Noise Signals for Hearing Aid Applications using Spectrogram Images and Convolutional Neural Networks. Proceedings of the 4th International Symposium on Multidisciplinary Studies and Innovative Technologies (ISMSIT), Istanbul, Turkey.10.1109/ISMSIT50672.2020.9254451 ↗
11. Dill, S., Schreiber, E., Engel, M., Heinzel, A., and Peichl, M.A. (2019, January 22–26). Drone carried multichannel Synthetic Aperture Radar for advanced buried object detection. Proceedings of the IEEE Radar Conference (RadarConf), Boston, MA, USA.10.1109/RADAR.2019.8835814 ↗
12. Automatic respiratory event scoring in obstructive sleep apnea using a long short-term memory neural network10.1109/JBHI.2021.3064694 ↗
13. Shen, Q., Qin, H., Wei, K., and Liu, G. (2021). Multiscale Deep Neural Network for Obstructive Sleep Apnea Detection Using RR Interval From Single-Lead ECG Signal. IEEE Trans. Instrum. Meas., 70.10.1109/TIM.2021.3062414 ↗
14. Wusk, G., and Gabler, H. (2018). Non-Invasive Detection of Respiration and Heart Rate with a Vehicle Seat Sensor. Sensors, 18.10.3390/s18051463 ↗
15. Focal Epileptic Area Recognition Employing Cross EEG Rhythm Spectrum Images and Convolutional Neural Network10.1109/JSEN.2021.3111102 ↗
16. Prasanna, J., Subathra, M., Mohammed, M., Damaševičius, R., Sairamya, N., and George, S. (2021). Automated Epileptic Seizure Detection in Pediatric Subjects of CHB-MIT EEG Database-A Survey. J. Pers. Med., 11.10.3390/jpm11101028 ↗
17. Naz, M., Shah, J., Khan, M., Sharif, M., Raza, M., and Damaševičius, R. (2021). From ECG signals to images: A transformation based approach for deep learning. PeerJ Comput. Sci., 7.10.7717/peerj-cs.386 ↗
18. Kang, S., Kim, D.-K., Lee, Y., Lim, Y.-H., Park, H.-K., and Cho, S. (2020). Non-contact diagnosis of obstructive sleep apnea using impulse-radio ultra-wideband radar. Sci. Rep., 10.10.1038/s41598-020-62061-4 ↗
19. Validation of novel automatic ultra-wideband radar for sleep apnea detection10.21037/jtd.2020.02.59 ↗
20. Tran, V., Al-Jumaily, A., and Islam, S. (2019). Doppler Radar-Based Non-Contact Health Monitoring for Obstructive Sleep Apnea Diagnosis: A Comprehensive Review. Big Data Cogn. Comput., 3.10.3390/bdcc3010003 ↗
21. Mashrur, F., Islam, S., Saha, D., Islam, R., and Moni, M. (2021). SCNN: Scalogram-based convolutional neural network to detect obstructive sleep apnea using single-lead electrocardiogram signals. Comput. Biol. Med., 134.10.1016/j.compbiomed.2021.104532 ↗
22. An intelligent system for the detection and interpretation of sleep apnea10.1016/S0957-4174(02)00184-7 ↗
23. Apnea MedAssist: Real-time Sleep Apnea Monitor Using Single-Lead ECG10.1109/TITB.2010.2087386 ↗
24. A review of ECG-based diagnosis support systems for obstructive sleep apnea10.1142/S0219519416400042 ↗
25. da Silva Pinho, A.M., Pombo, N., and Garcia, N.M. (2016, January 14–16). Sleep apnea detection using a feed-forward neural network on ECG signal. Proceedings of the IEEE 18th International Conference on e-Health Networking, Applications and Services (Healthcom), Munich, Germany.10.1109/HealthCom.2016.7749468 ↗
26. Panindre, P., Gandhi, V., and Kumar, S. (2021, January 28–29). Artificial Intelligence-based Remote Diagnosis of Sleep Apnea using Instantaneous Heart Rates. Proceedings of the 11th International Conference on Cloud Computing, Data Science and Engineering (Confluence), Noida, India.10.1109/Confluence51648.2021.9377149 ↗
27. Park, C., Kim, J., and Lee, D. (2020). Classication of Respiratory Status using UWB Radar based on a Learning Algorithm. Proceedings of the Symposium of the Korean Institute of Communications and Information Sciences, Korea Telecommunications Society.
28. Detection of obstructive sleep apnea in pediatric subjects using surface lead electrocardiogram features10.1093/sleep/27.4.784 ↗
29. Sleep Apnea Screening by Autoregressive Models from a Single ECG Lead10.1109/TBME.2009.2029563 ↗
30. Automatic classification of sleep apnea epochs using the electrocardiogram
31. Sadr, N., and De Chazal, P. (2014, January 7–10). Automated detection of obstructive sleep apnoea by single-lead ECG through ELM classification. Proceedings of the Computing in Cardiology 2014, Cambridge, MA, USA.
32. Application of the permutation entropy over the heart rate variability for the improvement of electrocardiogram-based sleep breathing pause detection10.3390/e17030914 ↗
33. An algorithm for sleep apnea detection from single-lead ECG using Hermite basis functions10.1016/j.compbiomed.2016.08.012 ↗
34. An obstructive sleep apnea detection approach using a discriminative hidden Markov model from ECG signals10.1109/TBME.2015.2498199 ↗
35. Tsoumas, I., Mitronikas, E., Georgoulas, G., and Safacas, A. (2005, January 7–9). A comparative study of induction motor current signature analysis techniques for mechanical faults detection. Proceedings of the 5th IEEE International Symposium on Diagnostics for Electric Machines, Power Electronics and Drives, Vienna, Austria.10.1109/DEMPED.2005.4662545 ↗
36. Meyer, P., Xu, Z., and Fingscheidt, T. (2021, January 19–22). Improving Convolutional Recurrent Neural Networks for Speech Emotion Recognition. Proceedings of the IEEE Spoken Language Technology Workshop (SLT), Shenzhen, China.10.1109/SLT48900.2021.9383513 ↗
37. Kwon, H., Son, D., Lee, D., Yoon, H., Lee, M., Lee, Y., Choi, S., and Park, K. (2021). Hybrid CNN-LSTM Network for Real-Time Apnea-Hypopnea Event Detection Based on IR-UWB Radar. IEEE Access, 1.10.1109/ACCESS.2021.3081747 ↗
38. Xu, H., Ebrahim, M., Hasan, K., Heydari, F., Howley, P., and Yuce, M. (2022). Accurate Heart Rate and Respiration Rate Detection Based on a Higher-Order Harmonics Peak Selection Method Using Radar Non-Contact Sensors. Sensors, 22.10.3390/s22010083 ↗
39. (2022, January 10). Novelda X4. Available online: https://www.xethru.com/x4-soc.html.
40. Respiratory pauses and apnea during daytime sleep in normal infants during the first year of life: Longitudinal observations10.1016/0013-4694(82)90105-5 ↗
41. Use of sample entropy approach to study heart rate variability in obstructive sleep apnea syndrome10.1109/TBME.2006.889772 ↗
42. Yadollahi, A., and Moussavi, Z. (2009, January 3–6). Acoustic obstructive sleep apnea detection. Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, Minneapolis, MN, USA.10.1109/IEMBS.2009.5332870 ↗
43. Diagnostic aspects of polysomnography in obstructive sleep apnea10.5124/jkma.2012.55.2.138 ↗
44. Solà-Soler, J., Giraldo, B.F., Fiz, J.A., and Jané, R. (2017, January 11–15). Relationship between heart rate excursion and apnea duration in patients with Obstructive Sleep Apnea. Proceedings of the 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Jeju, Korea.10.1109/EMBC.2017.8037129 ↗
45. Screening for obstructive sleep apnoea based on the electrocardiogram-the computers in cardiology challenge
46. Obstructive sleep apnea classification based on spectrogram patterns in the electrocardiogram
47. Automated processing of the single-lead electrocardiogram for the detection of obstructive sleep apnoea10.1109/TBME.2003.812203 ↗