journal article·2023-06-02Open access

NAMRTNet: Automatic Classification of Sleep Stages Based on Improved ResNet-TCN Network and Attention Mechanism

Xuebin Xu, Chen Chen, Kan Meng, Longbin Lu, Xiaorui Cheng, Haichao Fan

Applied Sciences· Volume 13· Issue 11

Abstract

Sleep, as the basis for regular body functioning, can affect human health. Poor sleep conditions can lead to various physical ailments, such as poor immunity, memory loss, slow cognitive development, and cardiovascular diseases. Along the increasing stress in society comes with a growing surge in conditions associated with sleep disorders. Studies have shown that sleep stages are essential for the body’s memory, immune system, and brain functioning. Therefore, automatic sleep stage classification is of great medical practice importance as a basis for monitoring sleep conditions. Although previous research into the classification of sleep stages has been promising, several challenges remain to be addressed: (1) The EEG signal is a non-smooth signal with harrowing feature extraction and high requirements for model accuracy. (2) Some existing network models suffer from overfitting and gradient descent. (3) Correlation between long time sequences is challenging to capture. This paper proposes NAMRTNet, a deep model architecture based on the original single-channel EEG signal to address these challenges. The model uses a modified ResNet network to extract features from sub-epochs of individual epochs, a lightweight attention mechanism normalization-based attention module (NAM) to suppress insignificant features, and a temporal convolutional network (TCN) network to capture dependencies between features of long time series. The recognition rate of 20-fold cross-validation with the NAMRTNet model for Fpz-cz channel data in the public sleep dataset Sleep-EDF was 86.2%. The experimental results demonstrate the network’s superiority in this paper, surpassing some state-of-the-art techniques in different evaluation metrics. Furthermore, the total time to train the network was 5.1 h, which was much less than the training time of other models.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: EEG and Brain-Computer Interfaces · Sleep and Wakefulness Research · Obstructive Sleep Apnea Research

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Computer Science and Technology, Xi’an University of Posts & Telecommunications, Xi’an 710121, China

Shaanxi Key Laboratory of Network Data Analysis and Intelligent Processing, Xi’an University of Posts & Telecommunications, Xi’an 710121, China

Funding

National Natural Science Foundation of China · Department of Education Shaanxi Province, China · Key Research and Development Program of Shaanxi Province

References (45)

Show source-provided references
1. Boards of Directors of the American Academy of Sleep Medicine and the Sleep Research Society
2. Ruiz-Herrera, N., Díaz-Román, A., Guillén-Riquelme, A., and Quevedo-Blasco, R. (2023). Sleep Patterns during the COVID-19 Lockdown in Spain. Int. J. Environ. Res. Public Health, 20.10.3390/ijerph20064841 ↗
3. An overview of polysomnography10.1016/S1567-4231(09)70028-0 ↗
4. Scoring accuracy of automated sleep staging from a bipolar electroocular recording compared to manual scoring by multiple raters10.1016/j.sleep.2013.04.022 ↗
5. Computer-aided sleep staging using complete ensemble empirical mode decomposition with adaptive noise and bootstrap aggregating10.1016/j.bspc.2015.09.002 ↗
6. Automatic sleep stages classification based on iterative filtering of electroencephalogram signals10.1007/s00521-017-2919-6 ↗
7. A decision support system for automatic sleep staging from EEG signals using tunable Q-factor wavelet transform and spectral features10.1016/j.jneumeth.2016.07.012 ↗
8. An ensemble system for automatic sleep stage classification using single channel EEG signal10.1016/j.compbiomed.2012.09.012 ↗
9. Learning machines and sleeping brains: Automatic sleep stage classification using decision-tree multi-class support vector machines10.1016/j.jneumeth.2015.01.022 ↗
10. Analysis and classification of sleep stages based on difference visibility graphs from a single-channel EEG signal10.1109/JBHI.2014.2303991 ↗
11. Discrimination among states of consciousness using EEG spectra
12. Signal estimation from modified short-time Fourier transform10.1109/TASSP.1984.1164317 ↗
13. Classification of EEG signals using the wavelet transform10.1016/S0165-1684(97)00038-8 ↗
14. Huang, N.E. (2014). Hilbert-Huang Transform and Its Applications, World Scientific.10.1142/8804 ↗
15. Khasawneh, N., Fraiwan, M., and Fraiwan, L. (2022). Detection of K-complexes in EEG waveform images using faster R-CNN and deep transfer learning. BMC Med. Inform. Decis. Mak., 22.10.1186/s12911-022-02042-x ↗
16. Tsinalis, O., Matthews, P.M., Guo, Y., and Zafeiriou, S. (2016). Automatic sleep stage scoring with single-channel EEG using convolutional neural networks. arXiv.
17. A convolutional neural network for sleep stage scoring from raw single-channel EEG10.1016/j.bspc.2017.12.001 ↗
18. Deep learning for automated feature discovery and classification of sleep stages10.1109/TCBB.2019.2912955 ↗
19. End-to-end sleep staging using convolutional neural network in raw single-channel EEG10.1016/j.bspc.2020.102203 ↗
20. A deep learning architecture for temporal sleep stage classification using multivariate and multimodal time series10.1109/TNSRE.2018.2813138 ↗
21. Fast Convolutional Method for Automatic Sleep Stage Classification10.4258/hir.2018.24.3.170 ↗
22. Berry, R.B., Brooks, R., Gamaldo, C.E., Harding, S.M., Marcus, C., and Vaughn, B.V. (2015). The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications, American Academy of Sleep Medicine.
23. Automatic sleep stage recurrent neural classifier using energy features of EEG signals10.1016/j.neucom.2012.11.003 ↗
24. DeepSleepNet: A model for automatic sleep stage scoring based on raw single-channel EEG10.1109/TNSRE.2017.2721116 ↗
25. SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Staging10.1109/TNSRE.2019.2896659 ↗
26. Liu, Y., Fan, R., and Liu, Y. (2018, January 6–8). Deep identity confusion for automatic sleep staging based on single-channel EEG. Proceedings of the 2018 14th International Conference on Mobile Ad-Hoc and Sensor Networks (MSN), Shenyang, China.10.1109/MSN.2018.000-6 ↗
27. Joint sleep staging model based on pressure-sensitive sleep signal10.1088/1757-899X/740/1/012159 ↗
28. Learning to forget: Continual prediction with LSTM10.1162/089976600300015015 ↗
29. Zhu, T., Luo, W., and Yu, F. (2020). Convolution- and Attention-Based Neural Network for Automated Sleep Stage Classification. Int. J. Environ. Res. Public Health, 17.10.3390/ijerph17114152 ↗
30. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
31. Woo, S., Park, J., Lee, J.Y., and Kweon, I.S. (2018, January 8–14). CBAM: Convolutional block attention module. Proceedings of the European Conference on Computer Vision, Munich, Germany.10.1007/978-3-030-01234-2_1 ↗
32. Ioffe, S., and Szegedy, C. (2015, January 6–11). Batch normalization: Accelerating deep network training by reducing internal covariate shift. Proceedings of the International Conference on Machine Learning, Lille, France.
33. Bai, S., Kolter, J.Z., and Koltun, V. (2018). An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv.
34. Long, J., Shelhamer, E., and Darrell, T. (2015, January 7–12). Fully convolutional networks for semantic segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Boston, MA, USA.10.1109/CVPR.2015.7298965 ↗
35. Lea, C., Flynn, M.D., Vidal, R., Reiter, A., and Hager, G.D. (2017, January 21–26). Temporal convolutional networks for action segmentation and detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.113 ↗
36. Local models-based regression trees for very short-term wind speed prediction10.1016/j.renene.2015.03.071 ↗
37. A coefficient of agreement for nominal scales10.1177/001316446002000104 ↗
38. Phan, H., Andreotti, F., Cooray, N., Chén, O.Y., and De Vos, M. (2018, January 18–21). DNN filter bank improves 1-max pooling CNN for single-channel EEG automatic sleep stage classification. Proceedings of the 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Honolulu, HI, USA.10.1109/EMBC.2018.8512286 ↗
39. Vilamala, A., Madsen, K.H., and Hansen, L.K. (2017, January 25–28). Deep convolutional neural networks for interpretable analysis of EEG sleep stage scoring. Proceedings of the IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP), Tokyo, Japan.10.1109/MLSP.2017.8168133 ↗
40. Mousavi, S., Afghah, F., and Acharya, U.R. (2019). SleepEEGNet: Automated sleep stage scoring with sequence to sequence deep learning approach. PLoS ONE, 14.10.1371/journal.pone.0216456 ↗
41. Neng, W., Lu, J., and Xu, L. (2021). Ccrrsleepnet: A hybrid relational inductive biases network for automatic sleep stage classification on raw single-channel eeg. Brain Sci., 11.10.3390/brainsci11040456 ↗
42. An attention-based deep learning approach for sleep stage classification with single-channel EEG10.1109/TNSRE.2021.3076234 ↗
43. Towards more accurate automatic sleep staging via deep transfer learning10.1109/TBME.2020.3020381 ↗
44. Intra-and inter-epoch temporal context network (IITNet) using sub-epoch features for automatic sleep scoring on raw single-channel EEG10.1016/j.bspc.2020.102037 ↗
45. Supratak, A., and Guo, Y. (2020, January 20–24). TinySleepNet: An efficient deep learning model for sleep stage scoring based on raw single-channel EEG. Proceedings of the 42nd Annual International Conference of the IEEE Engineering in Medicine Biology Society (EMBC), Montreal, QC, Canada.10.1109/EMBC44109.2020.9176741 ↗