1D-CNN: Speech Emotion Recognition System Using a Stacked Network with Dilated CNN Features
Source abstract
Abstract
Emotion recognition from speech data is an active and emerging area of research that plays an important role in numerous applications, such as robotics, virtual reality, behavior assessments, and emergency call centers. Recently, researchers have developed many techniques in this field in order to ensure an improvement in the accuracy by utilizing several deep learning approaches, but the recognition rate is still not convincing. Our main aim is to develop a new technique that increases the recognition rate with reasonable cost computations. In this paper, we suggested a new technique, which is a one-dimensional dilated convolutional neural network (1D-DCNN) for speech emotion recognition (SER) that utilizes the hierarchical features learning blocks (HFLBs) with a bi-directional gated recurrent unit (BiGRU). We designed a one-dimensional CNN network to enhance the speech signals, which uses a spectral analysis, and to extract the hidden patterns from the speech signals that are fed into a stacked one-dimensional dilated network that are called HFLBs. Each HFLB contains one dilated convolution layer (DCL), one batch normalization (BN), and one leaky_relu (Relu) layer in order to extract the emotional features using a hieratical correlation strategy. Furthermore, the learned emotional features are feed into a BiGRU in order to adjust the global weights and to recognize the temporal cues. The final state of the deep BiGRU is passed from a softmax classifier in order to produce the probabilities of the emotions. The proposed model was evaluated over three benchmarked datasets that included the IEMOCAP, EMO-DB, and RAVDESS, which achieved 72.75%, 91.14%, and 78.01% accuracy, respectively.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Emotion and Mood Recognition · Speech and Audio Processing · Music and Audio Processing
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (55)
Show source-provided references
1. Deep learning-based drivers emotion classification system in time series data for remote applications10.3390/rs12030587 ↗
2. Implementation of wavelet packet transform and non linear analysis for emotion classification in stroke patient using brain signals10.1016/j.bspc.2017.03.016 ↗
3. From real to complex: Enhancing radio-based activity recognition using complex-valued CSI10.1145/3338026 ↗
4. Databases, features and classifiers for speech emotion recognition: A review10.1007/s10772-018-9491-z ↗
5. A CNN-assisted enhanced audio signal processing for speech emotion recognition10.3390/s20010183 ↗
6. Application of fuzzy c-means clustering algorithm to spectral features for emotion classification from speech10.1007/s00521-016-2712-y ↗
7. Clustering-based speech emotion recognition by incorporating learned features and deep bilstm10.1109/ACCESS.2020.2990405 ↗
8. MLT-DNet: Speech emotion recognition using 1D dilated CNN based on multi-learning trick approach
9. Text-independent phoneme segmentation combining EGG and speech data10.1109/TASLP.2016.2533865 ↗
10. MPPIF-Net: Identification of plasmodium falciparum parasite mitochondrial proteins using deep features with multilayer bi-directional lstm10.3390/pr8060725 ↗
11. S. Tripathi, A. Kumar, A. Ramesh, C. Singh and P. Yenigalla, “Deep learning based emotion recognition system using speech features and transcriptions. Arxiv Preprint Arxiv:1906.05681, 2019.
12. Insights into lstm fully convolutional networks for time series classification10.1109/ACCESS.2019.2916828 ↗
13. Speech emotion recognition based on deep learning and kernel nonlinear PSVM
14. An interdisciplinary review of smart vehicular traffic and its applications and challenges10.3390/jsan8010013 ↗
15. Deep features-based speech emotion recognition for smart affective services10.1007/s11042-017-5292-7 ↗
16. IEMOCAP: Interactive emotional dyadic motion capture database10.1007/s10579-008-9076-6 ↗
17. The ryerson audio-visual database of emotional speech and song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in north american english10.1371/journal.pone.0196391 ↗
18. A visual-physiology multimodal system for detecting outlier behavior of participants in a reality TV show10.1177/1550147719864886 ↗
19. Exploring hashing and cryptonet based approaches for privacy-preserving speech emotion recognition
20. Evaluating deep learning architectures for speech emotion recognition10.1016/j.neunet.2017.02.013 ↗
21. Memento: An emotion-driven lifelogging system with wearables10.1145/3281630 ↗
22. Speech emotion recognition using deep learning techniques: A review10.1109/ACCESS.2019.2936124 ↗
23. Sound classification using convolutional neural network and tensor deep stacking network10.1109/ACCESS.2018.2888882 ↗
24. Speech emotion recognition using deep neural network and extreme learning machine
25. Heart ID: Human identification based on radar micro-Doppler signatures of the heart using deep learning10.3390/rs11101220 ↗
26. Imagenet classification with deep convolutional neural networks
27. K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” Arxiv Preprint Arxiv: 1409. 1556, 2014.
28. Dual exclusive attentive transfer for unsupervised deep convolutional domain adaptation in speech emotion recognition10.1109/ACCESS.2019.2924597 ↗
29. Convolutional, long short-term memory, fully connected deep neural networks
30. CLSTM: Deep feature-based speech emotion recognition using the hierarchical convlstm network10.3390/math8122133 ↗
31. Emotion recognition from variable-length speech segments using deep learning on spectrograms
32. Spiking echo state convolutional neural network for robust time series classification10.1109/ACCESS.2018.2887354 ↗
33. Speech emotion recognition based on feature selection and extreme learning machine decision tree10.1016/j.neucom.2017.07.050 ↗
34. Feature extraction methods LPC, PLP and MFCC in speech recognition
35. Learning salient features for speech emotion recognition using convolutional neural networks10.1109/TMM.2014.2360798 ↗
36. SVM or deep learning? A comparative study on remote sensing image classification10.1007/s00500-016-2247-2 ↗
37. Multi-cue fusion for emotion recognition in the wild10.1016/j.neucom.2018.03.068 ↗
38. Investigation on joint representation learning for robust feature extraction in speech emotion recognition
39. Spectrogram based multi-task audio classification10.1007/s11042-017-5539-3 ↗
40. Dropout: A simple way to prevent neural networks from overfitting
41. Speech enhancement using spectral subtraction-type algorithms: A comparison and simulation study10.1016/j.procs.2015.06.066 ↗
42. J. Chung, C. Gulcehre, K. Cho and Y. Bengio, “Empirical evaluation of gated recurrent neural networks on sequence modeling,” Arxiv Preprint Arxiv: 1412.3555, 2014.
43. A database of german emotional speech
44. Speech emotion recognition using deep 1D & 2D cnn lstm networks10.1016/j.bspc.2018.08.035 ↗
45. Exploration of complementary features for speech emotion recognition based on kernel extreme learning machine10.1109/ACCESS.2019.2921390 ↗
46. An experimental study of speech emotion recognition based on deep convolutional neural networks
47. Speech emotion recognition from 3D log-mel spectrograms with deep learning network10.1109/ACCESS.2019.2938007 ↗
48. Exploring deep spectrum representations via attention-based recurrent and convolutional neural networks for speech emotion recognition10.1109/ACCESS.2019.2928625 ↗
49. 3-D convolutional recurrent neural networks with attention model for speech emotion recognition10.1109/LSP.2018.2860246 ↗
50. Speech emotion recognition with deep convolutional neural networks10.1016/j.bspc.2020.101894 ↗
51. Parallelized convolutional recurrent neural network with spectral features for speech emotion recognition10.1109/ACCESS.2019.2927384 ↗
52. Learning temporal clusters using capsule routing for speech emotion recognition10.21437/Interspeech.2019-3068 ↗
53. Bagged support vector machines for emotion recognition from speech10.1016/j.knosys.2019.104886 ↗
54. Emotion detection from speech signals using voting mechanism on classified frames
55. SD-Net: Understanding overcrowded scenes in real-time via an efficient dilated convolutional neural network