journal article·2022Open access

EEG Emotion Recognition Using an Attention Mechanism Based on an Optimized Hybrid Model

Huiping Jiang, Demeng Wu, Xingqun Tang, Zhongjie Li, Wenbo Wu

Computers, Materials & Continua· Volume 73· Issue 2

Abstract

Emotions serve various functions. The traditional emotion recognition methods are based primarily on readily accessible facial expressions, gestures, and voice signals. However, it is often challenging to ensure that these non-physical signals are valid and reliable in practical applications. Electroencephalogram (EEG) signals are more successful than other signal recognition methods in recognizing these characteristics in real-time since they are difficult to camouflage. Although EEG signals are commonly used in current emotional recognition research, the accuracy is low when using traditional methods. Therefore, this study presented an optimized hybrid pattern with an attention mechanism (FFT_CLA) for EEG emotional recognition. First, the EEG signal was processed via the fast fourier transform (FFT), after which the convolutional neural network (CNN), long short-term memory (LSTM), and CNN-LSTM-attention (CLA) methods were used to extract and classify the EEG features. Finally, the experiments compared and analyzed the recognition results obtained via three DEAP dataset models, namely FFT_CNN, FFT_LSTM, and FFT_CLA. The final experimental results indicated that the recognition rates of the FFT_CNN, FFT_LSTM, and FFT_CLA models within the DEAP dataset were 87.39%, 88.30%, and 92.38%, respectively. The FFT_CLA model improved the accuracy of EEG emotion recognition and used the attention mechanism to address the often-ignored importance of different channels and samples when extracting EEG features.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: EEG and Brain-Computer Interfaces · Emotion and Mood Recognition · Gaze Tracking and Assistive Technology

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (35)

Show source-provided references
1. Emotion recognition using multi-modal data and machine learning techniques: A tutorial and review10.1016/j.inffus.2020.01.011 ↗
2. A machine learning model for emotion recognition from physiological signals10.1016/j.bspc.2019.101646 ↗
3. A parallel algorithm framework for feature extraction of EEG signals on MPI10.1155/2020/9812019 ↗
4. A study on classification and detection of small moths using cnn model10.32604/cmc.2022.022554 ↗
5. EEG-based emotion recognition via channel-wise attention and self attention
6. EEG-based emotion classification using deep belief networks
7. EEG emotion recognition using dynamical graph convolutional neural networks and broad learning system
8. Spatio-temporal representation of an electoencephalogram for emotion recognition using a three-dimensional convolutional neural network10.3390/s20123491 ↗
9. Multi-channel EEG-based emotion recognition via a multi-level features guided capsule network10.1016/j.compbiomed.2020.103927 ↗
10. Emotion recognition from spatiotemporal EEG representations with hybrid convolutional recurrent neural networks via wearable multi-channel headset10.1016/j.comcom.2020.02.051 ↗
11. Eyeblink recognition improves fatigue prediction from single-channel forehead EEG in a realistic sustained attention task10.1088/1741-2552/ab909f ↗
12. Multimodal fused emotion recognition about expression-EEG interaction and collaboration using deep learning
13. Deap: A database for emotion analysis; using physiological signals10.1109/T-AFFC.2011.15 ↗
14. EEG emotion recognition model based on the LIBSVM classifier10.1016/j.measurement.2020.108047 ↗
15. The dreem headband compared to polysomnography for electroencephalographic signal acquisition and sleep staging10.1093/sleep/zsaa097 ↗
16. Deep learning-based decoding and ap selection for radio stripe network10.32604/iasc.2022.021017 ↗
17. Feature extraction method for classification of alertness and drowsiness states EEG signals10.1016/j.apacoust.2020.107224 ↗
18. Cognitive imagery classification of EEG signals using CSP-based feature selection method10.1080/02564602.2019.1620138 ↗
19. Enhanced detection of epileptic seizure using EEG signals in combination with machine learning classifiers10.1109/ACCESS.2020.2970012 ↗
20. Development of efficient classification systems for the diagnosis of melanoma10.32604/csse.2022.021412 ↗
21. A convolutional recurrent attention model for subject-independent eeg signal analysis10.1109/LSP.2019.2906824 ↗
22. Image super-resolution using very deep residual channel attention networks
23. A robust 3-D medical watermarking based on wavelet transform for data protection10.32604/csse.2022.022305 ↗
24. Bidirectional LSTM with self-attention mechanism and multi-channel features for sentiment classification10.1016/j.neucom.2020.01.006 ↗
25. Synthesizer: Rethinking self-attention for transformer models
26. A residual based attention model for eeg based sleep staging10.1109/JBHI.2020.2978004 ↗
27. Triple color image encryption based on 2D multiple parameter fractional discrete Fourier transform and 3D arnold transform10.1016/j.optlaseng.2020.106139 ↗
28. Robust reversible audio watermarking scheme for telemedicine and privacy protection10.32604/cmc.2022.022304 ↗
29. EEG-based emotion recognition via capsule network with channel-wise attention and LSTM models10.1007/s42486-021-00078-y ↗
30. TBE-net: A three-branch embedding network with part-aware ability and feature complementary learning for vehicle re-identification10.1109/TITS.2021.3116045 ↗
31. Recognizing emotions evoked by music using CNN-LSTM networks on EEG signals10.1109/ACCESS.2020.3011882 ↗
32. Exploring self-attention for image recognition
33. Sun · Applied Intelligence · 2021 · 1
34. EEG-based emotion classification using spiking neural networks10.1109/ACCESS.2020.2978163 ↗
35. Emotion recognition from EEG signals by using multivariate empirical mode decomposition10.1007/s10044-016-0567-6 ↗