journal article·2022Open access

Human Emotions Classification Using EEG via Audiovisual Stimuli and AI

Abdullah A Asiri, Akhtar Badshah, Fazal Muhammad, Hassan A Alshamrani, Khalil Ullah, Khalaf A Alshamrani, Samar Alqhtani, Muhammad Irfan, Hanan Talal Halawani, Khlood M Mehdar

Computers, Materials & Continua· Volume 73· Issue 3

Abstract

Electroencephalogram (EEG) is a medical imaging technology that can measure the electrical activity of the scalp produced by the brain, measured and recorded chronologically the surface of the scalp from the brain. The recorded signals from the brain are rich with useful information. The inference of this useful information is a challenging task. This paper aims to process the EEG signals for the recognition of human emotions specifically happiness, anger, fear, sadness, and surprise in response to audiovisual stimuli. The EEG signals are recorded by placing neurosky mindwave headset on the subject’s scalp, in response to audiovisual stimuli for the mentioned emotions. Using a bandpass filter with a bandwidth of 1–100 Hz, recorded raw EEG signals are preprocessed. The preprocessed signals then further analyzed and twelve selected features in different domains are extracted. The Random forest (RF) and multilayer perceptron (MLP) algorithms are then used for the classification of the emotions through extracted features. The proposed audiovisual stimuli based EEG emotion classification system shows an average classification accuracy of 80% and 88% using MLP and RF classifiers respectively on hybrid features for experimental signals of different subjects. The proposed model outperforms in terms of cost and accuracy.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Emotion and Mood Recognition · EEG and Brain-Computer Interfaces · Color perception and design

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (33)

Show source-provided references
1. Emotions detection on an ambient intelligent 240 system using wearable devices10.1016/j.future.2018.03.038 ↗
2. Objective measures, sensors and computational techniques for stress recognition and classification: A survey10.1016/j.cmpb.2012.07.003 ↗
3. Speech emotion recognition: Emotional models, databases, features, preprocessing methods, supporting modalities, and classifiers10.1016/j.specom.2019.12.001 ↗
4. Deep facial expression recognition: A survey
5. Laughter and smiling in 16 positive emotions10.1109/TAFFC.2017.2737000 ↗
6. EEG-controlled wall-crawling cleaning robot using SSVEP-based brain-computer interface
7. Identifying human emotions from facial expressions with deep learning
8. A comparative analysis of signal processing and classification methods for different applications based on EEG signals10.1016/j.bbe.2020.02.002 ↗
9. Electroencephalograph (EEG) based emotion recognition system: A review10.1007/978-981-10-8204-7_5 ↗
10. Emotion recognition from sensory and bio-signals: A survey
11. Emotions recognition using EEG signals: A survey10.1109/TAFFC.2017.2714671 ↗
12. EEG-Based emotion recognition during watching movies
13. Predicting students happiness from physiology phone mobility and behavioral data
14. A. Choppin, “EEG-based human interface for disabled individuals: Emotion expression with neural networks,” Master’s thesis, Tokyo Institute of Technology, 2000.
15. Using machine learning to predict learner emotional state from brainwaves
16. Toward automatic detection of brain responses to emotional music through analysis of EEG effective connectivity10.1016/j.chb.2016.01.005 ↗
17. EEG-based emotion recognition using statistical measures and auto-regressive modeling
18. Improve the generalization of emotional classifiers across time by using training samples from different days
19. Emotion recognition from EEG using higher order crossings10.1109/TITB.2009.2034649 ↗
20. An optimal EEG-based emotion recognition algorithm using gabor
21. Toward an EEG-based recognition of music liking using time-frequency analysis10.1109/TBME.2012.2217495 ↗
22. Differential entropy feature for EEG-based emotion classification
23. An investigation on visual and audiovisual stimulus based emotion recognition using EEG10.1504/IJMEI.2009.022645 ↗
24. EEG-based emotion recognition in music listening10.1109/TBME.2010.2048568 ↗
25. Multi-feature input deep forest for EEG-based emotion recognition10.3389/fnbot.2020.617531 ↗
26. Human emotion recognition and analysis in response to audio music using brain signals10.1016/j.chb.2016.08.029 ↗
27. https://store.neurosky.com/pages/mindwave, Accessed: 2019.
28. https://store.neurosky.com/products/puzzlebox-synapse, Accessed: 2019.
29. K. Lee and S. Yang, “Method and apparatus for quantitatively evaluating mental states based on brain wave signal processing system,” US Patent App, 11/656, 828, 2008.
30. A new feature extraction method to improve emotion detection using EEG signals10.5565/rev/elcvia.1045 ↗
31. Classification of human emotion from EEG using discrete wavelet transform10.4236/jbise.2010.34054 ↗
32. An empirical evaluation of machine learning techniques for chronic kidney disease prophecy10.1109/ACCESS.2020.2981689 ↗
33. Cross-subject emotion recognition using flexible analytic wavelet transform from EEG signals10.1109/JSEN.2018.2883497 ↗