journal article·2022Open access

A Deep Learning Model for EEG-Based Lie Detection Test Using Spatial and Temporal Aspects

Abeer Abdulaziz AlArfaj, Hanan Ahmed Hosni Mahmoud

Computers, Materials & Continua· Volume 73· Issue 3

Abstract

Lie detection test is highly significant task due to its impact on criminology and society. Computerized lie detection test model using electroencephalogram (EEG) signals is studied in literature. In this paper we studied deep learning framework in lie detection test paradigm. First, we apply a preprocessing technique to utilize only a small fragment of the EEG image instead of the whole image. Our model describes a temporal feature map of the EEG signals measured during the lie detection test. A deep learning attention model (V-TAM) extracts the temporal map vector during the learning process. This technique reduces computational time and lessens the overfitting in Deep Learning architectures. We propose a Cascading attention model with a deep learning convolutional neural network (CNN). V-TAM model extracts local features and global features in separate paths spatial and temporal. Also, to enhance the EEG segmentation precision, a novel Visual-Temporal Attention Model (V-TAM) is proposed. The accuracy was evaluated using data measured from a sensor from a public dataset of 9512 subjects during fifteen minutes lie detection task. We compared our model with three recent published models. Our proposed model attained the highest performance of (98.5%) with (p
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Deception detection and forensic psychology · Adversarial Robustness in Machine Learning · Anomaly Detection Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (34)

Show source-provided references
1. Building a better lie detector with BERT: The difference between truth and lies
2. Lie detector with pupil dilation and eye blinks using hough transform and frame difference method with fuzzy logic
3. Deep learning model to detect suspects’ lies
4. Lie detection of young age subjects
5. Detecting COVID-19 patients in X-ray images based on MAI-nets10.2991/ijcis.d.210518.001 ↗
6. Joint learning of visual and spatial features for edit propagation from a single image10.1007/s00371-019-01633-6 ↗
7. A novel image classification approach via dense-MobileNet models
8. Instant edit propagation on images based on bilateral grid10.32604/cmc.2019.06094 ↗
9. HMM-Based deception recognition from visual cues
10. Combining prosodic lexical and cepstral systems for deceptive speech detection
11. Neural network based classification of stressed speech using nonlinear spectral and cepstral features
12. Deception detecting from speech signal using relevance vector machine and non-linear dynamics features10.1016/j.neucom.2014.04.083 ↗
13. Convolutional bidirectional long short-term memory for deception detection with acoustic features10.1109/ACCESS.2018.2882917 ↗
14. Voice stress detection: A method for stress analysis detecting fluctuations on lippold microtremor spectrum using FFT
15. Delta-spectral cepstral coefficients for robust speech recognition
16. Tailings pond risk prediction using long short-term memory networks10.1109/ACCESS.2019.2959820 ↗
17. A Short-term load forecasting method using integrated CNN and LSTM network10.1109/ACCESS.2021.3060654 ↗
18. Short-term photovoltaic power forecasting based on long short term memory neural network and attention mechanism10.1109/ACCESS.2019.2923006 ↗
19. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
20. Perceptual coding of digital audio
21. Multi-model modeling of CFB boiler bed temperature system based on principal component analysis10.1109/ACCESS.2019.2961414 ↗
22. Spectral based voice activity detection for real-time voice interface
23. Deep neural networks for small footprint text-dependent speaker verification
24. Unsupervised feature learning for audio classification using convolutional deep belief networks
25. Keyword extraction by entropy difference between the intrinsic and extrinsic mode10.1016/j.physa.2013.05.052 ↗
26. An experimental study on speech enhancement based on deep neural networks10.1109/LSP.2013.2291240 ↗
27. Deep neural networks for acoustic modeling in speech recognition: The shared views of four research groups10.1109/MSP.2012.2205597 ↗
28. Lie detector with the analysis of the change of diameter pupil and the eye movement use method Gabor wavelet transform and decision tree
29. Distinguishing deception from non-deception in Chinese speech
30. Thermal facial analysis for deception detection10.1109/TIFS.2014.2317309 ↗
31. Speech analysis using modulation-based features for detecting deception
32. A linear model based on principal component analysis for disease prediction10.1109/ACCESS.2019.2931956 ↗
33. Phychoacoustic masking of delta and time-difference cepstrum features for deception detection
34. An advanced deep residual dense network (DRDN) approach for image super-resolution10.2991/ijcis.d.191209.001 ↗