Event-Related Potentials during Verbal Recognition of Naturalistic Neutral-to-Emotional Dynamic Facial Expressions
Source abstract
Abstract
Event-related potentials during facial emotion recognition have been studied for more than twenty years. Nowadays, there has been a growing interest in the use of naturalistic stimuli. This research was aimed, therefore, at studying event-related potentials (ERP) during recognition of dynamic facial neutral-to-emotional expressions, more ecologically valid than static faces. We recorded the ERP of 112 participants who watched 144 dynamic morphs depicting a gradual change from a neutral expression to a basic emotional expression (anger, disgust, fear, happiness, sadness and surprise) and labelled those emotions verbally. We revealed some typical ERP, like N170, P2, EPN and LPP. Participants with lower accuracy exhibited a larger posterior P2. Participants with faster correct responses exhibited a larger amplitude of P2 and LPP. We also conducted a classification analysis that yielded the accuracy of 76% for prediction of participants who recognise emotions quickly on the basis of the amplitude of posterior P2 and LPP. These results extend data from previous research about the electroencephalographic correlates of facial emotion recognition.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Face Recognition and Perception · Neural and Behavioral Psychology Studies · Neural dynamics and brain function
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
International Laboratory of Social Neurobiology, HSE University, 101000 Moscow, Russia
Academy of Psychology and Education Sciences, Southern Federal University, 344006 Rostov-on-Don, Russia
Funding
International Laboratory of Social Neurobiology ICN HSE RF Government
References (85)
Show source-provided references
1. Darwin, C. (1872). The Expression of the Emotions in Man and Animals, Murray.10.1037/10001-000 ↗
2. Recognizing emotion from facial expressions: Psychological and neurological mechanisms10.1177/1534582302001001003 ↗
3. Facial expression recognition method with multi-label distribution learning for non-verbal behavior understanding in the classroom10.1016/j.infrared.2020.103594 ↗
4. MFDNet: Collaborative poses perception and matrix Fisher distribution for head pose estimation10.1109/TMM.2021.3081873 ↗
5. ARHPE: Asymmetric Relation-aware Representation Learning for Head Pose Estimation in Industrial Human-machine Interaction10.1109/TII.2022.3143605 ↗
6. Facial emotion recognition in child psychiatry: A systematic review10.1016/j.ridd.2013.01.008 ↗
7. Involvement of striate and extrastriate visual cortical areas in spatial attention10.1038/7274 ↗
8. Rapid emotional face processing in the human right and left brain hemispheres: An ERP study10.1097/00001756-199909090-00001 ↗
9. Visual event-related potentials index focused attention within bilateral stimulus arrays. II. Functional dissociation of P1 and N1 components10.1016/0013-4694(90)90139-B ↗
10. ERP measures indicate both attention and working memory encoding decrements in aging10.1111/j.1469-8986.2010.01128.x ↗
11. Mechanisms of human attention: Event-related potentials and oscillations10.1016/S0149-7634(01)00027-6 ↗
12. An electrophysiological investigation into the automaticity of emotional face processing in high versus low trait anxious individuals10.3758/CABN.9.3.323 ↗
13. Does processing of emotional facial expressions depend on intention? Time-resolved evidence from event-related brain potentials10.1016/j.biopsycho.2012.02.002 ↗
14. Electrophysiological correlates of rapid spatial orienting towards fearful faces10.1093/cercor/bhh023 ↗
15. Electrophysiological studies of face perception in humans10.1162/jocn.1996.8.6.551 ↗
16. N170 or N1? Spatiotemporal differences between object and face processing using ERPs10.1093/cercor/bhg111 ↗
17. N170 sensitivity to facial expression: A meta-analysis10.1016/j.neubiorev.2015.06.002 ↗
18. Scalp topography and analysis of intracranial sources of face-evoked potentials
19. Early lateralization and orientation tuning for face, word, and object processing in the visual cortex10.1016/j.neuroimage.2003.07.010 ↗
20. Brain mechanisms for emotional influences on perception and attention: What is magic and what is not10.1016/j.biopsycho.2012.02.007 ↗
21. The facilitated processing of threatening faces: An ERP analysis10.1037/1528-3542.4.2.189 ↗
22. Disgust exposure and explicit emotional appraisal enhance the LPP in response to disgusted facial expressions10.1080/17470919.2016.1182067 ↗
23. Emotional facial expressions evoke faster orienting responses, but weaker emotional responses at neural and behavioural levels compared to scenes: A simultaneous EEG and facial EMG study10.1016/j.neuroimage.2015.09.065 ↗
24. Early visual processing of snakes and angry faces: An ERP study10.1016/j.brainres.2017.10.031 ↗
25. Fleeting images: A new look at early emotion discrimination10.1111/1469-8986.3820175 ↗
26. Early posterior negativity as facial emotion recognition index in children with attention deficit hyperactivity disorder
27. Neural activation during the processing of ambiguous fearful facial expressions: An ERP study in anxious and nonanxious individuals10.1016/j.biopsycho.2011.08.001 ↗
28. Event-related potentials from a visual categorization task10.1016/S1385-299X(01)00055-1 ↗
29. A review of the evidence for P2 being an independent component process: Age, sleep and modality10.1016/j.clinph.2003.11.021 ↗
30. Abnormal spatiotemporal processing of emotional facial expressions in childhood autism: Dipole source analysis of event-related potentials10.1111/j.1460-9568.2008.06328.x ↗
31. Consciousness and emotional facial expression recognition: Subliminal/supraliminal stimulation effect on N200 and P300 ERPs10.1027/0269-8803.21.2.100 ↗
32. Recognition of facial expression and visual P300 in schizophrenic patients: Differences between paranoid type patients and non-paranoid patients10.1111/j.1440-1819.2004.01307.x ↗
33. Facial attractiveness modulates early and late event-related brain potentials10.1016/j.biopsycho.2007.06.008 ↗
34. Neural responses to cartoon facial attractiveness: An event-related potential study10.1007/s12264-013-1401-4 ↗
35. Effects of dynamic aspects of facial expressions: A review10.1177/1754073912451349 ↗
36. Deciphering the enigmatic face: The importance of facial dynamics in interpreting subtle facial expressions10.1111/j.0956-7976.2005.01548.x ↗
37. Recognizing famous faces: Exploring the benefits of facial motion10.1207/S15326969ECO1204_01 ↗
38. Dissociable neural pathways are involved in the recognition of emotion in static and dynamic facial expressions10.1006/nimg.2002.1323 ↗
39. Brain Responses to Dynamic Facial Expressions: A Normative Meta-Analysis10.3389/fnhum.2018.00227 ↗
40. Amaral, C.P., Simöes, M.A., and Castelo-Branco, M.S. (2015). Neural signals evoked by stimuli of increasing social scene complexity are detectable at the single-trial level and right lateralized. PLoS ONE, 10.10.1371/journal.pone.0121970 ↗
41. CAS(ME)2: A Database for Spontaneous Macro-Expression and Micro-Expression Spotting and Recognition10.1109/TAFFC.2017.2654440 ↗
42. Dynamic perception of facial affect and identity in the human brain10.1093/cercor/13.10.1023 ↗
43. Spatiotemporal neural network dynamics for the processing of dynamic facial expressions10.1038/srep12432 ↗
44. Enhanced neural activity in response to dynamic facial expressions of emotion: An fMRI study10.1016/j.cogbrainres.2004.01.008 ↗
45. Event-related potentials reveal temporal staging of dynamic facial expression and gaze shift effects on attentional orienting10.1080/17470910902809487 ↗
46. Electrophysiological correlates of perceiving and evaluating static and dynamic facial emotional expressions10.1016/j.brainres.2010.12.041 ↗
47. Trautmann-Lengsfeld, S.A., Domínguez-Borràs, J., Escera, C., Herrmann, M., and Fehr, T. (2013). The perception of dynamic and static facial expressions of happiness and disgust investigated by ERPs and fMRI constrained source analysis. PLoS ONE, 8.10.1371/journal.pone.0066997 ↗
48. Electro-cortical correlates of multisensory integration using ecologically valid emotional stimuli: Differential effects for fear and disgust10.1016/j.biopsycho.2019.01.011 ↗
49. Recognizing dynamic facial expressions of emotion: Specificity and intensity effects in event-related brain potentials10.1016/j.biopsycho.2013.12.003 ↗
50. Recognition of all basic emotions varies in accuracy and reaction time: A new verbal method of measurement10.1002/ijop.12512 ↗
51. EDMF: Efficient Deep Matrix Factorization with Review Feature Learning for Industrial Recommender System10.1109/TII.2021.3128240 ↗
52. Anisotropic angle distribution learning for head pose estimation and attention understanding in human-computer interaction10.1016/j.neucom.2020.09.068 ↗
53. Li, Z., Liu, H., Zhang, Z., Liu, T., and Xiong, N.N. (2021). Learning Knowledge Graph Embedding with Heterogeneous Relation Attention Networks. IEEE Trans. Neural Netw. Learn. Syst.10.1109/TNNLS.2021.3055147 ↗
54. Lundqvist, D., Flykt, A., and Öhman, A. (1998). The Karolinska Directed Emotional Faces—KDEF, CD ROM from Department of Clinical Neuroscience, Psychology Section, Karolinska Institutet, Karolinska Institutet. Available online: http://www.emotionlab.se/resources/kdef.10.1037/t27732-000 ↗
55. OpenSesame: An open-source, graphical experiment builder for the social sciences10.3758/s13428-011-0168-7 ↗
56. EEGLAB: An open source toolbox for analysis of single-trial EEG dynamics including independent component analysis10.1016/j.jneumeth.2003.10.009 ↗
57. A new method for off-line removal of ocular artifact10.1016/0013-4694(83)90135-9 ↗
58. Reliability of event-related potentials: The influence of number of trials and electrodes10.1016/j.physbeh.2014.03.008 ↗
59. Controlling the false discovery rate: A practical and powerful approach to multiple testing10.1111/j.2517-6161.1995.tb02031.x ↗
60. Derntl, B., Habel, U., Windischberger, C., Robinson, S., Kryspin-Exner, I., Gur, R.C., and Moser, E. (2009). General and specific responsiveness of the amygdala during explicit emotion recognition in females and males. BMC Neurosci., 10.10.1186/1471-2202-10-91 ↗
61. Further Evidence of the Zero-Association Between Symptoms of Insomnia and Facial Emotion Recognition—Results from a Sample of Adults in Their Late 30s10.3389/fpsyt.2018.00754 ↗
62. Face-sensitive P1 and N170 components are related to the perception of two-dimensional and three-dimensional objects10.1097/WNR.0000000000001003 ↗
63. Interpretive bias in social phobia: An ERP study with morphed emotional schematic faces10.1080/02699930801940461 ↗
64. Fear of negative evaluation and attentional bias for facial expressions: An event-related study10.1016/j.bandc.2013.05.008 ↗
65. Cross-modal integration of emotional face and voice in congruous and incongruous pairs: The P2 ERP effect10.1080/20445911.2011.473560 ↗
66. Event-related potentials and selective attention to auditory stimuli varying in pitch and localization10.1016/0301-0511(79)90027-9 ↗
67. Neural correlates of fast stimulus discrimination and response selection in top-level fencers10.1016/j.neulet.2006.08.085 ↗
68. Attentional orienting towards emotion: P2 and N400 ERP effects10.1016/j.neuropsychologia.2011.07.022 ↗
69. Proverbio, A.M., Zani, A., and Adorni, R. (2008). Neural markers of a greater female responsiveness to social stimuli. BMC Neurosci., 9.10.1186/1471-2202-9-56 ↗
70. Exogenous attention to facial versus non-facial emotional visual stimuli10.1093/scan/nss068 ↗
71. Effects of social and affective content on exogenous attention as revealed by event-related potentials10.1080/02699931.2018.1486287 ↗
72. Event-related potentials of emotional memory: Encoding pleasant, unpleasant, and neutral pictures10.3758/CABN.2.3.252 ↗
73. Event-related brain responses to emotional words, pictures, and faces—A cross-domain comparison10.3389/fpsyg.2014.01106 ↗
74. The role of spatial attention in the processing of facial expression: An ERP study of rapid brain responses to six basic emotions10.3758/CABN.3.2.97 ↗
75. The selective processing of briefly presented affective pictures: An ERP analysis10.1111/j.1469-8986.2004.00174.x ↗
76. Reduced electrocortical response to threatening faces in major depressive disorder10.1002/da.20712 ↗
77. Affective processing of loved faces: Contributions from peripheral and central electrophysiology10.1016/j.neuropsychologia.2010.05.031 ↗
78. Effect of empathy trait on attention to various facial expressions: Evidence from N170 and late positive potential (LPP)10.1186/1880-6805-33-18 ↗
79. Orienting of attention10.1080/00335558008248231 ↗
80. Voluntary modulations of attention in a semantic auditory-visual matching Task: An ERP study10.4067/S0716-97602008000400010 ↗
81. Plass, J.L., Moreno, R., and Brünken, R. (2010). Cognitive Load Theory, Cambridge University Press.10.1017/CBO9780511844744 ↗
82. Age and gender differences in emotion recognition10.3389/fpsyg.2019.02371 ↗
83. Sex differences in emotion recognition: Evidence for a small overall female superiority on facial disgust10.1037/emo0000446 ↗
84. Facial emotion recognition during pregnancy: Examining the effects of facial age and affect10.1016/j.infbeh.2018.09.008 ↗
85. On the universality and cultural specificity of emotion recognition: A meta-analysis10.1037/0033-2909.128.2.203 ↗