journal article·2025-11Open access

Cracking the Valence Code: Patterned Facial Kinematics and Neural Signatures of Emotional Expressions in Mice

Yujia Chen, Ruiqing Hou, Zhinan Chen, Junli Lu, Si Chen, Shisheng Xiong, Jianfeng Feng, Trevor W. Robbins, Haitao Yan, Xiao Xiao

Advanced Science· Volume 12· Issue 42

Abstract

Abstract Despite advances in linking mouse facial expressions to emotional states, the specific facial features and neural signatures remain elusive. An artificial intelligence (AI)‐based framework that decodes mouse facial expressions is presented, revealing stable valence and arousal dimensions analogous to those described in human emotion models. Facial expressions emerge as robust indicators of positive and negative emotional responses, validated through pharmacological manipulations, while responses to hallucinogens highlight the potential of valence‐specific prototype modeling for interpreting previously uncharacterized emotional states. Using automated multikeypoint tracking, patterned facial kinematics that are consistent within the same emotional valence are identified. Ear dynamics, in particular, emerge as critical features, offering distinct and sensitive markers of subtle emotional distinctions. Neurocorrelational analyses and optogenetic inhibition targeting the ventral tegmental area further demonstrate the intricate link between facial expressions and valence‐specific neural activity in dopaminergic and GABAergic neurons. These findings establish a precise, high‐temporal‐resolution platform for objectively decoding murine emotional states, advancing the understanding of emotional processing mechanisms and informing the development of mood‐regulating therapies.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Neural dynamics and brain function · Neuroscience and Neuropharmacology Research · Nicotinic Acetylcholine Receptors Study

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Behavioral and Cognitive Neuroscience Center Institute of Science and Technology for Brain‐Inspired Intelligence MOE Frontiers Center for Brain Science Key Laboratory of Computational Neuroscience and Brain‐Inspired Intelligence Ministry of Education Department of Endocrinology Huadong Hospital Fudan University Shanghai 200433 China

College of Future Information Technology Fudan University Shanghai 200433 China

Department of Educational Psychology Faculty of Education The Chinese University of Hong Kong Shatin Hong Kong SAR 999077 China

Department of Psychology Behavioural and Clinical Neuroscience Institute University of Cambridge Cambridge CB2 3EB UK

State Key Laboratory of National Security Specially Needed Medicines Beijing 100039 China

Funding

National Key Research and Development Program of China · National Natural Science Foundation of China · Higher Education Discipline Innovation Project · Shanghai Center for Brain Science and Brain-Inspired Technology

References (100+)

Show source-provided references
1. 10.1093/mind/os-IX.34.18810.1093/mind/os-IX.34.188 ↗
2. 10.1146/annurev.psych.60.110707.16353910.1146/annurev.psych.60.110707.163539 ↗
3. Adolphs R. · 2018
4. 10.1016/j.cell.2014.03.00310.1016/j.cell.2014.03.003 ↗
5. 10.1146/annurev-neuro-111020-10331410.1146/annurev-neuro-111020-103314 ↗
6. 10.1037/0003-066X.48.4.38410.1037/0003-066X.48.4.384 ↗
7. 10.1016/j.specom.2019.12.00110.1016/j.specom.2019.12.001 ↗
8. 10.1016/j.neuron.2015.02.01810.1016/j.neuron.2015.02.018 ↗
9. 10.1016/j.neubiorev.2023.10523710.1016/j.neubiorev.2023.105237 ↗
10. 10.1017/S095457940505034010.1017/S0954579405050340 ↗
11. 10.1016/j.neuron.2018.10.00110.1016/j.neuron.2018.10.001 ↗
12. 10.1016/j.conb.2021.01.00310.1016/j.conb.2021.01.003 ↗
13. 10.1093/oso/9780195112719.001.000110.1093/oso/9780195112719.001.0001 ↗
14. 10.1093/scan/nsw16110.1093/scan/nsw161 ↗
15. 10.1007/s42761-022-00125-610.1007/s42761-022-00125-6 ↗
16. Ekman P. · 2013
17. 10.1126/sciadv.abq842110.1126/sciadv.abq8421 ↗
18. 10.1038/s41598-019-52938-410.1038/s41598-019-52938-4 ↗
19. 10.3389/fvets.2024.143679510.3389/fvets.2024.1436795 ↗
20. 10.1038/s41598-023-35807-z10.1038/s41598-023-35807-z ↗
21. 10.7554/eLife.6119710.7554/eLife.61197 ↗
22. 10.1016/j.neubiorev.2020.07.01310.1016/j.neubiorev.2020.07.013 ↗
23. 10.1038/nmeth.145510.1038/nmeth.1455 ↗
24. 10.1177/174480691876365810.1177/1744806918763658 ↗
25. 10.1371/journal.pone.028893010.1371/journal.pone.0288930 ↗
26. 10.1126/science.aaz946810.1126/science.aaz9468 ↗
27. 10.1016/j.jpain.2023.02.11310.1016/j.jpain.2023.02.113 ↗
28. 10.1038/s41593-023-01490-610.1038/s41593-023-01490-6 ↗
29. 10.1016/j.brainres.2012.11.00110.1016/j.brainres.2012.11.001 ↗
30. 10.1038/nature1152710.1038/nature11527 ↗
31. 10.1038/s41467-022-28190-210.1038/s41467-022-28190-2 ↗
32. 10.1016/j.cobeha.2018.10.01010.1016/j.cobeha.2018.10.010 ↗
33. 10.1016/j.brainresrev.2007.05.00410.1016/j.brainresrev.2007.05.004 ↗
34. 10.1007/s00213-015-4151-310.1007/s00213-015-4151-3 ↗
35. 10.1016/j.pneurobio.2014.10.00210.1016/j.pneurobio.2014.10.002 ↗
36. 10.3389/fncir.2022.86705310.3389/fncir.2022.867053 ↗
37. 10.1523/JNEUROSCI.2114-22.202310.1523/JNEUROSCI.2114-22.2023 ↗
38. 10.1038/nature1576310.1038/nature15763 ↗
39. 10.1038/s41467-023-38028-010.1038/s41467-023-38028-0 ↗
40. 10.1038/nature0878310.1038/nature08783 ↗
41. 10.1016/j.cophys.2020.11.00610.1016/j.cophys.2020.11.006 ↗
42. 10.1038/s41467-019-12478-x10.1038/s41467-019-12478-x ↗
43. 10.1038/s41598-023-46743-310.1038/s41598-023-46743-3 ↗
44. 10.1038/s41398-020-0806-x10.1038/s41398-020-0806-x ↗
45. K.He X.Zhang S.Ren J.Sun in2016 IEEE Conf. Computer Vision and Pattern Recognition (CVPR) IEEE Piscataway NJ2016 pp.770–778.10.1109/CVPR.2016.90 ↗
46. N.Dalal B.Triggs in2005 IEEE Computer Society Conf. Computer Vision and Pattern Recognition (CVPR’05) Vol. 1 IEEE Piscataway NJ2005 pp.886–893.10.1109/CVPR.2005.177 ↗
47. 10.21105/joss.0086110.21105/joss.00861 ↗
48. 10.1258/00236770677847647910.1258/002367706778476479 ↗
49. 10.1038/ncomms1050310.1038/ncomms10503 ↗
50. 10.1145/338625210.1145/3386252 ↗
51. 10.1038/s41598-023-28588-y10.1038/s41598-023-28588-y ↗
52. Koch G. · 2015
53. M.Huber A. T.Luu P.Terhörst N.Damer in2024 IEEE/CVF Winter Conf. Applications Computer Vision (WACV) IEEE Piscataway NJ2024 pp.4724–4733.10.1109/WACV57701.2024.00467 ↗
54. L.Chen J.Chen H.Hajimirsadeghi G.Mori in2020 IEEE Winter Conf. Applications Computer Vision (WACV) IEEE Piscataway NJ2020 pp.2783–2792.10.1109/WACV45572.2020.9093461 ↗
55. 10.3390/jimaging910022410.3390/jimaging9100224 ↗
56. R. R.Selvaraju M.Cogswell A.Das R.Vedantam D.Parikh D.Batra in2017 IEEE Int. Conf. Computer Vision (ICCV) IEEE Piscataway NJ2017 pp.618–626.10.1109/ICCV.2017.74 ↗
57. 10.1016/j.physbeh.2012.03.02410.1016/j.physbeh.2012.03.024 ↗
58. 10.1038/npp.2015.22010.1038/npp.2015.220 ↗
59. 10.1186/s13041-021-00780-z10.1186/s13041-021-00780-z ↗
60. 10.1371/journal.pbio.300153710.1371/journal.pbio.3001537 ↗
61. 10.1038/s41386-019-0349-010.1038/s41386-019-0349-0 ↗
62. 10.1016/j.alcohol.2012.06.00110.1016/j.alcohol.2012.06.001 ↗
63. 10.1016/0091-3057(96)00069-X10.1016/0091-3057(96)00069-X ↗
64. 10.1007/s00213-019-05335-810.1007/s00213-019-05335-8 ↗
65. 10.1124/pr.115.01147810.1124/pr.115.011478 ↗
66. 10.3389/fphar.2018.0017210.3389/fphar.2018.00172 ↗
67. 10.1016/j.neuropharm.2013.08.02510.1016/j.neuropharm.2013.08.025 ↗
68. 10.1007/s00213-013-3006-z10.1007/s00213-013-3006-z ↗
69. 10.3389/fphar.2023.102172910.3389/fphar.2023.1021729 ↗
70. 10.1038/s41593-018-0209-y10.1038/s41593-018-0209-y ↗
71. 10.1162/neco.1997.9.8.173510.1162/neco.1997.9.8.1735 ↗
72. 10.1016/j.neuron.2019.03.03010.1016/j.neuron.2019.03.030 ↗
73. 10.3389/fncir.2019.0007810.3389/fncir.2019.00078 ↗
74. 10.1038/s41593-018-0288-910.1038/s41593-018-0288-9 ↗
75. 10.1038/nrn.2016.16510.1038/nrn.2016.165 ↗
76. 10.1016/j.cub.2021.10.03510.1016/j.cub.2021.10.035 ↗
77. 10.1016/j.bbi.2023.11.00510.1016/j.bbi.2023.11.005 ↗
78. 10.1016/j.inffus.2023.10180510.1016/j.inffus.2023.101805 ↗
79. 10.1016/j.beproc.2015.08.00210.1016/j.beproc.2015.08.002 ↗
80. 10.1523/ENEURO.0349-22.202210.1523/ENEURO.0349-22.2022 ↗
81. 10.1007/s10162-016-0579-310.1007/s10162-016-0579-3 ↗
82. 10.1007/s10162-016-0589-110.1007/s10162-016-0589-1 ↗
83. 10.1038/s41598-018-35905-310.1038/s41598-018-35905-3 ↗
84. 10.7120/09627286.25.2.17110.7120/09627286.25.2.171 ↗
85. 10.1016/j.applanim.2024.10626210.1016/j.applanim.2024.106262 ↗
86. 10.1016/j.celrep.2016.05.05710.1016/j.celrep.2016.05.057 ↗
87. 10.1038/nature1075410.1038/nature10754 ↗
88. 10.1073/pnas.140432311110.1073/pnas.1404323111 ↗
89. 10.1016/j.cub.2020.05.00310.1016/j.cub.2020.05.003 ↗
90. 10.1016/j.neuron.2023.02.01210.1016/j.neuron.2023.02.012 ↗
91. 10.1093/brain/awae17310.1093/brain/awae173 ↗
92. 10.1038/s41551-021-00736-710.1038/s41551-021-00736-7 ↗
93. 10.3389/fnins.2024.145245010.3389/fnins.2024.1452450 ↗
94. 10.1038/s41592-024-02319-110.1038/s41592-024-02319-1 ↗
95. Daruwalla K. · bioRxiv · 2025
96. 10.1016/j.neuron.2018.09.02010.1016/j.neuron.2018.09.020 ↗
97. 10.1038/s41592-022-01426-110.1038/s41592-022-01426-1 ↗
98. 10.7554/eLife.9570910.7554/eLife.95709 ↗
99. 10.1038/s41592-021-01106-610.1038/s41592-021-01106-6 ↗
100. 10.1016/j.jphs.2016.06.00110.1016/j.jphs.2016.06.001 ↗