Machine Learning-Enabled Emotion Recognition by Multisource Throat Signals
Source abstract
Abstract
Emotion monitoring plays a crucial role in mental health management. However, traditional methods of emotion recognition predominantly rely on subjective questionnaires or facial expression analyses, which are often inadequate for continuous and highly accurate monitoring. In this study, we propose a high-precision, fine-grained emotion recognition system based on multisource throat physiological signals. The system collects signals through optimized flexible multiporous skin sensors and analyzes them using machine learning models capable of efficiently capturing complex feature interactions. First, we adopt a two-step cross-linking strategy to modulate the porous structure of the sensitive layer to enable accurate detection of the diverse and weak physiological signals in the throat. By extracting four-dimensional features from the input of 7025 samples, the platform based on the Light Gradient Boosting Machine (LightGBM) efficiently captures their nonlinear interactions, ultimately achieving precise classification of five emotional states (relaxation, surprise, disgust, fear, and neutral) with an accuracy of 98.9%. Further validation on an independent data set reveals an average emotion recognition accuracy of 99.3%, demonstrating the system's robustness and reliability in real-world applications. This work provides a viable technological solution for real-time and continuous emotion monitoring, offering significant potential in mental health management and related fields.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Emotion and Mood Recognition · Infant Health and Development · EEG and Brain-Computer Interfaces
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
State Key Laboratory of Advanced Technology for Materials Synthesis and Processing, Center of Smart Materials and Devices
Wuhan University of Technology
School of Materials and Microelectronics
Wuzhen Laboratory
State Key Laboratory of New Ceramics and Fine Processing, School of Materials Science and Engineering
Tsinghua University
Funding
National Natural Science Foundation of China · Zhejiang Province Basic Public Welfare Research Program
References (67)
Show source-provided references
1. 10.1016/j.ebiom.2023.10470310.1016/j.ebiom.2023.104703 ↗
2. 10.1038/s41586-023-05748-810.1038/s41586-023-05748-8 ↗
3. 10.1038/s41593-024-01816-y10.1038/s41593-024-01816-y ↗
4. 10.1038/s44159-022-00040-410.1038/s44159-022-00040-4 ↗
5. 10.1016/S2215-0366(18)30511-X10.1016/S2215-0366(18)30511-X ↗
6. 10.1038/s44220-024-00251-z10.1038/s44220-024-00251-z ↗
7. 10.1038/s44220-023-00120-110.1038/s44220-023-00120-1 ↗
8. 10.1002/wps.2111010.1002/wps.21110 ↗
9. 10.1038/s41562-024-02033-010.1038/s41562-024-02033-0 ↗
10. 10.1038/s44220-024-00325-y10.1038/s44220-024-00325-y ↗
11. 10.1038/s41562-024-01903-x10.1038/s41562-024-01903-x ↗
12. 10.1038/s41593-022-01024-610.1038/s41593-022-01024-6 ↗
13. 10.1038/s43587-022-00341-610.1038/s43587-022-00341-6 ↗
14. 10.1038/s44220-024-00303-410.1038/s44220-024-00303-4 ↗
15. 10.1038/s41598-022-20207-610.1038/s41598-022-20207-6 ↗
16. 10.1038/s44220-024-00215-310.1038/s44220-024-00215-3 ↗
17. 10.1038/s41467-025-57629-510.1038/s41467-025-57629-5 ↗
18. 10.1038/s41598-024-79167-810.1038/s41598-024-79167-8 ↗
19. 10.1016/j.jii.2025.10078910.1016/j.jii.2025.100789 ↗
20. 10.1002/adfm.20220045710.1002/adfm.202200457 ↗
21. 10.1038/s41928-023-01091-y10.1038/s41928-023-01091-y ↗
22. 10.1002/adma.20210905510.1002/adma.202109055 ↗
23. 10.1038/s41586-024-07161-110.1038/s41586-024-07161-1 ↗
24. 10.34133/cbsystems.007410.34133/cbsystems.0074 ↗
25. 10.1038/s41467-023-44673-210.1038/s41467-023-44673-2 ↗
26. 10.1038/s41598-024-63651-210.1038/s41598-024-63651-2 ↗
27. 10.1038/s41597-024-03838-410.1038/s41597-024-03838-4 ↗
28. 10.1038/s41593-024-01799-w10.1038/s41593-024-01799-w ↗
29. 10.1038/s41746-019-0150-910.1038/s41746-019-0150-9 ↗
30. 10.1038/s41598-024-62990-410.1038/s41598-024-62990-4 ↗
31. 10.1038/s44220-024-00238-w10.1038/s44220-024-00238-w ↗
32. 10.1038/s41467-023-43664-710.1038/s41467-023-43664-7 ↗
33. 10.1038/s41928-024-01196-y10.1038/s41928-024-01196-y ↗
34. 10.1038/s41565-023-01383-610.1038/s41565-023-01383-6 ↗
35. 10.1038/s41467-024-45915-710.1038/s41467-024-45915-7 ↗
36. 10.1007/s40820-021-00770-910.1007/s40820-021-00770-9 ↗
37. 10.1038/s41467-022-28760-410.1038/s41467-022-28760-4 ↗
38. 10.1038/s42256-023-00744-z10.1038/s42256-023-00744-z ↗
39. 10.1038/s41591-023-02396-310.1038/s41591-023-02396-3 ↗
40. 10.1007/s40820-023-01013-910.1007/s40820-023-01013-9 ↗
41. 10.1002/adma.20240344710.1002/adma.202403447 ↗
42. 10.1038/s41467-024-49787-910.1038/s41467-024-49787-9 ↗
43. 10.1002/adma.20240540510.1002/adma.202405405 ↗
44. 10.1002/adfm.20240572210.1002/adfm.202405722 ↗
45. 10.1038/s41467-023-42361-910.1038/s41467-023-42361-9 ↗
46. 10.1021/acsanm.4c0484010.1021/acsanm.4c04840 ↗
47. 10.1002/anie.20221480910.1002/anie.202214809 ↗
48. 10.1002/adfm.20200349110.1002/adfm.202003491 ↗
49. 10.1038/s41467-023-36438-810.1038/s41467-023-36438-8 ↗
50. 10.1126/sciadv.ade697310.1126/sciadv.ade6973 ↗
51. 10.1002/anie.20240522810.1002/anie.202405228 ↗
52. 10.1002/adma.20240008410.1002/adma.202400084 ↗
53. 10.1002/adma.20241326810.1002/adma.202413268 ↗
54. 10.1002/adma.20231308810.1002/adma.202313088 ↗
55. 10.1002/adfm.20230681010.1002/adfm.202306810 ↗
56. 10.1038/s41586-021-03212-z10.1038/s41586-021-03212-z ↗
57. 10.1038/s41593-024-01816-y10.1038/s41593-024-01816-y ↗
58. 10.1038/s41586-024-08168-410.1038/s41586-024-08168-4 ↗
59. 10.1038/s41591-024-02929-410.1038/s41591-024-02929-4 ↗
60. 10.1016/j.neuron.2024.09.01210.1016/j.neuron.2024.09.012 ↗
61. 10.1038/s41586-024-08269-010.1038/s41586-024-08269-0 ↗
62. 10.1016/j.neuron.2020.10.03210.1016/j.neuron.2020.10.032 ↗
63. 10.1038/s41593-023-01562-710.1038/s41593-023-01562-7 ↗
64. 10.1016/j.inffus.2023.10201910.1016/j.inffus.2023.102019 ↗
65. 10.1016/j.inffus.2023.10221810.1016/j.inffus.2023.102218 ↗
66. 10.1038/s41586-022-04964-y10.1038/s41586-022-04964-y ↗
67. 10.1038/s41467-023-40517-110.1038/s41467-023-40517-1 ↗