journal article·2026-03

Dual‐Modality Flexible Calorimetric Sensor for Speech Emotion and Human Motion Recognition

Hong Ye, Zheng Gong, Zhiqiang Ma, Weitai Zhou, Biao Jin, Xiaochang Yang, Yudong Cao, Tianyu Sheng, Yonggang Jiang

Advanced Functional Materials· Volume 36· Issue 22
Publisher page

Abstract

Abstract Human motion and speech constitute fundamental dimensions of human activities. Conventionally, these modalities are monitored separately using accelerometers and acoustic sensors, thereby introducing complexities in structural design and system integration. Here, a dual‐modality flexible calorimetric (DMFC) sensor is introduced, which is capable of monitoring speech through acoustic particle velocity and human motion‐induced airflow variation. The DMFC sensor is capable of effectively recording frequency information below 1000 Hz in human speech signals while demonstrating high sensitivity, strong linearity, and good reliability in measuring motion‐induced airflow. It enables precise detection of respiratory events, speech emotions, and body movements. When coupled with deep‐learning models, the sensor achieves 99.3% accuracy in distinguishing cough, breath, and speech emotions, and 97.0% accuracy in classifying five representative human motions. This compact, ultrathin, lightweight sensor offers significant potential for advancing healthcare and disease prevention in the era of population aging.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Chemical Sensor Technologies · thermodynamics and calorimetric analyses · Advanced Sensor and Energy Harvesting Materials

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Mechanical Engineering and Automation Beihang University Beijing 100191 China

Funding

National Key Research and Development Program of China · Fundamental Research Funds for the Central Universities

References (56)

Show source-provided references
1. 10.1016/j.sna.2018.05.04410.1016/j.sna.2018.05.044 ↗
2. 10.1109/JMEMS.2007.90843710.1109/JMEMS.2007.908437 ↗
3. 10.3390/s2006169510.3390/s20061695 ↗
4. 10.1002/adma.20140479410.1002/adma.201404794 ↗
5. 10.1021/am500864t10.1021/am500864t ↗
6. 10.1109/MCOM.2012.612253010.1109/MCOM.2012.6122530 ↗
7. 10.1016/j.xcrp.2022.10116810.1016/j.xcrp.2022.101168 ↗
8. 10.1002/adfm.20210943010.1002/adfm.202109430 ↗
9. 10.1016/j.jshs.2012.07.00910.1016/j.jshs.2012.07.009 ↗
10. 10.1007/s00421-007-0606-510.1007/s00421-007-0606-5 ↗
11. J.Acharya A.Basu inIEEE Trans Biomed Circuits Syst IEEE New York2020 1.10.1109/TBCAS.2020.2981172 ↗
12. 10.1186/s12890-019-0928-110.1186/s12890-019-0928-1 ↗
13. 10.1038/s41598-017-04446-610.1038/s41598-017-04446-6 ↗
14. 10.1183/09031936.95.0812213910.1183/09031936.95.08122139 ↗
15. 10.1145/312934010.1145/3129340 ↗
16. 10.3390/s2205195410.3390/s22051954 ↗
17. S. K.Kim S.Hong D.Kim presented at9th IEEE‐RAS Int. Conf. on Humanoid Robots Paris France December 2009.
18. 10.1002/advs.20230413210.1002/advs.202304132 ↗
19. 10.3390/s15122985810.3390/s151229858 ↗
20. J. W.Weigold T. J.Brosnihan J.Bergeron X.Zhang in19th IEEE Int. Conf. on Micro Electro Mechanical Syst.IEEE New York2006 86.
21. 10.1016/j.nanoen.2018.08.05310.1016/j.nanoen.2018.08.053 ↗
22. 10.1109/JMEMS.2003.82028810.1109/JMEMS.2003.820288 ↗
23. 10.1002/adhm.20160023210.1002/adhm.201600232 ↗
24. 10.1016/j.nanoen.2023.10823710.1016/j.nanoen.2023.108237 ↗
25. 10.1038/s41467-020-19424-210.1038/s41467-020-19424-2 ↗
26. 10.1109/ACCESS.2020.300633610.1109/ACCESS.2020.3006336 ↗
27. 10.1016/j.sna.2003.10.01610.1016/j.sna.2003.10.016 ↗
28. 10.1088/0960-1317/14/11/00610.1088/0960-1317/14/11/006 ↗
29. 10.1016/S0924-4247(00)00454-410.1016/S0924-4247(00)00454-4 ↗
30. 10.1109/JMEMS.2005.84484810.1109/JMEMS.2005.844848 ↗
31. 10.1038/s41467-019-10465-w10.1038/s41467-019-10465-w ↗
32. 10.1121/1.42426610.1121/1.424266 ↗
33. 10.1002/advs.20220356510.1002/advs.202203565 ↗
34. D. C.Thomas Theses and Dissertations Brigham Young University Provo2008.
35. 10.1007/s00542-016-2915-210.1007/s00542-016-2915-2 ↗
36. 10.1117/12.14395110.1117/12.143951 ↗
37. 10.1063/1.499732310.1063/1.4997323 ↗
38. 10.3390/s1706133210.3390/s17061332 ↗
39. 10.1016/j.ijthermalsci.2017.02.01810.1016/j.ijthermalsci.2017.02.018 ↗
40. Rienstra S. W. · Ultrasound Med. Biol. · 1992
41. 10.1038/s41378-022-00402-110.1038/s41378-022-00402-1 ↗
42. 10.1121/1.496450910.1121/1.4964509 ↗
43. H. E.deBree W. F.Druyvesteyn presented atForum Acusticum Budapest 2005: 4th European Congress on Acoustics 29 August‐2 September 2005 Budapest Hungary.
44. 10.1016/S0167-6393(02)00084-510.1016/S0167-6393(02)00084-5 ↗
45. 10.21437/speechprosody.2010‐23910.21437/speechprosody.2010‐239 ↗
46. 10.1037/0022-3514.70.3.61410.1037/0022-3514.70.3.614 ↗
47. 10.1136/bmjresp-2017-00017810.1136/bmjresp-2017-000178 ↗
48. 10.3390/s2220771710.3390/s22207717 ↗
49. 10.1587/transinf.2023EDL804810.1587/transinf.2023EDL8048 ↗
50. 10.1016/j.eswa.2022.11921210.1016/j.eswa.2022.119212 ↗
51. 10.1186/s12888-025-06888-z10.1186/s12888-025-06888-z ↗
52. 10.1016/j.patcog.2017.10.01310.1016/j.patcog.2017.10.013 ↗
53. 10.1109/MCOM.2019.180015510.1109/MCOM.2019.1800155 ↗
54. V.Chernykh P.Prikhodko arXiv2018 arXiv.1701.08071.
55. 10.1109/TNSRE.2020.297176210.1109/TNSRE.2020.2971762 ↗
56. 10.1002/adma.20210954510.1002/adma.202109545 ↗