journal article·2026-05

Artificial Intelligence Powered Smart Multimodal Hand‐Wearable Systems for Healthcare and Human–Machine Interaction

Yutao Song, Yixiao Li, Yi Wang, Chan Ye, Chenxin Zhu, Rong Yang

Advanced Functional Materials· Volume 36· Issue 36
Publisher page

Abstract

ABSTRACT Hand‐wearable systems stand at the frontier of wearable electronics, leveraging the hand's intricate dexterity and rich physiological information for noninvasive, biocompatible healthcare monitoring and human–machine interaction (HMI). However, single‐modality constraints have highlighted the necessity for multimodal approaches. Through the convergence of advanced materials, multimodal sensing mechanisms, and artificial intelligence (AI), hand‐wearable systems are transforming into intelligent platforms capable of advanced signal processing, autonomous decision‐making, and adaptive interaction. This review systematically examines advancements in sensing materials, human–sensor interfaces, multimodal sensing mechanisms, system integration, and AI‐driven multimodal data fusion. A central focus is placed on the design and implementation of multimodal system architectures in healthcare monitoring and HMI. By synthesizing these advances and presenting a proposed framework, this review provides a comprehensive perspective to guide future research and accelerate the transition from laboratory prototypes to practical applications.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Hand Gesture Recognition Systems · Emotion and Mood Recognition

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

National Key Laboratory of Power Semiconductor and Integration Technology Engineering Research Center of Advanced Semiconductor Technology and Application of Ministry of Education Changsha Semiconductor Technology and Application Innovation Research Institute College of Semiconductors (College of Integrated Circuits) Hunan University Changsha Hunan China

School of Microelectronics University of Science and Technology of China Hefei Anhui China

Funding

National Key Research and Development Program of China · Songshan Lake Materials Laboratory · National Natural Science Foundation of China

References (100+)

Show source-provided references
1. 10.1002/inf2.1212210.1002/inf2.12122 ↗
2. 10.1038/s42256‐023‐00760‐z10.1038/s42256‐023‐00760‐z ↗
3. 10.1007/s40820-023-01235-x10.1007/s40820-023-01235-x ↗
4. 10.1007/s40820‐023‐01029‐110.1007/s40820‐023‐01029‐1 ↗
5. 10.1021/acs.chemrev.8b0057310.1021/acs.chemrev.8b00573 ↗
6. 10.1021/acs.chemrev.3c0050210.1021/acs.chemrev.3c00502 ↗
7. 10.1038/s41578‐022‐00460‐x10.1038/s41578‐022‐00460‐x ↗
8. 10.1021/acs.chemrev.3c0013910.1021/acs.chemrev.3c00139 ↗
9. 10.1038/s41928‐024‐01325‐710.1038/s41928‐024‐01325‐7 ↗
10. 10.1001/jama.2009.11610.1001/jama.2009.116 ↗
11. 10.1016/j.jbiomech.2004.05.04210.1016/j.jbiomech.2004.05.042 ↗
12. 10.1088/1748‐3190/ad262c10.1088/1748‐3190/ad262c ↗
13. 10.1109/RBME.2021.307819010.1109/RBME.2021.3078190 ↗
14. 10.1109/RBME.2020.301976910.1109/RBME.2020.3019769 ↗
15. 10.1093/nsr/nwad29810.1093/nsr/nwad298 ↗
16. 10.1002/aisy.20210004610.1002/aisy.202100046 ↗
17. 10.1038/s44222‐025‐00274‐w10.1038/s44222‐025‐00274‐w ↗
18. 10.1002/adma.20160316710.1002/adma.201603167 ↗
19. A Substrate‐Less Nanomesh Receptor With Meta‐learning for Rapid Hand Task Recognition
20. 10.1038/s41467‐020‐16268‐810.1038/s41467‐020‐16268‐8 ↗
21. 10.1002/adfm.20211308210.1002/adfm.202113082 ↗
22. 10.1126/scirobotics.adn684410.1126/scirobotics.adn6844 ↗
23. 10.1038/s41551‐018‐0305‐z10.1038/s41551‐018‐0305‐z ↗
24. 10.1038/s41591‐022‐01981‐210.1038/s41591‐022‐01981‐2 ↗
25. 10.1007/s40820-023-01013-910.1007/s40820-023-01013-9 ↗
26. 10.1039/D2CS00207H10.1039/D2CS00207H ↗
27. 10.1038/s41587‐019‐0045‐y10.1038/s41587‐019‐0045‐y ↗
28. 10.1038/s41565-018-0226-810.1038/s41565-018-0226-8 ↗
29. 10.1002/adma.20220743710.1002/adma.202207437 ↗
30. 10.1021/acs.chemrev.8b0034110.1021/acs.chemrev.8b00341 ↗
31. 10.1021/acs.chemrev.9b0023410.1021/acs.chemrev.9b00234 ↗
32. 10.1021/acsnano.2c0816610.1021/acsnano.2c08166 ↗
33. 10.1021/nn501204t10.1021/nn501204t ↗
34. 10.1016/j.cej.2019.12333610.1016/j.cej.2019.123336 ↗
35. 10.1126/sciadv.aaz869310.1126/sciadv.aaz8693 ↗
36. 10.1126/science.abc973510.1126/science.abc9735 ↗
37. 10.1021/acsnano.7b0218210.1021/acsnano.7b02182 ↗
38. 10.1126/science.abo663110.1126/science.abo6631 ↗
39. 10.1002/adma.20220365010.1002/adma.202203650 ↗
40. 10.1038/s41928‐025‐01443‐w10.1038/s41928‐025‐01443‐w ↗
41. 10.1007/s40820‐024‐01571‐610.1007/s40820‐024‐01571‐6 ↗
42. 10.1038/s41467‐022‐33454‐y10.1038/s41467‐022‐33454‐y ↗
43. 10.1126/sciadv.abg404110.1126/sciadv.abg4041 ↗
44. 10.1007/s40820-023-01311-210.1007/s40820-023-01311-2 ↗
45. 10.1126/science.abn732510.1126/science.abn7325 ↗
46. 10.1007/s40820‐023‐01314‐z10.1007/s40820‐023‐01314‐z ↗
47. 10.1038/s41928‐020‐0428‐610.1038/s41928‐020‐0428‐6 ↗
48. 10.1038/s41586‐019‐1234‐z10.1038/s41586‐019‐1234‐z ↗
49. 10.1002/adma.20220079310.1002/adma.202200793 ↗
50. 10.1016/j.mattod.2019.12.00410.1016/j.mattod.2019.12.004 ↗
51. 10.1002/inf2.1255510.1002/inf2.12555 ↗
52. 10.1021/acsami.9b1155410.1021/acsami.9b11554 ↗
53. 10.1038/s41563‐020‐00902‐310.1038/s41563‐020‐00902‐3 ↗
54. 10.1002/adma.20160642510.1002/adma.201606425 ↗
55. 10.1126/sciadv.adf057510.1126/sciadv.adf0575 ↗
56. 10.1126/science.ade734110.1126/science.ade7341 ↗
57. 10.1002/adma.20200806210.1002/adma.202008062 ↗
58. 10.1126/sciadv.abd020210.1126/sciadv.abd0202 ↗
59. 10.1038/s44222‐025‐00364‐910.1038/s44222‐025‐00364‐9 ↗
60. 10.1039/D2CS00173J10.1039/D2CS00173J ↗
61. 10.1038/s41578‐022‐00483‐410.1038/s41578‐022‐00483‐4 ↗
62. 10.1002/adma.20170032110.1002/adma.201700321 ↗
63. 10.1038/s41596‐023‐00878‐910.1038/s41596‐023‐00878‐9 ↗
64. 10.1016/j.ccr.2025.21719810.1016/j.ccr.2025.217198 ↗
65. 10.1016/j.nanoen.2020.10560910.1016/j.nanoen.2020.105609 ↗
66. 10.1126/sciadv.abb536710.1126/sciadv.abb5367 ↗
67. 10.34133/2021/986146710.34133/2021/9861467 ↗
68. 10.1038/s41467‐022‐30648‐210.1038/s41467‐022‐30648‐2 ↗
69. 10.1038/s41928‐022‐00887‐810.1038/s41928‐022‐00887‐8 ↗
70. 10.1038/nnano.2011.18410.1038/nnano.2011.184 ↗
71. 10.1039/C9TC03655E10.1039/C9TC03655E ↗
72. 10.1002/adfm.20250356810.1002/adfm.202503568 ↗
73. 10.1002/adma.20240476110.1002/adma.202404761 ↗
74. 10.1002/advs.20241442510.1002/advs.202414425 ↗
75. 10.1038/s41586‐024‐07161‐110.1038/s41586‐024‐07161‐1 ↗
76. 10.1002/adfm.20231633910.1002/adfm.202316339 ↗
77. 10.1002/advs.20230552810.1002/advs.202305528 ↗
78. 10.1002/adfm.20252012210.1002/adfm.202520122 ↗
79. 10.1126/sciadv.abb704310.1126/sciadv.abb7043 ↗
80. 10.1126/science.ade008610.1126/science.ade0086 ↗
81. 10.1126/sciadv.adh061510.1126/sciadv.adh0615 ↗
82. 10.1038/s41928‐020‐00510‐810.1038/s41928‐020‐00510‐8 ↗
83. 10.1021/acsnano.1c0669510.1021/acsnano.1c06695 ↗
84. 10.1038/s41928‐022‐00723‐z10.1038/s41928‐022‐00723‐z ↗
85. 10.1021/acsmaterialslett.1c0012810.1021/acsmaterialslett.1c00128 ↗
86. 10.1038/s41563‐023‐01615‐z10.1038/s41563‐023‐01615‐z ↗
87. 10.1021/acs.chemrev.9b0082110.1021/acs.chemrev.9b00821 ↗
88. 10.1039/D4CS00286E10.1039/D4CS00286E ↗
89. 10.1021/acs.chemrev.1c0050210.1021/acs.chemrev.1c00502 ↗
90. 10.1002/adma.20230057610.1002/adma.202300576 ↗
91. 10.1038/s44287‐024‐00063‐410.1038/s44287‐024‐00063‐4 ↗
92. 10.1126/sciadv.adv852310.1126/sciadv.adv8523 ↗
93. 10.1002/advs.20241631810.1002/advs.202416318 ↗
94. 10.1002/adfm.20242501410.1002/adfm.202425014 ↗
95. 10.1002/adfm.20242496510.1002/adfm.202424965 ↗
96. 10.1126/scirobotics.adx151910.1126/scirobotics.adx1519 ↗
97. 10.1126/sciadv.adv240610.1126/sciadv.adv2406 ↗
98. 10.1002/adma.20241232210.1002/adma.202412322 ↗
99. 10.1038/s41467‐024‐51609‐x10.1038/s41467‐024‐51609‐x ↗
100. 10.1038/s41563‐025‐02204‐y10.1038/s41563‐025‐02204‐y ↗