3D‐Printed Ion‐Conductive Hydrogels with Tunable Mechanical–Electrical Properties for Multimodal Sign Language Recognition
Source abstract
Abstract
ABSTRACT Sign language recognition technology holds significant importance for eliminating communication barriers faced by the hearing‐impaired population. To address the limitations of current wearable sensors‒such as complex fabrication or materials incompatibility within an integrated system, this study designed a 3D printed ion‐conductive hydrogel with tunable electromechanical performances for versatile wearable sensing. The hydrogel is primarily based on a polyampholyte network interpenetrated with a polyacrylamide (PAAM) framework and synergistically integrated with LiCl and a covalent organic framework (COF) to enhance its electromechanical performance. It exhibits low hysteresis (90.25% recovery ratio) with high elongation (550%) and large compressive strain tolerance (90%) for strain/pressure sensing, while its low modulus (0.09 MPa) and high conductivity (0.23 S m − 1 ) enabled high‐fidelity surface electromyography (sEMG) sensing. Leveraging these multifunctional hydrogels, we developed a multimodal sign language recognition system consisting of a pair of digital gloves, each embedded with 12 strain sensors and 5 pressure sensors, together with a flexible armband integrated with a 10‐channel differential sEMG electrode array. Coupled with a bidirectional long short‐term memory (Bi‐LSTM) multimodal fusion model, the system achieved a classification accuracy of 99.65% across 24 Chinese sign language gestures.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Dielectric materials and actuators · Conducting polymers and applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Shien‐Ming Wu School of Intelligent Engineering South China University of Technology Guangzhou China
School of Mechatronic Engineering Guangdong Polytechnic Normal University Guangzhou China
Department of Rehabilitation Medicine The Sixth Affiliated Hospital of Sun Yat‐Sen University Guangzhou China
Guangdong Provincial Clinical Research Center For Rehabilitation Medicine Guangzhou China
Funding
National Natural Science Foundation of China
References (56)
Show source-provided references
1. 10.1016/j.jmst.2023.10.00810.1016/j.jmst.2023.10.008 ↗
2. 10.1016/S0140-6736(21)00516-X10.1016/S0140-6736(21)00516-X ↗
3. 10.1038/s41586-023-06732-y10.1038/s41586-023-06732-y ↗
4. A Substrate‐Less Nanomesh Receptor with Meta‐Learning for Rapid Hand Task Recognition
5. 10.1126/science.abn732510.1126/science.abn7325 ↗
6. 10.1038/s41928-024-01189-x10.1038/s41928-024-01189-x ↗
7. 10.1038/s41586-022-05579-z10.1038/s41586-022-05579-z ↗
8. 10.1038/s41551-023-01010-810.1038/s41551-023-01010-8 ↗
9. 10.1109/TPAMI.2023.326922010.1109/TPAMI.2023.3269220 ↗
10. 10.1002/adfm.20242558610.1002/adfm.202425586 ↗
11. 10.1038/s41467-022-32745-810.1038/s41467-022-32745-8 ↗
12. 10.1038/s41928-024-01124-010.1038/s41928-024-01124-0 ↗
13. 10.1038/s42256-021-00337-810.1038/s42256-021-00337-8 ↗
14. 10.1007/s40820-025-01656-w10.1007/s40820-025-01656-w ↗
15. 10.1126/scirobotics.abd548310.1126/scirobotics.abd5483 ↗
16. 10.1038/s42256-023-00780-910.1038/s42256-023-00780-9 ↗
17. 10.1002/adfm.20230441510.1002/adfm.202304415 ↗
18. 10.1038/s41928-020-0428-610.1038/s41928-020-0428-6 ↗
19. 10.1002/adfm.20220827110.1002/adfm.202208271 ↗
20. 10.1002/adma.20240103510.1002/adma.202401035 ↗
21. 10.1038/s41528-023-00246-310.1038/s41528-023-00246-3 ↗
22. 10.1002/inf2.1241910.1002/inf2.12419 ↗
23. 10.1038/s41467-021-25637-w10.1038/s41467-021-25637-w ↗
24. 10.1038/s41928-020-00510-810.1038/s41928-020-00510-8 ↗
25. 10.1038/s41598-022-25108-210.1038/s41598-022-25108-2 ↗
26. Multimodal Fusion Framework Based on Statistical Attention and Contrastive Attention for Sign Language Recognition
27. 10.1038/s41563-020-00814-210.1038/s41563-020-00814-2 ↗
28. 10.1002/adma.20220679310.1002/adma.202206793 ↗
29. 10.1126/science.adj439710.1126/science.adj4397 ↗
30. 10.1038/s41586-021-03212-z10.1038/s41586-021-03212-z ↗
31. 10.1126/science.adh363210.1126/science.adh3632 ↗
32. 10.1038/s41928-023-00932-010.1038/s41928-023-00932-0 ↗
33. 10.1038/s41565-023-01483-310.1038/s41565-023-01483-3 ↗
34. 10.1002/adfm.20231248010.1002/adfm.202312480 ↗
35. 10.1002/adma.20230986810.1002/adma.202309868 ↗
36. 10.1016/j.nanoen.2023.10887510.1016/j.nanoen.2023.108875 ↗
37. 10.1002/adma.20241032410.1002/adma.202410324 ↗
38. 10.1002/adma.20240677810.1002/adma.202406778 ↗
39. 10.1038/s41587-022-01528-310.1038/s41587-022-01528-3 ↗
40. 10.1002/adfm.20220836210.1002/adfm.202208362 ↗
41. 10.1038/s41467-022-31051-710.1038/s41467-022-31051-7 ↗
42. 10.1016/j.cej.2019.04.07710.1016/j.cej.2019.04.077 ↗
43. 10.1021/acssensors.3c0217210.1021/acssensors.3c02172 ↗
44. 10.1021/acsnano.1c1067810.1021/acsnano.1c10678 ↗
45. 10.1002/sus2.24910.1002/sus2.249 ↗
46. 10.1002/adfm.20241645310.1002/adfm.202416453 ↗
47. 10.1038/s41563-023-01697-910.1038/s41563-023-01697-9 ↗
48. 10.1126/science.aaz669410.1126/science.aaz6694 ↗
49. 10.1126/science.abg632010.1126/science.abg6320 ↗
50. 10.1007/s40820-023-01015-710.1007/s40820-023-01015-7 ↗
51. 10.1016/j.nanoen.2024.10959910.1016/j.nanoen.2024.109599 ↗
52. 10.1038/s41467-024-48745-910.1038/s41467-024-48745-9 ↗
53. 10.1002/adfm.20210391710.1002/adfm.202103917 ↗
54. 10.1039/C5SM01423A10.1039/C5SM01423A ↗
55. 10.1016/j.cej.2025.16065710.1016/j.cej.2025.160657 ↗
56. 10.1021/acs.macromol.6b0043710.1021/acs.macromol.6b00437 ↗