Liquid Metal Composites‐Enabled Real‐Time Hand Gesture Recognizer with Superior Recognition Speed and Accuracy
Source abstract
Abstract
Abstract Prosthetic hands play a vital role in restoring forearm functionality for patients who have suffered hand loss or deformity. The hand gesture intention recognition system serves as a critical component within the prosthetic hand system. However, accurately and swiftly identifying hand gesture intentions remains a challenge in existing approaches. Here, a real‐time motion intention recognition system utilizing liquid metal composite sensor bracelets is proposed. The sensor bracelet detects pressure signals generated by forearm muscle movements to recognize hand gesture intent. Leveraging the remarkable pressure sensitivity of liquid metal composites and the efficient classifier based on the optimized recognition algorithm, this system achieves an average offline and real‐time recognition accuracy of 98.2% and 92.04%, respectively, with an average recognition speed of 0.364 s. Thus, this wearable system shows advantages in superior recognition speed and accuracy. Furthermore, this system finds applications in master‐slave control of prosthetic hands in unmanned scenarios, such as electrically powered operations, space exploration, and telemedicine. The proposed system promises significant advances in next‐generation intent‐controlled prosthetic hands and robots.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Muscle activation and electromyography studies · Advanced Sensor and Energy Harvesting Materials · Hand Gesture Recognition Systems
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
CAS Key Laboratory of Mechanical Behavior and Design of Materials School of Engineering Science University of Science and Technology of China Hefei Anhui 230026 China
Cambridge Graphene Centre University of Cambridge Cambridge CB3 0FA UK
Faculty of Engineering and Information Sciences University of Wollongong NSW 2522 Australia
Funding
National Natural Science Foundation of China
References (51)
Show source-provided references
1. Wang E. Z. · Energy Econ. · 2022 · 105 · 14
2. 10.1142/S021984361550011510.1142/S0219843615500115 ↗
3. H.Kato K.Takemura presented atProceedings of the ACM Int. Joint Conf. on Pervasive and Ubiquitous Computing (UbiComp)/20th ACM Int. Symp. on Wearable Computers (ISWC) Heidelberg Germany September2016.
4. 10.1186/1751-0473-8-1110.1186/1751-0473-8-11 ↗
5. 10.1109/THMS.2016.264138910.1109/THMS.2016.2641389 ↗
6. 10.1002/mus.1035810.1002/mus.10358 ↗
7. R.Crepin C. L.Fall Q.Mascret C.Gosselin A.Campeau‐Lecours B.Gosselin Annual Int. Conf. of the IEEE Engineering in Medicine and Biology Society IEEE Engineering in Medicine and Biology Society Annual Int. Conf. 2018 2655.10.1109/EMBC.2018.8512820 ↗
8. K. N.Han J. C.Wang X. L.Xiong Q.Fang D.Ng presented atProceedings of the IEEE Int. Symp. on Circuits and Systems (ISCAS) New York October 2020.
9. 10.1007/978-3-319-62212-5_810.1007/978-3-319-62212-5_8 ↗
10. 10.1109/TBME.2015.249812410.1109/TBME.2015.2498124 ↗
11. 10.1109/JBHI.2017.276624910.1109/JBHI.2017.2766249 ↗
12. 10.1109/TNSRE.2012.220791610.1109/TNSRE.2012.2207916 ↗
13. F. A.Bertsch V. V.Hafner presented at9th IEEE‐RAS Int. Conf. on Humanoid Robots 2009 pp.447.10.1109/ICHR.2009.5379541 ↗
14. C.Hu M. Q.Meng P. X. P.Liu X.Wang presented atProceedings of the IEEE/RSJ Int. Conf. on Intelligent Robots and Systems Las Vegas October 2003.
15. 10.1088/1742-6596/2683/1/01203710.1088/1742-6596/2683/1/012037 ↗
16. R.Vinjamuri Z.‐H.Mao R.Sclabassi M.Sun 2006 Int. Conf. of the IEEE Engineering in Medicine and Biology Society 2006 pp.4.
17. 10.1682/JRRD.2010.09.017710.1682/JRRD.2010.09.0177 ↗
18. Y.Honda S.Weber T. C.Lueth 3rd Int. IEEE/EMBS Conf. on Neural EngineeringIEEE Kohala Coast Hawaii2007 pp.4.
19. 10.1017/S026357470400129810.1017/S0263574704001298 ↗
20. 10.1016/j.bspc.2007.07.00910.1016/j.bspc.2007.07.009 ↗
21. 10.3389/fnbot.2014.0002210.3389/fnbot.2014.00022 ↗
22. 10.1088/1741-2552/ab0ab510.1088/1741-2552/ab0ab5 ↗
23. 10.1016/j.eswa.2014.05.01310.1016/j.eswa.2014.05.013 ↗
24. 10.3390/s1906142310.3390/s19061423 ↗
25. 10.1016/j.ultrasmedbio.2012.04.02110.1016/j.ultrasmedbio.2012.04.021 ↗
26. P.Boyd H. H.Liu presented atIEEE World Congress on Computational IntelligenceIEEE New York2020.
27. 10.1109/TNSRE.2018.282991310.1109/TNSRE.2018.2829913 ↗
28. 10.1007/3-540-46616-9_1010.1007/3-540-46616-9_10 ↗
29. C.Castellini V.Ravindra IEEE RAS/EMBS Int. Conf. on Biomedical Robotics and Biomechatronics (BioRob) IEEE New York2014.
30. 10.1016/S1672-6529(11)60095-410.1016/S1672-6529(11)60095-4 ↗
31. 10.1109/THMS.2017.269324510.1109/THMS.2017.2693245 ↗
32. M.Sakr C.Menon Proceedings of the IEEE Int. Conf. on Systems Man and Cybernetics (SMC) IEEE New York2017.
33. Zhang Q. · Smart Mater. Struct. · 2021 · 30
34. 10.1016/j.matt.2020.05.02210.1016/j.matt.2020.05.022 ↗
35. 10.1021/acsapm.1c0111110.1021/acsapm.1c01111 ↗
36. 10.1038/s41467-019-09325-410.1038/s41467-019-09325-4 ↗
37. 10.1109/TNN.2002.100013910.1109/TNN.2002.1000139 ↗
38. 10.1109/TIE.2019.289861410.1109/TIE.2019.2898614 ↗
39. 10.1016/j.bspc.2007.11.00510.1016/j.bspc.2007.11.005 ↗
40. 10.1088/1741-2560/12/4/04600510.1088/1741-2560/12/4/046005 ↗
41. 10.1109/TNSRE.2009.203961910.1109/TNSRE.2009.2039619 ↗
42. Y.Inoue F.Kato S.Tachi Proceedings of the 22nd IEEE Int. Symp. on Measurement and Control in Robotics (ISMCR) – Robotics for the Benefit of Humanity Houston TX USASeptember2019.
43. T.Wojtara K.Nonami IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS)IEEE Sendai Japan2004 pp.866.
44. T.Mouri H.Kawasaki K.Umelbayashi Proceedings of the IEEE/RSJ Int. Conf. on Intelligent Robots and Systems IEEE Edmonton Canada 2005.
45. 10.1109/JSEN.2014.237094510.1109/JSEN.2014.2370945 ↗
46. 10.3389/fbioe.2016.0001810.3389/fbioe.2016.00018 ↗
47. 10.1038/s41467-019-09325-410.1038/s41467-019-09325-4 ↗
48. 10.1007/s40010-014-0148-210.1007/s40010-014-0148-2 ↗
49. Tharwat A. · 2017 · 169
50. 10.1109/TBME.2013.229627410.1109/TBME.2013.2296274 ↗
51. 10.1109/TBME.2008.91973410.1109/TBME.2008.919734 ↗