journal article·2023-05Open access

Hydrogel and Machine Learning for Soft Robots’ Sensing and Signal Processing: A Review

Shuyu Wang, Zhaojia Sun

Journal of Bionic Engineering· Volume 20· Issue 3

Abstract

Abstract The soft robotics field is on the rise. The highly adaptive robots provide the opportunity to bridge the gap between machines and people. However, their elastomeric nature poses significant challenges to the perception, control, and signal processing. Hydrogels and machine learning provide promising solutions to the problems above. This review aims to summarize this recent trend by first assessing the current hydrogel-based sensing and actuation methods applied to soft robots. We outlined the mechanisms of perception in response to various external stimuli. Next, recent achievements of machine learning for soft robots’ sensing data processing and optimization are evaluated. Here we list the strategies for implementing machine learning models from the perspective of applications. Last, we discuss the challenges and future opportunities in perception data processing and soft robots’ high level tasks.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Advanced Materials and Mechanics · Dielectric materials and actuators

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (100+)

Show source-provided references
1. Byun, J., Lee, Y., Yoon, J., Lee, B., Oh, E., Chung, S., Lee, T., Cho, K.-J., Kim, J., & Hong, Y. (2018). Electronic skins for soft, compact, reversible assembly of wirelessly activated fully soft robots. Science Robotics. https://doi.org/10.1126/scirobotics.aas902010.1126/scirobotics.aas9020 ↗
2. Rus, D., & Tolley, M. T. (2015). Design, fabrication and control of soft robots. Nature, 521(7553), 467–475. https://doi.org/10.1038/nature1454310.1038/nature14543 ↗
3. Trivedi, D., Rahn, C. D., Kier, W. M., & Walker, I. D. (2008). Soft robotics: Biological inspiration, state of the art, and future research. Applied Bionics and Biomechanics, 5(3), 99–117. https://doi.org/10.1080/1176232080255786510.1080/11762320802557865 ↗
4. Li, S., Zhao, H., & Shepherd, R. F. (2017). Flexible and stretchable sensors for fluidic elastomer actuated soft robots. MRS Bulletin, 42(02), 138–142. https://doi.org/10.1557/mrs.2017.410.1557/mrs.2017.4 ↗
5. Ng, C. S. X., & Lum, G. Z. (2021). Untethered soft robots for future planetary explorations? Advanced Intelligent Systems. https://doi.org/10.1002/aisy.20210010610.1002/aisy.202100106 ↗
6. Thuruthel, T. G., Shih, B., Laschi, C., & Tolley, M. T. (2019). Soft robot perception using embedded soft sensors and recurrent neural networks. Science Robotics. https://doi.org/10.1126/scirobotics.aav148810.1126/scirobotics.aav1488 ↗
7. Su, M., Xie, R., Qiu, Y., & Guan, Y. (2022). Design, mobility analysis and gait planning of a leech-like soft crawling robot with stretching and bending deformation. Journal of Bionic Engineering. https://doi.org/10.1007/s42235-022-00256-310.1007/s42235-022-00256-3 ↗
8. Polygerinos, P., Correll, N., Morin, S. A., Mosadegh, B., Onal, C. D., Petersen, K., Cianchetti, M., Tolley, M. T., & Shepherd, R. F. (2017). Soft robotics: Review of fluid-driven intrinsically soft devices; manufacturing, sensing, control, and applications in human-robot interaction. Advanced Engineering Materials, 19(12), 1700016. https://doi.org/10.1002/adem.20170001610.1002/adem.201700016 ↗
9. George Thuruthel, T., Ansari, Y., Falotico, E., & Laschi, C. (2018). Control strategies for soft robotic manipulators: A survey. Soft Robotics, 5(2), 149–163. https://doi.org/10.1089/soro.2017.000710.1089/soro.2017.0007 ↗
10. Park, M., Jeong, B., & Park, Y.-L. (2021). Hybrid system analysis and control of a soft robotic gripper with embedded proprioceptive sensing for enhanced gripping performance. Advanced Intelligent Systems, 3(3), 2000061. https://doi.org/10.1002/aisy.20200006110.1002/aisy.202000061 ↗
11. Pan, L., Yu, G., Zhai, D., Lee, H. R., Zhao, W., Liu, N., Wang, H., Tee, B.C.-K., Shi, Y., Cui, Y., & Bao, Z. (2012). Hierarchical nanostructured conducting polymer hydrogel with high electrochemical activity. Proceedings of the National Academy of Sciences, 109(24), 9287–9292. https://doi.org/10.1073/pnas.120263610910.1073/pnas.1202636109 ↗
12. Wang, Z., Cong, Y., & Fu, J. (2020). Stretchable and tough conductive hydrogels for flexible pressure and strain sensors. Journal of Materials Chemistry B, 8(16), 3437–3459. https://doi.org/10.1039/C9TB02570G10.1039/C9TB02570G ↗
13. Wirthl, D., Pichler, R., Drack, M., Kettlguber, G., Moser, R., Gerstmayr, R., Hartmann, F., Bradt, E., Kaltseis, R., Siket, C. M., Schausberger, S. E., Hild, S., Bauer, S., & Kaltenbrunner, M. (2017). Instant tough bonding of hydrogels for soft machines and electronics. Science Advances. https://doi.org/10.1126/sciadv.170005310.1126/sciadv.1700053 ↗
14. Lee, Y., Song, W. J., & Sun, J.-Y. (2020). Hydrogel soft robotics. Materials Today Physics, 15, 100258. https://doi.org/10.1016/j.mtphys.2020.10025810.1016/j.mtphys.2020.100258 ↗
15. Howison, T., Hauser, S., Hughes, J., & Iida, F. (2021). Reality-assisted evolution of soft robots through large-scale physical experimentation: A review. Artificial Life, 26(4), 484–506. https://doi.org/10.1162/artl_a_0033010.1162/artl_a_00330 ↗
16. Phadke, A., Zhang, C., Arman, B., Hsu, C.-C., Mashelkar, R. A., Lele, A. K., Tauber, M. J., Arya, G., & Varghese, S. (2012). Rapid self-healing hydrogels. Proceedings of the National Academy of Sciences, 109(12), 4383–4388. https://doi.org/10.1073/pnas.120112210910.1073/pnas.1201122109 ↗
17. Shih, B., Shah, D., Li, J., Thuruthel, T. G., Park, Y.-L., Iida, F., Bao, Z., Kramer-Bottiglio, R., & Tolley, M. T. (2020). Electronic skins and machine learning for intelligent soft robots. Science Robotics. https://doi.org/10.1126/scirobotics.aaz923910.1126/scirobotics.aaz9239 ↗
18. Li, G., Wang, S., Li, M., & Duan, Y. Y. (2021). Towards real-life EEG applications: Novel superporous hydrogel-based semi-dry EEG electrodes enabling automatically ‘charge–discharge’ electrolyte. Journal of Neural Engineering, 18(4), 046016. https://doi.org/10.1088/1741-2552/abeeab10.1088/1741-2552/abeeab ↗
19. Calisti, M., Giorelli, M., Levy, G., Mazzolai, B., Hochner, B., Laschi, C., & Dario, P. (2011). An octopus-bioinspired solution to movement and manipulation for soft robots. Bioinspiration & Biomimetics, 6(3), 036002. https://doi.org/10.1088/1748-3182/6/3/03600210.1088/1748-3182/6/3/036002 ↗
20. Chin, K., Hellebrekers, T., & Majidi, C. (2020). Machine learning for soft robotic sensing and control. Advanced Intelligent Systems, 2(6), 1900171. https://doi.org/10.1002/aisy.20190017110.1002/aisy.201900171 ↗
21. Shi, Q., Zhang, Z., He, T., Sun, Z., Wang, B., Feng, Y., Shan, X., Salam, B., & Lee, C. (2020). Deep learning enabled smart mats as a scalable floor monitoring system. Nature Communications, 11(1), 4609. https://doi.org/10.1038/s41467-020-18471-z10.1038/s41467-020-18471-z ↗
22. Huang, H., Lin, J., Wu, L., Fang, B., Wen, Z., & Sun, F. (2020). Machine learning-based multi-modal information perception for soft robotic hands. Tsinghua Science and Technology, 25(2), 255–269. https://doi.org/10.26599/TST.2019.901000910.26599/TST.2019.9010009 ↗
23. van Meerbeek, I. M., de Sa, C. M., & Shepherd, R. F. (2018). Soft optoelectronic sensory foams with proprioception. Science Robotics. https://doi.org/10.1126/scirobotics.aau248910.1126/scirobotics.aau2489 ↗
24. Kroemer, O., Niekum, S., & Konidaris, G. (2021). A Review of Robot Learning for Manipulation: Challenges, Representations, and Algorithms. Journal of Machine Learning Research 22. Retrieved from http://jmlr.org/papers/v22/19-804.html.
25. Hughes, D., Lammie, J., & Correll, N. (2018). A robotic skin for collision avoidance and affective touch recognition. IEEE Robotics and Automation Letters, 3(3), 1386–1393. https://doi.org/10.1109/LRA.2018.279974310.1109/LRA.2018.2799743 ↗
26. Larson, C., Spjut, J., Knepper, R., & Shepherd, R. (2019). A deformable interface for human touch recognition using stretchable carbon nanotube dielectric elastomer sensors and deep neural networks. Soft Robotics, 6(5), 611–620. https://doi.org/10.1089/soro.2018.008610.1089/soro.2018.0086 ↗
27. Thuruthel, T. G., Falotico, E., Renda, F., & Laschi, C. (2019). Model-based reinforcement learning for closed-loop dynamic control of soft robotic manipulators. IEEE Transactions on Robotics, 35(1), 124–134. https://doi.org/10.1109/TRO.2018.287831810.1109/TRO.2018.2878318 ↗
28. Hofer, M., Sferrazza, C., & D’Andrea, R. (2021). A vision-based sensing approach for a spherical soft robotic arm. Frontiers in Robotics and A, I, 8. https://doi.org/10.3389/frobt.2021.63093510.3389/frobt.2021.630935 ↗
29. Zhu, J., Sun, Z., Xu, J., Walczak, R. D., Dziuban, J. A., & Lee, C. (2021). Volatile organic compounds sensing based on Bennet doubler-inspired triboelectric nanogenerator and machine learning-assisted ion mobility analysis. Science Bulletin, 66(12), 1176–1185. https://doi.org/10.1016/j.scib.2021.03.02110.1016/j.scib.2021.03.021 ↗
30. Yin, H., Varava, A., & Kragic, D. (2021). Modeling, learning, perception, and control methods for deformable object manipulation. Science Robotics. https://doi.org/10.1126/scirobotics.abd880310.1126/scirobotics.abd8803 ↗
31. Wu, J., Han, S., Yang, T., Li, Z., Wu, Z., Gui, X., Tao, K., Miao, J., Norford, L. K., Liu, C., & Huo, F. (2018). Highly stretchable and transparent thermistor based on self-healing double network hydrogel. ACS Applied Materials and Interfaces, 10(22), 19097–19105. https://doi.org/10.1021/acsami.8b0352410.1021/acsami.8b03524 ↗
32. Gong, J. P., Katsuyama, Y., Kurokawa, T., & Osada, Y. (2003). Double-network hydrogels with extremely high mechanical strength. Advanced Materials, 15(14), 1155–1158. https://doi.org/10.1002/adma.20030490710.1002/adma.200304907 ↗
33. Henderson, K. J., Zhou, T. C., Otim, K. J., & Shull, K. R. (2010). Ionically cross-linked triblock copolymer hydrogels with high strength. Macromolecules, 43(14), 6193–6201. https://doi.org/10.1021/ma100963m10.1021/ma100963m ↗
34. Sun, J.-Y., Zhao, X., Illeperuma, W. R. K., Chaudhuri, O., Oh, K. H., Mooney, D. J., Vlassak, J. J., & Suo, Z. (2012). Highly stretchable and tough hydrogels. Nature, 489(7414), 133–136. https://doi.org/10.1038/nature1140910.1038/nature11409 ↗
35. Moutos, F. T., Freed, L. E., & Guilak, F. (2007). A biomimetic three-dimensional woven composite scaffold for functional tissue engineering of cartilage. Nature Materials, 6(2), 162–167. https://doi.org/10.1038/nmat182210.1038/nmat1822 ↗
36. Chen, S., Tang, F., Tang, L., & Li, L. (2017). Synthesis of Cu-nanoparticle hydrogel with self-healing and photothermal properties. ACS Applied Materials & Interfaces, 9(24), 20895–20903. https://doi.org/10.1021/acsami.7b0495610.1021/acsami.7b04956 ↗
37. Diba, M., Wang, H., Kodger, T. E., Parsa, S., & Leeuwenburgh, S. C. G. (2017). Highly elastic and self-healing composite colloidal gels. Advanced Materials, 29(11), 1604672. https://doi.org/10.1002/adma.20160467210.1002/adma.201604672 ↗
38. Gaharwar, A. K., Rivera, C. P., Wu, C.-J., & Schmidt, G. (2011). Transparent, elastomeric and tough hydrogels from poly(ethylene glycol) and silicate nanoparticles. Acta Biomaterialia, 7(12), 4139–4148. https://doi.org/10.1016/j.actbio.2011.07.02310.1016/j.actbio.2011.07.023 ↗
39. Bin Imran, A., Esaki, K., Gotoh, H., Seki, T., Ito, K., Sakai, Y., & Takeoka, Y. (2014). Extremely stretchable thermosensitive hydrogels by introducing slide-ring polyrotaxane cross-linkers and ionic groups into the polymer network. Nature Communications, 5(1), 5124. https://doi.org/10.1038/ncomms612410.1038/ncomms6124 ↗
40. Lei, Z., & Wu, P. (2019). A highly transparent and ultra-stretchable conductor with stable conductivity during large deformation. Nature Communications, 10(1), 3429. https://doi.org/10.1038/s41467-019-11364-w10.1038/s41467-019-11364-w ↗
41. Ko, S., Chhetry, A., Kim, D., Yoon, H., & Park, J. Y. (2022). Hysteresis-free double-network hydrogel-based strain sensor for wearable smart bioelectronics. ACS Applied Materials & Interfaces, 14(27), 31363–31372. https://doi.org/10.1021/acsami.2c0989510.1021/acsami.2c09895 ↗
42. Meng, X., Qiao, Y., Do, C., Bras, W., He, C., Ke, Y., Russell, T. P., & Qiu, D. (2022). Hysteresis-free nanoparticle-reinforced hydrogels. Advanced Materials, 34(7), 2108243. https://doi.org/10.1002/adma.20210824310.1002/adma.202108243 ↗
43. White, S. R., Sottos, N. R., Geubelle, P. H., Moore, J. S., Kessler, M. R., Sriram, S. R., Brown, E. N., & Viswanathan, S. (2001). Autonomic healing of polymer composites. Nature, 409(6822), 794–797. https://doi.org/10.1038/3505723210.1038/35057232 ↗
44. Toohey, K. S., Sottos, N. R., Lewis, J. A., Moore, J. S., & White, S. R. (2007). Self-healing materials with microvascular networks. Nature Materials, 6(8), 581–585. https://doi.org/10.1038/nmat193410.1038/nmat1934 ↗
45. Yanagisawa, Y., Nan, Y., Okuro, K., & Aida, T. (2018). Mechanically robust, readily repairable polymers via tailored noncovalent cross-linking. Science, 359(6371), 72–76. https://doi.org/10.1126/science.aam758810.1126/science.aam7588 ↗
46. Darabi, M. A., Khosrozadeh, A., Mbeleck, R., Liu, Y., Chang, Q., Jiang, J., Cai, J., Wang, Q., Luo, G., & Xing, M. (2017). Skin-inspired multifunctional autonomic-intrinsic conductive self-healing hydrogels with pressure sensitivity, stretchability, and 3D printability. Advanced Materials, 29(31), 1–8. https://doi.org/10.1002/adma.20170053310.1002/adma.201700533 ↗
47. He, X., Zhang, C., Wang, M., Zhang, Y., Liu, L., & Yang, W. (2017). An electrically and mechanically autonomic self-healing hybrid hydrogel with tough and thermoplastic properties. ACS Applied Materials & Interfaces, 9(12), 11134–11143. https://doi.org/10.1021/acsami.7b0035810.1021/acsami.7b00358 ↗
48. Yuk, H., Zhang, T., Parada, G. A., Liu, X., & Zhao, X. (2016). Skin-inspired hydrogel–elastomer hybrids with robust interfaces and functional microstructures. Nature Communications, 7(1), 12028. https://doi.org/10.1038/ncomms1202810.1038/ncomms12028 ↗
49. Yang, H., Li, C., Yang, M., Pan, Y., Yin, Q., Tang, J., Qi, H. J., & Suo, Z. (2019). Printing hydrogels and elastomers in arbitrary sequence with strong adhesion. Advanced Functional Materials. https://doi.org/10.1002/adfm.20190172110.1002/adfm.201901721 ↗
50. Tian, K., Bae, J., Bakarich, S. E., Yang, C., Gately, R. D., Spinks, G. M., Pin her Panhuis, M., Suo, Z., & Vlassak, J. J. (2017). 3D printing of transparent and conductive heterogeneous hydrogel-elastomer systems. Advanced Materials, 29(10), 1604827. https://doi.org/10.1002/adma.20160482710.1002/adma.201604827 ↗
51. Hardman, D., Hughes, J., Thuruthel, T. G., Gilday, K., & Iida, F. (2021). 3D printable sensorized soft gelatin hydrogel for multi-material soft structures. IEEE Robotics and Automation Letters, 6(3), 5269–5275. https://doi.org/10.1109/LRA.2021.307260010.1109/LRA.2021.3072600 ↗
52. Liu, Y., Liu, J., Chen, S., Lei, T., Kim, Y., Niu, S., Wang, H., Wang, X., Foudeh, A. M., Tok, J.B.-H., & Bao, Z. (2019). Soft and elastic hydrogel-based microelectronics for localized low-voltage neuromodulation. Nature Biomedical Engineering, 3(1), 58–68. https://doi.org/10.1038/s41551-018-0335-610.1038/s41551-018-0335-6 ↗
53. Keplinger, C., Sun, J.-Y., Foo, C. C., Rothemund, P., Whitesides, G. M., & Suo, Z. (2013). Stretchable, transparent ionic conductors. Science, 341(6149), 984–987. https://doi.org/10.1126/science.124022810.1126/science.1240228 ↗
54. Someya, T., Sekitani, T., Iba, S., Kato, Y., Kawaguchi, H., & Sakurai, T. (2004). A large-area, flexible pressure sensor matrix with organic field-effect transistors for artificial skin applications. Proceedings of the National Academy of Sciences, 101(27), 9966–9970. https://doi.org/10.1073/pnas.040191810110.1073/pnas.0401918101 ↗
55. Choi, D., Jang, S., Kim, J. S., Kim, H.-J., Kim, D. H., & Kwon, J.-Y. (2019). A Highly sensitive tactile sensor using a pyramid-plug structure for detecting pressure, shear force, and torsion. Advanced Materials Technologies, 4(3), 1800284. https://doi.org/10.1002/admt.20180028410.1002/admt.201800284 ↗
56. Gao, G., Yang, F., Zhou, F., He, J., Lu, W., Xiao, P., Yan, H., Pan, C., Chen, T., & Wang, Z. L. (2020). Bioinspired self-healing human-machine interactive touch pad with pressure-sensitive adhesiveness on targeted substrates. Advanced Materials, 32(50), 2004290. https://doi.org/10.1002/adma.20200429010.1002/adma.202004290 ↗
57. Larson, C., Peele, B., Li, S., Robinson, S., Totaro, M., Beccai, L., Mazzolai, B., & Shepherd, R. (2016). Highly stretchable electroluminescent skin for optical signaling and tactile sensing. Science, 351(6277), 1071–1074. https://doi.org/10.1126/science.aac508210.1126/science.aac5082 ↗
58. Wang, H., Totaro, M., & Beccai, L. (2018). Toward perceptive soft robots: progress and challenges. Advanced Science, 5(9), 1800541. https://doi.org/10.1002/advs.20180054110.1002/advs.201800541 ↗
59. Wang, S., Sun, Z., Zhao, Y., & Zuo, L. (2021). A highly stretchable hydrogel sensor for soft robot multi-modal perception. Sensors and Actuators A: Physical, 331, 113006. https://doi.org/10.1016/j.sna.2021.11300610.1016/j.sna.2021.113006 ↗
60. Dobashi, Y., Yao, D., Petel, Y., Nguyen, T. N., Sarwar, M. S., Thabet, Y., Ng, C. L. W., Scabeni Glitz, E., Nguyen, G. T. M., Plesse, C., Vidal, F., Michal, C. A., & Madden, J. D. W. (2022). Piezoionic mechanoreceptors: Force-induced current generation in hydrogels. Science, 376(6592), 502–507. https://doi.org/10.1126/science.aaw197410.1126/science.aaw1974 ↗
61. Liu, Y., Hu, Y., Zhao, J., Wu, G., Tao, X., & Chen, W. (2016). Self-powered piezoionic strain sensor toward the monitoring of human activities. Small (Weinheim an der Bergstrasse, Germany), 12(36), 5074–5080. https://doi.org/10.1002/smll.20160055310.1002/smll.201600553 ↗
62. Wen, F., Sun, Z., He, T., Shi, Q., Zhu, M., Zhang, Z., Li, L., Zhang, T., & Lee, C. (2020). Machine learning glove using self-powered conductive superhydrophobic triboelectric textile for gesture recognition in VR/AR applications. Advanced Science, 7(14), 2000261. https://doi.org/10.1002/advs.20200026110.1002/advs.202000261 ↗
63. Guo, X., He, T., Zhang, Z., Luo, A., Wang, F., Ng, E. J., Zhu, Y., Liu, H., & Lee, C. (2021). Artificial intelligence-enabled caregiving walking stick powered by ultra-low-frequency human motion. ACS Nano, 15(12), 19054–19069. https://doi.org/10.1021/acsnano.1c0446410.1021/acsnano.1c04464 ↗
64. Xia, M., Pan, N., Zhang, C., Zhang, C., Fan, W., Xia, Y., Wang, Z., & Sui, K. (2022). Self-powered multifunction ionic skins based on gradient polyelectrolyte hydrogels. ACS Nano, 16(3), 4714–4725. https://doi.org/10.1021/acsnano.1c1150510.1021/acsnano.1c11505 ↗
65. Pu, X., Liu, M., Chen, X., Sun, J., Du, C., Zhang, Y., Zhai, J., Hu, W., & Wang, Z. L. (2017). Ultrastretchable, transparent triboelectric nanogenerator as electronic skin for biomechanical energy harvesting and tactile sensing. Science Advances. https://doi.org/10.1126/sciadv.170001510.1126/sciadv.1700015 ↗
66. Guo, Z. H., Wang, H. L., Shao, J., Shao, Y., Jia, L., Li, L., Pu, X., & Wang, Z. L. (2022). Bioinspired soft electroreceptors for artificial precontact somatosensation. Science Advances. https://doi.org/10.1126/sciadv.abo520110.1126/sciadv.abo5201 ↗
67. Truby, R. L., Wehner, M., Grosskopf, A. K., Vogt, D. M., Uzel, S. G. M., Wood, R. J., & Lewis, J. A. (2018). Soft somatosensitive actuators via embedded 3D printing. Advanced Materials, 30(15), 1706383. https://doi.org/10.1002/adma.20170638310.1002/adma.201706383 ↗
68. Jing, L., Hsiao, L.-Y., Li, S., Yang, H., Ng, P. L. P., Ding, M., van Truong, T., Gao, S.-P., Li, K., Guo, Y.-X., y Alvarado, P. V., & Chen, P.-Y. (2021). 2D-Material-integrated hydrogels as multifunctional protective skins for soft robots. Materials Horizons, 8(7), 2065–2078. https://doi.org/10.1039/D0MH01594F10.1039/D0MH01594F ↗
69. Ying, B., Chen, R. Z., Zuo, R., Li, J., & Liu, X. (2021). An anti-freezing, ambient-stable and highly stretchable ionic skin with strong surface adhesion for wearable sensing and soft robotics. Advanced Functional Materials, 31(42), 2104665. https://doi.org/10.1002/adfm.20210466510.1002/adfm.202104665 ↗
70. Hardman, D., George Thuruthel, T., & Iida, F. (2022). Self-healing ionic gelatin/glycerol hydrogels for strain sensing applications. NPG Asia Materials, 14(1), 11. https://doi.org/10.1038/s41427-022-00357-910.1038/s41427-022-00357-9 ↗
71. Shin, S.-H., Lee, W., Kim, S.-M., Lee, M., Koo, J. M., Hwang, S. Y., Oh, D. X., & Park, J. (2019). Ion-conductive self-healing hydrogels based on an interpenetrating polymer network for a multimodal sensor. Chemical Engineering Journal, 371, 452–460. https://doi.org/10.1016/j.cej.2019.04.07710.1016/j.cej.2019.04.077 ↗
72. Wu, J., Wu, Z., Wei, Y., Ding, H., Huang, W., Gui, X., Shi, W., Shen, Y., Tao, K., & Xie, X. (2020). Ultrasensitive and stretchable temperature sensors based on thermally stable and self-healing organohydrogels. ACS Applied Materials and Interfaces, 12(16), 19069–19079. https://doi.org/10.1021/acsami.0c0435910.1021/acsami.0c04359 ↗
73. Wu, Z., Ding, H., Tao, K., Wei, Y., Gui, X., Shi, W., Xie, X., & Wu, J. (2021). Ultrasensitive, stretchable, and fast-response temperature sensors based on hydrogel films for wearable applications. ACS Applied Materials & Interfaces, 13(18), 21854–21864. https://doi.org/10.1021/acsami.1c0529110.1021/acsami.1c05291 ↗
74. Lei, Z., Wang, Q., & Wu, P. (2017). A multifunctional skin-like sensor based on a 3D printed thermo-responsive hydrogel. Materials Horizons, 4(4), 694–700. https://doi.org/10.1039/C7MH00262A10.1039/C7MH00262A ↗
75. Han, C.-G., Qian, X., Li, Q., Deng, B., Zhu, Y., Han, Z., Zhang, W., Wang, W., Feng, S.-P., Chen, G., & Liu, W. (2020). Giant thermopower of ionic gelatin near room temperature. Science, 368(6495), 1091–1098. https://doi.org/10.1126/science.aaz504510.1126/science.aaz5045 ↗
76. Chen, B., Chen, Q., Xiao, S., Feng, J., Zhang, X., & Wang, T. (2021). Giant negative thermopower of ionic hydrogel by synergistic coordination and hydration interactions. Science Advances. https://doi.org/10.1126/sciadv.abi723310.1126/sciadv.abi7233 ↗
77. Banerjee, H., Suhail, M., & Ren, H. (2018). Hydrogel actuators and sensors for biomedical soft robots: brief overview with impending challenges. Biomimetics, 3(3), 15. https://doi.org/10.3390/biomimetics303001510.3390/biomimetics3030015 ↗
78. Ionov, L. (2014). Hydrogel-based actuators: Possibilities and limitations. Materials Today, 17(10), 494–503. https://doi.org/10.1016/j.mattod.2014.07.00210.1016/j.mattod.2014.07.002 ↗
79. Li, G., Chen, X., Zhou, F., Liang, Y., Xiao, Y., Cao, X., Zhang, Z., Zhang, M., Wu, B., Yin, S., Xu, Y., Fan, H., Chen, Z., Song, W., Yang, W., Pan, B., Hou, J., & Yang, W. (2021). Self-powered soft robot in the Mariana Trench. Nature, 591(7848), 66–71. https://doi.org/10.1038/s41586-020-03153-z10.1038/s41586-020-03153-z ↗
80. Yuk, H., Lin, S., Ma, C., Takaffoli, M., Fang, N. X., & Zhao, X. (2017). Hydraulic hydrogel actuators and robots optically and sonically camouflaged in water. Nature Communications, 8(1), 14230. https://doi.org/10.1038/ncomms1423010.1038/ncomms14230 ↗
81. Homberg, B. S., Katzschmann, R. K., Dogar, M. R., & Rus, D. (2019). Robust proprioceptive grasping with a soft robot hand. Autonomous Robots, 43(3), 681–696. https://doi.org/10.1007/s10514-018-9754-110.1007/s10514-018-9754-1 ↗
82. Yu, Y., Li, J., Solomon, S. A., Min, J., Tu, J., Guo, W., Xu, C., Song, Y., & Gao, W. (2022). All-printed soft human-machine interface for robotic physicochemical sensing. Science Robotics. https://doi.org/10.1126/scirobotics.abn049510.1126/scirobotics.abn0495 ↗
83. Thuruthel, T. G., Gilday, K., & Iida, F. (2020). Drift-free latent space representation for soft strain sensors. 2020 3rd IEEE International Conference on Soft Robotics, RoboSoft. https://doi.org/10.1109/RoboSoft48309.2020.911602110.1109/RoboSoft48309.2020.9116021 ↗
84. Spielberg, A., Amini, A., Chin, L., Matusik, W., & Rus, D. (2021). Co-learning of task and sensor placement for soft robotics. IEEE Robotics and Automation Letters, 6(2), 1208–1215. https://doi.org/10.1109/LRA.2021.305636910.1109/LRA.2021.3056369 ↗
85. Wang, R., Wang, S., Du, S., Xiao, E., Yuan, W., & Feng, C. (2020). Real-time soft body 3D proprioception via deep vision-based sensing. IEEE Robotics and Automation Letters, 5(2), 3382–3389. https://doi.org/10.1109/LRA.2020.297570910.1109/LRA.2020.2975709 ↗
86. She, Y., Liu, S. Q., Yu, P., & Adelson, E. (2020). Exoskeleton-covered soft finger with vision-based proprioception and tactile sensing. In 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France, IEEE. https://doi.org/10.1109/ICRA40945.2020.919736910.1109/ICRA40945.2020.9197369 ↗
87. Dong, S., Yuan, W., & Adelson, E. H. (2017). Improved GelSight tactile sensor for measuring geometry and slip. In 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Vancouver, BC, Canada, IEEE. https://doi.org/10.1109/IROS.2017.820214910.1109/IROS.2017.8202149 ↗
88. Li, Y., Zhu, J.-Y., Tedrake, R., & Torralba, A. (2019). Connecting touch and vision via cross-modal prediction. In 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE. https://doi.org/10.1109/CVPR.2019.0108610.1109/CVPR.2019.01086 ↗
89. Sun, Z., Wang, S., Zhao, Y., Zhong, Z., & Zuo, L. (2022). Discriminating soft actuators’ thermal stimuli and mechanical deformation by hydrogel sensors and machine learning. Advanced Intelligent Systems, 4(9), 2200089. https://doi.org/10.1002/aisy.20220008910.1002/aisy.202200089 ↗
90. Thuruthel, T. G., & Iida, F. (2022). Multimodel sensor fusion for learning rich models for interacting soft robots. arXiv. https://doi.org/10.48550/arXiv.2205.0420210.48550/arXiv.2205.04202 ↗
91. Jin, T., Sun, Z., Li, L., Zhang, Q., Zhu, M., Zhang, Z., Yuan, G., Chen, T., Tian, Y., Hou, X., & Lee, C. (2020). Triboelectric nanogenerator sensors for soft robotics aiming at digital twin applications. Nature Communications, 11(1), 5381. https://doi.org/10.1038/s41467-020-19059-310.1038/s41467-020-19059-3 ↗
92. Truby, R. L., Katzschmann, R. K., Lewis, J. A., & Rus, D. (2019). Soft robotic fingers with embedded ionogel sensors and discrete actuation modes for somatosensitive manipulation. In 2019 2nd IEEE International Conference on Soft Robotics (RoboSoft), Seoul, Korea (South), IEEE. https://doi.org/10.1109/ROBOSOFT.2019.872272210.1109/ROBOSOFT.2019.8722722 ↗
93. Zhu, M., He, T., & Lee, C. (2020). Technologies toward next generation human machine interfaces: From machine learning enhanced tactile sensing to neuromorphic sensory systems. Applied Physics Reviews, 7(3), 031305. https://doi.org/10.1063/5.001648510.1063/5.0016485 ↗
94. Zhang, Z., He, T., Zhu, M., Sun, Z., Shi, Q., Zhu, J., Dong, B., Yuce, M. R., & Lee, C. (2020). Deep learning-enabled triboelectric smart socks for IoT-based gait analysis and VR applications. npj Flexible Electronics, 4(1), 29. https://doi.org/10.1038/s41528-020-00092-710.1038/s41528-020-00092-7 ↗
95. Glauser, O., Panozzo, D., Hilliges, O., & Sorkine-Hornung, O. (2019). Deformation capture via soft and stretchable sensor arrays. ACM Transactions on Graphics, 38(2), 1–16. https://doi.org/10.1145/331197210.1145/3311972 ↗
96. Li, G., Liu, S., Wang, L., & Zhu, R. (2020). Skin-inspired quadruple tactile sensors integrated on a robot hand enable object recognition. Science Robotics. https://doi.org/10.1126/scirobotics.abc813410.1126/scirobotics.abc8134 ↗
97. Li, J., Dong, S., & Adelson, E. (2018). Slip detection with combined tactile and visual information. 2018 IEEE International Conference on Robotics and Automation (ICRA), 2018, pp. 7772–7777. https://doi.org/10.1109/ICRA.2018.846049510.1109/ICRA.2018.8460495 ↗
98. Alspach, A., Hashimoto, K., Kuppuswamy, N., & Tedrake, R. (2019). Soft-bubble: A highly compliant dense geometry tactile sensor for robot manipulation. In 2019 2nd IEEE International Conference on Soft Robotics (RoboSoft). IEEE. https://doi.org/10.1109/ROBOSOFT.2019.872271310.1109/ROBOSOFT.2019.8722713 ↗
99. Lee, M. A., Zhu, Y., Zachares, P., Tan, M., Srinivasan, K., Savarese, S., Fei-Fei, L., Garg, A., & Bohg, J. (2020). Making sense of vision and touch: learning multimodal representations for contact-rich tasks. IEEE Transactions on Robotics, 36(3), 582–596. https://doi.org/10.1109/TRO.2019.295944510.1109/TRO.2019.2959445 ↗
100. Calandra, R., Owens, A., Jayaraman, D., Lin, J., Yuan, W., Malik, J., Adelson, E. H., & Levine, S. (2018). More than a feeling: learning to grasp and regrasp using vision and touch. IEEE Robotics and Automation Letters, 3(4), 3300–3307. https://doi.org/10.1109/LRA.2018.285277910.1109/LRA.2018.2852779 ↗