journal article·2022-08-13Open access

An artificial neuromorphic somatosensory system with spatio-temporal tactile perception and feedback functions

Fuqin Sun, Qifeng Lu, Mingming Hao, Yue Wu, Yue Li, Lin Liu, Lianhui Li, Yingyi Wang, Ting Zhang

npj Flexible Electronics· Volume 6· Issue 1

Abstract

Abstract The advancement in flexible electronics and neuromorphic electronics has opened up opportunities to construct artificial perception systems to emulate biological functions which are of great importance for intelligent robotics and human-machine interactions. However, artificial systems that can mimic the somatosensory feedback functions have not been demonstrated yet despite the great achievement in this area. In this work, inspired by human somatosensory feedback pathways, an artificial somatosensory system with both perception and feedback functions was designed and constructed by integrating the flexible tactile sensors, synaptic transistor, artificial muscle, and the coupling circuit. Also, benefiting from the synaptic characteristics of the designed artificial synapse, the system shows spatio-temporal information-processing ability, which can further enhance the efficiency of the system. This research outcome has a potential contribution to the development of sensor technology from signal sensing to perception and cognition, which can provide a special paradigm for the next generation of bionic tactile perception systems towards e-skin, neurorobotics, and advanced bio-robots.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Advanced Sensor and Energy Harvesting Materials · Neuroscience and Neural Engineering

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (36)

Show source-provided references
1. Abraira, V. E. & Ginty, D. D. The sensory neurons of touch. Neuron 79, 618–639 (2013).10.1016/j.neuron.2013.07.051 ↗
2. Grace Gaerlan, M., Alpert, P. T., Cross, C., Louis, M. & Kowalski, S. Postural balance in young adults: The role of visual, vestibular and somatosensory systems. J. Am. Acad. Nurse Pract. 24, 375–381 (2012).10.1111/j.1745-7599.2012.00699.x ↗
3. Ebner, F. F. & Kaas, J. H. The Rat Nervous System, 4th edn (ed Paxinos, G.) 675–701 (Academic Press, 2015).10.1016/B978-0-12-374245-2.00024-3 ↗
4. Ager, A. L. et al. Proprioception: How is it affected by shoulder pain? A systematic review. J. Hand Ther. 33, 507–516 (2020).10.1016/j.jht.2019.06.002 ↗
5. Martín-Alguacil, N., de Gaspar, I., Schober, J. M. & Pfaff, D. W. Neuroscience in the 21st Century: From Basic to Clinical (ed Pfaff, D. W.) 743–780 (Springer New York, 2013).10.1007/978-1-4614-1997-6_27 ↗
6. Collinger, J. L. et al. Collaborative approach in the development of high‐performance brain–computer interfaces for a neuroprosthetic arm: Translation from animal models to human control. Clin. Transl. Sci. 7, 52–59 (2014).10.1111/cts.12086 ↗
7. Velliste, M., Perel, S., Spalding, M. C., Whitford, A. S. & Schwartz, A. B. Cortical control of a prosthetic arm for self-feeding. Nature 453, 1098–1101 (2008).10.1038/nature06996 ↗
8. Hammock, M. L., Chortos, A., Tee, B. C.-K., Tok, J. B.-H. & Bao, Z. 25th anniversary article: The evolution of Electronic Skin (E-Skin): A brief history, design considerations, and recent progress. Adv. Mater. 25, 5997–6038 (2013).10.1002/adma.201302240 ↗
9. Sun, K., Chen, J. & Yan, X. The future of memristors: Materials engineering and neural networks. Adv. Funct. Mater. 31, 2006773 (2021).10.1002/adfm.202006773 ↗
10. Huh, W., Lee, D. & Lee, C. H. Memristors based on 2D materials as an artificial synapse for neuromorphic electronics. Adv. Mater. 32, 2002092 (2020).10.1002/adma.202002092 ↗
11. Shao, L., Zhao, Y. & Liu, Y. Organic synaptic transistors: The evolutionary path from memory cells to the application of artificial neural networks. Adv. Funct. Mater. 31, 2101951 (2021).10.1002/adfm.202101951 ↗
12. Wang, D. et al. Recent advanced applications of ion-gel in ionic-gated transistor. npj Flex. Electron. 5, 1–16 (2021).10.1038/s41528-021-00110-2 ↗
13. Ham, S. et al. One-dimensional organic artificial multi-synapses enabling electronic textile neural network for wearable neuromorphic applications. Sci. Adv. 6, eaba1178 (2020).10.1126/sciadv.aba1178 ↗
14. Khan, A. I. et al. Ultralow–switching current density multilevel phase-change memory on a flexible substrate. Science 373, 1243–1247 (2021).10.1126/science.abj1261 ↗
15. Sun, F., Lu, Q., Feng, S. & Zhang, T. Flexible artificial sensory systems based on neuromorphic devices. ACS Nano 15, 3875–3899 (2021).10.1021/acsnano.0c10049 ↗
16. Seo, D.-G., Go, G.-T., Park, H.-L. & Lee, T.-W. Organic synaptic transistors for flexible and stretchable artificial sensory nerves. MRS Bull. 46, 321–329 (2021).10.1557/s43577-021-00093-5 ↗
17. Kim, Y. et al. A bioinspired flexible organic artificial afferent nerve. Science 360, 998–1003 (2018).10.1126/science.aao0098 ↗
18. Lee, Y. et al. Stretchable organic optoelectronic sensorimotor synapse. Sci. Adv. 4, eaat7387 (2018).10.1126/sciadv.aat7387 ↗
19. He, K. et al. An artificial somatic reflex arc. Adv. Mater. 32, 1905399 (2020).10.1002/adma.201905399 ↗
20. Horch, K. W. & Kipke, D. R. Neuroprosthetics: Theory and Practice Vol. 8 (World Scientific, 2017).10.1142/10368 ↗
21. Sun, F. et al. Novel flexible pressure sensor combining with dynamic-time-warping algorithm for handwriting identification. Sens. Actuators, A 293, 70–76 (2019).10.1016/j.sna.2019.04.018 ↗
22. Sun, F. et al. Bioinspired flexible, dual‐modulation synaptic transistors toward artificial visual memory systems. Adv. Mater. Technol. 5, 1900888 (2020).10.1002/admt.201900888 ↗
23. Liu, Z. et al. Somatosensitive film soft crawling robots driven by artificial muscle for load carrying and multi-terrain locomotion. Mater. Horiz. 8, 1783–1794 (2021).10.1039/D1MH00457C ↗
24. Leng, X. et al. Tuning the reversibility of hair artificial muscles by disulfide cross-linking for sensors, switches, and soft robotics. Mater. Horiz. 8, 1538–1546 (2021).10.1039/D1MH00234A ↗
25. Xia, Y., He, Y., Zhang, F., Liu, Y. & Leng, J. A review of shape memory polymers and composites: Mechanisms, materials, and applications. Adv. Mater. 33, 2000713 (2021).10.1002/adma.202000713 ↗
26. Mukai, K. et al. Highly conductive sheets from millimeter‐long single‐walled carbon nanotubes and ionic liquids: Application to fast‐moving, low‐voltage electromechanical actuators operable in air. Adv. Mater. 21, 1582–1585 (2009).10.1002/adma.200802817 ↗
27. Zou, M. et al. Progresses in tensile, torsional, and multifunctional soft actuators. Adv. Funct. Mater. 31, 2007437 (2021).10.1002/adfm.202007437 ↗
28. Zhou, X., Fang, S., Leng, X., Liu, Z. & Baughman, R. H. The power of fiber twist. Acc. Chem. Res. 54, 2624–2636 (2021).10.1021/acs.accounts.1c00112 ↗
29. Johansson, R. S. & Flanagan, J. R. Coding and use of tactile signals from the fingertips in object manipulation tasks. Nat. Rev. Neurosci. 10, 345–359 (2009).10.1038/nrn2621 ↗
30. Fernandes, A. M. & Albuquerque, P. B. Tactual perception: A review of experimental variables and procedures. Cogn. Process. 13, 285–301 (2012).10.1007/s10339-012-0443-2 ↗
31. Choi, S. et al. Parallel ascending spinal pathways for affective touch and pain. Nature 587, 258–263 (2020).10.1038/s41586-020-2860-1 ↗
32. Lucas, K. The “all or none” contraction of the amphibian skeletal muscle fibre. J. Physiol. 38, 113–133 (1909).10.1113/jphysiol.1909.sp001298 ↗
33. Wang, L., Ma, L., Yang, J. & Wu, J. Human somatosensory processing and artificial somatosensation. Cyborg. Bionic. Syst. 2021, 9843259 (2021).
34. Gu, Y. et al. Flexible electronic eardrum. Nano Res. 10, 2683–2691 (2017).10.1007/s12274-017-1470-1 ↗
35. Terasawa, N., Takeuchi, I. & Matsumoto, H. Electrochemical properties and actuation mechanisms of actuators using carbon nanotube-ionic liquid gel. Sens. Actuators, B. 139, 624–630 (2009).10.1016/j.snb.2009.03.057 ↗
36. Fukushima, T., Asaka, K., Kosaka, A. & Aida, T. Fully plastic actuator through layer-by-layer casting with ionic-liquid-based bucky gel. Angew. Chem., Int. Ed. 44, 2410–2413 (2005).10.1002/anie.200462318 ↗