Multifunctional biomimetic tactile system via a stick-slip sensing strategy for human–machine interactions
Source abstract
Abstract
Abstract A tactile sensor system enables natural interaction between humans and machines; this interaction is crucial for dexterous robotic hands, interactive entertainment, and other smart scenarios. However, the lack of sliding friction detection significantly limits the accuracy and scope of interactions due to the absence of sophisticated information, such as slippage, material and roughness of held objects. Here, inspired by the stick-slip phenomena in the sliding process, we have developed a multifunctional biomimetic tactile system based on the stick-slip sensing strategy, which is a universal method to detect slippage and estimate the surface properties of objects by sliding. This system consists of a flexible fingertip-inspired tactile sensor, a read-out circuit and a machine-learning module. Based on the stick-slip sensing strategy, our system was endowed with high recognition rates for slippage detection (100.0%), material classification (93.3%) and roughness discrimination (92.8%). Moreover, robotic hand manipulation, interactive games and object classification are demonstrated with this multifunctional system for comprehensive and promising human–machine interactions.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Tactile and Sensory Interactions · Muscle activation and electromyography studies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (40)
Show source-provided references
1. Li, G., Liu, S., Wang, L. & Zhu, R. Skin-inspired quadruple tactile sensors integrated on a robot hand enable object recognition. Sci. Robot. 5, eabc8134 (2020).10.1126/scirobotics.abc8134 ↗
2. Sundaram, S. How to improve robotic touch Challenges for instrumenting robotic hands to match human performance are outlined. Science 370, 768–769 (2020).10.1126/science.abd3643 ↗
3. Kim, T. et al. Heterogeneous sensing in a multifunctional soft sensor for human-robot interfaces. Sci. Robot. 5, eabc6878 (2020).10.1126/scirobotics.abc6878 ↗
4. Khan, M., Silva, B. N. & Han, K. Internet of things based energy aware smart home control system. IEEE Access 4, 7556–7566 (2016).10.1109/ACCESS.2016.2621752 ↗
5. Li, M. & Lin, H. J. Design and implementation of smart home control systems based on wireless sensor networks and power line communications. IEEE Trans. Ind. Electron. 62, 4430–4442 (2015).10.1109/TIE.2014.2379586 ↗
6. Yu, X. et al. Skin-integrated wireless haptic interfaces for virtual and augmented reality. Nature 575, 473–479 (2019).10.1038/s41586-019-1687-0 ↗
7. Zhu, M. et al. Haptic-feedback smart glove as a creative human-machine interface (HMI) for virtual/augmented reality applications. Sci. Adv. 6, eaaz8693 (2020).10.1126/sciadv.aaz8693 ↗
8. Zhou, Z. et al. Sign-to-speech translation using machine-learning-assisted stretchable sensor arrays. Nat. Electron. 3, 571–578 (2020).10.1038/s41928-020-0428-6 ↗
9. D’Anna, E. et al. A closed-loop hand prosthesis with simultaneous intraneural tactile and position feedback. Sci. Robot. 4, eaau8892 (2019).10.1126/scirobotics.aau8892 ↗
10. Dong, B. et al. Wearable triboelectric-human-machine interface (THMI) using robust nanophotonic readout. ACS Nano 14, 8915–8930 (2020).10.1021/acsnano.0c03728 ↗
11. Muthukumarana, S., Elvitigala, D. S., Forero Cortes, J. P., Matthies, D. J. & Nanayakkara, S. Touch me gently: recreating the perception of touch using a shape-memory alloy matrix. Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems, New York, NY: Association for Computing Machinery, 1–12. https://doi.org/10.1145/3313831.3376491 (2020).10.1145/3313831.3376491 ↗
12. Araromi, O. A. et al. Ultra-sensitive and resilient compliant strain gauges for soft machines. Nature 587, 219–224 (2020).10.1038/s41586-020-2892-6 ↗
13. Yang, Y. et al. A non-printed integrated-circuit textile for wireless theranostics. Nat. Commun. 12, 4876 (2021).10.1038/s41467-021-25075-8 ↗
14. Shi, J. et al. Smart textile‐integrated microelectronic systems for wearable applications. Adv. Mater. 32, 1901958 (2019).10.1002/adma.201901958 ↗
15. Yao, H. et al. Near-hysteresis-free soft tactile electronic skins for wearables and reliable machine learning. Proc. Natl Acad. Sci. U.S.A. 117, 25352–25359 (2020).10.1073/pnas.2010989117 ↗
16. Lee, J. H. et al. A behavior-learned cross-reactive sensor matrix for intelligent skin perception. Adv. Mater. 32, e2000969 (2020).10.1002/adma.202000969 ↗
17. Jiang, C. et al. A high-performance bionic pressure memory device based on piezo-OLED and piezo-memristor as luminescence-fish neuromorphic tactile system. Nano Energy 77, 105120 (2020).10.1016/j.nanoen.2020.105120 ↗
18. Chen, Y. et al. Piezotronic graphene artificial sensory synapse. Adv. Funct. Mater. 29, 1900959 (2019).10.1002/adfm.201900959 ↗
19. Boutry, C. M. et al. A hierarchically patterned, bioinspired e-skin able to detect the direction of applied pressure for robotics. Sci. Robot. 3, eaau6914 (2018).10.1126/scirobotics.aau6914 ↗
20. Viry, L. et al. Flexible three-axial force sensor for soft and highly sensitive artificial touch. Adv. Mater. 26, 2659–2664 (2014).10.1002/adma.201305064 ↗
21. Chen, H. et al. Fingertip-inspired electronic skin based on triboelectric sliding sensing and porous piezoresistive pressure detection. Nano Energy 40, 65–72 (2017).10.1016/j.nanoen.2017.08.001 ↗
22. Wang, Y. et al. Hierarchically patterned self-powered sensors for multifunctional tactile sensing. Sci. Adv. 6, eabb9083 (2020).10.1126/sciadv.abb9083 ↗
23. Charalambides, A. & Bergbreiter, S. Rapid manufacturing of mechanoreceptive skins for slip detection in robotic grasping. Adv. Mater. Technol. 2, 1600188 (2017).10.1002/admt.201600188 ↗
24. Ren, Z. et al. Fully elastic and metal-free tactile sensors for detecting both normal and tangential forces based on triboelectric nanogenerators. Adv. Funct. Mater. 28, 1802989 (2018).10.1002/adfm.201802989 ↗
25. Yamaguchi, T., Kashiwagi, T., Arie, T., Akita, S. & Takei, K. Human‐like electronic skin‐integrated soft robotic hand. Adv. Intell. Syst. 1, 1900018 (2019).10.1002/aisy.201900018 ↗
26. Schwarz, C. The slip hypothesis: tactile perception and its neuronal bases. Trends Neurosci. 39, 449–462 (2016).10.1016/j.tins.2016.04.008 ↗
27. Weber, A. I. et al. Spatial and temporal codes mediate the tactile perception of natural textures. Proc. Natl Acad. Sci. U.S.A. 110, 17107–17112 (2013).10.1073/pnas.1305509110 ↗
28. Johansson, R. S. & Flanagan, J. R. Coding and use of tactile signals from the fingertips in object manipulation tasks. Nat. Rev. Neurosci. 10, 345–359 (2009).10.1038/nrn2621 ↗
29. Thompson, P. A. & Robbins, M. O. Origin of stick-slip motion in boundary lubrication. Science 250, 792–794 (1990).10.1126/science.250.4982.792 ↗
30. Berman, A. D., Ducker, W. A. & Israelachvili, J. N. Origin and characterization of different stick-slip friction mechanisms. Langmuir 12, 4559–4563 (1996).10.1021/la950896z ↗
31. Heslot, F., Baumberger, T., Perrin, B., Caroli, B. & Caroli, C. Creep, stick-slip, and dry-friction dynamics: experiments and a heuristic model. Phys. Rev. E. 49, 4973–4988 (1994).10.1103/PhysRevE.49.4973 ↗
32. Popov, V. L. Contact mechanics and friction: physical principles and applications (Springer Science & Business Media, 2010).
33. Ponomarev, I. V. & Meyerovich, A. E. Surface roughness and effective stick-slip motion. Phys. Rev. E. 67, 026302 (2003).10.1103/PhysRevE.67.026302 ↗
34. Oden, J. T. & Martins, J. Models and computational methods for dynamic friction phenomena. Comput. Methods Appl. Mech. Eng. 52, 527–634 (1985).10.1016/0045-7825(85)90009-X ↗
35. Delhaye, B., Lefevre, P. & Thonnard, J. L. Dynamics of fingertip contact during the onset of tangential slip. J. R. Soc. Interface 11, 20140698 (2014).10.1098/rsif.2014.0698 ↗
36. Andre, T., Levesque, V., Hayward, V., Lefevre, P. & Thonnard, J. L. Effect of skin hydration on the dynamics of fingertip gripping contact. J. R. Soc. Interface 8, 1574–1583 (2011).10.1098/rsif.2011.0086 ↗
37. Tada, M. & Kanade, T. An imaging system of incipient slip for modelling how human perceives slip of a fingertip. 26th Annu. Int. Conf. IEEE Eng. Med. Biol. Soc. 1, 2045–2048 (2004).10.1109/IEMBS.2004.1403601 ↗
38. Bensmaïa, S. J. & Hollins, M. The vibrations of texture. Somatosens. Mot. Res. 20, 33–43 (2003).10.1080/0899022031000083825 ↗
39. Scheibert, J., Leurent, S., Prevost, A. & Debrégeas, G. The role of fingerprints in the coding of tactile information probed with a biomimetic sensor. Science 323, 1503–1506 (2009).10.1126/science.1166467 ↗
40. Abraira, V. E. & Ginty, D. D. The sensory neurons of touch. Neuron 79, 618–639 (2013).10.1016/j.neuron.2013.07.051 ↗