A soft magnetoelectric finger for robots’ multidirectional tactile perception in non-visual recognition environments
Source abstract
Abstract
Abstract Robotic fingers with multidirectional tactile perception are of great importance for the robotic exploration of complex unknown space, especially in environments in which visualization is not possible. Unfortunately, most existing tactile sensors for robotic fingers cannot detect multidirectional forces, which greatly limits their potential for further development in navigating complex environments. Here, we demonstrate a soft magnetoelectric finger (SMF) that can achieve self-generated-signal and multidirectional tactile sensing. The SMF is composed of two parts: a ‘finger’ covered with a skin-like flexible sheath containing five liquid metal (LM) coils and a ‘phalangeal bone’ containing a magnet. Due to the changes in magnetic flux through the LM coils caused by external forces, diverse induced voltages are generated and collected in real-time, which can be explained by Maxwell’s numerical simulation. By the analysis of the signals generated by the five LM coils, the SMF can detect forces in varied directions and distinguish 6 different common objects with varied Young’s moduli with an accuracy of 97.46%. These capabilities make the SMF suitable for complex unknown space exploration tasks, as proved by the black box exploration. The SMF can enable the development of self-generated-signal and multidirectional tactile perception for future robots.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Tactile and Sensory Interactions · Interactive and Immersive Displays
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (29)
Show source-provided references
1. Luo, S. et al. Robotic tactile perception of object properties: a review. Mechatronics 48, 54–67 (2017).10.1016/j.mechatronics.2017.11.002 ↗
2. Skedung, L. et al. Feeling small: exploring the tactile perception limits. Sci. Rep. 3, 2617 (2013).10.1038/srep02617 ↗
3. Lederman, S. J. & Klatzky, R. L. Haptic perception: a tutorial. Atten. Percept. Psychol. 71, 1439–1459 (2009).10.3758/APP.71.7.1439 ↗
4. Schneider, A. et al. Object identification with tactile sensors using bag-of-features. in 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems, 243–248 (2009).10.1109/IROS.2009.5354648 ↗
5. Dahiya, R. S., Mittendorfer, P., Valle, M., Cheng, G. & Lumelsky, V. J. Directions toward effective utilization of tactile skin: a review. IEEE Sens. J. 13, 4121–4138 (2013).10.1109/JSEN.2013.2279056 ↗
6. Xie, H. et al. Fiber optics tactile array probe for tissue palpation during minimally invasive surgery. in 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems, 2539–2544 (2013).10.1109/IROS.2013.6696714 ↗
7. Yamazaki, H., Nishiyama, H. & Watanabe, K. A fiber-optic mechanoreceptor in a finger-shaped end effector for human-like tactile sensing. IEEE Sens. J. 17, 5123–5129 (2017).10.1109/JSEN.2017.2720753 ↗
8. Lin, C. H., Erickson, T. W., Fihshel, J. A., Wettels, N. & Loeb, G. E. Signal processing and fabrication of a biomimetic tactile sensor array with thermal, force and microvibration modalities. In 2009 IEEE International Conference on Robotics and Biomimetics (ROBIO), 129–134 (2009).10.1109/ROBIO.2009.5420611 ↗
9. Ge, J. et al. A bimodal soft electronic skin for tactile and touchless interaction in real time. Nat. Commun. 10, 4405 (2019).10.1038/s41467-019-12303-5 ↗
10. Tomo, T. P. et al. Covering a robot fingertip with uSkin: a soft electronic skin with distributed 3-axis force sensitive elements for robot hands. IEEE Robot. Autom. Lett. 3, 124–131 (2017).10.1109/LRA.2017.2734965 ↗
11. Sun, H., Kuchenbecker, K. J. & Martius, G. A soft thumb-sized vision-based sensor with accurate all-round force perception. Nat. Mach. Intell. 4, 135–145 (2022).10.1038/s42256-021-00439-3 ↗
12. Padmanabha, A. et al. OmniTact: A multi-directional high-resolution touch sensor. in 2020 IEEE International Conference on Robotics and Automation (ICRA), 618–624 (2020).10.1109/ICRA40945.2020.9196712 ↗
13. Gomes, D. F., Lin, Z. & Luo, S. GelTip: A finger-shaped optical tactile sensor for robotic manipulation. in 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 9903–9909 (2020).10.1109/IROS45743.2020.9340881 ↗
14. Jamone, L., Natale, L., Metta, G. & Sandini, G. Highly sensitive soft tactile sensors for an anthropomorphic robotic hand. IEEE Sens. J. 15, 4226–4233 (2015).10.1109/JSEN.2015.2417759 ↗
15. Wang, H. et al. Design methodology for magnetic field-based soft tri-axis tactile sensors. Sensors 16, 1356 (2016).10.3390/s16091356 ↗
16. Youssefian, S., Rahbar, N. & Torres-Jara, E. Contact behavior of soft spherical tactile sensors. IEEE Sens. J. 14, 1435–1442 (2014).10.1109/JSEN.2013.2296208 ↗
17. Dahiya, R. S., Metta, G., Valle, M. & Sandini, G. Tactile sensing—from humans to humanoids. IEEE Trans. Robot. 26, 1–20 (2010).10.1109/TRO.2009.2033627 ↗
18. Li, S. et al. Self-powered stretchable strain sensors for motion monitoring and wireless control. Nano Energy 92, 106754 (2022).10.1016/j.nanoen.2021.106754 ↗
19. Ma, Z. et al. Merkel’s disks bioinspired self-powered flexible magnetoelectric sensors toward the robotic arm’s tactile perceptual functioning and smart learning. Adv. Intell. Syst. 2, 1900140 (2020).10.1002/aisy.201900140 ↗
20. Yue, Y. et al. Active perception in non-visual recognition environments by stretchable tentacle sensor arrays. ACS Appl. Mater. Inter. 14, 26913–26922 (2022).10.1021/acsami.2c04717 ↗
21. Zhang, X. et al. Liquid metal based stretchable magnetoelectric films and their capacity for mechanoelectrical conversion. Adv. Funct. Mater. 30, 2003680 (2020).10.1002/adfm.202003680 ↗
22. Zhang, S. et al. Magnetic/conductive/elastic multi-material 3D-printed self-powered sensing gloves for underwater/smoke environmental Human-Computer Interaction. Chem. Eng. J. 463, 142388 (2023).10.1016/j.cej.2023.142388 ↗
23. Dickey, M. D. Stretchable and soft electronics using liquid metal. Adv. Mater. 29, 1606425 (2017).10.1002/adma.201606425 ↗
24. Kawasetsu, T., Niiyama, R., & Kuniyoshi, Y. Flexible and soft inductive tri-axis tactile sensor using liquid metal as sensing target. in 2019 IEEE SENSORS, 1–4 (2019).10.1109/SENSORS43011.2019.8956736 ↗
25. Ladd, C., So, J., Muth, J. & Dickey, M. D. 3D printing of free standing liquid metal microstructures. Adv. Mater. 25, 5081–5085 (2013).10.1002/adma.201301400 ↗
26. Ma, J. et al. Shaping a soft future: patterning liquid metals. Adv. Mater. 35, 2205196 (2022).10.1002/adma.202205196 ↗
27. Guru, B. S. & Hiziroglu, H. R. Electromagnetic Field Theory Fundamentals (Cambridge Univ. Press, Cambridge, 2009).
28. Qu, X. et al. Artificial tactile perception smart finger for material identification based on triboelectric sensing. Sci. Adv. 8, eabq2521 (2022).10.1126/sciadv.abq2521 ↗
29. Tao, J. et al. Self-powered tactile sensor array systems based on the triboelectric effect. Adv. Funct. Mater. 29, 1806379 (2018).10.1002/adfm.201806379 ↗