journal article·2025-08-12Open access

An optical/electronic artificial skin extends the robotic sense to molecular sensing

Benhui Dai, Yingjie Zheng, Yihang Qian, Xiaoyong Hu, Zhizhong Sun, Zenghong Ma, Guanjun Bao, Huaping Wu, Xuan Luo, Josie Hughes, Xiangjiang Liu, Yibin Ying, Lijuan Xie

npj Flexible Electronics· Volume 9· Issue 1

Abstract

Abstract Artificial skins are essential for bridging sensory gaps between robots and environments, enabling natural and intuitive interactions. While artificial skins can sense stimuli like pressure and stretchability, their capabilities need to be expanded into chemical sensing for specific applications. Here, we introduce optical/electronic artificial skins (oe-skins), advancing robotic sensing from physical perception to chemical sensation. Our design integrates optical fibers into a carbon nanotube (CNT)-based haptic electronic skin. This empowers the skin to sense force and temperature, while detecting near-infrared (NIR) optical signals from molecules, giving dual modalities of physical and chemical sensing. We successfully implement the oe-skin into robots, enabling intraocular pressure and glucose level detection for diagnosing glaucoma and diabetes. Additionally, we demonstrated their effectiveness in delicately harvesting fruits and grading them by ripeness, firmness, and sugar levels. We present a blueprint for next-generation intelligent electronics where technological progress aligns with sustainable development and societal well-being.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Tactile and Sensory Interactions · Polydiacetylene-based materials and applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (51)

Show source-provided references
1. Chen, J. et al. Recent progress in essential functions of soft electronic skin. Adv. Funct. Mater. 31, 2104686 (2021).10.1002/adfm.202104686 ↗
2. Zarei, M., Lee, G., Lee, S. G. & Cho, K. Advances in biodegradable electronic skin: Material progress and recent applications in sensing, robotics, and human–machine interfaces. Adv. Mater. 35, 2203193 (2023).10.1002/adma.202203193 ↗
3. Yin, F. et al. Advanced polymer materials-based electronic skins for tactile and non-contact sensing applications. InfoMat 5, e12424 (2023).10.1002/inf2.12424 ↗
4. Lee, Y. et al. Mimicking human and biological skins for multifunctional skin electronics. Adv. Funct. Mater. 30, 1904523 (2020).10.1002/adfm.201904523 ↗
5. Zhao, C., Park, J., Root, S. E. & Bao, Z. Skin-inspired soft bioelectronic materials, devices and systems. Nat. Rev. Bioeng. 2, 671–690 (2024).10.1038/s44222-024-00194-1 ↗
6. Wu, X., Zhu, J., Evans, J. W., Lu, C. & Arias, A. C. A potentiometric electronic skin for thermosensation and mechanosensation. Adv. Funct. Mater. 31, 2010824 (2021).10.1002/adfm.202010824 ↗
7. Han, S. et al. All resistive pressure–temperature bimodal sensing e-skin for object classification. Small 19, 2301593 (2023).10.1002/smll.202301593 ↗
8. Wang, Y. et al. Flexible integrated sensor with asymmetric structure for simultaneously 3D tactile and thermal sensing. Biosens. Bioelectron. 224, 115054 (2023).10.1016/j.bios.2022.115054 ↗
9. Gao, F.-L. et al. Multifunctional thermoelectric temperature sensor for noncontact information transfer and tactile sensing in human-machine interaction. Adv. Funct. Mater. 34, 2309553 (2023).10.1002/adfm.202309553 ↗
10. Gao, F.-L. et al. Ti3C2Tx MXene-based multifunctional tactile sensors for precisely detecting and distinguishing temperature and pressure stimuli. ACS Nano 17, 16036–16047 (2023).10.1021/acsnano.3c04650 ↗
11. Wang, Y. et al. Stretchable temperature-responsive multimodal neuromorphic electronic skin with spontaneous synaptic plasticity recovery. ACS Nano 16, 8283–8293 (2022).10.1021/acsnano.2c02089 ↗
12. Wang, H. et al. Transparent, self-adhesive, highly environmental stable, and water-resistant ionogel enabled reliable strain/temperature sensors and underwater communicators. Chem. Eng. J. 471, 144674 (2023).10.1016/j.cej.2023.144674 ↗
13. Bai, N. et al. A robotic sensory system with high spatiotemporal resolution for texture recognition. Nat. Commun. 14, 7121 (2023).10.1038/s41467-023-42722-4 ↗
14. Zhang, C. et al. Bioinspired environment-adaptable and ultrasensitive multifunctional electronic skin for human healthcare and robotic sensations. Small 19, 2304004 (2023).10.1002/smll.202304004 ↗
15. Li, G., Liu, S., Wang, L. & Zhu, R. Skin-inspired quadruple tactile sensors integrated on a robot hand enable object recognition. Sci. Robot. 5, eabc8134 (2020).10.1126/scirobotics.abc8134 ↗
16. Lee, G. et al. Fingerpad-inspired multimodal electronic skin for material discrimination and texture recognition. Adv. Sci. 8, 2002606 (2021).10.1002/advs.202002606 ↗
17. Yu, Y. et al. Biofuel-powered soft electronic skin with multiplexed and wireless sensing for human-machine interfaces. Sci. Robot. 5, eaaz7946 (2020).10.1126/scirobotics.aaz7946 ↗
18. Zhang, Y. et al. Dual-mode electronic skin with integrated tactile sensing and visualized injury warning. ACS Appl. Mater. Interfaces 9, 37493–37500 (2017).10.1021/acsami.7b13016 ↗
19. Liu, F. et al. Neuro-inspired electronic skin for robots. Sci. Robot. 7, eabl7344 (2022).10.1126/scirobotics.abl7344 ↗
20. Park, M. et al. Stretchable glove for accurate and robust hand pose reconstruction based on comprehensive motion data. Nat. Commun. 15, 5821 (2024).10.1038/s41467-024-50101-w ↗
21. Shih, B. et al. Electronic skins and machine learning for intelligent soft robots. Sci. Robot. 5, eaaz9239 (2020).10.1126/scirobotics.aaz9239 ↗
22. Li, G., Liu, S., Mao, Q. & Zhu, R. Multifunctional electronic skins enable robots to safely and dexterously interact with human. Adv. Sci. 9, 2104969 (2022).10.1002/advs.202104969 ↗
23. Yang, J. C. et al. Electronic skin: Recent progress and future prospects for skin-attachable devices for health monitoring, robotics, and prosthetics. Adv. Mater. 31, 1970337 (2019).10.1002/adma.201970337 ↗
24. Wong, S. H. D. et al. Smart skin-adhesive patches: From design to biomedical applications. Adv. Funct. Mater. 33, 2213560 (2023).10.1002/adfm.202213560 ↗
25. Zhang, Y. et al. Meso-reconstruction of silk fibroin based on molecular and nano-templates for electronic skin in medical applications. Adv. Funct. Mater. 31, 2100150 (2021).10.1002/adfm.202100150 ↗
26. Qiu, Y. et al. Nondestructive identification of softness via bioinspired multisensory electronic skins integrated on a robotic hand. Npj Flex. Electron. 6, 45 (2022).10.1038/s41528-022-00181-9 ↗
27. Zhao, H., O’Brien, K., Li, S. & Shepherd, R. F. Optoelectronically innervated soft prosthetic hand via stretchable optical waveguides. Sci. Robot. 1, eaai7529 (2016).10.1126/scirobotics.aai7529 ↗
28. Anderson, R. R. & Parrish, J. A. The optics of human skin. J. Invest. Dermatol. 77, 13–19 (1981).10.1111/1523-1747.ep12479191 ↗
29. Lister, T., Wright, P. A. & Chappell, P. H. Optical properties of human skin. J. Biomed. Opt. 17, 090901 (2012).10.1117/1.JBO.17.9.090901 ↗
30. Ash, C., Dubec, M., Donne, K. & Bashford, T. Effect of wavelength and beam width on penetration in light-tissue interaction using computational methods. Lasers Med. Sci. 32, 1909–1918 (2017).10.1007/s10103-017-2317-4 ↗
31. Finlayson, L. et al. Depth penetration of light into skin as a function of wavelength from 200 to 1000 nm. Photochem. Photobiol. 98, 974–981 (2022).10.1111/php.13550 ↗
32. Franklin, D. et al. Synchronized wearables for the detection of haemodynamic states via electrocardiography and multispectral photoplethysmography. Nat. Biomed. Eng. 7, 1229–1241 (2023).10.1038/s41551-023-01098-y ↗
33. Jin, H. et al. A flexible optoacoustic blood ‘stethoscope’ for noninvasive multiparametric cardiovascular monitoring. Nat. Commun. 14, 4692 (2023).10.1038/s41467-023-40181-5 ↗
34. Ong, J. J. et al. Optical biosensors - Illuminating the path to personalized drug dosing. Biosens. Bioelectron. 188, 113331 (2021).10.1016/j.bios.2021.113331 ↗
35. Duan, L., D’hooge, D. R. & Cardon, L. Recent progress on flexible and stretchable piezoresistive strain sensors: From design to application. Prog. Mater. Sci. 114, 100617 (2020).10.1016/j.pmatsci.2019.100617 ↗
36. Ding, Y., Xu, T., Onyilagha, O., Fong, H. & Zhu, Z. Recent advances in flexible and wearable pressure sensors based on piezoresistive 3D monolithic conductive sponges. ACS Appl. Mater. Interfaces 11, 6685–6704 (2019).10.1021/acsami.8b20929 ↗
37. Wang, R. et al. Carbon nanotube-based strain sensors: structures, fabrication, and applications. Adv. Mater. Technol. 8, 2200855 (2022).10.1002/admt.202200855 ↗
38. Kim, J.-J., Liu, H., Ashtiani, A. O. & Jiang, H. Biologically inspired artificial eyes and photonics. Rep. Prog. Phys. 83, 047101 (2020).10.1088/1361-6633/ab6a42 ↗
39. Kazanskiy, N. L., Khonina, S. N. & Butt, M. A. Smart contact lenses—A step towards non-invasive continuous eye health monitoring. Biosensors 13, 933 (2023).10.3390/bios13100933 ↗
40. Hu, X., Liu, Z. & Zhang, Y. Three-Dimensionally Architected Tactile Electronic Skins. ACS Nano. 19, 14523–14539 (2025).10.1021/acsnano.5c02232 ↗
41. Qiu, Y. et al. Quantitative softness and texture bimodal haptic sensors for robotic clinical feature identification and intelligent picking. Sci. Adv. 10, eadp0348 (2024).10.1126/sciadv.adp0348 ↗
42. Fastier-Wooller, J. W. et al. Multimodal Fibrous Static and Dynamic Tactile Sensor. ACS Appl. Mater. Interfaces 14, 27317–27327 (2022).10.1021/acsami.2c08195 ↗
43. Pyo, S., Lee, J., Kim, W., Jo, E. & Kim, J. Multi-layered, hierarchical fabric-based tactile sensors with high sensitivity and linearity in ultrawide pressure range. Adv. Funct. Mater. 29, 1902484 (2019).10.1002/adfm.201902484 ↗
44. Yang, Y. et al. All-organic transparent plant e-skin for noninvasive phenotyping. Sci. Adv. 10, eadk7488 (2024).10.1126/sciadv.adk7488 ↗
45. Sundaram, S. et al. Learning the signatures of the human grasp using a scalable tactile glove. Nature 569, 698–702 (2019).10.1038/s41586-019-1234-z ↗
46. Dai, B., Zhou, R., Ping, J., Ying, Y. & Xie, L. Recent advances in carbon nanotube-based biosensors for biomolecular detection. TrAC Trends Anal. Chem. 154, 116658 (2022).10.1016/j.trac.2022.116658 ↗
47. Liu, W. et al. Touchless interactive teaching of soft robots through flexible bimodal sensory interfaces. Nat. Commun. 13, 5030 (2022).10.1038/s41467-022-32702-5 ↗
48. Wang, Y. et al. Cross-Wavelength Hierarchical Metamaterials Enabled for Trans-Scale Molecules Detection Simultaneously. Adv. Sci. 9, 2105447 (2022).10.1002/advs.202105447 ↗
49. Yang, Z., Albrow-Owen, T., Cai, W. & Hasan, T. Miniaturization of optical spectrometers. Science 371, eabe0722 (2021).10.1126/science.abe0722 ↗
50. Fastier-Wooller, J. W. et al. Flexible Iron-On Sensor Embedded in Smart Sock for Gait Event Detection. ACS Appl. Mater. Interfaces 16, 1638–1649 (2024).10.1021/acsami.3c11805 ↗
51. Yu, Y. et al. All-printed soft human-machine interface for robotic physicochemical sensing. Sci. Robot. 7, eabn0495 (2022).10.1126/scirobotics.abn0495 ↗