Integration of AI with artificial sensory systems for multidimensional intelligent augmentation
Source abstract
Abstract
Abstract Artificial sensory systems mimic the five human senses to facilitate data interaction between the real and virtual worlds. Accurate data analysis is crucial for converting external stimuli from each artificial sense into user-relevant information, yet conventional signal processing methods struggle with the massive scale, noise, and artificial sensory systems characteristics of data generated by artificial sensory devices. Integrating artificial intelligence (AI) is essential for addressing these challenges and enhancing the performance of artificial sensory systems, making it a rapidly growing area of research in recent years. However, no studies have systematically categorized the output functions of these systems or analyzed the associated AI algorithms and data processing methods. In this review, we present a systematic overview of the latest AI techniques aimed at enhancing the cognitive capabilities of artificial sensory systems replicating the five human senses: touch, taste, vision, smell, and hearing. We categorize the AI-enabled capabilities of artificial sensory systems into four key areas: cognitive simulation, perceptual enhancement, adaptive adjustment, and early warning. We introduce specialized AI algorithms and raw data processing methods for each function, designed to enhance and optimize sensing performance. Finally, we offer a perspective on the future of AI-integrated artificial sensory systems, highlighting technical challenges and potential real-world application scenarios for further innovation. Integration of AI with artificial sensory systems will enable advanced multimodal perception, real-time learning, and predictive capabilities. This will drive precise environmental adaptation and personalized feedback, ultimately positioning these systems as foundational technologies in smart healthcare, agriculture, and automation.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: EEG and Brain-Computer Interfaces · Tactile and Sensory Interactions · Advanced Sensor and Energy Harvesting Materials
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (100+)
Show source-provided references
1. Bioinspired electronics for artificial sensory systems10.1002/adma.201803637 ↗
2. A programmable electronic skin with event-driven in-sensor touch differential and decision-making10.1002/adfm.202412649 ↗
3. Evaluation of the quality grade of congou black tea by the fusion of GC-E-nose, E-tongue, and E-eye10.1016/j.fochx.2024.101519 ↗
4. “Electronic nose” predicts immunotherapy response10.1001/jama.2019.18225 ↗
5. A novel integrated system of visual communication and touch technology for people with disabilities
6. Smelling, seeing, tasting- old senses for new sensing10.1021/acsnano.7b03176 ↗
7. Flavor analysis of three kinds of edible fungus plant steaks by electronic sensory technology combined with artificial sensory evaluation10.13651/j.cnki.fjnykj.2024.03.001 ↗
8. Body-integrated ultrasensitive all-textile pressure sensors for skin-inspired artificial sensory systems10.1002/smsc.202400026 ↗
9. A smart artificial finger with multisensations of matter, temperature, and proximity10.1002/admt.201800056 ↗
10. An artificial sensory neuron with visual-haptic fusion10.1038/s41467-020-18375-y ↗
11. Sensory feedback in artificial control of human mobility10.3233/THC-1999-7602 ↗
12. Artificial skin perception10.1002/adma.202003014 ↗
13. Tactile sensors for advanced intelligent systems10.1002/aisy.201900090 ↗
14. A novel method for the discrimination of Hawthorn and its processed products using an intelligent sensory system and artificial neural networks10.1007/s10068-016-0239-8 ↗
15. Recent advances in transistor-based bionic perceptual devices for artificial sensory systems10.3389/fnano.2022.954165 ↗
16. An artificial intelligence approach towards sensorial materials
17. Towards artificial visual sensory system: organic optoelectronic synaptic materials and devices10.1002/anie.202313634 ↗
18. Artificial sensory system based on memristive devices10.1002/EXP.20220162 ↗
19. Solution-processing approach of nanomaterials toward an artificial sensory system10.1088/2631-7990/ad4c29 ↗
20. Multiarray nanopattern electronic nose (E-Nose) by high-resolution top-down nanolithography10.1002/adfm.202002486 ↗
21. Embedded artificial intelligence approach for gas recognition in smart agriculture applications using low cost MOX gas sensors
22. Artificial sense technology: emulating and extending biological senses10.1021/acsnano.1c10313 ↗
23. Flexible hybrid electronics for digital healthcare10.1002/adma.201902062 ↗
24. Artificial intelligence: a game changer in sensor research10.1021/acssensors.3c00589 ↗
25. Non-volatile taste active compounds in the meat of river snail (Sinotaia quadrata) determined by 1H NMR, e-tongue and sensory analysis10.1016/j.ijgfs.2023.100803 ↗
26. A neuromorphic bionic eye with filter-free color vision using hemispherical perovskite nanowire array retina10.1038/s41467-023-37581-y ↗
27. An all-protein multisensory highly bionic skin10.1021/acsnano.3c12525 ↗
28. 3D-printed bionic ear for sound identification and localization based on in situ polling of PVDF-TrFE film10.1002/mabi.202200374 ↗
29. Artificial olfaction for detection and classification of gases using E-Nose and machine learning for industrial application
30. A fiber optic interface coupled to nanosensors: applications to protein aggregation and organic molecule quantification10.1021/acsnano.0c03417 ↗
31. Bio-inspired flexible electronics for smart E-skin10.1016/j.actbio.2021.06.018 ↗
32. A battery-free, wireless, flexible bandlike e-nose based on MEMS gas sensors for precisely volatile organic compounds detection10.1016/j.nanoen.2024.109711 ↗
33. Integrated bionic human retina process and in-sensor RC system based on 2D retinomorphic memristor array10.1002/adfm.202406547 ↗
34. A neuromorphic bionic eye with broadband vision and biocompatibility using TIPS-pentacene-based phototransistor array retina10.1016/j.apmt.2023.101885 ↗
35. Two-stage amplification of an ultrasensitive MXene-based intelligent artificial eardrum10.1126/sciadv.abn2156 ↗
36. Optimum design and test of a novel bionic electronic stethoscope based on the cruciform microcantilever with leaf microelectromechanical systems structure10.1002/admt.202101501 ↗
37. A 128×128 1.5% contrast sensitivity 0.9% FPN 3 µs latency 4 mW asynchronous frame-free dynamic vision sensor using transimpedance preamplifiers10.1109/JSSC.2012.2230553 ↗
38. Development of ultrasensitive biomimetic auditory hair cells based on piezoresistive hydrogel nanocomposites10.1021/acsami.1c12515 ↗
39. Human-interactive, active-matrix displays for visualization of tactile pressures10.1002/admt.201900082 ↗
40. A highly flexible and multifunctional strain sensor based on a network-structured MXene/polyurethane mat with ultra-high sensitivity and a broad sensing range10.1039/C9NR00488B ↗
41. Metallic Ti3C2Tx MXene gas sensors with ultrahigh signal-to-noise ratio10.1021/acsnano.7b07460 ↗
42. Machine-learning-enhanced fluorescent nanosensor based on carbon quantum dots for heavy metal detection10.1021/acsanm.4c00359 ↗
43. Top-down approaches for 10 nm-scale nanochannel: toward exceptional H2S detection10.1021/acsnano.2c07785 ↗
44. Zero-biased bionic fingertip E-Skin with multimodal tactile perception and artificial intelligence for augmented touch awareness10.1002/adma.202406778 ↗
45. Artificially intelligent tactile ferroelectric skin10.1002/advs.202001662 ↗
46. In-sensor computing: materials, devices, and integration technologies10.1002/adma.202203830 ↗
47. Near-sensor and in-sensor computing10.1038/s41928-020-00501-9 ↗
48. Recent advances in sensor fault diagnosis: a review10.1016/j.sna.2020.111990 ↗
49. Simultaneous measurement of humidity and vibration based on a microwire sensor system using fast Fourier transform technique10.1109/JLT.2016.2580003 ↗
50. Sensor data fusion using Kalman filter10.1109/IFIC.2000.859866 ↗
51. Boosting diffusion models with moving average sampling in frequency domain
52. Machine learning and computation-enabled intelligent sensor design10.1038/s42256-021-00360-9 ↗
53. Brandt · 2023
54. Stationary wavelet transform based ECG signal denoising method10.1016/j.isatra.2020.12.029 ↗
55. Signaling pathways have an inherent need for noise to acquire information10.1186/s12859-020-03778-x ↗
56. An investigation of a biomimetic optical system and an evaluation model for the qualitative analysis of laser interference visual levels10.3390/biomimetics9040220 ↗
57. Finding hidden signals in chemical sensors using deep learning10.1021/acs.analchem.0c00137 ↗
58. Scalable photonic nose development through corona phase molecular recognition10.1021/acssensors.4c02327 ↗
59. Haptic rendering: programming touch interaction with virtual objects
60. Detection of vapours and odours from a multisensor array using pattern recognition Part 1. Principal component and cluster analysis10.1016/0925-4005(91)80185-M ↗
61. Detection of vapours and odours from a multisensor array using pattern-recognition techniques Part 2. Artificial neural networks10.1016/0925-4005(92)80187-3 ↗
62. Flexible artificial sensory systems based on neuromorphic devices10.1021/acsnano.0c10049 ↗
63. Piezotronic synapse based on a single GaN microwire for artificial sensory systems10.1021/acs.nanolett.0c00733 ↗
64. Multimodal artificial neurological sensory–memory system based on flexible carbon nanotube synaptic transistor10.1021/acsnano.1c04298 ↗
65. An optoneuronic device with realistic retinal expressions for bioinspired machine vision10.1002/aisy.201900115 ↗
66. A simple approach to biophysical profiling of blood cells in extranodal NK/T cell lymphoma patients using deep learning-integrated image cytometry10.1002/bmm2.12128 ↗
67. An AI-powered e-nose system using a density-based clustering method for identifying adulteration in specialty coffees10.1016/j.microc.2023.109844 ↗
68. Prostate cancer detection using e-nose and AI for high probability assessment10.1186/s12911-023-02312-2 ↗
69. Bioinspired integrated triboelectric electronic tongue10.1038/s41378-024-00690-9 ↗
70. Energy autonomous electronic skin with direct temperature-pressure perception10.1016/j.nanoen.2022.107273 ↗
71. An electronic nose for identifying multiple combustible/harmful gases and their concentration levels via artificial intelligence10.1016/j.measurement.2022.111458 ↗
72. Approach and application of extracting matching features from E-nose signals for AI tasks10.1016/j.bspc.2023.105869 ↗
73. Deep transfer learning-based adaptive gesture recognition of a soft e-skin patch with reduced training data and time10.1016/j.sna.2023.114693 ↗
74. A nIR fluorescent single walled carbon nanotube sensor for broad-spectrum diagnostics10.1039/D3SD00257H ↗
75. Human-like artificial skin sensor for physical human-robot interaction
76. Sensor design strategy for environmental and biological monitoring10.1002/eom2.12332 ↗
77. Artificial intelligence-oriented user interface design and human behavior recognition based on human–computer nature interaction10.1142/S0219843622500207 ↗
78. Measuring and improving user experience through artificial intelligence-aided design10.3389/fpsyg.2020.595374 ↗
79. Community-guided learning: exploiting mobile sensor users to model human behavior
80. Artificial Intelligence and User Experience in reciprocity: contributions and state of the art10.3233/IDT-230092 ↗
81. Myers · 2007 · 28 · 4710.1609/aimag.v28i2.2039 ↗
82. Intelligent in-vehicle interaction technologies10.1002/aisy.202100122 ↗
83. High spatiotemporal precision mapping of optical nanosensor array using machine learning10.1021/acssensors.4c01763 ↗
84. Integrated sensing-communication-computation for edge artificial intelligence10.1109/IOTM.001.2300146 ↗
85. Gas recognition in E-nose system: a review10.1109/TBCAS.2022.3166530 ↗
86. Perception modeling for human-like artificial sensor systems10.1016/j.ijhcs.2006.11.003 ↗
87. Development of sensitivity and active behavior of cognitive robot by means artificial intelligence10.33545/26648776.2020.v2.i1a.28 ↗
88. Bionic olfactory synaptic transistors for artificial neuromotor pathway construction and gas recognition10.1002/adfm.202401965 ↗
89. Robust tactile object recognition in open-set scenarios using Gaussian prototype learning10.3389/fnins.2022.1070645 ↗
90. Synaptic computation enabled by joule heating of single-layered semiconductors for sound localization10.1021/acs.nanolett.8b00994 ↗
91. Toward the development of combined artificial sensing systems for food quality evaluation: a review on the application of data fusion of electronic noses, electronic tongues and electronic eyes10.3390/s22020577 ↗
92. Food analysis using artificial senses10.1021/jf403215y ↗
93. Taste bud-inspired single-drop multitaste sensing for comprehensive flavor analysis with deep learning algorithms10.1021/acsami.3c09684 ↗
94. Perception-to-cognition tactile sensing based on artificial-intelligence-motivated human full-skin bionic electronic skin10.1002/adma.202202622 ↗
95. Ultrathin eardrum-inspired self-powered acoustic sensor for vocal synchronization recognition with the assistance of machine learning10.1002/smll.202106960 ↗
96. A robotic sensory system with high spatiotemporal resolution for texture recognition10.1038/s41467-023-42722-4 ↗
97. Advances in flexible sensors for intelligent perception system enhanced by artificial intelligence10.1002/inf2.12412 ↗
98. Bio-inspired sensory receptors for artificial-intelligence perception10.1002/adma.202403150 ↗
99. A review on machine learning principles for multi-view biological data integration10.1093/bib/bbw113 ↗
100. Deep learning in diverse intelligent sensor based systems10.3390/s23010062 ↗