journal article·2024-05-28

Integration of MoS2 Memtransistor Devices and Analogue Circuits for Sensor Fusion in Autonomous Vehicle Target Localization

Tian Tan, Haoyue Guo, Yida Li, Yafei Wang, Weiwei Cai, Wenzhong Bao, Peng Zhou, Xuewei Feng

ACS Nano· Volume 18· Issue 21
Publisher page

Abstract

In contemporary autonomous driving systems relying on sensor fusion, traditional digital processors encounter challenges associated with analogue-to-digital conversion and iterative vector–matrix operations, which are encumbered by limitations in terms of response time and energy consumption. In this study, we present an analogue Kalman filter circuit based on molybdenum disulfide (MoS 2 ) memtransistor, designed to accelerate sensor fusion for precise localization in autonomous vehicle applications. The nonvolatile memory characteristics of the memtransistor allow for the storage of a fixed Kalman gain, which eliminates the data convergence and thus accelerates the processing speeds. Additionally, the modulation of multiple conductance states by the gate terminal enables fast adaptability to diverse autonomous driving scenarios by tuning multiple Kalman filter gains. Our proposed analogue Kalman filter circuit accurately estimates the position coordinates of target vehicles by fusing sensor data from light detection and ranging (LiDAR), millimeter-wave radar (Radar), and camera, and it successfully solves real-word problems in a signal-free crossroad intersection. Notably, our system achieves a 1000-fold improvement in energy efficiency compared to that of digital circuits. This work underscores the viability of a memtransistor for achieving fast, energy-efficient real-time sensing, and continuous signal processing in advanced sensor fusion technology.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Memory and Neural Computing · Robotics and Automated Systems · Infrared Target Detection Methodologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China

School of Microelectronics, Southern University of Science and Technology, Shenzhen 518055, China

School of Microelectronics, Fudan University, Shanghai 200433, China

Shaoxing Laboratory, Shaoxing 312300, China

Funding

Fudan University · National Key Research and Development Program of China · Shenzhen Fundamental Research Program · Department of Education of Guangdong Province · National Natural Science Foundation of China · Zhujiang Young Talent Program

References (51)

Show source-provided references
1. Elmenreich, W. An Introduction to Sensor Fusion; Vienna University of Technology: Austria, 2002; Vol. 502, pp 1–28.
2. 10.1038/s41928-023-00950-y10.1038/s41928-023-00950-y ↗
3. 10.1038/s41467-020-18375-y10.1038/s41467-020-18375-y ↗
4. 10.1038/s41928-022-00847-210.1038/s41928-022-00847-2 ↗
5. 10.1002/adsr.20220003410.1002/adsr.202200034 ↗
6. 10.1038/s41467-023-40686-z10.1038/s41467-023-40686-z ↗
7. 10.1038/s41467-022-30564-510.1038/s41467-022-30564-5 ↗
8. 10.1109/TIV.2023.326465810.1109/TIV.2023.3264658 ↗
9. Bijelic, M.; Gruber, T.; Mannan, F.; Kraus, F.; Ritter, W.; Dietmayer, K.; Heide, F. Seeing Through Fog Without Seeing Fog: Deep Multimodal Sensor Fusion in Unseen Adverse Weather 2020; pp 11679–11689.10.1109/CVPR42600.2020.01170 ↗
10. 10.1038/s41598-023-30406-410.1038/s41598-023-30406-4 ↗
11. 10.1038/s41598-023-40961-510.1038/s41598-023-40961-5 ↗
12. 10.1038/s42256-022-00520-510.1038/s42256-022-00520-5 ↗
13. 10.1109/TITS.2020.304481310.1109/TITS.2020.3044813 ↗
14. 10.1177/095965182097552310.1177/0959651820975523 ↗
15. 10.1109/MSP.2016.262891410.1109/MSP.2016.2628914 ↗
16. Ogawa, T.; Sakai, H.; Suzuki, Y.; Takagi, K.; Morikawa, K. Pedestrian detection and tracking using in-vehicle lidar for automotive application 2011; pp 734–739.10.1109/IVS.2011.5940555 ↗
17. 10.1126/scirobotics.abb693810.1126/scirobotics.abb6938 ↗
18. 10.1038/s41467-020-18105-410.1038/s41467-020-18105-4 ↗
19. 10.1038/s41928-018-0054-810.1038/s41928-018-0054-8 ↗
20. 10.1038/s41928-018-0100-610.1038/s41928-018-0100-6 ↗
21. 10.1073/pnas.181568211610.1073/pnas.1815682116 ↗
22. 10.1126/sciadv.aay237810.1126/sciadv.aay2378 ↗
23. 10.1038/nature0693210.1038/nature06932 ↗
24. 10.1038/s41563-019-0291-x10.1038/s41563-019-0291-x ↗
25. 10.1080/23746149.2016.125958510.1080/23746149.2016.1259585 ↗
26. 10.1038/s41928-018-0023-210.1038/s41928-018-0023-2 ↗
27. 10.1038/s41467-018-04484-210.1038/s41467-018-04484-2 ↗
28. 10.1038/nature2574710.1038/nature25747 ↗
29. 10.1002/adfm.20190110610.1002/adfm.201901106 ↗
30. 10.1021/acsnano.9b0742110.1021/acsnano.9b07421 ↗
31. 10.1021/acsnano.0c0944110.1021/acsnano.0c09441 ↗
32. 10.1002/adfm.20200368310.1002/adfm.202003683 ↗
33. 10.1063/5.003179910.1063/5.0031799 ↗
34. 10.1016/j.nanoen.2023.10833310.1016/j.nanoen.2023.108333 ↗
35. 10.1039/D2NR06853B10.1039/D2NR06853B ↗
36. 10.1021/acsnano.2c0787710.1021/acsnano.2c07877 ↗
37. 10.1038/s41565-021-00963-810.1038/s41565-021-00963-8 ↗
38. 10.1038/s41467-022-33053-x10.1038/s41467-022-33053-x ↗
39. 10.1038/s41563-023-01671-510.1038/s41563-023-01671-5 ↗
40. 10.1038/s41467-021-26230-x10.1038/s41467-021-26230-x ↗
41. 10.1038/s41586-023-05973-110.1038/s41586-023-05973-1 ↗
42. 10.1038/s41928-023-01064-110.1038/s41928-023-01064-1 ↗
43. 10.1038/s41563-023-01704-z10.1038/s41563-023-01704-z ↗
44. 10.1038/s41928-020-0460-610.1038/s41928-020-0460-6 ↗
45. 10.1038/s41467-022-30519-w10.1038/s41467-022-30519-w ↗
46. 10.1002/adfm.20230294910.1002/adfm.202302949 ↗
47. 10.1038/s41566-023-01158-410.1038/s41566-023-01158-4 ↗
48. 10.1016/j.sigpro.2017.01.00210.1016/j.sigpro.2017.01.002 ↗
49. 10.1021/acsnano.2c0450410.1021/acsnano.2c04504 ↗
50. Yu, H.; Luo, Y.; Shu, M.; Huo, Y.; Yang, Z.; Shi, Y.; Guo, Z.; Li, H.; Hu, X.; Yuan, J.; Nie, Z. DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detection, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022; pp 21329–21338.10.1109/CVPR52688.2022.02067 ↗
51. Kocić, J.; Jovičić, N.; Drndarević, V. Sensors and Sensor Fusion in Autonomous Vehicles, 2018 26th Telecommunications Forum (TELFOR), 2018; pp 420–425.10.1109/TELFOR.2018.8612054 ↗