A Sensor Drift Compensation Method with a Masked Autoencoder Module
Source abstract
Abstract
Deep learning algorithms are widely used for pattern recognition in electronic noses, which are sensor arrays for gas mixtures. One of the challenges of using electronic noses is sensor drift, which can degrade the accuracy of the system over time, even if it is initially trained to accurately estimate concentrations from sensor data. In this paper, an effective drift compensation method is introduced that adds sensor drift information during training of a neural network that estimates gas concentrations. This is achieved by concatenating a calibration feature vector with sensor data and using this as an input to the neural network. The calibration feature vector is generated via a masked-autoencoder-based feature extractor trained with transfer samples, and acts as a prompt to convey sensor drift information. Our method is tested on a 3-year gas sensor array drift dataset, showing that a neural network using our method performs better than other models, including a network with additional fine tuning, demonstrating that our method is efficient at compensating for sensor drift. In this study, the effectiveness of using prompts for network training is confirmed, which better compensates for drifts in new sensor signals than network fine-tuning.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Chemical Sensor Technologies · Gas Sensing Nanomaterials and Sensors · Insect Pheromone Research and Control
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Electrical Engineering, Korea Advanced Institute of Science and Technology, Daejeon 34141, Republic of Korea
Robot Innovation Group, Samsung Display Co., Yongin-si 17113, Republic of Korea
Chem-Bio Technology Center, Agency for Defense Development, Daejeon 34186, Republic of Korea
Funding
Korean Government
References (38)
Show source-provided references
1. Handling non-stationarity in E-nose design: A review10.1108/SR-02-2021-0038 ↗
2. Electronic nose and its applications: A survey10.1007/s11633-019-1212-9 ↗
3. Połap, D., Srivastava, G., and Jaszcz, A. (2023). Energy consumption prediction model for smart homes via decentralized federated learning with LSTM. IEEE Trans. Consum. Electron., 1.10.1109/TCE.2023.3325941 ↗
4. A calibration method for handling the temporal drift of solid state gas-sensors10.1016/S0003-2670(99)00784-9 ↗
5. Calibration update and drift correction for electronic noses and tongues10.3389/fchem.2018.00433 ↗
6. Laref, R., Losson, E., Sava, A., Adjallah, K., and Siadat, M. (2018, January 19–22). A comparison between SVM and PLS for E-nose based gas concentration monitoring. Proceedings of the 2018 IEEE International Conference on Industrial Technology (ICIT), Lyon, France.10.1109/ICIT.2018.8352372 ↗
7. Ye, Z., Liu, Y., and Li, Q. (2021). Recent progress in smart electronic nose technologies enabled with machine learning methods. Sensors, 21.10.3390/s21227620 ↗
8. Jang, H.D., Park, J.H., Nam, H., and Chang, D.E. (December, January 27). Deep neural networks for gas concentration estimation and the effect of hyperparameter optimization on the estimation performance. Proceedings of the 2022 22nd International Conference on Control, Automation and Systems (ICCAS), Busan, Republic Korea.10.23919/ICCAS55662.2022.10003915 ↗
9. Caterini, A.L., and Chang, D.E. (2018). Deep Neural Networks in a Mathematical Framework, Springer.10.1007/978-3-319-75304-1 ↗
10. A novel high accuracy fast gas detection algorithm based on multi-task learning10.1016/j.measurement.2024.114383 ↗
11. Anti-drift in E-nose: A subspace projection approach with drift reduction10.1016/j.snb.2017.06.156 ↗
12. A concentration-based drift calibration transfer learning method for gas sensor array data10.1109/LSENS.2020.3027959 ↗
13. Hybrid 3DCNN-RBM network for gas mixture concentration estimation with sensor array10.1109/JSEN.2021.3105414 ↗
14. Deep learning-based gas identification and quantification with auto-tuning of hyper-parameters10.1007/s00500-021-06222-1 ↗
15. Gas identification with drift counteraction for electronic noses using augmented convolutional neural network10.1016/j.snb.2021.130986 ↗
16. Ma, Z., Luo, G., Qin, K., Wang, N., and Niu, W. (2018). Online sensor drift compensation for E-nose systems using domain adaptation and extreme learning machine. Sensors, 18.10.3390/s18030742 ↗
17. Online drift compensation by adaptive active learning on mixed kernel for electronic noses10.1016/j.snb.2020.128065 ↗
18. Online drift compensation framework based on active learning for gas classification and concentration prediction10.1016/j.snb.2023.134716 ↗
19. Petroni, F., Rocktäschel, T., Lewis, P., Bakhtin, A., Wu, Y., Miller, A.H., and Riedel, S. (2019). Language models as knowledge bases?. arXiv.10.18653/v1/D19-1250 ↗
20. Exploring the limits of transfer learning with a unified text-to-text transformer
21. Schick, T., and Schütze, H. (2020). Exploiting cloze questions for few shot text classification and natural language inference. arXiv.10.18653/v1/2021.eacl-main.20 ↗
22. Language models are few-shot learners
23. Shin, T., Razeghi, Y., Logan IV, R.L., Wallace, E., and Singh, S. (2020). Autoprompt: Eliciting knowledge from language models with automatically generated prompts. arXiv.10.18653/v1/2020.emnlp-main.346 ↗
24. Gao, T., Fisch, A., and Chen, D. (2020). Making pre-trained language models better few-shot learners. arXiv.10.18653/v1/2021.acl-long.295 ↗
25. Liu, X., Ji, K., Fu, Y., Tam, W., Du, Z., Yang, Z., and Tang, J. (2022, January 22–27). P-tuning: Prompt tuning can be comparable to fine-tuning across scales and tasks. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers), Dublin, Ireland.10.18653/v1/2022.acl-short.8 ↗
26. Liu, X., Zheng, Y., Du, Z., Ding, M., Qian, Y., Yang, Z., and Tang, J. (2023). GPT understands, too. AI Open, in press.10.1016/j.aiopen.2023.08.012 ↗
27. Chemical gas sensor drift compensation using classifier ensembles10.1016/j.snb.2012.01.074 ↗
28. Lu, S., Guo, J., Liu, S., Yang, B., Liu, M., Yin, L., and Zheng, W. (2022). An improved algorithm of drift compensation for olfactory sensors. Appl. Sci., 12.10.3390/app12199529 ↗
29. Domain adaptation extreme learning machines for drift compensation in E-nose systems10.1109/TIM.2014.2367775 ↗
30. Jiang, Q., Zhang, Y., Zhang, Y., Liu, J., Xu, M., Ma, C., and Jia, P. (2024, March 19). An Adversarial Network Used for Drift Correction in Electronic Nose. Available online: https://ssrn.com/abstract=4725735.10.2139/ssrn.4725735 ↗
31. Characteristics of semiconductor gas sensors I. Steady state gas response10.1016/0250-6874(82)80026-7 ↗
32. Temperature and temporal drift compensation for Al2O3-gate ISFET-based pH sensor using machine learning techniques10.1016/j.mejo.2020.104710 ↗
33. He, K., Chen, X., Xie, S., Li, Y., Dollár, P., and Girshick, R. (2022, January 18–24). Masked autoencoders are scalable vision learners. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01553 ↗
34. Research and application of improved gas concentration prediction model based on grey theory and BP neural network in digital mine10.1016/j.procir.2016.10.092 ↗
35. Multi hours ahead prediction of surface ozone gas concentration: Robust artificial intelligence approach10.1016/j.apr.2020.06.024 ↗
36. Use of partial least squares (PLS) in strategic management research: A review of four recent studies10.1002/(SICI)1097-0266(199902)20:2<195::AID-SMJ13>3.0.CO;2-7 ↗
37. Some recent developments in PLS modeling10.1016/S0169-7439(01)00156-3 ↗
38. Partial least squares (PLS) methods: Origins, evolution, and application to social sciences10.1080/03610921003778225 ↗