Sensor Fault Detection and Classification Using Multi-Step-Ahead Prediction with an Long Short-Term Memoery (LSTM) Autoencoder
Source abstract
Abstract
The Internet of Things (IoT) is witnessing a surge in sensor-equipped devices. The data generated by these IoT devices serve as a critical foundation for informed decision-making, real-time insights, and innovative solutions across various applications in everyday life. However, data reliability is often compromised due to the vulnerability of sensors to faults arising from harsh operational conditions that can adversely affect the subsequent operations that depend on the collected data. Hence, the identification of anomalies within sensor-derived data holds significant importance in the IoT context. This article proposes a sensor fault detection method using a Long Short-Term Memory autoencoder (LSTM-AE). The AE, trained on normal sensor data, predicts a 20-step window, generating three statistical features via SHapley Additive exPlanations from the estimated steps. These features aid in determining potential faults in the predicted steps using a machine learning classifier. A secondary classifier identifies the type of fault in the sensor signal. Experimentation on two sensor datasets showcases the method’s functionality, achieving fault detection accuracies of approximately 93% and 97%. It is possible to attain a perfect fault classification performance by slightly modifying the feature calculation approach. In a univariate prediction scenario, our proposed approach demonstrates good fault detection and classification performance.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Fault Detection and Control Systems · Anomaly Detection Techniques and Applications · Machine Fault Diagnosis Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical, Electronic and Computer Engineering, University of Ulsan, 93 Daehak-ro, Nam-gu, Ulsan 44610, Republic of Korea
School of Computing, Engineering and Built Environment, Edinburgh Napier University, Edinburgh EH10 5DT, UK
Funding
Regional Innovation Strategy (RIS) · Ministry of Education (MOE)
References (55)
Show source-provided references
1. An IoT-based interoperable architecture for wireless biomonitoring of patients with sensor patches10.1016/j.iot.2022.100547 ↗
2. An IoT-Based Healthcare Platform for Patients in ICU Beds During the COVID-19 Outbreak10.1109/ACCESS.2021.3058448 ↗
3. Forcén-Muñoz, M., Pavón-Pulido, N., López-Riquelme, J.A., Temnani-Rajjaf, A., Berríos, P., Morais, R., and Pérez-Pastor, A. (2021). Irriman platform: Enhancing farming sustainability through cloud computing techniques for irrigation management. Sensors, 22.10.3390/s22010228 ↗
4. Mendes, J., Peres, E., Neves dos Santos, F., Silva, N., Silva, R., Sousa, J.J., Cortez, I., and Morais, R. (2022). VineInspector: The vineyard assistant. Agriculture, 12.10.3390/agriculture12050730 ↗
5. Ahmed, M.A., Gallardo, J.L., Zuniga, M.D., Pedraza, M.A., Carvajal, G., Jara, N., and Carvajal, R. (2022). LoRa based IoT platform for remote monitoring of large-scale agriculture farms in Chile. Sensors, 22.10.3390/s22082824 ↗
6. Bates, H., Pierce, M., and Benter, A. (2021). Real-time environmental monitoring for aquaculture using a LoRaWAN-based IoT sensor network. Sensors, 21.10.3390/s21237963 ↗
7. Khan, F., Siddiqui, M.A.B., Rehman, A.U., Khan, J., Asad, M.T.S.A., and Asad, A. (2020, January 22–23). IoT based power monitoring system for smart grid applications. Proceedings of the 2020 International Conference on Engineering and Emerging Technologies (ICEET), Lahore, Pakistan.10.1109/ICEET48479.2020.9048229 ↗
8. Shashank, A., Vincent, R., Sivaraman, A.K., Balasundaram, A., Rajesh, M., and Ashokkumar, S. (2021, January 30–31). Power analysis of household appliances using IoT. Proceedings of the 2021 International Conference on System, Computation, Automation and Networking (ICSCAN), Puducherry, India.10.1109/ICSCAN53069.2021.9526428 ↗
9. Power theft detection and alert system using IOT
10. Cloud-based IoT applications and their roles in smart cities10.3390/smartcities4030064 ↗
11. Padmanaban, S., Samavat, T., Nasab, M.A., Nasab, M.A., Zand, M., and Nikokar, F. (2023). Electric vehicles and IoT in smart cities. Artificial Intelligence-Based Smart Power Systems, John Wiley & Sons, Inc.10.1201/9781003331117-9 ↗
12. Sunny, A.I., Zhao, A., Li, L., and Sakiliba, S.K. (2020). Low-cost IoT-based sensor system: A case study on harsh environmental monitoring. Sensors, 21.10.3390/s21010214 ↗
13. Aryal, S., Baniya, A.A., and Santosh, K. (2019). Improved histogram-based anomaly detector with the extended principal component features. arXiv.
14. Recent advances in sensor fault diagnosis: A review10.1016/j.sna.2020.111990 ↗
15. Deep convolutional neural network model based chemical process fault diagnosis10.1016/j.compchemeng.2018.04.009 ↗
16. Sensor fault classification based on support vector machine and statistical time-domain features10.1109/ACCESS.2017.2705644 ↗
17. Peng, D., Yun, S., Yin, D., Shen, B., Xu, C., and Zhang, H. (2021, January 20–22). A sensor fault diagnosis method for gas turbine control system based on EMD and SVM. Proceedings of the 2021 Power System and Green Energy Conference (PSGEC), Shanghai, China.10.1109/PSGEC51302.2021.9541594 ↗
18. Sensor fault diagnosis method based on-grey wolf optimization-support vector machine10.1155/2021/1956394 ↗
19. Fault detection and isolation of a pressurized water reactor based on neural network and k-nearest neighbor10.1109/ACCESS.2022.3149772 ↗
20. Quadratic support vector machine and K-nearest neighbor based robust sensor fault detection and isolation10.30684/etj.v39i5A.2002 ↗
21. Fault diagnosis based on extremely randomized trees in wireless sensor networks10.1016/j.ress.2020.107284 ↗
22. Huang, J., Li, M., Zhang, Y., Mu, L., Ao, Z., and Gong, H. (2021, January 26–28). Fault detection and classification for sensor faults of UAV by deep learning and time-frequency analysis. Proceedings of the 2021 40th Chinese Control Conference (CCC), Shanghai, China.10.23919/CCC52363.2021.9550141 ↗
23. Aeroengine control system sensor fault diagnosis based on CWT and CNN10.1155/2020/5357146 ↗
24. Zhao, T., Zhang, H., Zhang, X., Sun, Y., Dou, L., and Wu, S. (2021, January 23–27). Multi-fault identification of iron oxide gas sensor based on CNN-wavelelet-based network. Proceedings of the 2021 19th International Conference on Optical Communications and Networks (ICOCN), Qufu, China.10.1109/ICOCN53177.2021.9563630 ↗
25. Toma, R.N., Piltan, F., and Kim, J.M. (2021). A deep autoencoder-based convolution neural network framework for bearing fault classification in induction motors. Sensors, 21.10.3390/s21248453 ↗
26. FDI attack detection using extra trees algorithm and deep learning algorithm-autoencoder in smart grid10.1016/j.ijcip.2022.100508 ↗
27. Adversarial Autoencoder Based Feature Learning for Fault Detection in Industrial Processes10.1109/TII.2021.3078414 ↗
28. Temporal convolutional autoencoder for unsupervised anomaly detection in time series10.1016/j.asoc.2021.107751 ↗
29. Impact of Covid-19 pandemic on electricity demand in the UK based on multivariate time series forecasting with Bidirectional Long Short Term Memory10.1016/j.energy.2021.120455 ↗
30. Multivariate time series forecasting via attention-based encoder–decoder framework10.1016/j.neucom.2019.12.118 ↗
31. Gangopadhyay, T., Tan, S.Y., Jiang, Z., Meng, R., and Sarkar, S. (2021, January 6–11). Spatiotemporal attention for multivariate time series prediction and interpretation. Proceedings of the ICASSP 2021–2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Toronto, ON, Canada.10.1109/ICASSP39728.2021.9413914 ↗
32. Fault detection with LSTM-based variational autoencoder for maritime components10.1109/JSEN.2021.3105226 ↗
33. A variational autoencoder for a semiconductor fault detection model robust to process drift due to incomplete maintenance10.1007/s10845-021-01810-2 ↗
34. CNN and Convolutional Autoencoder (CAE) based real-time sensor fault detection, localization, and correction10.1016/j.ymssp.2021.108723 ↗
35. A novel transformer-based multi-variable multi-step prediction method for chemical process fault prognosis10.1016/j.psep.2022.11.062 ↗
36. Analyzing the Impact of Outlier Data Points on Multi-Step Internet Traffic Prediction using Deep Sequence Models10.1109/TNSM.2023.3262406 ↗
37. Gradual Leak Detection in Water Distribution Networks Based on Multistep Forecasting Strategy10.1061/JWRMD5.WRENG-6001 ↗
38. multi-step-ahead voltage prediction and voltage fault diagnosis based on gated recurrent unit neural network and incremental training10.1016/j.energy.2022.126496 ↗
39. Tool health monitoring and prediction via attention-based encoder–decoder with a multi-step mechanism10.1007/s00170-022-09894-7 ↗
40. Deep Learning Approach for Sensor Data Prediction and Sensor Fault Diagnosis in Wind Turbine Blade10.1109/ACCESS.2022.3219480 ↗
41. Wasserstein GAN-based digital twin-inspired model for early drift fault detection in wireless sensor networks10.1109/JSEN.2023.3272908 ↗
42. Friend-guard adversarial noise designed for electroencephalogram-based brain–computer interface spellers10.1016/j.neucom.2022.06.089 ↗
43. Multi-targeted audio adversarial example for use against speech recognition systems10.1016/j.cose.2023.103168 ↗
44. Safavi, S., Safavi, M.A., Hamid, H., and Fallah, S. (2021). Multi-sensor fault detection, identification, isolation and health forecasting for autonomous vehicles. Sensors, 21.10.3390/s21072547 ↗
45. Sensor-fault detection, isolation and accommodation for digital twins via modular data-driven architecture10.1109/JSEN.2020.3029459 ↗
46. Informer: Beyond efficient transformer for long sequence time-series forecasting
47. Suthaharan, S., Alzahrani, M., Rajasegarar, S., Leckie, C., and Palaniswami, M. (2010, January 7–10). Labelled data collection for anomaly detection in wireless sensor networks. Proceedings of the 2010 sixth international conference on intelligent sensors, sensor networks and information processing, Brisbane, QLD, Australia.10.1109/ISSNIP.2010.5706782 ↗
48. Saeed, U., Lee, Y.D., Jan, S.U., and Koo, I. (2021). CAFD: Context-aware fault diagnostic scheme towards sensor faults utilizing machine learning. Sensors, 21.10.3390/s21020617 ↗
49. Sensor drift fault diagnosis for chiller system using deep recurrent canonical correlation analysis and k-nearest neighbor classifier10.1016/j.isatra.2021.04.037 ↗
50. A new convolutional neural network with random forest method for hydrogen sensor fault diagnosis10.1109/ACCESS.2020.2992231 ↗
51. Lundberg, S.M., and Lee, S.I. (2017, January 4–9). A unified approach to interpreting model predictions. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA.
52. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗
53. Probabilistic LSTM-Autoencoder Based Hour-Ahead Solar Power Forecasting Model for Intra-Day Electricity Market Participation: A Polish Case Study10.1109/ACCESS.2022.3215080 ↗
54. Aksan, F., Li, Y., Suresh, V., and Janik, P. (2023). Multistep Forecasting of Power Flow Based on LSTM Autoencoder: A Study Case in Regional Grid Cluster Proposal. Energies, 16.10.3390/en16135014 ↗
55. A distributed sensor-fault detection and diagnosis framework using machine learning10.1016/j.ins.2020.08.068 ↗