journal article·2022-06-21Open access

Unsupervised Anomaly Detection for Time Series Data of Spacecraft Using Multi-Task Learning

Kaifei Yang, Yakun Wang, Xiaodong Han, Yuehua Cheng, Lifang Guo, Jianglei Gong

Applied Sciences· Volume 12· Issue 13

Abstract

Although in-orbit anomaly detection is extremely important to ensure spacecraft safety, the complex spatial-temporal correlation and sparsity of anomalies in the data pose significant challenges. This study proposes the new multi-task learning-based time series anomaly detection (MTAD) method, which captures the spatial-temporal correlation of the data to learn the generalized normal patterns and hence facilitates anomaly detection. First, four proxy tasks are implemented for feature extraction through joint learning: (1) Long short-term memory-based data prediction; (2) autoencoder-based latent representation learning and data reconstruction; (3) variational autoencoder-based latent representation learning and data reconstruction; and (4) joint latent representation-based data prediction. Proxy Tasks 1 and 4 capture the temporal correlation of the data by fusing the latent space, whereas Tasks 2 and 3 fully capture the spatial correlation of the data. The isolation forest algorithm then detects anomalies from the extracted features. Application to a real spacecraft dataset reveals the superiority of our method over existing techniques, and further ablation testing for each task proves the effectiveness of fusing multiple tasks. The proposed MTAD method demonstrates promising potential for effective in-orbit anomaly detection for spacecraft.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Anomaly Detection Techniques and Applications · Time Series Analysis and Forecasting · Data-Driven Disease Surveillance

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute of Telecommunication and Navigation Satellites, China Academy of Space Technology, Beijing 100094, China

College of Automation Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing 210016, China

School of Aerospace Science and Technology, Xidian University, Xi’an 710071, China

Funding

National Natural Science Foundation of China · Key Research Program

References (44)

Show source-provided references
1. Barreyre, C., Boussouf, L., Cabon, B., Laurent, B., and Loubes, J.-M. (2019). Statistical methods for outlier detection in space telemetries. Space Operations: Inspiring Humankind’s Future, Springer.10.1007/978-3-030-11536-4_20 ↗
2. Fujimaki, R., Yairi, T., and Machida, K. (2005, January 21). An approach to spacecraft anomaly detection problem using kernel feature space. Proceedings of the Eleventh ACM SIGKDD International Conference on Knowledge Discovery in Data Mining, Chicago, IL, USA.10.1145/1081870.1081917 ↗
3. Anomaly detection: A survey10.1145/1541880.1541882 ↗
4. Review on anomaly detection of spacecraft telemetry data
5. Fuertes, S., Picart, G., Tourneret, J.-Y., Chaari, L., Ferrari, A., and Richard, C. (2016, January 16–20). Improving spacecraft health monitoring with automatic anomaly detection techniques. Proceedings of the 14th International Conference on Space Operations, Daejeon, Korea.10.2514/6.2016-2430 ↗
6. Hundman, K., Constantinou, V., Laporte, C., Colwell, I., and Soderstrom, T. (2018, January 19–23). Detecting spacecraft anomalies using lstms and nonparametric dynamic thresholding. Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, London, UK.10.1145/3219819.3219845 ↗
7. Ding, N., Gao, H., Bu, H., Ma, H., and Si, H. (2018). Multivariate-time-series-driven real-time anomaly detection based on bayesian network. Sensors, 18.10.3390/s18103367 ↗
8. Su, Y., Zhao, Y., Niu, C., Liu, R., Sun, W., and Pei, D. (2019, January 4–8). Robust anomaly detection for multivariate time series through stochastic recurrent neural network. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA.10.1145/3292500.3330672 ↗
9. Geiger, A., Liu, D., Alnegheimish, S., Cuesta-Infante, A., and Veeramachaneni, K. (2020, January 10–13). TadGAN: Time series anomaly detection using generative adversarial networks. Proceedings of the 2020 IEEE International Conference on Big Data (Big Data), Atlanta, GA, USA.10.1109/BigData50022.2020.9378139 ↗
10. Space-time signal processing for distributed pattern detection in sensor networks10.1109/JSTSP.2012.2237381 ↗
11. Latecki, L.J., Lazarevic, A., and Pokrajac, D. (2007). Outlier detection with kernel density functions. International Workshop on Machine Learning and Data Mining in Pattern Recognition, Springer.10.1007/978-3-540-73499-4_6 ↗
12. Estimating the support of a high-dimensional distribution10.1162/089976601750264965 ↗
13. Sakurada, M., and Yairi, T. (2014, January 2). Anomaly detection using autoencoders with nonlinear dimensionality reduction. Proceedings of the MLSDA 2014 2nd Workshop on Machine Learning for Sensory Data Analysis, Gold Coast, Australia.10.1145/2689746.2689747 ↗
14. Zhang, Y., Chen, Y., Wang, J., and Pan, Z. (2021). Unsupervised deep anomaly detection for multi-sensor time-series signals. IEEE Trans. Knowl. Data Eng.10.1109/TKDE.2021.3102110 ↗
15. Li, Z., Zhao, Y., Han, J., Su, Y., Jiao, R., Wen, X., and Pei, D. (2021, January 14–18). Multivariate Time Series Anomaly Detection and Interpretation using Hierarchical Inter-Metric and Temporal Embedding. Proceedings of the 27th ACM SIGKDD Conference on Knowledge Discovery & Data Mining, Washington, DA, USA.10.1145/3447548.3467075 ↗
16. A survey of spacecraft autonomous fault diagnosis research
17. Design and Implementation of Autonomous Health Management System for GF-3 Satellite
18. Early Fault Diagnosis Method of Rolling Bearings Based on Optimization of VMD and MCKD
19. Hierarchical fault detection for nano-pico satellite attitude control system
20. Small fault detection method for actuator of satellite attitude control system
21. Spacecraft Anomaly Recognition Based on Morphological Variational Mode Decomposition and JRD10.1051/jnwpu/20183610020 ↗
22. Fault detection and isolation of control moment gyros for satellite attitude control subsystem10.1016/j.ymssp.2019.106419 ↗
23. Deep learning10.1038/nature14539 ↗
24. Chalapathy, R., and Chawla, S. (2019). Deep learning for anomaly detection: A survey. arXiv.10.1145/3394486.3406704 ↗
25. Fault diagnosis of satellite attitude actuator based on recurrent neural network
26. Deep learning theory with application in intelligent fault diagnosis of aircraft10.3901/JME.2019.07.027 ↗
27. Satellite Telemetry Data Anomaly Detection Using Causal Network and Feature-Attention-Based LSTM
28. Multitask learning10.1023/A:1007379606734 ↗
29. Survey on multi-output learning
30. Zhang, Y., and Yang, Q. (2021). A survey on multi-task learning. IEEE Trans. Knowl. Data Eng.10.1109/TKDE.2021.3070203 ↗
31. Ruder, S. (2017). An overview of multi-task learning in deep neural networks. arXiv.
32. Georgescu, M.-I., Barbalau, A., Ionescu, R.T., Khan, F.S., Popescu, M., and Shah, M. (2021, January 20–25). Anomaly detection in video via self-supervised and multi-task learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA.10.1109/CVPR46437.2021.01255 ↗
33. Deep multitask learning for railway track inspection10.1109/TITS.2016.2568758 ↗
34. Jezequel, L., Vu, N.-S., Beaudet, J., and Histace, A. (2021, January 16–19). Fine-grained anomaly detection via multi-task self-supervision. Proceedings of the 17th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), Washington, DC, USA.10.1109/AVSS52988.2021.9663783 ↗
35. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
36. Bai, S., Kolter, J.Z., and Koltun, V. (2018). An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv.
37. Oord, A.v.d., Dieleman, S., Zen, H., Simonyan, K., Vinyals, O., Graves, A., Kalchbrenner, N., Senior, A., and Kavukcuoglu, K. (2016). Wavenet: A generative model for raw audio. arXiv.
38. Yu, F., and Koltun, V. (2015). Multi-scale context aggregation by dilated convolutions. arXiv.
39. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
40. Kingma, D.P., and Welling, M. (2013). Auto-encoding variational bayes. arXiv.
41. Liu, F.T., Ting, K.M., and Zhou, Z.-H. (2008, January 15–19). Isolation forest. Proceedings of the 2008 Eighth IEEE International Conference on Data Mining, Pisa, Italy.10.1109/ICDM.2008.17 ↗
42. A Deep Learning Anomaly Detection Framework for Satellite Telemetry with Fake Anomalies
43. Akosa, J. (2017, January 2–5). Predictive accuracy: A misleading performance measure for highly imbalanced data. Proceedings of the SAS Global Forum, Orlando, FL, USA.
44. Malhotra, P., Ramakrishnan, A., Anand, G., Vig, L., Agarwal, P., and Shroff, G. (2016). LSTM-based encoder-decoder for multi-sensor anomaly detection. arXiv.