journal article·2024Open access

Missing Value Imputation for Radar-Derived Time-Series Tracks of Aerial Targets Based on Improved Self-Attention-Based Network

Zihao Song, Yan Zhou, Wei Cheng, Futai Liang, Chenhao Zhang

Computers, Materials & Continua· Volume 78· Issue 3

Abstract

The frequent missing values in radar-derived time-series tracks of aerial targets (RTT-AT) lead to significant challenges in subsequent data-driven tasks. However, the majority of imputation research focuses on random missing (RM) that differs significantly from common missing patterns of RTT-AT. The method for solving the RM may experience performance degradation or failure when applied to RTT-AT imputation. Conventional autoregressive deep learning methods are prone to error accumulation and long-term dependency loss. In this paper, a non-autoregressive imputation model that addresses the issue of missing value imputation for two common missing patterns in RTT-AT is proposed. Our model consists of two probabilistic sparse diagonal masking self-attention (PSDMSA) units and a weight fusion unit. It learns missing values by combining the representations outputted by the two units, aiming to minimize the difference between the missing values and their actual values. The PSDMSA units effectively capture temporal dependencies and attribute correlations between time steps, improving imputation quality. The weight fusion unit automatically updates the weights of the output representations from the two units to obtain a more accurate final representation. The experimental results indicate that, despite varying missing rates in the two missing patterns, our model consistently outperforms other methods in imputation performance and exhibits a low frequency of deviations in estimates for specific missing entries. Compared to the state-of-the-art autoregressive deep learning imputation model Bidirectional Recurrent Imputation for Time Series (BRITS), our proposed model reduces mean absolute error (MAE) by 31%~50%. Additionally, the model attains a training speed that is 4 to 8 times faster when compared to both BRITS and a standard Transformer model when trained on the same dataset. Finally, the findings from the ablation experiments demonstrate that the PSDMSA, the weight fusion unit, cascade network design, and imputation loss enhance imputation performance and confirm the efficacy of our design.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Target Tracking and Data Fusion in Sensor Networks · Remote Sensing and LiDAR Applications · Advanced SAR Imaging Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (57)

Show source-provided references
1. Deep trajectory clustering with autoencoders
2. Mining regular behaviors based on multidimensional trajectories10.1016/j.eswa.2016.09.015 ↗
3. Trajectory clustering and an application to airspace monitoring10.1109/TITS.2011.2160628 ↗
4. A flight maneuver recognition method based on multi-strategy affine canonical time warping10.1016/j.asoc.2020.106527 ↗
5. An online ensemble semi-supervised classification framework for air combat target maneuver recognition10.1016/j.cja.2023.04.020 ↗
6. Jing · Advances in Guidance, Navigation and Control · 2022 · 510910.1007/978-981-15-8155-7_421 ↗
7. Quick intention identification of an enemy aerial target through information classification processing10.1016/j.ast.2022.108005 ↗
8. STABC-IR: An air target intention recognition method based on bidirectional gated recurrent unit and conditional random field with space-time attention mechanism10.1016/j.cja.2022.11.018 ↗
9. Air combat intention recognition with incomplete information based on decision tree and GRU network10.3390/e25040671 ↗
10. Outlier detection for temporal data: A survey10.1109/TKDE.2013.184 ↗
11. An approach to outlier detection and smoothing applied to a trajectography radar data10.5028/jatm.v6i3.325 ↗
12. Trajectory outlier detection: Algorithms, taxonomies, evaluation, and open challenges10.1145/3399631 ↗
13. A method for LSTM-based trajectory modeling and abnormal trajectory detection10.1109/ACCESS.2020.2997967 ↗
14. Threat assessment method of low altitude slow small (LSS) targets based on information entropy and AHP10.3390/e23101292 ↗
15. Interval TOPSIS with a novel interval number comprehensive weight for threat evaluation on uncertain information10.3233/JIFS-210945 ↗
16. The SSA-BP-based potential threat prediction for aerial target considering commander emotion10.1016/j.dt.2021.05.017 ↗
17. Target threat level assessment based on cloud model under fuzzy and uncertain conditions in air combat simulation10.1016/j.ast.2017.03.033 ↗
18. Tensor completion-based trajectory imputation approach in air traffic control10.1016/j.ast.2021.106754 ↗
19. Comparison of performance of data imputation methods for numeric dataset10.1080/08839514.2019.1637138 ↗
20. Swapping repair for misplaced attribute values
21. G. Batista, and M. C. Monard, “A study of k-nearest neighbour as an imputation method,” Presented at the Hybrid break=``Y" Intell. Syst., ser Front Artif. Intell. Appl., Jan. 2002, pp. 251–260.
22. Missing data imputation for traffic congestion data based on joint matrix factorization10.1016/j.knosys.2021.107114 ↗
23. Autoregressive matrix factorization for imputation and forecasting of spatiotemporal structural monitoring time series10.1016/j.ymssp.2021.108718 ↗
24. Imputation of missing data in time series for air pollutants10.1016/j.atmosenv.2014.11.049 ↗
25. Missing data: A comparison of neural network and expectation maximization techniques
26. SCREEN: Stream data cleaning under speed constraints
27. Enriching data imputation with extensive similarity neighbors10.14778/2809974.2809989 ↗
28. Deep residual learning for image recognition
29. J. Devlin, M. W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” arXiv:1810.04805 2019. doi: 10.48550/arXiv.1810.04805.
30. Golgi_DF: Golgi proteins classification with deep forest
31. CMSENN: Computational modification sites with ensemble neural network10.1016/j.chemolab.2018.12.009 ↗
32. A review of irregular time series data handling with gated recurrent neural networks10.1016/j.neucom.2021.02.046 ↗
33. Imputation of missing data in time series for air pollutants using long short-term memory recurrent neural networks
34. Time series imputation via integration of revealed information based on the residual shortcut connection10.1109/ACCESS.2019.2928641 ↗
35. Estimating missing data in temporal data streams using multi-directional recurrent neural networks10.1109/TBME.2018.2874712 ↗
36. BRITS: Bidirectional recurrent imputation for time series
37. Data scientist’s analysis toolbox: Comparison of python, R, and SAS performance
38. Empirical comparison of supervised learning techniques for missing value imputation10.1007/s10115-022-01661-0 ↗
39. A review of missing values handling methods on time-series data
40. D. Fung, “Methods for the estimation of missing values in time series,” Theses: Doctorates and Masters,” 2006 Accessed: Jan. 3, 2024. [Online]. Available: https://ro.ecu.edu.au/theses/63
41. Low-rank autoregressive tensor completion for spatiotemporal traffic data imputation10.1109/TITS.2021.3113608 ↗
42. Missing data imputation using fuzzy-rough methods10.1016/j.neucom.2016.04.015 ↗
43. Comparison of seventeen missing value imputation techniques
44. Efficient determination of distance thresholds for differential dependencies10.1109/TKDE.2013.84 ↗
45. Comparable dependencies over heterogeneous data10.1007/s00778-012-0285-7 ↗
46. Cleaning structured event logs: A graph repair approach
47. C. Fang, and C. Wang, “Time series data imputation: A survey on deep learning approaches,” arXiv:2011.11347, 2020. doi: 10.48550/arXiv.2011.11347.
48. Missing value imputation using decision trees and decision forests by splitting and merging records: Two novel techniques10.1016/j.knosys.2013.08.023 ↗
49. Single imputation with multilayer perceptron and multiple imputation combining multilayer perceptron and k-nearest neighbours for monotone patterns10.1016/j.asoc.2014.09.052 ↗
50. Random forest missing data algorithms, statistical analysis and data mining: The ASA
51. MBGAN: An improved generative adversarial network with multi-head self-attention and bidirectional RNN for time series imputation10.1016/j.engappai.2022.105232 ↗
52. Multivariate time series imputation with generative adversarial networks
53. BRNN-GAN: Generative adversarial networks with bi-directional recurrent neural networks for multivariate time series imputation
54. Improved techniques for training GANs
55. Vaswani · Advances in Neural Information Processing Systems 30 (NIPS 2017) · 2017
56. H. Zhou et al., “Informer: Beyond efficient transformer for long sequence time-series forecasting,” arXiv:2012.07436, 2021. doi: 10.48550/arXiv.2012.07436.10.1609/aaai.v35i12.17325 ↗
57. Missing value imputation for gene expression data: Computational techniques to recover missing data from available information10.1093/bib/bbq080 ↗