journal article·2021-11-29Open access

Tri-Partition Alphabet-Based State Prediction for Multivariate Time-Series

Zuo-Cheng Wen, Zhi-Heng Zhang, Xiang-Bing Zhou, Jian-Gang Gu, Shao-Peng Shen, Gong-Suo Chen, Wu Deng

Applied Sciences· Volume 11· Issue 23

Abstract

Recently, predicting multivariate time-series (MTS) has attracted much attention to obtain richer semantics with similar or better performances. In this paper, we propose a tri-partition alphabet-based state (tri-state) prediction method for symbolic MTSs. First, for each variable, the set of all symbols, i.e., alphabets, is divided into strong, medium, and weak using two user-specified thresholds. With the tri-partitioned alphabet, the tri-state takes the form of a matrix. One order contains the whole variables. The other is a feature vector that includes the most likely occurring strong, medium, and weak symbols. Second, a tri-partition strategy based on the deviation degree is proposed. We introduce the piecewise and symbolic aggregate approximation techniques to polymerize and discretize the original MTS. This way, the symbol is stronger and has a bigger deviation. Moreover, most popular numerical or symbolic similarity or distance metrics can be combined. Third, we propose an along–across similarity model to obtain the k-nearest matrix neighbors. This model considers the associations among the time stamps and variables simultaneously. Fourth, we design two post-filling strategies to obtain a completed tri-state. The experimental results from the four-domain datasets show that (1) the tri-state has greater recall but lower precision; (2) the two post-filling strategies can slightly improve the recall; and (3) the along–across similarity model composed by the Triangle and Jaccard metrics are first recommended for new datasets.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Time Series Analysis and Forecasting · Advanced Text Analysis Techniques · Sensory Analysis and Statistical Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Information and Engineering, Sichuan Tourism University, Chengdu 610100, China

School of Resources and Environment, University of Electronic Science and Technology of China, Chengdu 611731, China

School of Software Engineering, Chengdu University of Information Technology, Chengdu 610225, China

School of Electronic Information and Automation, Civil Aviation University of China, Tianjing 300300, China

Funding

the National Natural Science Foundation of China · the Sichuan Science and Technology Program · the Scientific Research and Innovation Team of Sichuan Tourism University

References (56)

Show source-provided references
1. Wei, W.W.S. (2018). Multivariate Time Series Analysis and Applications, John Wiley & Sons.10.1002/9781119502951 ↗
2. SAX-ARM: Deviant event pattern discovery from multivariate time series using symbolic aggregate approximation and association rule mining10.1016/j.eswa.2019.112950 ↗
3. Pattern discovery via constraint programming10.1016/j.knosys.2015.10.031 ↗
4. Frequent state transition patterns of multivariate time series10.1109/ACCESS.2019.2943881 ↗
5. Zhang, Z.H., Min, F., Chen, G.S., Shen, S.P., Wen, Z.C., and Zhou, X.B. (2021). Tri-Partition state alphabet-based sequential pattern for multivariate time series. Cogn. Comput., 1–19.10.1007/s12559-021-09871-4 ↗
6. Initialization by a novel clustering for wavelet neural network as time series predictor10.1155/2015/572592 ↗
7. Multivariate time series clustering based on common principal component analysis10.1016/j.neucom.2019.03.060 ↗
8. Multivariate time series clustering based on complex network10.1016/j.patcog.2021.107919 ↗
9. Multivariate times series classification through an interpretable representation10.1016/j.ins.2021.05.024 ↗
10. Learning a symbolic representation for multivariate time series classification10.1007/s10618-014-0349-y ↗
11. A class of hybrid morphological perceptrons with application in time series forecasting10.1016/j.knosys.2011.01.001 ↗
12. Detecting Causality in Complex Ecosystems10.1126/science.1227079 ↗
13. A piecewise aggregate pattern representation approach for anomaly detection in time series10.1016/j.knosys.2017.07.021 ↗
14. A model combining convolutional neural network and LightGBM algorithm for ultra-short-term wind power forecasting10.1109/ACCESS.2019.2901920 ↗
15. Multidimensional k-nearest neighbor model based on EEMD for financial time series forecasting10.1016/j.physa.2017.02.072 ↗
16. Multivariate Time Series Forecasting based on Elastic Net and High-Order Fuzzy Cognitive Maps: A Case Study on Human Action Prediction through EEG Signals10.1109/TFUZZ.2020.2998513 ↗
17. Real-time road traffic state prediction based on kernel-kNN
18. Forecasting traffic time series with multivariate predicting method
19. Improving air quality prediction accuracy at larger temporal resolutions using deep learning and transfer learning techniques10.1016/j.atmosenv.2019.116885 ↗
20. CNN-FCM: System modeling promotes stability of deep learning in time series prediction10.1016/j.knosys.2020.106081 ↗
21. A methodology for applying k-nearest neighbor to time series forecasting10.1007/s10462-017-9593-z ↗
22. Cash flow prediction: MLP and LSTM compared to ARIMA and Prophet10.1007/s10660-019-09362-7 ↗
23. Bayesian low-tubal-rank robust tensor factorization with multi-rank determination10.1109/TPAMI.2019.2923240 ↗
24. Probabilistic rank-one tensor analysis with concurrent regularizations10.1109/TCYB.2019.2914316 ↗
25. A weighted LS-SVM based learning system for time series forecasting10.1016/j.ins.2014.12.031 ↗
26. Feature selection based multivariate time series forecasting: An application to antibiotic resistance outbreaks prediction10.1016/j.artmed.2020.101818 ↗
27. Oblique random forest ensemble via least square estimation for time series forecasting10.1016/j.ins.2017.08.060 ↗
28. The geometry of three-way decision10.1007/s10489-020-02142-z ↗
29. Set-theoretic models of three-way decision10.1007/s41066-020-00211-9 ↗
30. Tri-level thinking: Models of three-way decision10.1007/s13042-019-01040-2 ↗
31. Decision-theoretic rough set model of multi-source decision systems10.1007/s13042-017-0729-x ↗
32. Three-way cognitive concept learning via multi-granularity10.1016/j.ins.2016.04.051 ↗
33. Three-way decisions and cognitive computing10.1007/s12559-016-9397-5 ↗
34. Decision-theoretic three-way approximations of fuzzy sets10.1016/j.ins.2014.04.022 ↗
35. Three-way decisions space and three-way decisions10.1016/j.ins.2014.05.015 ↗
36. Sequential three-way decisions via multi-granularity10.1016/j.ins.2019.03.052 ↗
37. Generalized three-way decision models based on subset evaluation10.1016/j.ijar.2017.01.005 ↗
38. A novel three-way decision model based on incomplete information system10.1016/j.knosys.2015.07.036 ↗
39. Information Fusion Based on Information Entropy in Fuzzy Multi-source Incomplete Information System10.1007/s40815-016-0230-9 ↗
40. Regression-based three-way recommendation10.1016/j.ins.2016.03.019 ↗
41. Active learning through density clustering10.1016/j.eswa.2017.05.046 ↗
42. An active three-way clustering method via low-rank matrices for multi-view data10.1016/j.ins.2018.03.009 ↗
43. Tri-partition neighborhood covering reduction for robust classification10.1016/j.ijar.2016.11.010 ↗
44. Cost-sensitive three-way email spam filtering10.1007/s10844-013-0254-7 ↗
45. Sequential three-way decision and granulation for cost-sensitive face recognition10.1016/j.knosys.2015.07.040 ↗
46. Frequent pattern discovery with tri-partition alphabets10.1016/j.ins.2018.04.013 ↗
47. Experiencing SAX: A novel symbolic representation of time series10.1007/s10618-007-0064-z ↗
48. Shi, Q.Q., Yin, J.M., Cai, J.J., Cichocki, A., Yokota, T., Chen, L., Yuan, M.X., and Zeng, J. (2020, January 7–12). Block Hankel tensor ARIMA for multiple short time series forecasting. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i04.6032 ↗
49. Ma, X.Y., Zhang, L., Xu, L., Liu, Z.C., Chen, G., Xiao, Z.L., Wang, Y., and Wu, Z.T. (2019, January 4–8). Large-scale user visits understanding and forecasting with deep spatial-temporal tensor factorization framework. Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, Anchorage, AK, USA.10.1145/3292500.3330728 ↗
50. Chen, X.Y., and Sun, L.J. (2020). Low-rank autoregressive tensor completion for multivariate time series forecasting. arXiv.
51. Wu, Y.K., Zhuang, D.Y., Labbe, A., and Sun, L.J. (2020). Inductive graph neural networks for spatiotemporal kriging. arXiv.10.1609/aaai.v35i5.16575 ↗
52. Efficient discovery of unusual patterns in time series10.1007/s00354-006-0004-2 ↗
53. Dynamic and internal longest common substring10.1007/s00453-020-00744-0 ↗
54. A novel approach for the structural comparison of origin-destination matrices: Levenshtein distance10.1016/j.trc.2020.01.005 ↗
55. Chung, N.C., Miasojedow, B., Startek, M., and Gambin, A. (2019). Jaccard/Tanimoto similarity test and estimation methods for biological presence-absence data. BMC Bioinform., 20.10.1186/s12859-019-3118-5 ↗
56. Sun, S.B., Zhang, Z.H., Dong, X.L., Zhang, H.R., Li, T.J., Zhang, L., and Min, F. (2017). Integrating triangle and jaccard similarities for recommendation. PLoS ONE, 12.10.1371/journal.pone.0183570 ↗