journal article·2024-01-01Open access

A decomposition-guided mechanism for nonstationary time series forecasting

Hao Wang, Lubna Al Tarawneh, Changqing Cheng, Yu Jin

AIP Advances· Volume 14· Issue 1

Abstract

Time series forecasting has been playing an important role in decision making, control, and monitoring across various fields. Specifically, the forecasting of nonstationarity time series remains a challenging problem where traditional time series modeling may not fully capture temporal dynamics. Recent studies of applying machine learning (ML) or more advanced hybrid models combining the ML and decomposition methods have shown their flexible nonstationary and nonlinear modeling capability. However, the end-effect problem introduced by the decomposition methods still introduces significant forecasting errors because of the unknown realm beyond the time series boundary. Therefore, a novel method applying a decomposition-guided mechanism is proposed in this work to eliminate the end effect problem while inheriting the knowledge learned from the decomposition state space to improve the prediction accuracy of such hybrid models in time series forecasting. Additionally, a domain adaptation model is integrated with the proposed mechanism to transfer knowledge from the source domain to the target domain regarding the decomposition state space. In this work, the intrinsic time-scale decomposition and Gaussian process are considered as examples of decomposition and ML methods to demonstrate the proposed mechanism’s effectiveness. Both simulation experiments and real-world case studies are conducted to show that a hybrid model with the proposed mechanism outperforms the conventional time series forecasting model, pure ML, and the original hybrid model in terms of prediction accuracy.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Time Series Analysis and Forecasting · Energy Load and Power Forecasting · Stock Market Forecasting Methods

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Systems Science and Industrial Engineering, State University of New York at Binghamton , Binghamton, New York 13902, USA

Funding

Research Foundation for the State University of New York

References (41)

Show source-provided references
1. A prediction and compensation scheme for in-plane shape deviation of additive manufacturing with information on process parameters10.1080/24725854.2017.1402224 ↗
2. Time series forecasting energy-efficient organization of wireless sensor networks10.3390/s7091766 ↗
3. Arima-based decoupled time series forecasting of electric vehicle charging demand for stochastic power system operation10.1016/j.epsr.2016.06.003 ↗
4. Deep learning for time series forecasting: The electric load case10.1049/cit2.12060 ↗
5. Intrinsic recurrence quantification analysis of nonlinear and nonstationary short-term time series10.1063/5.0006537 ↗
6. 2003
7. Multi-scale Gaussian process experts for dynamic evolution prediction of complex systems10.1016/j.eswa.2018.01.021 ↗
8. Empirical mode decomposition as a filter bank10.1109/lsp.2003.821662 ↗
9. Does restraining end effect matter in EMD-based modeling framework for time series prediction? Some experimental evidences10.1016/j.neucom.2013.07.004 ↗
10. Application of support vector regression machines to the processing of end effects of Hilbert–Huang transform10.1016/j.ymssp.2005.09.005 ↗
11. An approach to eliminating end effects of EMD through mirror extension coupled with support vector machine method10.1007/s00779-018-01198-6 ↗
12. Time series forecasting for nonlinear and non-stationary processes: A review and comparative study10.1080/0740817x.2014.999180 ↗
13. Stock price prediction using the ARIMA model
14. Prediction of COVID-19 corona virus pandemic based on time series data using support vector machine10.1080/09720529.2020.1784535 ↗
15. DSTP-RNN: A dual-stage two-phase attention-based recurrent neural network for long-term and multivariate time series prediction10.1016/j.eswa.2019.113082 ↗
16. Gaussian process regression for numerical wind speed prediction enhancement10.1016/j.renene.2019.08.018 ↗
17. 2001 · 64
18. H. Salehinejad , S.Sankar, J.Barfett, E.Colak, and S.Valaee, “Recent advances in recurrent neural networks,” arXiv:1801.01078 (2017).
19. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
20. Spatiotemporal attention networks for wind power forecasting
21. N. Wu , B.Green, X.Ben, and S.O’Banion, “Deep transformer models for time series forecasting: The influenza prevalence case,” arXiv:2001.08317 (2020).
22. Informer: Beyond efficient transformer for long sequence time-series forecasting
23. Adversarial sparse transformer for time series forecasting
24. A transformer-based framework for multivariate time series representation learning
25. Multivariate time series forecasting via attention-based encoder–decoder framework10.1016/j.neucom.2019.12.118 ↗
26. Attention is all you need
27. Temporal fusion transformers for interpretable multi-horizon time series forecasting10.1016/j.ijforecast.2021.03.012 ↗
28. Crossformer: Transformer utilizing cross-dimension dependency for multivariate time series forecasting
29. Domain adaptation for time series forecasting via attention sharing
30. A review and discussion of decomposition-based hybrid models for wind energy forecasting applications10.1016/j.apenergy.2018.10.080 ↗
31. 2001
32. The undecimated wavelet decomposition and its reconstruction10.1109/tip.2006.887733 ↗
33. Intrinsic time-scale decomposition: Time–frequency–energy analysis and real-time filtering of non-stationary signals10.1098/rspa.2006.1761 ↗
34. On practical challenges of decomposition-based hybrid forecasting algorithms for wind speed and solar irradiation10.1016/j.energy.2016.06.075 ↗
35. Empirical mode decomposition based hybrid ensemble model for electrical energy consumption forecasting of the cement grinding process10.1016/j.measurement.2019.02.062 ↗
36. Forecasting monthly and quarterly time series using STL decomposition10.1016/j.ijforecast.2010.11.002 ↗
37. Forecasting the evolution of nonlinear and nonstationary systems using recurrence-based local Gaussian process models10.1103/physreve.82.056206 ↗
38. AdaRNN: Adaptive learning and forecasting of time series
39. Volatility clustering in financial markets: A microsimulation of interacting agents10.1142/s0219024900000826 ↗
40. Covariate shift by kernel mean matching
41. A survey on deep transfer learning