journal article·2023-12-20Open access

Research on Ensemble Learning-Based Feature Selection Method for Time-Series Prediction

Da Huang, Zhaoguo Liu, Dan Wu

Applied Sciences· Volume 14· Issue 1

Abstract

Feature selection has perennially stood as a pivotal concern in the realm of time-series forecasting due to its direct influence on the efficacy of predictive models. Conventional approaches to feature selection predominantly rely on domain knowledge and experiential insights and are, therefore, susceptible to individual subjectivity and the resultant inconsistencies in the outcomes. Particularly in domains such as financial markets, and within datasets comprising time-series information, an abundance of features adds complexity, necessitating adept handling of high-dimensional data. The computational expenses associated with traditional methodologies in managing such data dimensions, coupled with vulnerability to the curse of dimensionality, further compound the challenges at hand. In response to these challenges, this paper advocates for an innovative approach—a feature selection method grounded in ensemble learning. The paper explicitly delineates the formal integration of ensemble learning into feature selection, guided by the overarching principle of “good but different”. To operationalize this concept, five feature selection methods that are well suited to ensemble learning were identified, and their respective weights were determined through K-fold cross-validation when applied to specific datasets. This ensemble method amalgamates the outcomes of diverse feature selection techniques into a numeric composite, thereby mitigating potential biases inherent in traditional methods and elevating the precision and comprehensiveness of feature selection. Consequently, this method improves the performance of time-series prediction models.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Stock Market Forecasting Methods · Time Series Analysis and Forecasting · Forecasting Techniques and Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute for Quantum Information & State Key Laboratory of High Performance Computing, College of Computer Science and Technology, National University of Defense Technology, Changsha 410073, China

References (28)

Show source-provided references
1. Exponential smoothing forecasting method and its application in economic forecast
2. Hyndman, R.J., and Athanasopoulos, G. (2018). Forecasting: Principles and Practice, OTexts.
3. Forecasting analysis of Shanghai stock index based on ARIMA model10.1051/matecconf/201710002029 ↗
4. A wavelet neural network forecasting model based on ARIM10.4028/www.scientific.net/AMM.347-350.3013 ↗
5. Choi, H.K. (2018). Stock price correlation coefficient prediction with ARIMA-LSTM hybrid model. arXiv.
6. Forecasting stock indices with back propagation neural network10.1016/j.eswa.2011.04.222 ↗
7. Economic prediction using neural networks: The case of IBM daily stock returns
8. The forecasting model of stock price based on PCA and BP neural network10.4236/jfrm.2018.74021 ↗
9. Kim, T., and Kim, H.Y. (2019). Forecasting stock prices with a feature fusion LSTM-CNN model using different representations of the same data. PLoS ONE, 14.10.1371/journal.pone.0212320 ↗
10. Li, X., Li, Y., Yang, H., Yang, L., and Liu, X.Y. (2019). DP-LSTM: Differential privacy-inspired LSTM for stock prediction using financial news. arXiv.
11. Stock price prediction using deep learning models
12. Stock market prediction based on generative adversarial network10.1016/j.procs.2019.01.256 ↗
13. Stock market prediction on high-frequency data using generative adversarial nets
14. Lee, J.W. (2001, January 12–16). Stock price prediction using reinforcement learning. Proceedings of the ISIE 2001, International Symposium on Industrial Electronics Proceedings (Cat. No.01TH8570), Pusan, Republic of Korea.
15. Global stock market prediction based on stock chart images using deep Q-network10.1109/ACCESS.2019.2953542 ↗
16. Li, X., Li, Y., Zhan, Y., and Liu, X.Y. (2019). Optimistic bull or pessimistic bear: Adaptive deep reinforcement learning for stock portfolio allocation. arXiv.
17. A multivariate time series forecasting algorithm based on self-evolution and pre-training
18. Goodfellow, I., Bengio, Y., and Courville, A. (2016). Deep Learning, MIT Press.
19. Recent advances in convolutional neural networks10.1016/j.patcog.2017.10.013 ↗
20. Bai, S., Kolter, J.Z., and Koltun, V. (2018). An empirical evaluation of generic convolutional and recurrent networks for sequence modeling. arXiv.
21. Bidirectional recurrent neural networks10.1109/78.650093 ↗
22. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
23. Framewise phoneme classification with bidirectional LSTM and other neural network architectures10.1016/j.neunet.2005.06.042 ↗
24. Siami-Namini, S., Tavakoli, N., and Namin, A.S. (2019, January 9–12). The performance of LSTM and BiLSTM in forecasting time series. Proceedings of the 2019 IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA.10.1109/BigData47090.2019.9005997 ↗
25. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., and Kaiser, Ł. (2017). Illia Polosukhin Attention is all you need. arXiv.
26. Wen, Q., Zhou, T., Zhang, C., Chen, W., Ma, Z., Yan, J., and Sun, L. (2022). Transformers in time series: A survey. arXiv.10.24963/ijcai.2023/759 ↗
27. Informer: Beyond efficient transformer for long sequence time-series forecasting
28. Temporal fusion transformers for interpretable multi-horizon time series forecasting10.1016/j.ijforecast.2021.03.012 ↗