Automated Machine Learning Algorithm Using Recurrent Neural Network to Perform Long-Term Time Series Forecasting
Source abstract
Abstract
Long-term time series forecasting stands as a crucial research domain within the realm of automated machine learning (AutoML). At present, forecasting, whether rooted in machine learning or statistical learning, typically relies on expert input and necessitates substantial manual involvement. This manual effort spans model development, feature engineering, hyper-parameter tuning, and the intricate construction of time series models. The complexity of these tasks renders complete automation unfeasible, as they inherently demand human intervention at multiple junctures. To surmount these challenges, this article proposes leveraging Long Short-Term Memory, which is the variant of Recurrent Neural Networks, harnessing memory cells and gating mechanisms to facilitate long-term time series prediction. However, forecasting accuracy by particular neural network and traditional models can degrade significantly, when addressing long-term time-series tasks. Therefore, our research demonstrates that this innovative approach outperforms the traditional Autoregressive Integrated Moving Average (ARIMA) method in forecasting long-term univariate time series. ARIMA is a high-quality and competitive model in time series prediction, and yet it requires significant preprocessing efforts. Using multiple accuracy metrics, we have evaluated both ARIMA and proposed method on the simulated time-series data and real data in both short and long term. Furthermore, our findings indicate its superiority over alternative network architectures, including Fully Connected Neural Networks, Convolutional Neural Networks, and Nonpooling Convolutional Neural Networks. Our AutoML approach enables non-professional to attain highly accurate and effective time series forecasting, and can be widely applied to various domains, particularly in business and finance.
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Stock Market Forecasting Methods · Forecasting Techniques and Applications · Energy Load and Power Forecasting
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (32)
Show source-provided references
1. C. Liang and Y. F. Lu, “Using automl for time series forecasting,” 2020. [Online]. Available: https://www.googblogs.com/using-automl-for-time-series-forecasting/ (accessed on 04/01/2024).
2. Review of ML and AutoML solutions to forecast time-series data10.1007/s11831-022-09765-0 ↗
3. Coevolution of remaining useful lifetime estimation pipelines for automated predictive maintenance
4. Neural architecture search: A survey
5. Improving neural networks for time-series forecasting using data augmentation and automl
6. Robustness of automl for time series forecasting in sensor networks
7. BOAT: A bayesian optimization automl time-series framework for industrial applications
8. Review of automated time series forecasting pipelines10.1002/widm.1475 ↗
9. Nonpooling convolutional neural network forecasting for seasonal time series with trends10.1109/TNNLS.2019.2934110 ↗
10. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
11. A clockwork RNN
12. Neural network forecasting for seasonal and trend time series10.1016/j.ejor.2003.08.037 ↗
13. How neural networks learn from experience10.1038/scientificamerican0992-144 ↗
14. Forecasting of preprocessed daily solar radiation time series using neural networks10.1016/j.solener.2010.08.011 ↗
15. Convolutional neural networks for speech recognition10.1109/TASLP.2014.2339736 ↗
16. Learning representations by back-propagating errors10.1038/323533a0 ↗
17. Backpropagation through time: What it does and how to do it10.1109/5.58337 ↗
18. Deep hybrid modeling of chemical process: Application to hydraulic fracturing10.1016/j.compchemeng.2019.106696 ↗
19. Development of a hybrid model for a partially known intracellular signaling pathway through correction term estimation and neural network modeling10.1371/journal.pcbi.1008472 ↗
20. Physics-informed neural networks for hybrid modeling of lab-scale batch fermentation for β-carotene production using saccharomyces cerevisiae10.1016/j.cherd.2022.01.041 ↗
21. Deep neural network-based hybrid modeling and experimental validation for an industry-scale fermentation process: Identification of time-varying dependencies among parameters10.1016/j.cej.2022.135643 ↗
22. Exploring the potential of time-series transformers for process modeling and control in chemical systems: An inevitable paradigm shift?10.1016/j.cherd.2023.04.028 ↗
23. CrystalGPT Enhancing system-to-system transferability in crystallization prediction and control using time-series-transformers10.1016/j.compchemeng.2023.108339 ↗
24. Introducing hybrid modeling with time-series-transformers: A comparative study of series and parallel approach in batch crystallization10.1021/acs.iecr.3c02624 ↗
25. Box · Time Series Analysis: Forecasting and Control · 2015
26. K. O’Shea and R. Nash, “An introduction to convolutional neural networks,” arXiv preprint arXiv:1511.08458, 2015.
27. A. Ruderman, N. C. Rabinowitz, A. S. Morcos, and D. Zoran, “Pooling is neither necessary nor sufficient for appropriate deformation stability in CNNs,” arXiv preprint arXiv:1804.04438, 2018.
28. Deep learning10.1038/nature14539 ↗
29. The vanishing gradient problem during learning recurrent neural nets and problem solutions10.1142/S0218488598000094 ↗
30. Trends in the composition of Australian wine 1984–201410.1111/ajgw.12195 ↗
31. Modeling and forecasting rainfall patterns of southwest monsoons in North-East India as a SARIMA process10.1007/s00703-017-0504-2 ↗
32. Time-series forecasting of seasonal items sales using machine learning–A comparative analysis