Prediction of Complex Stock Market Data Using an Improved Hybrid EMD-LSTM Model
Source abstract
Abstract
Because of the complexity, nonlinearity, and volatility, stock market forecasting is either highly difficult or yields very unsatisfactory outcomes when utilizing traditional time series or machine learning techniques. To cope with this problem and improve the complex stock market’s prediction accuracy, we propose a new hybrid novel method that is based on a new version of EMD and a deep learning technique known as long-short memory (LSTM) network. The forecasting precision of the proposed hybrid ensemble method is evaluated using the KSE-100 index of the Pakistan Stock Exchange. Using a new version of EMD that uses the Akima spline interpolation technique instead of cubic spline interpolation, the noisy stock data are first divided into multiple components technically known as intrinsic mode functions (IMFs) varying from high to low frequency and a single monotone residue. The highly correlated sub-components are then used to build the LSTM network. By comparing the proposed hybrid model with a single LSTM and other ensemble models such as the support vector machine (SVM), Random Forest, and Decision Tree, its prediction performance is thoroughly evaluated. Three alternative statistical metrics, namely root means square error (RMSE), mean absolute error (MAE) and mean absolute percentage error (MAPE), are used to compare the aforementioned techniques. The empirical results show that the suggested hybrid Akima-EMD-LSTM model beats all other models taken into consideration for this study and is therefore recommended as an effective model for the prediction of non-stationary and nonlinear complex financial time series data.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Stock Market Forecasting Methods · Energy Load and Power Forecasting · Complex Systems and Time Series Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Statistics, Abdul Wali Khan University Mardan, Mardan 23200, Pakistan
Department of Mathematical Sciences, College of Science, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia
Higher Institute of Engineering and Technology, El-Mahala El-Kobra 31951, Egypt
Funding
Princess Nourah bint Abdulrahman University Researchers Supporting Project
References (59)
Show source-provided references
1. Petram, L.O. (2011). The World’s First Stock Exchange: How the Amsterdam Market for Dutch East India Company Shares Became a Modern Securities Market, 1602–1700. [Ph.D. Thesis, Universiteit van Amsterdam].
2. Market Efficiency, Long-Term Returns, and Behavioral Finance10.1016/S0304-405X(98)00026-9 ↗
3. A Novel Text Mining Approach to Financial Time Series Forecasting10.1016/j.neucom.2011.12.013 ↗
4. 25 Years of IIF Time Series Forecasting: A Selective Review. Tinbergen Institute Discussion Papers
5. A Review of Time-Frequency Methods for Structural Vibration Analysis10.1016/S0141-0296(02)00194-3 ↗
6. Modeling Video Traffic Using M/G/∞ Input Processes: A Compromise between Markovian and LRD Models10.1109/49.700909 ↗
7. Farina, L., and Rinaldi, S. (2000). Positive Linea Systems: Theory and Applications, Wiley.10.1002/9781118033029 ↗
8. ARIMA Models to Predict Next-Day Electricity Prices10.1109/MPER.2002.4312577 ↗
9. A Tutorial on Support Vector Regression10.1023/B:STCO.0000035301.49549.88 ↗
10. Computational Intelligence and Financial Markets: A Survey and Future Directions10.1016/j.eswa.2016.02.006 ↗
11. Deep learning based modeling of groundwater storage change
12. Deep learning based supervised image classification using UAV images for forest areas classification10.1007/s12524-020-01231-3 ↗
13. Variational Mode Decomposition10.1109/TSP.2013.2288675 ↗
14. Synchrosqueezed Wavelet Transforms: An Empirical Mode Decomposition-like Tool10.1016/j.acha.2010.08.002 ↗
15. Enhancing Intraday Stock Price Manipulation Detection by Leveraging Recurrent Neural Networks with Ensemble Learning10.1016/j.neucom.2019.03.006 ↗
16. Integration of Principal Component Analysis and Recurrent Neural Network to Forecast the Stock Price of Casablanca Stock Exchange10.1016/j.procs.2019.01.008 ↗
17. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗
18. From Feedforward to Recurrent LSTM Neural Networks for Language Modeling10.1109/TASLP.2015.2400218 ↗
19. Deep Neural Networks Understand Investors Better10.1016/j.dss.2018.06.002 ↗
20. Decision Support from Financial Disclosures with Deep Neural Networks and Transfer Learning10.1016/j.dss.2017.10.001 ↗
21. (2019). Deep Learning for Decision Making and the Optimization of Socially Responsible Investments and Portfolio. Decis. Support Syst., 124, 113097.10.1016/j.dss.2019.113097 ↗
22. Photovoltaic Power Forecasting Based LSTM-Convolutional Network10.1016/j.energy.2019.116225 ↗
23. Transductive LSTM for Time-Series Prediction: An Application to Weather Forecasting10.1016/j.neunet.2019.12.030 ↗
24. Study on the Prediction of Stock Price Based on the Associated Network Model of LSTM10.1007/s13042-019-01041-1 ↗
25. Exploring the Attention Mechanism in LSTM-Based Hong Kong Stock Price Movement Prediction10.1080/14697688.2019.1622287 ↗
26. ModAugNet: A New Forecasting Framework for Stock Market Index Value with an Overfitting Prevention LSTM Module and a Prediction LSTM Module10.1016/j.eswa.2018.07.019 ↗
27. Liang, X., Ge, Z., Sun, L., He, M., and Chen, H. (2019). LSTM with Wavelet Transform Based Data Preprocessing for Stock Price Prediction. Math. Probl. Eng.10.1155/2019/1340174 ↗
28. Automatic Evaluation of Facial Nerve Paralysis by Dual-Path LSTM with Deep Differentiated Network10.1016/j.neucom.2020.01.014 ↗
29. Low-cost bilayered structure for improving the performance of solar stills: Performance/cost analysis and water yield prediction using machine learning
30. Productivity forecasting of solar distiller integrated with evacuated tubes and external condenser using artificial intelligence model and moth-flame optimizer10.1016/j.csite.2021.101671 ↗
31. A new optimized artificial neural network model to predict thermal efficiency and water yield of tubular solar still10.1016/j.csite.2021.101750 ↗
32. Elsheikh, A. (2022). Bistable Morphing Composites for Energy-Harvesting Applications. Polymers, 14.10.3390/polym14091893 ↗
33. Modeling ultrasonic welding of polymers using an optimized artificial intelligence model using a gradient-based optimizer10.1007/s40194-021-01197-x ↗
34. Prediction of laser cutting parameters for polymethylmethacrylate sheets using random vector functional link network integrated with equilibrium optimizer10.1007/s10845-020-01617-7 ↗
35. Moustafa, E.B., and Elsheikh, A. (2023). Predicting Characteristics of Dissimilar Laser Welded Polymeric Joints Using a Multi-Layer Perceptrons Model Coupled with Archimedes Optimizer. Polymers, 15.10.3390/polym15010233 ↗
36. A new optimized predictive model based on political optimizer for eco-friendly MQL-turning of AISI 4340 alloy with nano-lubricants10.1016/j.jmapro.2021.05.014 ↗
37. Khoshaim, A.B., Moustafa, E.B., Bafakeeh, O.T., and Elsheikh, A.H. (2021). An optimized multilayer perceptrons model using grey wolf optimizer to predict mechanical and microstructural properties of friction stir processed aluminum alloy reinforced by nanoparticles. Coatings, 11.10.3390/coatings11121476 ↗
38. Forecasting the Volatility of Stock Price Index: A Hybrid Model Integrating LSTM with Multiple GARCH-Type Models10.1016/j.eswa.2018.03.002 ↗
39. Financial Time Series Forecasting Model Based on CEEMDAN and LSTM10.1016/j.physa.2018.11.061 ↗
40. A Weighted EMD-Based Prediction Model Based on TOPSIS and Feed Forward Neural Network for Noised Time Series10.1016/j.knosys.2017.06.022 ↗
41. Chen, L., Chi, Y., Guan, Y., and Fan, J. (2019). 2019 2nd International Conference on Artificial Intelligence and Big Data (ICAIBD), IEEE.
42. Stock Closing Price Prediction Based on Sentiment Analysis and LSTM10.1007/s00521-019-04504-2 ↗
43. Li, C., and Qian, G. (2023). Stock Price Prediction Using a Frequency Decomposition Based GRU Transformer Neural Network. Appl. Sci., 13.10.3390/app13010222 ↗
44. Aldhyani, T.H., and Alkahtani, H. (2023). Cyber Security for Detecting Distributed Denial of Service Attacks in Agriculture 4.0: Deep Learning Model. Mathematics, 11.10.3390/math11010233 ↗
45. Liu, Y., Liu, X., Zhang, Y., and Li, S. (2023). CEGH: A Hybrid Model Using CEEMD, Entropy, GRU, and History Attention for Intraday Stock Market Forecasting. Entropy, 25.10.3390/e25010071 ↗
46. Lazcano, A., Herrera, P.J., and Monge, M. (2023). A Combined Model Based on Recurrent Neural Networks and Graph Convolutional Networks for Financial Time Series Forecasting. Mathematics, 11.10.3390/math11010224 ↗
47. Forecasting the crude oil prices with an EMD-ISBM-FNN model10.1016/j.energy.2022.125407 ↗
48. The Empirical Mode Decomposition and the Hilbert Spectrum for Nonlinear and Non-Stationary Time Series Analysis10.1098/rspa.1998.0193 ↗
49. Short-term wind speed prediction using EEMD-LSSVM model10.1155/2017/6856139 ↗
50. Improving Forecasting Accuracy of Annual Runoff Time Series Using ARIMA Based on EEMD Decomposition10.1007/s11269-015-0962-6 ↗
51. A Novel Decomposition Ensemble Model with Extended Extreme Learning Machine for Crude Oil Price Forecasting10.1016/j.engappai.2015.04.016 ↗
52. Ensemble Empirical Mode Decomposition: A Noise-Assisted Data Analysis Method10.1142/S1793536909000047 ↗
53. Kim, D., Kim, K.O., and Oh, H.S. (2012). Extending the scope of empirical mode decomposition by smoothing. EURASIP J. Adv. Signal Process., 1–17.10.1186/1687-6180-2012-168 ↗
54. Exploiting Inherent Relationships in RNN Architectures10.1016/S0893-6080(99)00076-3 ↗
55. Recurrent Neural Network for Combined Economic and Emission Dispatch10.1007/s10489-017-1072-3 ↗
56. Guo, T., Xu, Z., Yao, X., Chen, H., Aberer, K., and Funaya, K. (2016). 2016 IEEE International Conference on Data Science and Advanced Analytics (DSAA), IEEE.
57. Ali, M., Khan, D.M., Aamir, M., Khalil, U., and Khan, Z. (2020). Forecasting COVID-19 in Pakistan. PLoS ONE, 15.10.1371/journal.pone.0242762 ↗
58. Khan, D.M., Ali, M., Iqbal, N., Khalil, U., Aljohani, H.M., Alharthi, A.S., and Afify, A.Z. (2022). Short-Term Prediction of COVID-19 Using Novel Hybrid Ensemble Empirical Mode Decomposition and Error Trend Seasonal Model. Front. Public Health, 1652.10.3389/fpubh.2022.922795 ↗
59. Predicting the direction movement of financial time series using artificial neural network and support vector machine10.1155/2021/2906463 ↗