A Novel Approach to Short-Term Stock Price Movement Prediction using Transfer Learning
Source abstract
Abstract
Stock price prediction has always been an important application in time series predictions. Recently, deep neural networks have been employed extensively for financial time series tasks. The network typically requires a large amount of training samples to achieve high accuracy. However, in the stock market, the number of data points collected on a daily basis is limited in one year, which leads to insufficient training samples and accordingly results in an overfitting problem. Moreover, predicting stock price movement is affected by various factors in the stock market. Therefore, choosing appropriate input features for prediction models should be taken into account. To address these problems, this paper proposes a novel framework, named deep transfer with related stock information (DTRSI), which takes advantage of a deep neural network and transfer learning. First, a base model using long short-term memory (LSTM) cells is pre-trained based on a large amount of data, which are obtained from a number of different stocks, to optimize initial training parameters. Second, the base model is fine-tuned by using a small amount data from a target stock and different types of input features (constructed based on the relationship between stocks) in order to enhance performance. Experiments are conducted with data from top-five companies in the Korean market and the United States (US) market from 2012 to 2018 in terms of the highest market capitalization. Experimental results demonstrate the effectiveness of transfer learning and using stock relationship information in helping to improve model performance, and the proposed approach shows remarkable performance (compared to other baselines) in terms of prediction accuracy.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Stock Market Forecasting Methods · Time Series Analysis and Forecasting · Currency Recognition and Detection
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electrical and Computer Engineering, University of Ulsan, Ulsan 680-749, Korea
References (50)
Show source-provided references
1. Introduction to financial forecasting10.1007/BF00126626 ↗
2. A hybrid approach based on neural networks and genetic algorithms for detecting temporal patterns in stock markets10.1016/j.asoc.2006.03.004 ↗
3. Using artificial neural network models in stock market index prediction10.1016/j.eswa.2011.02.068 ↗
4. Lin, Y., Guo, H., and Hu, J. (2013, January 4–9). An SVM-based approach for stock market trend prediction. Proceedings of the 2013 International Joint Conference on Neural Networks (IJCNN), Dallas, TX, USA.10.1109/IJCNN.2013.6706743 ↗
5. Booth, A., Gerding, E., and McGroarty, F. (2014, January 27–28). Predicting equity market price impact with performance weighted ensembles of random forests. Proceedings of the 2014 IEEE Conference on Computational Intelligence for Financial Engineering & Economics (CIFEr), London, UK.10.1109/CIFEr.2014.6924085 ↗
6. Lipton, Z.C., Berkowitz, J., and Elkan, C. (arXiv, 2015). A critical review of recurrent neural networks for sequence learning, arXiv.
7. Liu, Y., Guan, L., Hou, C., Han, H., Liu, Z., Sun, Y., and Zheng, M. (2019). Wind Power Short-Term Prediction Based on LSTM and Discrete Wavelet Transform. Appl. Sci., 9.10.3390/app9061108 ↗
8. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
9. Using support vector machine with a hybrid feature selection method to the stock trend prediction10.1016/j.eswa.2009.02.038 ↗
10. Ng, A.Y. (2004, January 4–8). Feature selection, L 1 vs. L 2 regularization, and rotational invariance. In Proceedings of the Twenty-First International Conference on Machine Learning, Banff, AB, Canada.
11. Dropout: A simple way to prevent neural networks from overfitting
12. Wong, S.C., Gatt, A., Stamatescu, V., and McDonnell, M.D. (December, January 30). Understanding data augmentation for classification: when to warp?. Proceedings of the 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA), Gold Coast, Australia.10.1109/DICTA.2016.7797091 ↗
13. Caruana, R., Lawrence, S., and Giles, C.L. (2001, January 21). Overfitting in neural nets: Backpropagation, conjugate gradient, and early stopping. Proceedings of the Advances in Neural Information Processing Systems, River Edge, NJ, USA.10.1109/IJCNN.2000.857823 ↗
14. Automatically identifying, counting, and describing wild animals in camera-trap images with deep learning10.1073/pnas.1719367115 ↗
15. Identifying medical diagnoses and treatable diseases by image-based deep learning10.1016/j.cell.2018.02.010 ↗
16. Oliver, A., Odena, A., Raffel, C.A., Cubuk, E.D., and Goodfellow, I. (2018, January 17). Realistic evaluation of deep semi-supervised learning algorithms. Proceedings of the Advances in Neural Information Processing Systems, Palais des Congrès de Montréal, QC, Canada.
17. Lee, J., Park, J., Kim, K., and Nam, J. (2018). Samplecnn: End-to-end deep convolutional neural networks using very small filters for music classification. Appl. Sci., 8.10.3390/app8010150 ↗
18. Izadpanahkakhk, M., Razavi, S., Taghipour-Gorjikolaie, M., Zahiri, S., and Uncini, A. (2018). Deep region of interest and feature extraction models for palmprint verification using convolutional neural networks transfer learning. Appl. Sci., 8.10.3390/app8071210 ↗
19. Zhang, L., Wang, D., Bao, C., Wang, Y., and Xu, K. (2019). Large-Scale Whale-Call Classification by Transfer Learning on Multi-Scale Waveforms and Time-Frequency Features. Appl. Sci., 9.10.3390/app9051020 ↗
20. Deep learning with long short-term memory networks for financial market predictions10.1016/j.ejor.2017.11.054 ↗
21. Ziegel, E.R. (2002). Analysis of Financial Time Series, Taylor & Francis.10.1198/tech.2002.s96 ↗
22. Evaluating the Forecasting Performance of GARCH Models. Evidence from Romania10.1016/j.sbspro.2012.09.171 ↗
23. Ariyo, A.A., Adewumi, A.O., and Ayo, C.K. (2014, January 26–28). Stock price prediction using the ARIMA model. Proceedings of the 2014 UKSim-AMSS 16th International Conference on Computer Modelling and Simulation, Cambridge, UK.10.1109/UKSim.2014.67 ↗
24. Artificial neural networks architectures for stock price prediction: Comparisons and applications
25. Comparison of ARIMA and artificial neural networks models for stock price prediction10.1155/2014/614342 ↗
26. A feature weighted support vector machine and K-nearest neighbor algorithm for stock market indices prediction10.1016/j.eswa.2017.02.044 ↗
27. Predicting direction of stock price index movement using artificial neural networks and support vector machines: The sample of the Istanbul Stock Exchange10.1016/j.eswa.2010.10.027 ↗
28. Qiu, M., and Song, Y. (2016). Predicting the direction of stock market index movement using an optimized artificial neural network model. PLoS ONE, 11.10.1371/journal.pone.0155133 ↗
29. Integrating metaheuristics and artificial neural networks for improved stock price prediction10.1016/j.eswa.2015.09.029 ↗
30. Chen, K., Zhou, Y., and Dai, F. (November, January 29). A LSTM-based method for stock returns prediction: A case study of China stock market. Proceedings of the 2015 IEEE International Conference on Big Data (Big Data), Santa Clara, CA, USA.10.1109/BigData.2015.7364089 ↗
31. Recurrent neural networks approach to the financial forecast of Google assets
32. Liu, S., Liao, G., and Ding, Y. (June, January 31). Stock transaction prediction modeling and analysis based on LSTM. Proceedings of the 2018 13th IEEE Conference on Industrial Electronics and Applications (ICIEA), Wuhan, China.10.1109/ICIEA.2018.8398183 ↗
33. Forecasting stock markets using wavelet transforms and recurrent neural networks: An integrated system based on artificial bee colony algorithm10.1016/j.asoc.2010.09.007 ↗
34. Chung, H., and Shin, K.S. (2018). Genetic algorithm-optimized long short-term memory network for stock market prediction. Sustainability, 10.10.3390/su10103765 ↗
35. Bao, W., Yue, J., and Rao, Y. (2017). A deep learning framework for financial time series using stacked autoencoders and long-short term memory. PLoS ONE, 12.10.1371/journal.pone.0180944 ↗
36. Feature Engineering for Mid-Price Prediction With Deep Learning10.1109/ACCESS.2019.2924353 ↗
37. Surveying stock market forecasting techniques–Part II: Soft computing methods10.1016/j.eswa.2008.07.006 ↗
38. CAST: Using neural networks to improve trading systems based on technical analysis by means of the RSI financial indicator10.1016/j.eswa.2011.03.023 ↗
39. Modeling fitting-function-based fuzzy time series patterns for evolving stock index forecasting10.1007/s10489-014-0520-6 ↗
40. Predicting stock and stock price index movement using trend deterministic data preparation and machine learning techniques10.1016/j.eswa.2014.07.040 ↗
41. An adaptive stock index trading decision support system10.1016/j.eswa.2016.04.025 ↗
42. Forecasting price movements using technical indicators: Investigating the impact of varying input window length10.1016/j.neucom.2016.11.095 ↗
43. Deep learning-based feature engineering for stock price movement prediction10.1016/j.knosys.2018.10.034 ↗
44. Akita, R., Yoshihara, A., Matsubara, T., and Uehara, K. (2016, January 26–29). Deep learning for stock prediction using numerical and textual information. Proceedings of the 2016 IEEE/ACIS 15th International Conference on Computer and Information Science (ICIS), Okayama, Japan.10.1109/ICIS.2016.7550882 ↗
45. Vargas, M.R., De Lima, B.S., and Evsukoff, A.G. (2017, January 26–28). Deep learning for stock market prediction from financial news articles. Proceedings of the 2017 IEEE International Conference on Computational Intelligence and Virtual Environments for Measurement Systems and Applications (CIVEMSA), Annecy, France.10.1109/CIVEMSA.2017.7995302 ↗
46. Yasir, M., Durrani, M.Y., Afzal, S., Maqsood, M., Aadil, F., Mehmood, I., and Rho, S. (2019). An Intelligent Event-Sentiment-Based Daily Foreign Exchange Rate Forecasting System. Appl. Sci., 9.10.3390/app9152980 ↗
47. Twitter mood predicts the stock market10.1016/j.jocs.2010.12.007 ↗
48. Automated news reading: Stock price prediction based on financial news using context-capturing features10.1016/j.dss.2013.02.006 ↗
49. A survey on transfer learning10.1109/TKDE.2009.191 ↗
50. Ruder, S. (arXiv, 2016). An overview of gradient descent optimization algorithms, arXiv.