journal article·2025-06-01Open access

A survey on the application and research progress of large language models in financial forecasting

Ruonan Wu, Hong Liu

AIP Advances· Volume 15· Issue 6

Abstract

Large language models (LLMs) are reshaping the technical paradigms of financial forecasting through their robust representation learning and reasoning capabilities. This paper systematically reviews the application pathways of architectures such as transformers and graph neural networks in scenarios like stock prediction and risk management, highlighting key technologies for enhancing prediction accuracy through knowledge injection and temporal modeling improvements. The study reveals that LLMs demonstrate significant advantages in unstructured data processing and cross-market correlation analysis but face challenges related to economic logic interpretability and data non-stationarity. Future research should focus on advancing causal reasoning augmentation and federated learning collaboration to achieve secure and trustworthy evolution of financial forecasting systems.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Topic Modeling · Stock Market Forecasting Methods · Advanced Text Analysis Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Economics, Capital University of Economics and Business , Beijing 100070,

References (61)

Show source-provided references
1. 2014
2. Machine learning algorithms–A review10.21275/art20203995 ↗
3. H. Zhao , Z.Liu, Z.Wu, Y.Li, T.Yang, P.Shu, S.Xu, H.Dai, L.Zhao, G.Mai, “Revolutionizing finance with LLMs: An overview of applications and insights,” arXiv:2401.11641 (2024).
4. J. Shi and B.Hollifield, “Predictive power of LLMs in financial markets,” arXiv:2411.16569 (2024).
5. Review of gen AI models for financial risk management10.32628/cseit2511114 ↗
6. Optimized financial planning: Integrating individual and cooperative budgeting models with LLM recommendations10.3390/ai5010006 ↗
7. Large language models in finance (FinLLMs)10.1007/s00521-024-10495-6 ↗
8. Financial analysis: Intelligent financial data analysis system based on LLM-rag10.54254/2755-2721/2025.22221 ↗
9. A. Tavasoli , M.Sharbaf, and S. M.Madani, “Responsible innovation: A strategic framework for financial LLM integration,” arXiv:2504.02165 (2025).
10. Bert rediscovers the classical NLP pipeline
11. Financial knowledge graph based financial report query system10.1109/access.2021.3077916 ↗
12. Transformer-gated recurrent unit method for predicting stock price based on news sentiments and technical indicators10.1109/access.2023.3298445 ↗
13. D. Wang , D.Kim, B.Jin, X.Zhao, T.Fu, S.Yang, and X.-Y.Liu, “Finlora: Finetuning quantized financial large language models using low-rank adaptation,” arXiv:2412.11378 (2024).
14. Can large language models beat wall street? Evaluating GPT-4’s impact on financial decision-making with MarketSenseAI10.1007/s00521-024-10613-4 ↗
15. Large language models in finance: A survey
16. Integrating PEGA’s AI-driven workflows for end-to-end process optimization in financial services
17. J. Su , C.Jiang, X.Jin, Y.Qiao, T.Xiao, H.Ma, R.Wei, Z.Jing, J.Xu, and J.Lin, “Large language models for forecasting and anomaly detection: A systematic literature review,” arXiv:2402.10350 (2024).
18. The role of AI in financial forecasting: ChatGPT’s potential and challenges
19. Innovative research on the application of large language models in data analysis and prediction in the financial industry10.19772/j.cnki.2096-4455.2024.4.036 ↗
20. Empirical investigation on modeling solar radiation series with ARMA–GARCH models10.1016/j.enconman.2014.12.072 ↗
21. Forecasting time series using vector autoregressive model10.22075/ijnaa.2022.5521 ↗
22. 2017
23. A Bayesian vector error correction model for forecasting exchange rates10.1016/s0305-0548(02)00041-2 ↗
24. Recurrent neural networks approach to the financial forecast of Google assets
25. Application of improved convolution neural network in financial forecasting
26. Can transformers transform financial forecasting?10.1108/cfri-01-2024-0032 ↗
27. A. Lopez-Lira and Y.Tang, “Can ChatGPT forecast stock price movements? Return predictability and large language models,” arXiv:2304.07619 (2023).10.2139/ssrn.4412788 ↗
28. A financial time-series prediction model based on multiplex attention and linear transformer structure10.3390/app13085175 ↗
29. Z. Zeng , R.Kaur, S.Siddagangappa, S.Rahimi, T.Balch, and M.Veloso, “Financial time series forecasting using CNN and transformer,” arXiv:2304.04912 (2023).
30. M. Jin , Q.Wen, Y.Liang, C.Zhang, S.Xue, X.Wang, J.Zhang, Y.Wang, H.Chen, X.Li, “Large models for time series and spatio-temporal data: A survey and outlook,” arXiv:2310.10196 (2023).
31. J. Wang , S.Zhang, Y.Xiao, and R.Song, “A review on graph neural network methods in financial applications,” arXiv:2111.15367 (2021).10.6339/22-JDS1047 ↗
32. Temporal and heterogeneous graph neural network for financial time series prediction
33. B. Egressy , “Financial networks and other adventures in graph learning,” Ph.D. thesis, ETH Zurich, 2024.
34. Semantic graph learning for trend prediction from long financial documents
35. Transformer in transformer10.48550/arXiv.2103.00112 ↗
36. What does Bert learn about the structure of language?
37. GPT (generative pre-trained transformer)—A comprehensive review on enabling technologies, potential applications, emerging challenges, and future directions10.1109/access.2024.3389497 ↗
38. Exploring the limits of transfer learning with a unified text-to-text transformer10.48550/arXiv.1910.10683 ↗
39. Incorporating multiple knowledge sources for targeted aspect-based financial sentiment analysis10.1145/3580480 ↗
40. Enhancing financial sentiment analysis via retrieval augmented large language models
41. A low-latency library in FPGA hardware for high-frequency trading (HFT)
42. K. Kirtac and G.Germano, “Large language models in finance: Estimating financial sentiment for stock prediction,” arXiv:2503.03612 (2025).10.2139/ssrn.5166656 ↗
43. Prediction of stock market trends based on large language models
44. Assessment of the applicability of large language models for quantitative stock price prediction
45. Leveraging large language models for predicting stock option valuation and financial risk mitigation
46. H. Lee , “Unleashing the potential of large language models in the finance industry,” Techical Report No. ahkd3v1, Center for Open Science, 2025.10.31219/osf.io/ahkd3 ↗
47. Y. Nie , Y.Kong, X.Dong, J. M.Mulvey, H. V.Poor, Q.Wen, and S.Zohren, “A survey of large language models for financial applications: Progress, prospects and challenges,” arXiv:2406.11903 (2024).
48. A novel multi-step-prompt approach for LLM-based Q&As on banking supervisory regulations
49. AI in finance: Leveraging large language models for enhanced decision-making and risk management10.5281/zenodo.13299843 ↗
50. Large language models for financial and investment management: Models, opportunities, and challenges10.3905/jpm.2024.1.646 ↗
51. JPMorgan is developing a CHATGPT-like A.I. service that gives investment advice
52. Utilizing large language models for advanced service management: Potential applications and operational challenges
53. Secure interactions with large language models in financial services: A study on implementing safeguards for large language models
54. ChatGPT and other large language models empower the financial industry in the digital age: Based on privacy protection, algorithmic discrimination, and systemic risk10.11778/j.jnxb.20240229 ↗
55. The large language model in the financial industry10.19609/j.cnki.cn10-1255/f.2023.11.015 ↗
56. Tree of thoughts: Deliberate problem solving with large language models10.48550/arXiv.2305.10601 ↗
57. Research on the application of blockchain technology in supply chain finance based on cross border e-commerce scenarios
58. X.-Y. Liu , G.Wang, H.Yang, and D.Zha, “FinGPT: Democratizing internet-scale data for financial large language models,” arXiv:2307.10485 (2023).
59. Explainability for large language models: A survey10.1145/3639372 ↗
60. G. Zhao and E.Song, “Privacy-preserving large language models: Mechanisms, applications, and future directions,” arXiv:2412.06113 (2024).
61. Advancing language models through domain knowledge integration: A comprehensive approach to training, evaluation, and optimization of social scientific neural word embeddings10.1007/s42001-024-00286-3 ↗