AI-Driven Sensing for Cross-Lingual Risk Prediction via Semantic Alignment and Multimodal Temporal Fusion
Source abstract
Abstract
In the context of highly interconnected global markets and the rapid dissemination of multilingual information, traditional risk prediction methods that rely on single numerical sequences or monolingual text are insufficient for achieving early perception of cross-market risks. To address this issue, a cross-market risk early warning framework based on multilingual large language models and multimodal sensing fusion is proposed. The proposed approach is centered on a unified risk semantic space, where cross-lingual semantic alignment is employed to reduce semantic discrepancies across languages. Furthermore, a semantic–volatility coupling attention mechanism is introduced to capture the dynamic relationship between textual semantic evolution and market fluctuations. In addition, cross-market knowledge transfer and low-resource enhancement strategies are incorporated to improve the model’s generalization capability across multilingual and multi-market environments, thereby establishing an intelligent perception and early warning system for complex sensing scenarios. Experimental results demonstrate that the proposed method significantly outperforms multiple baseline models in multilingual cross-market risk prediction tasks. In the main experiment, the model achieves a root mean squared error (RMSE) of 0.1127, an mean absolute error (MAE) of 0.0846, and an area under the curve (AUC) of 0.8879, while the early warning gain is improved to 5.2 days, which is substantially better than the Transformer model (RMSE 0.1365, AUC 0.8042) and the multilingual BERT-based fusion model (AUC 0.8395). In terms of classification performance, higher accuracy, precision, and recall are consistently achieved, with overall accuracy exceeding 0.88, and both precision and recall are maintained above 0.85, indicating strong discriminative capability in risk identification tasks. Cross-lingual generalization experiments further verify the robustness of the proposed framework. When trained solely on the English market, the model achieves AUC values of 0.8624 and 0.8471 on the Chinese and European markets, respectively, with RMSE reduced to 0.1185, significantly outperforming competing methods. Overall, the proposed approach achieves substantial improvements in prediction accuracy, cross-lingual generalization, and early warning performance, providing an effective solution for artificial intelligence-driven sensing and risk early warning.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Stock Market Forecasting Methods · Forecasting Techniques and Applications · Machine Learning in Healthcare
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
National School of Development, Peking University, Beijing 100871, China
China Agricultural University, Beijing 100083, China
School of Economics and Management, Tsinghua University, Beijing 100084, China
Funding
National Natural Science Foundation of China
References (54)
Show source-provided references
1. Cross-asset contagion and risk transmission in global financial networks10.1016/j.najef.2025.102511 ↗
2. Bridging Languages in International Finance: The Translator’s Function in Global Organizations
3. Enterprise financial risk prediction and intelligent early warning model based on deep learning10.1007/s44163-025-00497-1 ↗
4. Developing evaluation metrics for cross-lingual LLM-based detection of subtle sentiment manipulation in online financial content10.69987/JACS.2023.30903 ↗
5. Jain, Y.K., Gupta, S.K., Alsekait, D.M., Albeshri, M.Y., and AbdElminaam, D.S. (2026). Enhanced Predictive Modeling for Financial Risk Assessment using Hybrid AI (ML & DL) on Structured and Unstructured Data. Res. Sq.10.21203/rs.3.rs-8373542/v1 ↗
6. A hybrid learning approach integrating ARIMA-GARCH-LSTM for value-at-risk forecasting10.1142/S2424786326500118 ↗
7. Optimizing Predictive Model Accuracy In Risk Management Using Complex Analysis And Numerical Techniques
8. Huang, H. (2024). Technology-driven financial risk management: Exploring the benefits of machine learning for non-profit organizations. Systems, 12.10.3390/systems12100416 ↗
9. A Cross-Market Predictive System for Financial Contagion and Crash Propagation Using Cointegration and Vector Error Correction Models with Deep Learning Enhancements
10. Abdulla, Y.Y., and Al-Alawi, A.I. (2024, January 28–29). Advances in machine learning for financial risk management: A systematic literature review. Proceedings of the 2024 ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS), Manama, Bahrain.10.1109/ICETSIS61505.2024.10459536 ↗
11. Research on financial risk intelligent monitoring and early warning model based on LSTM, transformer, and deep learning
12. Financial Risk Prediction Model Based on Bert and Attention Mechanism Fusion10.63367/199115992025063603005 ↗
13. Zhang, L., Zhang, Y., and Ma, X. (2021, January 17–19). A new strategy for tuning ReLUs: Self-adaptive linear units (SALUs). Proceedings of the ICMLCA 2021—2nd International Conference on Machine Learning and Computer Application, VDE, Shenyang, China.
14. Yanglet, X.Y.L., Cao, Y., and Deng, L. (2025). Multimodal financial foundation models (MFFMs): Progress, prospects, and challenges. arXiv.
15. Zhu, S., Xu, S., Sun, H., Pan, L., Cui, M., Du, J., Jin, R., Branco, A., and Xiong, D. (2024). Multilingual large language models: A systematic survey. arXiv.
16. Zhang, L., Lin, Q., Meng, F., Liang, S., Lu, J., Liu, S., Chen, K., and Zhan, Y. (2025). Leveraging Contrastive Semantics and Language Adaptation for Robust Financial Text Classification Across Languages. Computers, 14.10.3390/computers14080338 ↗
17. TRAM-FIN: A transformer-based real-time assessment model for financial risk detection in multinational corporate statements10.69987/JACS.2023.30905 ↗
18. A Deep Learning Approach to Financial Uncertainty: Unified Risk Analysis for Market Investments and Construction Projects
19. Yue, D. (2025, January 25–27). Dynamic Weighted Multimodal Financial Forecasting Models: Fusion Strategies and Market Validation. Proceedings of the 2025 4th International Conference on Artificial Intelligence, Internet and Digital Economy (ICAID), Guangzhou, China.10.1109/ICAID65275.2025.11034630 ↗
20. Chuang, H.M., He, H.C., and Hu, M.C. (2025). Chinese Financial News Analysis for Sentiment and Stock Prediction: A Comparative Framework with Language Models. Big Data Cogn. Comput., 9.10.3390/bdcc9100263 ↗
21. Yang, Z., Zeng, L., Lou, F., Qi, Q., Zhang, W., Wu, Z., Yu, Z., Han, J., Jin, Z., and Zhang, L. (2026). UniFinEval: Towards Unified Evaluation of Financial Multimodal Models across Text, Images and Videos. arXiv.
22. Kostopoulos, G., Stefani, A., Vasiliadis, V., and Kotsiantis, S. (2026). Deep Learning for e-Commerce: Recent Developments in Prediction, Personalization and Decision Intelligence. Appl. Sci., 16.10.3390/app16052263 ↗
23. Zhang, M., Wang, X., Yang, Z., Chen, H., Liu, J., and Li, L. (2024, January 13–16). Machine Learning Techniques for Dynamic Risk Measurement and Stock Prediction. Proceedings of the Machine Learning and Systems (MLSys) Conference, Santa Clara, CA, USA.
24. Time series-based quantitative risk models: Enhancing accuracy in forecasting and risk assessment
25. Forecasting volatility by using wavelet transform, ARIMA and GARCH models10.1007/s40822-023-00243-x ↗
26. The Role of Regression Analysis in Financial Modeling
27. Karimkhani, M., Aluvihara, S., Karimkhani, M., and Alqasi, N.J.K. (2025). The Machine Learning (ML) Revolution in Financial Risk Management from Traditional Methods to a Predictive Paradigm: A Review. Proceedings of the Second National Conference on A World Without Oil, Iranian E-Commerce Scientific Association.
28. Temporal dependency modeling in loan default prediction with hybrid LSTM-GRU architecture
29. Financial risk analysis using integrated data and transformer-based deep learning
30. Deep Learning Model-Driven Financial Risk Prediction and Analysis10.54254/2755-2721/67/2024MA0064 ↗
31. A Review of Machine Learning for Financial Risk Prediction and Investment Optimization in Listed Companies Using Multimodal Data10.56028/aemr.15.1.1050.2025 ↗
32. Fataliyev, K., and Liu, W. (2023, January 9). MCASP: Multi-modal cross attention network for stock market prediction. Proceedings of the 21st Annual Workshop of the Australasian Language Technology Association, Melbourne, Australia.
33. Singh, S., and Dhir, V. (2025, January 23–25). Cross-Sector Insights for Robust Stock Market Prediction: Merging Deep Learning with Multi-Modal Data Streams. Proceedings of the 2025 IEEE 2nd International Conference on Information Technology, Electronics and Intelligent Communication Systems (ICITEICS), Yueyang, China.10.1109/ICITEICS64870.2025.11341176 ↗
34. Textual analysis of earnings calls for predictive risk assessment: Evidence from banking sector
35. Lexicon-based prompt for financial dimensional sentiment analysis10.1016/j.eswa.2023.122936 ↗
36. Financial Risk Prediction and Management using Machine Learning and Natural Language Processing
37. Explainable hybrid word representations for sentiment analysis of financial news10.1016/j.neunet.2023.04.011 ↗
38. Tan, H., and Xie, Y. (2025). Financial text analysis and credit risk assessment using a GPT-4 and improved BERT fusion model. PLoS ONE, 20.10.1371/journal.pone.0336217 ↗
39. A Financial Risk Prediction Method Based on Conditional Random Fields10.1142/S0129156425403936 ↗
40. Zhang, G., Zeng, H., and Jiang, L. (2026). Uni-FinLLM: A Unified Multimodal Large Language Model with Modular Task Heads for Micro-Level Stock Prediction and Macro-Level Systemic Risk Assessment. arXiv.
41. Chiu, Y.T., and Bai, Z.H. (2025, January 10). Translation or multilingual retrieval? evaluating cross-lingual search strategies for traditional chinese financial documents. Proceedings of the FinTech in AI CUP Special Session, Tokyo, Japan.
42. Wang, L. (2024, January 23–25). Cross-Lingual NLP: Bridging Language Barriers with Multilingual Model. Proceedings of the 2024 International Conference on Electronics and Devices, Computational Science (ICEDCS), Marseille, France.10.1109/ICEDCS64328.2024.00185 ↗
43. Cao, Y., Chen, Z., Kumar, P., Pei, Q., Yu, Y., Li, H., Dimino, F., Ausiello, L., Subbalakshmi, K., and Ndiaye, P.M. (2025, January 12–15). RiskLabs: Predicting financial risk using large language model based on multimodal and multi-sources data. Proceedings of the 2025 IEEE International Conference on Data Mining Workshops (ICDMW), Washington, DC, USA.10.1109/ICDMW69685.2025.00107 ↗
44. Nie, Y., Kong, Y., Dong, X., Mulvey, J.M., Poor, H.V., Wen, Q., and Zohren, S. (2024). A survey of large language models for financial applications: Progress, prospects and challenges. arXiv.
45. Chiang, C., Li, D., Ying, R., Wang, Y., Gan, Q., and Li, J. (2025, January 14–16). Deep Learning-Based Dynamic Graph Framework for Robust Corporate Financial Health Risk Prediction. Proceedings of the 2025 3rd International Conference on Mathematics and Machine Learning, Nanjing, China.10.1145/3783779.3783796 ↗
46. Target-oriented causal representation learning for robust cross-market return prediction
47. Box, G.E., Jenkins, G.M., Reinsel, G.C., and Ljung, G.M. (2015). Time Series Analysis: Forecasting and Control, Wiley.
48. Support vector regression
49. Long short-term memory10.1162/neco.1997.9.8.1735 ↗
50. Cho, K., Van Merriënboer, B., Gulçehre, Ç., Bahdanau, D., Bougares, F., Schwenk, H., and Bengio, Y. (2014, January 25–29). Learning phrase representations using RNN encoder–decoder for statistical machine translation. Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP), Doha, Qatar.10.3115/v1/D14-1179 ↗
51. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017, January 4–9). Attention is all you need. Proceedings of the 31st International Conference on Neural Information Processing Systems, Long Beach, CA, USA.
52. Devlin, J., Chang, M.W., Lee, K., and Toutanova, K. (2019, January 2–7). Bert: Pre-training of deep bidirectional transformers for language understanding. Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long and Short Papers), Minneapolis, MN, USA.
53. Pires, T., Schlinger, E., and Garrette, D. (August, January 28). How multilingual is multilingual BERT?. Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics, Florence, Italy.
54. Ngiam, J., Khosla, A., Kim, M., Nam, J., Lee, H., and Ng, A.Y. (July, January 28). Multimodal deep learning. Proceedings of the 28th International Conference on Machine Learning, Bellevue, WA, USA.