Turkish Telephone Conversations in Credit Risk Management: Natural Language Processing and LSTM Approach
Source abstract
Abstract
This study aims to analyze text data obtained from Turkish phone calls to manage credit risk in the banking sector and predict whether customers will fulfill their payment promises. Data cleaning was identified as a critical step to improve the quality of the texts, and various natural language processing (NLP) techniques were used. The model was built using a two-layer LSTM architecture, starting with a Self-Embedding layer, and achieved approximately 80% accuracy on the test data. The findings indicate that customers who break their payment promises often cite personal life issues such as health problems, family issues, financial difficulties, and religious beliefs to ensure reliability. These results demonstrate the importance of text data in the banking sector, the applicability of different embedding methods to Turkish datasets, and their advantages and disadvantages. Furthermore, the model built using data obtained from customer conversations can help predict credit risk more accurately and contribute to improving call center processes. Automating data cleaning processes and developing speech-to-text translation tools are recommended for future studies.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Financial Distress and Bankruptcy Prediction · Mental Health via Writing · Machine Learning in Healthcare
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Statistics, Faculty of Arts & Sciences, Yildiz Technical University, Istanbul 34220, Türkiye
Department of Management Information Systems, Faculty of Business Administration, Marmara University, Istanbul 34180, Türkiye
References (35)
Show source-provided references
1. An experimental comparison of classification algorithms for imbalanced credit scoring data sets10.1016/j.eswa.2011.09.033 ↗
2. Poledna, S., Hinteregger, A., and Thurner, S. (2018). Identifying Systemically Important Companies by Using the Credit Network of an Entire Nation. Entropy, 20.10.3390/e20100792 ↗
3. Forecasting Loan Default in Europe with Machine Learning
4. Graves, A. (2014). Generating Sequences with Recurrent Neural Networks. arXiv.
5. Long Short-Term Memory10.1162/neco.1997.9.8.1735 ↗
6. Sirignano, J., Sadhwani, A., and Giesecke, K. (2018). Deep Learning for Mortgage Risk. arXiv.10.2139/ssrn.2799443 ↗
7. Agricultural loan delinquency prediction using machine learning methods10.22434/IFAMR2020.0019 ↗
8. When Words Sweat: Identifying Signals for Loan Default in the Text of Loan Applications10.1177/0022243719852959 ↗
9. Research on Default Prediction for Credit Card Users Based on XGBoost-LSTM Model10.1155/2021/5080472 ↗
10. When Is a Liability Not a Liability? Textual Analysis, Dictionaries, and 10-Ks10.1111/j.1540-6261.2010.01625.x ↗
11. Credit default prediction from user-generated text in peer-to-peer lending using deep learning10.1016/j.ejor.2021.12.024 ↗
12. Listening to the investors: A novel framework for online lending default prediction using deep learning neural networks10.1016/j.ipm.2020.102236 ↗
13. Credit Risk Evaluation Based on Text Analysis
14. The value of text for small business default prediction: A deep learning approach10.1016/j.ejor.2021.03.008 ↗
15. Lis, S., Kubkowski, M., Borkowska, O., Serwa, D., and Kurpanik, J. (2023). Analyzing Credit Risk Model Problems through NLP-Based Clustering and Machine Learning: Insights from Validation Reports. arXiv.10.21314/JRMV.2024.006 ↗
16. Credit Risk Meets Large Language Models: Building a Risk Indicator from Loan Descriptions in P2P Lending10.4114/intartif.vol28iss75pp220-247 ↗
17. Alamsyah, A., Hafidh, A.A., and Mulya, A.D. (2025). Innovative Credit Risk Assessment: Leveraging Social Media Data for Inclusive Credit Scoring in Indonesia’s Fintech Sector. J. Risk Financ. Manag., 18.10.3390/jrfm18020074 ↗
18. Unleashing the power of text for credit default prediction: Comparing human-written and generative AI-refined texts10.1016/j.ejor.2025.04.032 ↗
19. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2023). Attention Is All You Need. arXiv.
20. Achiam, J., Adler, S., Agarwal, S., Ahmad, L., Akkaya, I., Aleman, F.L., Almeida, D., Altenschmidt, J., and Altman, S. (2024). GPT-4 Technical Report. arXiv.
21. Chen, Z., Liu, Y., Shi, L., Chen, X., Zhao, Y., and Ren, F. (2025). MDEval: Evaluating and Enhancing Markdown Awareness in Large Language Models. arXiv.10.1145/3696410.3714674 ↗
22. Chen, J., Li, J., Peng, Z., Wang, W., Ren, Y., Shi, L., and Hu, X. (2025). LoTA-QAF: Lossless Ternary Adaptation for Quantization-Aware Fine-Tuning. arXiv.
23. Mussakhojayeva, S., Dauletbek, K., Yeshpanov, R., and Varol, H.A. (2023). Multilingual Speech Recognition for Turkic Languages. Information, 14.10.3390/info14020074 ↗
24. Automatic Speech Recognition using Advanced Deep Learning Approaches: A survey10.1016/j.inffus.2024.102422 ↗
25. Customized deep learning based Turkish automatic speech recognition system supported by language model10.7717/peerj-cs.1981 ↗
26. End-to-end neural automatic speech recognition system for low resource languages10.1016/j.eij.2025.100615 ↗
27. Automatic speech-to-text transcription: Evidence from a smartphone survey with voice answers10.1080/13645579.2024.2443633 ↗
28. Borandağ, E. (2024). LSRM: A New Method for Turkish Text Classification. Appl. Sci., 14.10.3390/app142311143 ↗
29. Zümberoğlu, K.B., Dik, S.Z., Karadeniz, B.S., and Sahmoud, S. (2025). Towards Better Sentiment Analysis in the Turkish Language: Dataset Improvements and Model Innovations. Appl. Sci., 15.10.3390/app15042062 ↗
30. Peters, M.E., Neumann, M., Iyyer, M., Gardner, M., Clark, C., Lee, K., and Zettlemoyer, L. (2018, January 1–6). Deep Contextualized Word Representations. Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 (Long Papers), New Orleans, LA, USA.10.18653/v1/N18-1202 ↗
31. Devlin, J., Chang, M.-W., Lee, K., and Toutanova, K. (2019). BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding. arXiv.
32. Bojanowski, P., Grave, E., Joulin, A., and Mikolov, T. (2017). Enriching Word Vectors with Subword Information. arXiv.10.1162/tacl_a_00051 ↗
33. Pascanu, R., Mikolov, T., and Bengio, Y. (2013). On the difficulty of training Recurrent Neural Networks. arXiv.
34. Li, K., and Chen, X. (2025). Machine Learning-Based Lithium Battery State of Health Prediction Research. Appl. Sci., 15.10.3390/app15020516 ↗
35. Górny, K., Kuwałek, P., and Pietrowski, W. (2021). Increasing Electric Vehicles Reliability by Non-Invasive Diagnosis of Motor Winding Faults. Energies, 14.10.3390/en14092510 ↗