An Enhanced Multi-Task Deep Learning Framework for Joint Prediction of Customer Churn and Downsell
Source abstract
Abstract
Customer churn refers to the termination of a customer’s business relationship with a bank, representing a direct loss of future revenue. Product downsell manifests as a reduction in the number of financial products held or a downgrade in service tier, often signaling early customer disengagement. Accurately identifying customers at risk of these two behaviors has become a cornerstone of profitable growth in the competitive retail banking industry as downsell frequently serves as a precursor to total churn. However, the existing research typically treats these highly correlated behaviors as independent prediction tasks, overlooking their intrinsic link and failing to address the critical challenges of class imbalance and regulatory demands for model interpretability. To tackle these problems, we propose an enhanced multi-task learning network (EMTL-Net), a deep learning framework specifically designed to capture the nuanced interplay between churn and downsell behaviors. EMTL-Net introduces an explicit feature interaction module to enhance the modeling of high-order feature relationships and utilizes a shared representation layer to extract universal customer risk patterns, enabling the joint prediction of churn and downsell. Furthermore, we employ Focal Loss as the training objective to dynamically adjust sample weights, effectively mitigating the class imbalance problem. Critically, to meet financial compliance requirements, we implement a SHAP-based interpretation mechanism that is compatible with multi-task outputs, providing preliminary insights into feature importance. Formal validation of interpretability claims remains an important direction for future research. The experimental results on a publicly available pedagogical bank customer benchmark dataset demonstrate that EMTL-Net achieves excellent performance on both tasks. For churn prediction, the model achieves an AUC of 0.8259, an accuracy of 0.8361, and an F1-score of 0.6235, significantly outperforming the existing baseline models. For downsell prediction (noting that the downsell label is rule-derived from the number of products held), the model achieves an AUC of 0.8932, an accuracy of 0.8571, and an F1-score of 0.7504. Ablation studies confirm the critical contributions of the explicit feature interaction module, Focal Loss, and the residual structure to model performance. Crucially, the interpretability analysis corroborates business intuition by identifying customer age, account balance, and product holdings as dominant churn drivers—a consistency that reinforces the model’s credibility and practical utility in high-stakes financial environments.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Customer churn and segmentation · Customer Service Quality and Loyalty · Recommender Systems and Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Economics and Management, North University of China, Taiyuan 030051, China
School of Computer Science and Technology, Taiyuan University of Science and Technology, Taiyuan 030024, China
Funding
Shanxi Federation of Social Sciences · Doctoral Start-up Funds of North University of China · Postgraduate Education Innovation Program of Shanxi Province
References (45)
Show source-provided references
1. A comprehensive survey on customer churn analysis studies
2. Improving bank customer churn prediction with feature reduction using GA10.1038/s41598-025-23867-2 ↗
3. Wang, Q., Zhang, H., Ji, J., Tang, C., and Tang, Y. (2023). Dendritic neural regression model trained by chicken swarm optimization algorithm for bank customer churn prediction. Proceedings of the International Conference on Neural Information Processing (ICONIP), Changsha, China, 20–23 November 2023, Springer Nature.10.1007/978-981-99-8184-7_20 ↗
4. Bank customer churn prediction using machine learning framework
5. Bank customer churn prediction using machine learning
6. Prediction of bank credit customers churn based on machine learning and interpretability analysis10.3934/DSFE.2025002 ↗
7. Bank customer churn prediction with machine learning methods
8. Zhang, N., Zheng, Y., and Duan, C. (2024, January 26–28). Bank customer churn prediction based on random forest algorithm. Proceedings of the 5th International Conference on Computer Information and Big Data Applications (CIBDA), Wuhan, China.10.1145/3671151.3671331 ↗
9. A novel deep learning based customer churn prediction for the banking sectors with efficient feature selection strategy
10. Predict customer churn using combination deep learning networks model10.1007/s00521-023-09327-w ↗
11. Neural multi-task learning in drug design10.1038/s42256-023-00785-4 ↗
12. A multi-task test case optimization framework with integrated explainable AI for customer churn prediction: TB Trinh et al10.1007/s11227-025-07816-4 ↗
13. Peng, K., Peng, Y., and Li, W. (2023). Research on customer churn prediction and model interpretability analysis. PLoS ONE, 18.10.1371/journal.pone.0289724 ↗
14. Imani, M., Joudaki, M., Beikmohammadi, A., and Arabnia, H.R. (2025). Customer churn prediction: A systematic review of recent advances, trends, and challenges in machine learning and deep learning. Mach. Learn. Knowl. Extr., 7.10.20944/preprints202503.1969.v2 ↗
15. TBformer: Multi-Scale Transformer with Time-Behavior Attention for Multi-Modal Customer Churn Prediction10.1109/TCE.2025.3563905 ↗
16. Wang, Y., Zheng, S., Liu, G., and Li, J. (2023, January 24–26). Research on bank customer churn model based on attention network. Proceedings of the 2023 IEEE 2nd International Conference on Electrical Engineering, Big Data and Algorithms (EEBDA), Changchun, China.10.1109/EEBDA56825.2023.10090614 ↗
17. Yang, C., Xia, G., Zheng, L., Zhang, X., and Yu, C. (2025). Customer Churn Prediction Based on Coordinate Attention Mechanism with CNN-BiLSTM. Electronics, 14.10.3390/electronics14101916 ↗
18. Imbalanced customer churn classification using a new multi-strategy collaborative processing method10.1016/j.eswa.2024.123251 ↗
19. A framework to improve churn prediction performance in retail banking10.1186/s40854-023-00558-3 ↗
20. Ensemble-based customer churn prediction in banking: A voting classifier approach for improved client retention using demographic and behavioral data10.1007/s43621-025-00807-8 ↗
21. Experimental data analysis to recognize and visualise the factors contributing to bank customer churn prediction using ensemble learning models10.9734/ajrcos/2025/v18i5668 ↗
22. Huseyinov, I., and Okocha, O. (2022, January 15–16). A machine learning approach to the prediction of bank customer churn problem. Proceedings of the 2022 3rd International Informatics and Software Engineering Conference (IISEC), Ankara, Turkey.10.1109/IISEC56263.2022.9998299 ↗
23. He, H. (2022, January 14–16). Bank customer churn prediction analysis based on improved WOA-SVM. Proceedings of the 2022 3rd International Conference on Electronic Communication and Artificial Intelligence (IWECAI), Zhuhai, China.10.1109/IWECAI55315.2022.00093 ↗
24. Murindanyi, S., Mugalu, B.W., Nakatumba-Nabende, J., and Marvin, G. (2023, January 11–13). Interpretable machine learning for predicting customer churn in retail banking. Proceedings of the 2023 7th International Conference on Trends in Electronics and Informatics (ICOEI), Tirunelveli, India.10.1109/ICOEI56765.2023.10125859 ↗
25. Sun, P. (2025, January 14–17). Temporal graph networks for bank customer churn prediction with dynamic. Proceedings of the 2nd International Conference on Data Science and Engineering ICDSE—Volume 1, Alberta, Canada.10.5220/0013688900004670 ↗
26. Pires, I.T. (2023). Customer Churn Prediction in Portuguese Banking Sector: Using a Machine Learning Approach. [Master’s Thesis, Universidade NOVA de Lisboa].
27. Li, L.J., and Junn, K.Y. (2023, January 13–14). Decision tree with genetic algorithm for bank customer churn prediction. Proceedings of the 2023 IEEE 21st Student Conference on Research and Development, SCOReD, Kuala Lumpur, Malaysia.10.1109/SCOReD60679.2023.10563975 ↗
28. Jiao, Y., and Xiu, P. (2025). A lightweight attention-mlp ensemble for interpretable bank customer churn prediction. International Conference on Information, Computing and Technology (ICICT), Springer.10.1007/978-3-032-11957-5_18 ↗
29. Bank customer churn prediction using SMOTE: A comparative analysis
30. Berrada Chakour, O., Maizate, A., Ettaoufik, A., and Aissaoui, K. (2025, January 16–18). Enhancing bank customer churn prediction from an imbalanced dataset using machine learning and SMOTE-Tomek resampling. Proceedings of the International Conference on Connected Objects and Artificial Intelligence (COAI), Casablanca, Morocco.10.1007/978-3-032-01536-5_127 ↗
31. Gulati, A., Sharma, H., and Bhardwaj, V. (2025, January 28–30). Bank customer churn prediction using machine learning: A comparative study with SMOTE-based class balancing. Proceedings of the 2025 10th International Conference on Communication and Electronics Systems (ICCES), Coimbatore, India.10.1109/ICCES67310.2025.11336881 ↗
32. Development of a customer churn model for banking industry based on hard and soft data fusion10.1109/ACCESS.2023.3257352 ↗
33. A novel hybrid forecasting approach for customers churn in banking industry10.1142/S0219649222500897 ↗
34. Optimized churn prediction using ensemble-based feature selection via second-order cone programming10.1007/s10479-025-06543-6 ↗
35. Silveira, L.J., Pinheiro, P.R., and de Melo Junior, L.S. (2021). A novel model structured on predictive churn methods in a banking organization. J. Risk Financ. Manag., 14.10.3390/jrfm14100481 ↗
36. Prakash, R. (2025). Customer Churn Prediction in Retail Banking Using Predictive Analytics. [Ph.D. Thesis, National College of Ireland].
37. Gebreegziabher, B. (2022). Bank Customer Churn Prediction Model: The Case of Commercial Bank of Ethiopia. [Ph.D. Thesis, St. Mary’s University].
38. Predicting customers churning in banking industry: A machine learning approach
39. Mardi, A., and Ghorbani, H. (2024, January 29). Customer churn prediction: Leveraging data analysis and machine learning approaches. Proceedings of the 2024 10th International Conference on Artificial Intelligence and Robotics (QICAR), Qazvin, Iran.10.1109/QICAR61538.2024.10496629 ↗
40. Predictive and analytics using data mining and machine learning for customer churn prediction10.47738/jads.v4i4.131 ↗
41. Harbaugh, S.P. (2022). Predicting Retail Bank Customer Churn Using Push, Mooring, and Temporal Inputs with Machine Learning. [Ph.D. Thesis, Northcentral University].
42. AI-Driven Predictive Modeling for Banking Customer Churn: Insights for the US Financial Sector10.62754/joe.v4i1.6188 ↗
43. Bank customer churn and extra benefits prediction using machine learning model
44. Customer churn prediction in the banking sector using Sentence Transformers and a stacking ensemble framework10.56578/ataiml040204 ↗
45. Customer churn prediction model based on hybrid neural networks10.1038/s41598-024-79603-9 ↗