Intelligent Decision Forest Models for Customer Churn Prediction
Source abstract
Abstract
Customer churn is a critical issue impacting enterprises and organizations, particularly in the emerging and highly competitive telecommunications industry. It is important to researchers and industry analysts interested in projecting customer behavior to separate churn from non-churn consumers. The fundamental incentive is a firm’s intent desire to keep current consumers, along with the exorbitant expense of gaining new ones. Many solutions have been developed to address customer churn prediction (CCP), such as rule-based and machine learning (ML) solutions. However, the issue of scalability and robustness of rule-based customer churn solutions is a critical drawback, while the imbalanced nature of churn datasets has a detrimental impact on the prediction efficacy of conventional ML techniques in CCP. As a result, in this study, we developed intelligent decision forest (DF) models for CCP in telecommunication. Specifically, we investigated the prediction performances of the logistic model tree (LMT), random forest (RF), and Functional Trees (FT) as DF models and enhanced DF (LMT, RF, and FT) models based on weighted soft voting and weighted stacking methods. Extensive experimentation was performed to ascertain the efficacy of the suggested DF models utilizing publicly accessible benchmark telecom CCP datasets. The suggested DF models efficiently distinguish churn from non-churn consumers in the presence of the class imbalance problem. In addition, when compared to baseline and existing ML-based CCP methods, comparative findings showed that the proposed DF models provided superior prediction performances and optimal solutions for CCP in the telecom industry. Hence, the development and deployment of DF-based models for CCP and applicable ML tasks are recommended.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Customer churn and segmentation · Consumer Retail Behavior Studies · Customer Service Quality and Loyalty
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Science, University of Ilorin, Ilorin 1515, Nigeria
Department of Computer and Information Science, Universiti Teknologi PETRONAS, Seri Iskandar 32610, Malaysia
Department of Electrical and Computer Engineering, Western University, London, ON N6A 5B9, Canada
Division of Science, Yale-NUS College, Singapore 138533, Singapore
Department of Technical Informatics and Telecommunications, Gdansk University of Technology, Gabriela Narutowicza 11/12, 80-233 Gdansk, Poland
References (71)
Show source-provided references
1. Customer churn prediction system: A machine learning approach10.1007/s00607-021-00908-y ↗
2. Customer Churn Prediction in Telecommunication Industry Using Decision Tree and Artificial Neural Network Algorithms
3. Park, S.-H., Kim, M.-Y., Kim, Y.-J., and Park, Y.-H. (2022). A Deep Learning Approach to Analyze Airline Customer Propensities: The Case of South Korea. Appl. Sci., 12.10.3390/app12041916 ↗
4. Arifin, A.S. (2020, January 25–27). Telecommunication service subscriber churn likelihood prediction analysis using diverse machine learning model. Proceedings of the 2020 3rd International Conference on Mechanical, Electronics, Computer, and Industrial Technology (MECnIT), Medan, Indonesia.
5. Domingos, E., Ojeme, B., and Daramola, O. (2021). Experimental analysis of hyperparameters for deep learning-based churn prediction in the banking sector. Computation, 9.10.3390/computation9030034 ↗
6. Xiong, Y., Tao, J., Zhao, S., Wu, R., Shen, X., Lyu, T., Fan, C., Hu, Z., Zhao, S., and Pan, G. (2022). Explainable AI for Cheating Detection and Churn Prediction in Online Games. IEEE Trans. Games.
7. Sabourin, V., and Jabo, J.T. (2022). IoT Benefits and Growth Opportunities for the Telecom Industry: Key Technology Drivers for Companies, CRC Press.10.1201/9781003294412 ↗
8. Brânduşoiu, I., Toderean, G., and Beleiu, H. (2016, January 9–10). Methods for churn prediction in the pre-paid mobile telecommunications industry. Proceedings of the 2016 International conference on communications (COMM), Bucharest, Romania.10.1109/ICComm.2016.7528311 ↗
9. Cao, S., Liu, W., Chen, Y., and Zhu, X. (2019, January 23–25). Deep learning based customer churn analysis. Proceedings of the 2019 11th International Conference on Wireless Communications and Signal Processing (WCSP), Xi’an, China.10.1109/WCSP.2019.8927877 ↗
10. Mishra, A., and Reddy, U.S. (2017, January 23–24). A comparative study of customer churn prediction in telecom industry using ensemble based classifiers. Proceedings of the 2017 International Conference on Inventive Computing and Informatics (ICICI), Coimbatore, India.10.1109/ICICI.2017.8365230 ↗
11. Zhang, T., Moro, S., and Ramos, R.F. (2022). A Data-Driven Approach to Improve Customer Churn Prediction Based on Telecom Customer Segmentation. Future Internet, 14.10.3390/fi14030094 ↗
12. Telecom churn prediction and used techniques, datasets and performance measures: A review10.1007/s11235-020-00727-0 ↗
13. Customer churn prediction in the telecommunication sector using a rough set approach10.1016/j.neucom.2016.12.009 ↗
14. Customer churn prediction in telecommunication industry using data certainty10.1016/j.jbusres.2018.03.003 ↗
15. Customer Churn Prediction in Telecommunication Industry Using Deep Learning
16. Hybrid approach using machine learning algorithms for customers’ churn prediction in the telecommunications industry10.1002/cpe.6627 ↗
17. Anovel HEOMGA Approach for Class Imbalance Problem in the Application of Customer Churn Prediction10.1007/s42979-021-00850-y ↗
18. A survey on addressing high-class imbalance in big data10.1186/s40537-018-0151-6 ↗
19. Wang, L., Xu, S., Wang, X., and Zhu, Q. (2021, January 2–9). Addressing class imbalance in federated learning. Proceedings of the AAAI Conference on Artificial Intelligence, Palo Alto, CA, USA.
20. Software defect prediction: Analysis of class imbalance and performance stability
21. Balogun, A.O., Lafenwa-Balogun, F.B., Mojeed, H.A., Adeyemo, V.E., Akande, O.N., Akintola, A.G., Bajeh, A.O., and Usman-Hamza, F.E. (2020, January 1–4). SMOTE-based homogeneous ensemble methods for software defect prediction. Proceedings of the International Conference on Computational Science and its Applications, Cagliari, Italy.10.1007/978-3-030-58817-5_45 ↗
22. Explainable decision forest: Transforming a decision forest into an interpretable tree10.1016/j.inffus.2020.03.013 ↗
23. Churn prediction in the telecommunications sector using support vector machines
24. Hossain, M.M., and Miah, M.S. (2015, January 21–23). Evaluation of different SVM kernels for predicting customer churn. Proceedings of the 2015 18th International Conference on Computer and Information Technology (ICCIT), Dhaka, Bangladesh.10.1109/ICCITechn.2015.7488032 ↗
25. Mohammad, N.I., Ismail, S.A., Kama, M.N., Yusop, O.M., and Azmi, A. (2019, January 26–28). Customer churn prediction in telecommunication industry using machine learning classifiers. Proceedings of the 3rd International Conference on Vision, Image and Signal Processing, Vancouver, BC, Canada.10.1145/3387168.3387219 ↗
26. Predicting customer churn in mobile telephony industry using probabilistic classifiers in data mining
27. A neuro-fuzzy classifier for customer churn prediction
28. Zhang, C., Li, H., Xu, G., and Zhu, X. (2021, January 23–25). Customer churn model based on complementarity measure and random forest. Proceedings of the 2021 International Conference on Computer, Blockchain and Financial Development (CBFD), Nanjing, China.10.1109/CBFD52659.2021.00026 ↗
29. Karanovic, M., Popovac, M., Sladojevic, S., Arsenovic, M., and Stefanovic, D. (2018, January 20–21). Telecommunication services churn prediction-deep learning approach. Proceedings of the 2018 26th Telecommunications Forum (TELFOR), Belgrade, Serbia.10.1109/TELFOR.2018.8612067 ↗
30. Spanoudes, P., and Nguyen, T. (2017). Deep learning in customer churn prediction: Unsupervised feature learning on abstract company independent feature vectors. arXiv.
31. Deep learning as a vector embedding model for customer churn10.1016/j.procs.2021.01.048 ↗
32. Prashanth, R., Deepak, K., and Meher, A.K. (2017, January 15–20). High accuracy predictive modelling for customer churn prediction in telecom industry. Proceedings of the International Conference on Machine Learning and Data Mining in Pattern Recognition, New York, NY, USA.10.1007/978-3-319-62416-7_28 ↗
33. Agrawal, S., Das, A., Gaikwad, A., and Dhage, S. (2018, January 11–12). Customer churn prediction modelling based on behavioural patterns analysis using deep learning. Proceedings of the 2018 International Conference on Smart Computing and Electronic Enterprise (ICSCEE), Selangor, Malaysia.10.1109/ICSCEE.2018.8538420 ↗
34. A Stacking-Based Data Mining Solution to Customer Churn Prediction
35. Xu, T., Ma, Y., and Kim, K. (2021). Telecom churn prediction system based on ensemble learning using feature grouping. Appl. Sci., 11.10.3390/app11114742 ↗
36. Saghir, M., Bibi, Z., Bashir, S., and Khan, F.H. (2019, January 8–12). Churn prediction using neural network based individual and ensemble models. Proceedings of the 2019 16th International Bhurban Conference on Applied Sciences and Technology (IBCAST), Islamabad, Pakistan.10.1109/IBCAST.2019.8667113 ↗
37. An ensemble based approach using a combination of clustering and classification algorithms to enhance customer churn prediction in telecom industry10.7717/peerj-cs.854 ↗
38. Logistic model trees10.1007/s10994-005-0466-3 ↗
39. Adeyemo, V.E., Balogun, A.O., Mojeed, H.A., Akande, N.O., and Adewole, K.S. (2020, January 8–9). Ensemble-based logistic model trees for website phishing detection. Proceedings of the International Conference on Advances in Cyber Security, Penang, Malaysia.10.1007/978-981-33-6835-4_41 ↗
40. Improving the phishing website detection using empirical analysis of Function Tree and its variants10.1016/j.heliyon.2021.e07437 ↗
41. Functional trees10.1023/B:MACH.0000027782.67192.13 ↗
42. Balogun, A.O., Adewole, K.S., Bajeh, A.O., and Jimoh, R.G. (2021, January 24–25). Cascade generalization based functional tree for website phishing detection. Proceedings of the International Conference on Advances in Cyber Security, Penang, Malaysia.10.1007/978-981-16-8059-5_17 ↗
43. Cutler, A., Cutler, D.R., and Stevens, J.R. (2012). Random forests. Ensemble Machine Learning, Springer.10.1007/978-1-4419-9326-7_5 ↗
44. Random forests for global sensitivity analysis: A selective review10.1016/j.ress.2020.107312 ↗
45. Balogun, A.O., Mojeed, H.A., Adewole, K.S., Akintola, A.G., Salihu, S.A., Bajeh, A.O., and Jimoh, R.G. (2021, January 1). Optimized decision forest for website phishing detection. Proceedings of the Computational Methods in Systems and Software, Online.10.1007/978-3-030-90321-3_47 ↗
46. Decision forest: Twenty years of research10.1016/j.inffus.2015.06.005 ↗
47. Akintola, A.G., Balogun, A.O., Capretz, L.F., Mojeed, H.A., Basri, S., Salihu, S.A., Usman-Hamza, F.E., Sadiku, P.O., Balogun, G.B., and Alanamu, Z.O. (2022). Empirical Analysis of Forest Penalizing Attribute and Its Enhanced Variations for Android Malware Detection. Appl. Sci., 12.10.3390/app12094664 ↗
48. Phishing website detection: Forest by penalizing attributes algorithm and its enhanced variations10.1007/s13369-020-04802-1 ↗
49. Balogun, A.O., Odejide, B.J., Bajeh, A.O., Alanamu, Z.O., Usman-Hamza, F.E., Adeleke, H.O., Mabayoje, M.A., and Yusuff, S.R. (2022, January 4–7). Empirical Analysis of Data Sampling-Based Ensemble Methods in Software Defect Prediction. Proceedings of the 22nd International Conference on Computational Science and Its Applications (ICCSA), Malaga, Spain.10.1007/978-3-031-10548-7_27 ↗
50. Software Defect Prediction Using Ensemble Learning: An ANP Based Evaluation Method10.46792/fuoyejet.v3i2.200 ↗
51. A PROMETHEE based evaluation of software defect predictors
52. Xu, Z., Liu, J., Yang, Z., An, G., and Jia, X. (2016, January 23–27). The impact of feature selection on defect prediction performance: An empirical comparison. Proceedings of the 2016 IEEE 27th International Symposium on Software Reliability Engineering (ISSRE), Ottawa, ON, Canada.10.1109/ISSRE.2016.13 ↗
53. The performance stability of defect prediction models with class imbalance: An empirical study10.1587/transinf.2016EDP7204 ↗
54. Yadav, S., and Shukla, S. (2016, January 27–28). Analysis of k-fold cross-validation over hold-out validation on colossal datasets for quality classification. Proceedings of the 2016 IEEE 6th International Conference on Advanced Computing (IACC), Bhimavaram, India.10.1109/IACC.2016.25 ↗
55. Choice of V for V-fold cross-validation in least-squares density estimation
56. Balogun, A.O., Basri, S., Jadid, S.A., Mahamad, S., Al-momani, M.A., Bajeh, A.O., and Alazzawi, A.K. (2020, January 15). Search-Based Wrapper Feature Selection Methods in Software Defect Prediction: An Empirical Analysis. Proceedings of the Computer Science Online Conference, Zlin, Czech Republic.10.1007/978-3-030-51965-0_43 ↗
57. The WEKA data mining software: An update10.1145/1656274.1656278 ↗
58. Crawley, M.J. (2012). The R Book, John Wiley & Sons.
59. Hybrid ensemble learning approaches to customer churn prediction10.1108/K-04-2020-0214 ↗
60. Customer churn prediction in telecom using machine learning in big data platform10.1186/s40537-019-0191-6 ↗
61. Faris, H. (2018). A hybrid swarm intelligent neural network model for customer churn prediction and identifying the influencing factors. Information, 9.10.3390/info9110288 ↗
62. A proposed churn prediction model
63. Churn prediction in telecommunication using logistic regression and logit boost10.1016/j.procs.2020.03.187 ↗
64. Chicco, D., and Jurman, G. (2020). The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation. BMC Genom., 21.10.1186/s12864-019-6413-7 ↗
65. On the performance of Matthews correlation coefficient (MCC) for imbalanced dataset10.1016/j.patrec.2020.03.030 ↗
66. Intelligent tree-based ensemble approaches for phishing website detection
67. Odejide, B.J., Bajeh, A.O., Balogun, A.O., Alanamu, Z.O., Adewole, K.S., Akintola, A.G., Salihu, S.A., Usman-Hamza, F.E., and Mojeed, H.A. (2022, January 26–30). An Empirical Study on Data Sampling Methods in Addressing Class Imbalance Problem in Software Defect Prediction. Proceedings of the Computer Science Online Conference, Online.10.1007/978-3-031-09070-7_49 ↗
68. Jain, H., Khunteta, A., and Shrivastav, S.P. (2021). Telecom Churn Prediction Using Seven Machine Learning Experiments integrating Features engineering and Normalization. Res. Sq., preprint.10.21203/rs.3.rs-239201/v1 ↗
69. An effective customer churn prediction model using adaptive gain with back propagation neural network in cloud computing environment10.36872/LEPI/V51I1/301034 ↗
70. Fuzzy particle swarm optimization (FPSO) based feature selection and hybrid kernel distance based possibilistic fuzzy local information C-means (HKD-PFLICM) clustering for churn prediction in telecom industry10.1007/s42452-021-04576-7 ↗
71. Impact of Hyperparameters on Deep Learning Model for Customer Churn Prediction in Telecommunication Sector10.1155/2022/4720539 ↗