journal article·2024-05-27Open access

Comparing Two Deep-Learning Models in Discrete Choice Analysis of Customers’ Mobile Plan Preferences

Chidimma Oliobi, Knowledge Chinhamu, Temesgen Zewotir

Applied Sciences· Volume 14· Issue 11

Abstract

A discrete choice experiment (DCE) was used to investigate students’ preferences for mobile phone plans at a South African university. Upon obtaining the data, this study compares the predictive performance of two machine-learning models for discrete choice analysis and makes recommendations for model selection. Using concepts from blocked fractional factorial designs, a locally optimal DCE was created for the choice sets. This contrasts with alternative ways that, in practice, could be more difficult, especially when there is a large number of attributes. The call rate, data speed, customer service, premiums, and network coverage were the features considered. A total of 180 respondents were chosen from the student population using a two-stage sample approach, and data were gathered through face-to-face interviews. In this study, two deep-learning models are examined to analyze the data, which are the artificial neural network (ANN) and the extreme gradient boosting (XGBoost) models. Root mean square error (RMSE) and mean absolute error (MAE) are used to assess the model fitness, while accuracy, precision, recall and F1 score were used to compare the models’ performance. The results showed that XGBoost performs better compared to ANN in model fitness and prediction. Thus, the use of the XGBoost deep-learning model in choice preference modeling is therefore encouraged.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Human Mobility and Location-Based Analysis

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Statistics, School of Mathematics, Statistics and Computer Science, College of Agriculture, Engineering and Science, University of Kwazulu-Natal, Durban 3630, South Africa

References (52)

Show source-provided references
1. da Silva, M.M., and Guerreiro, J. (2020). On the 5G and Beyond. Appl. Sci., 10.10.3390/app10207091 ↗
2. A survey on 5G: The next generation of mobile communication10.1016/j.phycom.2015.10.006 ↗
3. Lindquist. How important are mobile broadband networks for the global economic development?10.1016/j.infoecopol.2018.10.001 ↗
4. Umoh, V., Ekpe, U., Davidson, I., and Akpan, J. (2023). Mobile Broadband Adoption, Performance Measurements and Methodology: A Review. Electronics, 12.10.3390/electronics12071630 ↗
5. Factors Determinants the Choice of Mobile Service Providers: Structural Equation Modeling Approach on Bangladeshi Consumers
6. Determinants of Users’ Choice of Mobile Service Providers in the Nigerian Telecommunications Market
7. Consumer preferences for improvements in mobile telecommunication services10.1016/j.tele.2015.07.002 ↗
8. Analysis of consumer preferences for mobile telecom plans using a discrete choice experiment10.1016/j.telpol.2016.12.009 ↗
9. Louviere, J., Hensher, D.A., and Swait, J. (2000). Combining sources of preference data. Stated Choice Methods, Cambridge University Press.10.1017/CBO9780511753831 ↗
10. Multinomial Logit Models in Marketing—From Fundamentals to State-of-the-Art10.15358/0344-1369-2017-3-32 ↗
11. Modelling Willingness to Pay of Electricity Supply Using Machine Learning Approach10.53964/mem.2022009 ↗
12. Pettitt and Bayesian Change Point Detcetions in The Price of Kerosene in The Southwestern Region of Nigeria10.18517/ijods.3.1.33-44.2022 ↗
13. COVID-19 Contact Tracing Apps: Predicted Uptake in the Netherlands Based on a Discrete Choice Experiment10.2196/20741 ↗
14. Public preference for COVID-19 vaccines in China: A discrete choice experiment10.1111/hex.13140 ↗
15. Discrete-choice modelling of patient preferences for modes of drug administration10.1186/s13561-017-0162-6 ↗
16. Exploring preferences for improved fish species among farmers: A discrete choice experiment applied in rural Odisha, India10.1016/j.aquaculture.2024.740627 ↗
17. Block, J.B., Danne, M., and Mußhoff, O. (2024). Farmers’ Willingness to Participate in a Carbon Sequestration Program—A Discrete Choice Experiment. Environ. Manag., 1–18.10.1007/s00267-024-01963-9 ↗
18. Prospective tourist preferences for sustainable tourism development in Small Island Developing States10.1016/j.tourman.2020.104178 ↗
19. The state of the art of discrete choice experiments in food research10.1016/j.foodqual.2022.104678 ↗
20. Which private investors are willing to pay for sustainable investments? Empirical evidence from stated choice experiments10.1016/j.jbankfin.2019.03.007 ↗
21. A review of the application and contribution of discrete choice experiments to inform human resources policy interventions10.1186/1478-4491-7-62 ↗
22. Estimating demand for fixed-line telecommunication bundles10.1016/j.telpol.2017.01.011 ↗
23. Analysis of consumer preferences for prepaid mobile internet packages in Iran: A Discrete Choice Experiment10.20885/ejem.vol12.iss1.art4 ↗
24. Modelling Students’ Preferences for Mobile Telecommunication Plans: A Discrete Choice Experiment10.9734/acri/2021/v21i330234 ↗
25. Over-the-top bundled services in the Korean broadcasting and telecommunications market: Consumer preference analysis using a mixed logit model10.1016/j.tele.2021.101599 ↗
26. (1973). Conditional Logit Analysis of Qualitative Choice Behavior. Frontiers in Econometrics, Academic Press.
27. Train, K.E. (2001). Discrete Choice Methods with Simulation, Cambridge University Press.10.1017/CBO9780511805271 ↗
28. Discrete Choice Analysis: Theory and Application to Travel Demand
29. Airline itinerary choice modeling using machine learning10.1016/j.jocm.2018.02.002 ↗
30. Values, attitudes and travel behavior: A hierarchical latent variable mixed logit model of travel mode choice10.1007/s11116-013-9504-3 ↗
31. Inclusion of latent variables in Mixed Logit models: Modelling and forecasting10.1016/j.tra.2010.07.007 ↗
32. Prediction and behavioral analysis of travel mode choice: A comparison of machine learning and logit models10.1016/j.tbs.2020.02.003 ↗
33. Pattern Recognition and Machine Learning10.1117/1.2819119 ↗
34. Lazar, A., Ballow, A., Jin, L., Spurlock, C.A., Sim, A., and Wu, K. (2019, January 9–12). Machine Learning for Prediction of Mid to Long Term Habitual Transportation Mode Use. Proceedings of the 2019 IEEE International Conference on Big Data (Big Data), Los Angeles, CA, USA.10.1109/BigData47090.2019.9006411 ↗
35. A comparative study of machine learning classifiers for modeling travel mode choice10.1016/j.eswa.2017.01.057 ↗
36. Applying a random forest method approach to model travel mode choice behavior10.1016/j.tbs.2018.09.002 ↗
37. Comparison of Four Types of Artificial Neural Network and a Multinomial Logit Model for Travel Mode Choice Modeling10.1177/0361198118796971 ↗
38. Paredes, M., Hemberg, E., O’Reilly, U.-M., and Zegras, C. (2017, January 26–28). Machine learning or discrete choice models for car ownership demand estimation and prediction?. Proceedings of the 2017 5th IEEE International Conference on Models and Technologies for Intelligent Transportation Systems (MT-ITS), Naples, Italy.10.1109/MTITS.2017.8005618 ↗
39. Modeling Mode Choice Behaviors for Public Transport Commuters in Beijing10.1061/(ASCE)UP.1943-5444.0000459 ↗
40. Household travel mode choice estimation with large-scale data—An empirical analysis based on mobility data in Milan10.1080/15568318.2019.1686782 ↗
41. Travel Mode Choice Modeling: A Comparison of Bayesian Networks and Neural Networks
42. A two-step method for mode choice estimation with socioeconomic and spatial information10.1016/j.spasta.2014.12.002 ↗
43. Mode Choice Analysis Using Random Forrest Decision Trees10.1016/j.trpro.2016.11.119 ↗
44. Machine Learning Travel Mode Choices: Comparing the Performance of an Extreme Gradient Boosting Model with a Multinomial Logit Model10.1177/0361198118773556 ↗
45. Modeling Smallholder Farmers’ Preferences for Soil Management Measures: A Case Study from South Ethiopia10.1016/j.ecolecon.2017.11.027 ↗
46. Kantardzic, M. (2019). Data Mining: Concepts, Models, Methods, and Algorithms, Wiley-IEEE Press. [3rd ed.]. Available online: https://ieeexplore.ieee.org/servlet/opac?bknumber=6105606.10.1002/9781119516057 ↗
47. Deep learning
48. The Performance of Artificial Neural Network Using Heterogeneous Transfer Functions10.18517/ijods.2.2.92-103.2021 ↗
49. Ripley, B.D. (1996). Pattern Recognition and Neural Networks, Cambridge University Press.10.1017/CBO9780511812651 ↗
50. Shalev-Shwartz, S., and Ben-David, S. (2014). Understanding Machine Learning, Cambridge University Press.10.1017/CBO9781107298019 ↗
51. Chen, T., and Guestrin, C. (2016, January 13–17). XGBoost. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
52. Toward safer highways, application of XGBoost and SHAP for real-time accident detection and feature analysis10.1016/j.aap.2019.105405 ↗