journal article·2026-07-29

Retail Sales Forecasting Using Tree-Based Machine Learning Models: An Empirical Study of Preprocessing Configurations and Feature Ablation

Sarah Albassam, Atheer Alqahtani, Amal Alazba

Applied Sciences· Volume 16· Issue 15
Publisher page

Abstract

Sales forecasting plays a critical role in business decision-making, including financial planning, resource allocation, and inventory management. Despite the growing adoption of machine learning in forecasting applications, controlled evaluations of how preprocessing decisions and contextual feature availability affect model performance remain limited. This study presents a controlled benchmarking evaluation that systematically examines preprocessing strategies and contextual feature availability across seven representative tree-based machine learning models, using two publicly available retail datasets: BigMart and Rossmann. Multiple preprocessing configurations are evaluated on both datasets, and ablation studies are conducted on the Rossmann dataset to quantify the independent contribution of seasonal and promotional features and the Customers variable to forecasting accuracy. Results show that GradientBoosting achieved the best performance on BigMart (R2 = 0.611), while RandomForest and ExtraTrees led on Rossmann R2=0.884 under realistic conditions excluding the Customers variable, and R2=0.965 in an ablation scenario where Customers, typically unavailable at forecast time, is included. Ablation analysis confirmed that seasonal and promotional features are critical drivers of forecasting accuracy, and that the Customers variable is the single most influential predictor in the Rossmann dataset. These findings highlight the importance of preprocessing design and contextual feature availability in retail sales forecasting and provide practical insights for building effective forecasting pipelines.
Source: crossref · Quality: baseline

Affiliations

Department of Information Systems, College of Computer and Information Sciences, King Saud University, Riyadh 11451, Saudi Arabia

Funding

King Saud University, Riyadh, Saudi Arabia

References (36)

Show source-provided references
1. Xactly (2026, May 01). Sales Forecasting: What It Is and Why It’s Important. Available online: https://www.xactlycorp.com/blog/forecasting/sales-forecasting-what-it-and-why-its-important.
2. Rostami-Tabar, B., Greene, T., Shmueli, G., and Hyndman, R.J. (2024). Responsible forecasting: Identifying and typifying forecasting harms. arXiv.
3. AI-driven business analytics and decision making10.30574/wjarr.2024.24.1.3093 ↗
4. AI-Powered Sales Forecasting: Transforming Accuracy and Efficiency in Predictive Analytics10.51219/JAIMLD/premkumar-ganesan/280 ↗
5. Addressing seasonality and trend detection in predictive sales forecasting: A machine learning perspective10.32996/jbms.2024.6.2.10 ↗
6. The impact of daily weather on retail sales: An empirical study in brick-and-mortar stores10.1016/j.jretconser.2019.101921 ↗
7. Anwar, M. (2026, May 01). The Importance of Data Preparation for Machine Learning. Available online: https://www.astera.com/type/blog/data-preparation-for-machine-learning.
8. Forecasting financial stability in SMEs: A comprehensive analysis of strategic budgeting and revenue management10.53022/oarjms.2024.8.1.0055 ↗
9. Why do tree-based models still outperform deep learning on tabular data?10.52202/068431-0037 ↗
10. Dharshini, M.P.A., and Vijila, S.A. (2021). Survey of machine learning and deep learning approaches on sales forecasting. Proceedings of the 2021 4th International Conference on Computing and Communications Technologies (ICCCT), IEEE.10.1109/ICCCT53315.2021.9711878 ↗
11. Cheriyan, S., Ibrahim, S., Mohanan, S., and Treesa, S. (2018). Intelligent sales prediction using machine learning techniques. Proceedings of the 2018 International Conference on Computing, Electronics & Communications Engineering (iCCECE), IEEE.10.1109/iCCECOME.2018.8659115 ↗
12. Krishna, A., Akhilesh, V., Aich, A., and Hegde, C. (2018). Sales-forecasting of retail stores using machine learning techniques. Proceedings of the 2018 3rd International Conference on Computational Systems and Information Technology for Sustainable Solutions (CSITSS), IEEE.10.1109/CSITSS.2018.8768765 ↗
13. Swami, D., Shah, A.D., and Ray, S.K. (2020). Predicting future sales of retail products using machine learning. arXiv.
14. Sales prediction using machine learning algorithms
15. Ranjitha, P., and Spandana, M. (2021). Predictive analysis for big mart sales using machine learning algorithms. Proceedings of the 2021 5th International Conference on Intelligent Computing and Control Systems (ICICCS), IEEE.
16. Huo, Z. (2021). Sales prediction based on machine learning. Proceedings of the 2021 2nd International Conference on E-Commerce and Internet Technology (ECIT), IEEE.10.1109/ECIT52743.2021.00093 ↗
17. Comparative analysis of supervised machine learning techniques for sales forecasting
18. Sales forecasting using machine learning algorithms10.7769/gesec.v14i7.1670 ↗
19. Sim, D.Y.Y., and Wei, Z. (2023). XGBoost Regression Algorithms for Efficient Predictions on Inventory Sales and Management. Proceedings of the 2023 6th International Conference on Electronics and Electrical Engineering Technology (EEET), IEEE.10.1109/EEET61723.2023.00033 ↗
20. Comparative analysis of modern machine learning models for retail sales forecasting10.17535/crorr.2026.0021 ↗
21. Bijalwan, O., Arora, A., Chauhan, R., Bhatt, C., and Porkhariya, H. (2023). Impact of Machine Learning on Sales Forecasting Accuracy. Proceedings of the 2023 International Conference on Advances in Computation, Communication and Information Technology (ICAICCIT), IEEE.10.1109/ICAICCIT60255.2023.10465801 ↗
22. Comparative Analysis of Machine Learning Models for Accurate Retail Sales Demand Forecasting10.32996/jcsts.2024.6.1.23 ↗
23. Greedy Function Approximation: A Gradient Boosting Machine10.1214/aos/1013203451 ↗
24. Chen, T., and Guestrin, C. (2016). XGBoost: A Scalable Tree Boosting System. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, Association for Computing Machinery.10.1145/2939672.2939785 ↗
25. Cluster-based demand forecasting using Bayesian model averaging: An ensemble learning approach10.1016/j.dajour.2022.100033 ↗
26. Nasseri, M., Falatouri, T., Brandtner, P., and Darbanian, F. (2023). Applying Machine Learning in Retail Demand Prediction—A Comparison of Tree-Based Ensembles and Long Short-Term Memory-Based Deep Learning. Appl. Sci., 13.10.3390/app131911112 ↗
27. Explainable Retail Demand Forecasting: A Hybrid LightGBM-SHAP Framework for Inventory Optimization10.1109/ACCESS.2026.3675540 ↗
28. The substantial role of weather data in consumer spending prediction: A robust machine learning assessment10.1016/j.jretconser.2025.104649 ↗
29. Forecasting weekly sales using lag-based feature engineering and a bagged tree ensemble
30. Chang, O., Naranjo, I., Guerron, C., Criollo, D., Guerron, J., and Mosquera, G. (2026, June 05). A Deep Learning Algorithm to Forecast Sales of Pharmaceutical Products. Available online: https://www.academia.edu/35010555/A_Deep_Learning_Algorithm_to_Forecast_Sales_of_Pharmaceutical_Products.
31. Neelakandan, S., Prakash, V., PranavKumar, M.S., and Balasubramaniam, R. (2023). Forecasting of E-commerce system for sale prediction using deep learning modified neural networks. Proceedings of the 2023 International Conference on Applied Intelligence and Sustainable Computing (ICAISC), IEEE.10.1109/ICAISC58445.2023.10199817 ↗
32. A Predictive Sales System Based on Deep Learning
33. Kaggle (2026, June 05). BigMart Sales Dataset, Uploaded by Yasserh. Available online: https://www.kaggle.com/datasets/yasserh/bigmartsalesdataset.
34. Kaggle (2026, June 05). Rossmann Store Sales. Available online: https://www.kaggle.com/c/rossmann-store-sales.
35. Temporal–Contextual Self-Supervised Time-Series Learning for Automated Fault Detection and Diagnosis of Air Handling Units in Buildings10.1016/j.buildenv.2026.114300 ↗
36. Class-aware temporal and contextual contrastive framework for semi-supervised automated fault detection and diagnosis in air handling units10.1016/j.enbuild.2026.117233 ↗