Augmented Data and XGBoost Improvement for Sales Forecasting in the Large-Scale Retail Sector
Source abstract
Abstract
The organized large-scale retail sector has been gradually establishing itself around the world, and has increased activities exponentially in the pandemic period. This modern sales system uses Data Mining technologies processing precious information to increase profit. In this direction, the extreme gradient boosting (XGBoost) algorithm was applied in an industrial project as a supervised learning algorithm to predict product sales including promotion condition and a multiparametric analysis. The implemented XGBoost model was trained and tested by the use of the Augmented Data (AD) technique in the event that the available data are not sufficient to achieve the desired accuracy, as for many practical cases of artificial intelligence data processing, where a large dataset is not available. The prediction was applied to a grid of segmented customers by allowing personalized services according to their purchasing behavior. The AD technique conferred a good accuracy if compared with results adopting the initial dataset with few records. An improvement of the prediction error, such as the Root Mean Square Error (RMSE) and Mean Square Error (MSE), which decreases by about an order of magnitude, was achieved. The AD technique formulated for large-scale retail sector also represents a good way to calibrate the training model.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Forecasting Techniques and Applications · Big Data and Business Intelligence · Stock Market Forecasting Methods
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Dyrecta Lab, IT Research Laboratory, Vescovo Simplicio 45, 70014 Conversano, Italy
References (61)
Show source-provided references
1. Raschka, S., and Mirjalili, V. (2019). Python Machine Learning, Packt. [3rd ed.].
2. Zinoviev, D. (2021, July 22). Data Science Essentials in Python Collect → Organize → Explore → Predict → Value. Available online: https://pragprog.com/titles/dzpyds/data-science-essentials-in-python/.
3. Massaro, A., Panarese, A., Dipierro, G., Cannella, E., and Galiano, A. (2020, January 3–5). Infrared Thermography and Image Processing applied on Weldings Quality Monitoring. Proceedings of the IEEE International Workshop on Metrology for Industry 4.0 & IoT, Roma, Italy.10.1109/MetroInd4.0IoT48571.2020.9138310 ↗
4. Palmer, A., Jiménez, R., and Gervilla, E. (2011). Data Mining: Machine Learning and Statistical Techniques. Knowledge-Oriented Applications in Data Mining, Available online: https://www.intechopen.com/books/1358.10.5772/13621 ↗
5. Shmueli, G., Patel, N.R., and Bruce, P.C. (2007). Data Mining for Business Intelligence. Concepts, Techniques, and Applications in Microsoft Office Excel with XLMiner, John Wiley & Sons.
6. Massaro, A., Panarese, A., Selicato, S., and Galiano, A. (2021, January 7–9). CNN-LSTM Neural Network Applied for Thermal Infrared Underground Water Leakage. Proceedings of the IEEE International Workshop on Metrology for Industry 4.0 & IoT (MetroInd4.0&IoT), Rome, Italy.10.1109/MetroInd4.0IoT51437.2021.9488536 ↗
7. Massaro, A., Panarese, A., and Galiano, A. (2021, January 7–9). Technological Platform for Hydrogeological Risk Computation and Water Leakage Detection based on a Convolutional Neural Network. Proceedings of the IEEE International Workshop on Metrology for Industry 4.0 & IoT (MetroInd4.0&IoT), Rome, Italy.10.1109/MetroInd4.0IoT51437.2021.9488561 ↗
8. Competing on Analytics. Harvard Business Review
9. Joint Activities of Market Basket Analysis and Product Facing for Business Intelligence oriented on Global Distribution Market: Examples of Data Mining Applications
10. Salonen, J., and Pirttimaki, V. (2021, August 03). Outsourcing a Business Intelligence Function. Available online: https://researchportal.tuni.fi/en/publications/outsourcing-a-business-intelligence-function.
11. Turban, E., and Aronson, J.E. (2001). Decision Support Systems and Intelligent Systems, Prentice-Hall. [6th ed.].
12. Aguasca-Colomo, R., Castellanos-Nieves, D., and Méndez, M. (2019). Comparative Analysis of Rainfall Prediction Models Using Machine Learning in Islands with Complex Orography: Tenerife Island. Appl. Sci., 9.10.3390/app9224931 ↗
13. Liu, Z., Yang, J., Jiang, W., Wei, C., Zhang, P., and Xu, J. (2019). Research on Optimized Energy Scheduling of Rural Microgrid. Appl. Sci., 9.10.3390/app9214641 ↗
14. Phan, Q., Wu, Y.K., and Phan, Q. (2021). A Hybrid Wind Power Forecasting Model with XGBoost, Data Preprocessing Considering Different NWPs. Appl. Sci., 11.10.3390/app11031100 ↗
15. Zheng, H., and Wu, Y. (2019). A XGBoost Model with Weather Similarity Analysis and Feature Engineering for Short-Term Wind Power Forecasting. Appl. Sci., 9.10.3390/app9153019 ↗
16. Research on sales Forecast based on XGBoost-LSTM algorithm Model10.1088/1742-6596/1754/1/012191 ↗
17. Pavlyshenko, B.M. (2019). Machine-Learning Models for Sales Time Series Forecasting. Data, 4.10.3390/data4010015 ↗
18. Chang, W., Liu, Y., Xiao, Y., Xu, X., Zhou, S., Lu, X., and Cheng, Y. (2019). Probability Analysis of Hypertension-Related Symptoms Based on XGBoost and Clustering Algorithm. Appl. Sci., 9.10.3390/app9061215 ↗
19. Heart Disease Prediction Based on Clustering and XGboost Algorithm
20. Li, M., Fu, X., and Li, D. (2020). Diabetes Prediction Based on XGBoost Algorithm. IOP Conf. Ser. Mater. Sci. Eng., 768.10.1088/1757-899X/768/7/072093 ↗
21. Gumus, M., and Kıran, M.S. (2017, January 5–8). Crude Oil Price Forecasting Using XGBoost. Proceedings of the International Conference on Computer Science and Engineering (UBMK), Antalya, Turkey.10.1109/UBMK.2017.8093500 ↗
22. Shi, X., Li, Q., Qi, Y., Huang, T., and Li, J. (2017, January 24–26). An accident prediction approach based on XGBoost. Proceedings of the 12th International Conference on Intelligent Systems and Knowledge Engineering (ISKE), Nanjing, China.10.1109/ISKE.2017.8258806 ↗
23. Data Mining Applied in Food Trade Network
24. Re-Engineering Process in a Food Factory: An Overview of Technologies and Approaches for the Design of Pasta Production Processes
25. Massaro, A., Selicato, S., Miraglia, R., Panarese, A., Calicchio, A., and Galiano, A. (2020, January 3–5). Production Optimization Monitoring System Implementing Artificial Intelligence and Big Data. Proceedings of the IEEE International Workshop on Metrology for Industry 4.0 & IoT, Roma, Italy.10.1109/MetroInd4.0IoT48571.2020.9138198 ↗
26. Machine to Machine (M2M) Open Data System for Business Intelligence in Products Massive Distribution oriented on Big Data
27. Data Mining Model Performance of Sales Predictive Algorithms Based on Rapidminer Workflows
28. Massaro, A., Barbuzzi, D., Vitti, V., Galiano, A., Aruci, M., and Pirlo, G. (2016, January 18–19). Predictive Sales Analysis According to the Effect of Weather. Proceedings of the 2nd International Conference on Recent Trends and Applications in Computer Science and Information Technology, Tirana, Albania.
29. Business Intelligence Improved by Data Mining Algorithms and Big Data Systems: An Overview of Different Tools Applied in Industrial Research
30. Intelligent Real-time 3D Configuration Platform for Customizing E-commerce Products10.5121/ijcga.2019.9402 ↗
31. Decision Support System for Multistore Online Sales Based on Priority Rules and Data Mining
32. Feature Analysis of Coronary Artery Heart Disease Data Sets10.1016/j.procs.2015.09.132 ↗
33. Sabay, A., Harris, L., Bejugama, V., and Jaceldo-Siegl, K. (2018). Overcoming Small Data Limitations in Heart Disease Prediction by Using Surrogate Data. SMU Data Sci. Rev., 1, Available online: https://scholar.smu.edu/datasciencereview/vol1/iss3/12.
34. Li, H., Xiong, L., and Jiang, X. (2014). Differentially Private Synthesization of Multi-Dimensional Data using Copula Functions. Adv Database Technol., 475–486.
35. Akshay, K., Akhilesh, V., Animikh, A., and Chetana, H. (2018, January 20–22). Sales-Forecasting of Retail Stores using Machine Learning Techniques. Proceedings of the 3rd IEEE International Conference on Computational Systems and Information Technology for Sustainable Solutions, Bengaluru, India.
36. Huang, W., Zhang, Q., Xu, W., Fu, H., Wang, M., and Liang, X. (2015). A Novel Trigger Model for Sales Prediction with Data Mining Techniques. Data Sci. J., 14.10.5334/dsj-2015-015 ↗
37. Gao, M., Xu, W., Fu, H., Wang, M., and Liang, X. (2014, January 4–6). A Novel Forecasting Method for Large-Scale Sales Prediction Using Extreme Learning Machine. Proceedings of the Seventh International Joint Conference on Computational Sciences and Optimization, Beijing, China.10.1109/CSO.2014.116 ↗
38. A Decision Support System for Sales Forecasting through Fuzzy Neural Networks with Asymmetric Fuzzy Weights10.1016/S0167-9236(98)00067-0 ↗
39. Artificial Neural Network Models for Forecasting and Decision Making10.1016/0169-2070(94)90045-0 ↗
40. Liu, C.-J., Huang, T.-S., Ho, P.-T., Huang, J.-C., and Hsieh, C.-T. (2020). Machine Learning-Based E-Commerce Platform Repurchase Customer Prediction Model. PLoS ONE, 15.10.1371/journal.pone.0243105 ↗
41. An Application of a Three-Stage XGBoost-Based Model to Sales Forecasting of a Cross-Border E-Commerce Enterprise10.1155/2019/8503252 ↗
42. An XGBoost Algorithm for Predicting Purchasing Behaviour on E-Commerce Platforms
43. Implementation of a Decision Support System and Business Intelligence Algorithms for the Automated Management of Insurance Agents Activities
44. Massaro, A., Maritati, V., Giannone, D., Convertini, D., and Galiano, A. (2019). LSTM DSS Automatism and Dataset Optimization for Diabetes Prediction. Appl. Sci., 9.10.3390/app9173532 ↗
45. A Case Study of Innovation in the Implementation of a DSS System for Intelligent Insurance Hub Services10.13189/csit.2021.090102 ↗
46. A Survey of Forecast Error Measures
47. The Accuracy of Intermittent Demand Estimates10.1016/j.ijforecast.2004.10.001 ↗
48. A Synergistic Use of Chemometrics and Deep Learning Improved the Predictive Performance of near-Infrared Spectroscopy Models for Dry Matter Prediction in Mango Fruit10.1016/j.chemolab.2021.104287 ↗
49. A Monte Carlo Model for determination of binary diffusion coefficients in gases10.1016/j.jcp.2011.03.053 ↗
50. Gradient Boosting Feature Selection with Machine Learning Classifiers for Intrusion Detection on Power Grids10.1109/TNSM.2020.3032618 ↗
51. Scikit-Learn: Machine Learning in Python
52. Charoen-Ung, P., and Mittrapiyanuruk, P. (2018, January 11–13). Sugarcane Yield Grade Prediction using Random Forest and Gradient Boosting Tree Techniques. Proceedings of the 15th International Joint Conference on Computer Science and Software Engineering (JCSSE), Nakhon Pathom, Thailand.10.1109/JCSSE.2018.8457391 ↗
53. Molecular Dynamics Calculation of the Spectral Densities of Plasma Fluctuations10.1017/S0022377818000491 ↗
54. Natural fluctuations in un-magnetized and magnetized plasmas10.1017/S0022377815000070 ↗
55. Performance Measures, Consistency, and Power for Artificial Neural Network Models10.1016/0895-7177(94)00207-5 ↗
56. Phan, Q.-T., and Wu, Y.-K. (2020, January 13–16). A Comparative Analysis of XGBoost and Temporal Convolutional Network Models for Wind Power Forecasting. Proceedings of the International Symposium on Computer, Consumer and Control (IS3C), Taichung City, Taiwan.10.1109/IS3C50286.2020.00113 ↗
57. Deka, B., Maji, P., Mitra, S., Bhattacharyya, D., Bora, P., and Pal, S. (2019). Comparative Analysis of Artificial Neural Network and XGBoost Algorithm for PolSAR Image Classification. Pattern Recognition and Machine Intelligence, Springer. PReMI 2019. Lecture Notes in Computer Science.10.1007/978-3-030-34872-4 ↗
58. Nelli, F. (2015). Machine Learning with Scikit-Learn. Python Data Anal., 237–264.10.1007/978-1-4842-0958-5_8 ↗
59. Chen, T., and Guestrin, C. (2016, January 13–17). XGBoost: A Scalable Tree Boosting System. Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, San Francisco, CA, USA.10.1145/2939672.2939785 ↗
60. Massaro, A., Maritati, V., Savino, N., Galiano, A., Convertini, D., De Fonte, E., and Di Muro, M. (2018). A Study of a Health Resources Management Platform Integrating Neural Networks and DSS Telemedicine for Homecare Assistance. Information, 9.10.3390/info9070176 ↗
61. Model of Multiple Artificial Neural Networks Oriented on Sales Prediction and Product Shelf Design