TransTLA: A Transfer Learning Approach with TCN-LSTM-Attention for Household Appliance Sales Forecasting in Small Towns
Source abstract
Abstract
Deep learning (DL) has been widely applied to forecast the sales volume of household appliances with high accuracy. Unfortunately, in small towns, due to the limited amount of historical sales data, it is difficult to forecast household appliance sales accurately. To overcome the above-mentioned challenge, we propose a novel household appliance sales forecasting algorithm based on transfer learning, temporal convolutional network (TCN), long short-term memory (LSTM), and attention mechanism (called “TransTLA”). Firstly, we combine TCN and LSTM to exploit the spatiotemporal correlation of sales data. Secondly, we utilize the attention mechanism to make full use of the features of sales data. Finally, in order to mitigate the impact of data scarcity and regional differences, a transfer learning technique is used to improve the predictive performance in small towns, with the help of the learning experience from the megacity. The experimental outcomes reveal that the proposed TransTLA model significantly outperforms traditional forecasting methods in predicting small town household appliance sales volumes. Specifically, TransTLA achieves an average mean absolute error (MAE) improvement of 27.60% over LSTM, 9.23% over convolutional neural networks (CNN), and 11.00% over the CNN-LSTM-Attention model across one to four step-ahead predictions. This study addresses the data scarcity problem in small town sales forecasting, helping businesses improve inventory management, enhance customer satisfaction, and contribute to a more efficient supply chain, benefiting the overall economy.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Forecasting Techniques and Applications · Energy Load and Power Forecasting · Air Quality Monitoring and Forecasting
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Information and Communication Engineering, Tongji University, Shanghai 201804, China
References (27)
Show source-provided references
1. Optimization of WEEE Recycling Network for E-Wastes Based on Discrete Event Simulation10.1016/j.procir.2020.02.049 ↗
2. Situation and Development Trend for Recycling of Electrical and Electronic Equipment
3. Home Appliance Demand Forecasting: A Comparative Approach Using Traditional and Machine Learning Algorithms
4. Akdağ, T. (2019). Application of Sales Forecasting Techniques for A Company in The Home Appliances. [Master’s Thesis, Marmara University].
5. Jiang, H., Ruan, J., and Sun, J. (2021, January 5–8). Application of Machine Learning Model and Hybrid Model in Retail Sales Forecast. Proceedings of the 2021 IEEE 6th International Conference on Big Data Analytics (ICBDA), Xiamen, China.10.1109/ICBDA51983.2021.9403224 ↗
6. Automatic Time Series Forecasting: The Forecast Package for R10.18637/jss.v027.i03 ↗
7. Wang, J. (2020, January 4–6). A Hybrid Machine Learning Model for Sales Prediction. Proceedings of the 2020 International Conference on Intelligent Computing and Human-Computer Interaction (ICHCI), Sanya, China.10.1109/ICHCI51889.2020.00083 ↗
8. A Study on Forecasting Bigmart Sales Using Optimized Machine Learning Techniques10.31763/sitech.v1i2.167 ↗
9. Exploring the Use of Deep Neural Networks for Sales Forecasting in Fashion Retail10.1016/j.dss.2018.08.010 ↗
10. Li, X., Du, J., Wang, Y., and Cao, Y. (2020, January 20–22). Automatic Sales Forecasting System Based On LSTM Network. Proceedings of the 2020 International Conference on Computer Science and Management Technology (ICCSMT), Shanghai, China.10.1109/ICCSMT51754.2020.00088 ↗
11. A Comprehensive Survey on Transfer Learning10.1109/JPROC.2020.3004555 ↗
12. Machine Learning Based Restaurant Sales Forecasting10.3390/make4010006 ↗
13. Sales Forecasting by Combining Clustering and Machine-Learning Techniques for Computer Retailing10.1007/s00521-016-2215-x ↗
14. Cheriyan, S., Ibrahim, S., Mohanan, S., and Treesa, S. (2018, January 16–17). Intelligent Sales Prediction Using Machine Learning Techniques. Proceedings of the 2018 International Conference on Computing, Electronics & Communications Engineering (iCCECE), Southend, UK.10.1109/iCCECOME.2018.8659115 ↗
15. Nguyen, N.T., Gaol, F.L., Hong, T.-P., and Trawiński, B. (2019). A LSTM Approach for Sales Forecasting of Goods with Short-Term Demands in E-Commerce. Intelligent Information and Database Systems, Proceedings of the 11th Asian Conference, ACIIDS 2019, Yogyakarta, Indonesia, 8–11 April 2019, Springer International Publishing.
16. LSTM with Particle Swam Optimization for Sales forecasting10.1016/j.elerap.2022.101118 ↗
17. Hiranya Pemathilake, R.G., Karunathilake, S.P., Achira Jeewaka Shamal, J.L., and Ganegoda, G.U. (2018, January 28–30). Sales Forecasting Based on AutoRegressive Integrated Moving Average and Recurrent Neural Network Hybrid Model. Proceedings of the 2018 14th International Conference on Natural Computation, Fuzzy Systems and Knowledge Discovery (ICNC-FSKD), Huangshan, China.10.1109/FSKD.2018.8686936 ↗
18. Kaunchi, P., Jadhav, T., Dandawate, Y., and Marathe, P. (2021, January 1–3). Future Sales Prediction For Indian Products Using Convolutional Neural Network-Long Short Term Memory. Proceedings of the 2021 2nd Global Conference for Advancement in Technology (GCAT), Bangalore, India.10.1109/GCAT52182.2021.9587668 ↗
19. Liu, Y. (2024, January 27–29). Deep Learning for Enterprise Sales Prediction: Haressing CNN-LSTM-Attention Model. Proceedings of the 2024 IEEE 3rd International Conference on Electrical Engineering, Big Data and Algorithms (EEBDA), Changchun, China.10.1109/EEBDA60612.2024.10485889 ↗
20. L’Heureux, A., Grolinger, K., and Capretz, M.A.M. (2022). Transformer-Based Model for Electrical Load Forecasting. Energies, 15.10.3390/en15144993 ↗
21. Staffini, A. (2023). A CNN–BiLSTM Architecture for Macroeconomic Time Series Forecasting. Eng. Proc., 39.10.3390/engproc2023039033 ↗
22. Rathore, N., Rathore, P., Basak, A., Nistala, S.H., and Runkana, V. (2021, January 15–18). Multi Scale Graph Wavenet for Wind Speed Forecasting. Proceedings of the 2021 IEEE International Conference on Big Data (Big Data), Orlando, FL, USA.10.1109/BigData52589.2021.9671624 ↗
23. Bai, S., Kolter, J.Z., and Koltun, V. (2018). An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling. arXiv.
24. Bahdanau, D., Cho, K., and Bengio, Y. (2016). Neural Machine Translation by Jointly Learning to Align and Translate. arXiv.
25. Csurka, G. (2017). Domain-Adversarial Training of Neural Networks. Domain Adaptation in Computer Vision Applications, Springer International Publishing. Advances in Computer Vision and Pattern Recognition.10.1007/978-3-319-58347-1 ↗
26. Finn, C., Abbeel, P., and Levine, S. (2017, January 6–11). Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks. Proceedings of the 34th International Conference on Machine Learning, Sydney, NSW, Australia.
27. Paszke, A., Gross, S., Massa, F., Lerer, A., Bradbury, J., Chanan, G., Killeen, T., Lin, Z., Gimelshein, N., and Antiga, L. (2019, January 8–14). PyTorch: An Imperative Style, High-Performance Deep Learning Library. Proceedings of the 33rd Conference on Neural Information Processing Systems (NeurIPS), Vancouver, BC, Canada.