Concept Drift Adaptation Methods under the Deep Learning Framework: A Literature Review
Source abstract
Abstract
With the advent of the fourth industrial revolution, data-driven decision making has also become an integral part of decision making. At the same time, deep learning is one of the core technologies of the fourth industrial revolution that have become vital in decision making. However, in the era of epidemics and big data, the volume of data has increased dramatically while the sources have become progressively more complex, making data distribution highly susceptible to change. These situations can easily lead to concept drift, which directly affects the effectiveness of prediction models. How to cope with such complex situations and make timely and accurate decisions from multiple perspectives is a challenging research issue. To address this challenge, we summarize concept drift adaptation methods under the deep learning framework, which is beneficial to help decision makers make better decisions and analyze the causes of concept drift. First, we provide an overall introduction to concept drift, including the definition, causes, types, and process of concept drift adaptation methods under the deep learning framework. Second, we summarize concept drift adaptation methods in terms of discriminative learning, generative learning, hybrid learning, and others. For each aspect, we elaborate on the update modes, detection modes, and adaptation drift types of concept drift adaptation methods. In addition, we briefly describe the characteristics and application fields of deep learning algorithms using concept drift adaptation methods. Finally, we summarize common datasets and evaluation metrics and present future directions.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Data Stream Mining Techniques · Smart Grid Energy Management · Air Quality Monitoring and Forecasting
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Computer and Information Science, Chongqing Normal University, Chongqing 401331, China
Funding
Key Program of Chongqing Education Science Planning Project · Doctoral Research Foundation of Chongqing Normal University
References (100+)
Show source-provided references
1. Augmenting organizational decision-making with deep learning algorithms: Principles, promises, and challenges10.1016/j.jbusres.2020.09.068 ↗
2. Incremental learning from noisy data10.1007/BF00116895 ↗
3. Data-driven decision support under concept drift in streamed big data10.1007/s40747-019-00124-4 ↗
4. A survey on concept drift adaptation10.1145/2523813 ↗
5. Improved Long Short-Term Memory based anomaly detection with concept drift adaptive method for supporting IoT services10.1016/j.future.2020.05.035 ↗
6. Financial portfolio optimization with online deep reinforcement learning and restricted stacked autoencoder—DeepBreath10.1016/j.eswa.2020.113456 ↗
7. Wang, X., Chen, W., Xia, J., Chen, Z., Xu, D., Wu, X., Xu, M., and Schreck, T. (2020, January 25–30). ConceptExplorer: Visual Analysis of Concept Drifts in Multi-source Time-series Data. Proceedings of the IEEE Conference on Visual Analytics Science and Technology (VAST), Salt Lake City, UT, USA.10.1109/VAST50239.2020.00006 ↗
8. Learning from streaming data with concept drift and imbalance: An overview10.1007/s13748-011-0008-0 ↗
9. A survey of the classification of data streams with concept drift
10. Learning in Nonstationary Environments: A Survey10.1109/MCI.2015.2471196 ↗
11. Characterizing concept drift10.1007/s10618-015-0448-4 ↗
12. Ensemble learning for data stream analysis: A survey10.1016/j.inffus.2017.02.004 ↗
13. Discussion and review on evolving data streams and concept drift adapting10.1007/s12530-016-9168-2 ↗
14. Learning under Concept Drift: A Review
15. Ab Ghani, N.L., Aziz, I.A., and Mehat, M. (2020, January 8–11). Concept Drift Detection on Unlabeled Data Streams: A Systematic Literature Review. Proceedings of the IEEE Conference on Big Data and Analytics (ICBDA), Xiamen, China.10.1109/ICBDA50157.2020.9289802 ↗
16. Learning Under Concept Drift for Regression—A Systematic Literature Review10.1109/ACCESS.2022.3169785 ↗
17. From concept drift to model degradation: An overview on performance-aware drift detectors10.1016/j.knosys.2022.108632 ↗
18. Addressing Concept Drifts Using Deep Learning for Heart Disease Prediction: A Review10.1007/978-981-16-3346-1_13 ↗
19. An Overview on Concept Drift Learning10.1109/ACCESS.2018.2886026 ↗
20. (2007). R.O. Duda, P.E. Hart, and D.G. Stork, Pattern Classification, New York: John Wiley & Sons, 2001, pp. xx + 654, ISBN: 0-471-05669-3. J. Classif., 24, 305–307.10.1007/s00357-007-0015-9 ↗
21. Concept Drift Detection in Data Stream Mining: A literature review
22. Korycki, Ł., and Krawczyk, B. (2022). Adversarial concept drift detection under poisoning attacks for robust data stream mining. Mach. Learn., 1–36.10.1007/s10994-022-06177-w ↗
23. Concept learning using one-class classifiers for implicit drift detection in evolving data streams10.1007/s10462-020-09939-x ↗
24. Concept drift type identification based on multi-sliding windows10.1016/j.ins.2021.11.023 ↗
25. Reactive Soft Prototype Computing for Concept Drift Streams10.1016/j.neucom.2019.11.111 ↗
26. Gözüaçık, Ö., Büyükçakır, A., Bonab, H., and Can, F. (2019, January 3–7). Unsupervised concept drift detection with a discriminative classifier. Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing China.10.1145/3357384.3358144 ↗
27. Cerqueira, V., Gomes, H.M., Bifet, A., and Torgo, L. (2022). STUDD: A student–teacher method for unsupervised concept drift detection. Mach. Learn., 1–28.10.1007/s10994-022-06188-7 ↗
28. A Diversity Framework for Dealing with Multiple Types of Concept Drift Based on Clustering in the Model Space10.1109/TNNLS.2020.3041684 ↗
29. Diversity measure as a new drift detection method in data streaming10.1016/j.knosys.2019.105227 ↗
30. Yuan, L., Li, H., Xia, B., Gao, C., Liu, M., Yuan, W., and You, X. (2022, January 23–29). Recent Advances in Concept Drift Adaptation Methods for Deep Learning. Proceedings of the 31st International Joint Conference on Artificial Intelligence, Vienna, Austria.10.24963/ijcai.2022/788 ↗
31. Deep Learning: A Comprehensive Overview on Techniques, Taxonomy, Applications and Research Directions10.1007/s42979-021-00815-1 ↗
32. Leväsluoto, J., Kohl, J., Sigfrids, A., Pihlajamäki, J., and Martikainen, J. (2021). Digitalization as an Engine for Change? Building a Vision Pathway towards a Sustainable Health Care System by Using the MLP and Health Economic Decision Modelling. Sustainability, 13.10.3390/su132313007 ↗
33. Selective ensemble-based online adaptive deep neural networks for streaming data with concept drift10.1016/j.neunet.2021.06.027 ↗
34. Han, Y.-N., Liu, J.-W., Xiao, B.-B., Wang, X.-T., and Luo, X.-L. (2021, January 14–17). Bilevel Online Deep Learning in Non-stationary Environment. Proceedings of the 30th International Conference on Artificial Neural Networks, Bratislava, Slovakia.10.1007/978-3-030-86340-1_28 ↗
35. Pratama, M., Za’In, C., Ashfahani, A., Ong, Y.S., and Ding, W. (2019, January 3–7). Automatic Construction of Multi-layer Perceptron Network from Streaming Examples. Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing China.10.1145/3357384.3357946 ↗
36. Priya, S., and Uthra, R.A. (2021). Deep learning framework for handling concept drift and class imbalanced complex decision-making on streaming data. Complex Intell. Syst., 1–17.10.1007/s40747-021-00456-0 ↗
37. Dezfouli, A., Griffiths, K., Ramos, F., Dayan, P., and Balleine, B.W. (2019). Models that learn how humans learn: The case of decision-making and its disorders. PLoS Comput. Biol., 15.10.1371/journal.pcbi.1006903 ↗
38. Deep learning for load forecasting with smart meter data: Online Adaptive Recurrent Neural Network10.1016/j.apenergy.2020.116177 ↗
39. Load Forecasting Under Concept Drift: Online Ensemble Learning with Recurrent Neural Network and ARIMA10.1109/ACCESS.2021.3095420 ↗
40. Enhanced Data Stream Classification by Optimized Weight Updated Meta-learning: Continuous learning-based on Concept-Drift10.1108/IJWIS-01-2021-0007 ↗
41. An Adaptive Behavioral-Based Incremental Batch Learning Malware Variants Detection Model Using Concept Drift Detection and Sequential Deep Learning10.1109/ACCESS.2021.3093366 ↗
42. Das, M., Pratama, M., Savitri, S., and Zhang, J. (2019, January 8–11). MUSE-RNN: A Multilayer Self-Evolving Recurrent Neural Network for Data Stream Classification. Proceedings of the IEEE International Conference on Data Mining (ICDM), Beijing, China.10.1109/ICDM.2019.00021 ↗
43. Decision-Making Techniques using LSTM on Antam Mining Shares before and during the COVID-19 Pandemic in Indonesia
44. Improving the prediction of continuous integration build failures using deep learning10.1007/s10515-021-00319-5 ↗
45. An Optimal Big Data Analytics with Concept Drift Detection on High-Dimensional Streaming Data
46. Fog-DeepStream: A new approach combining LSTM and Concept Drift for data stream analytics on Fog computing10.1016/j.iot.2023.100731 ↗
47. An adaptive deep learning framework for day-ahead forecasting of photovoltaic power generation
48. Adaptive Dendritic Cell-Deep Learning Approach for Industrial Prognosis Under Changing Conditions10.1109/TII.2021.3058350 ↗
49. Deeply Explain CNN Via Hierarchical Decomposition10.1007/s11263-022-01746-x ↗
50. Recent advances in convolutional neural networks10.1016/j.patcog.2017.10.013 ↗
51. Li, X., Zhang, Z., Zhao, Z., Wu, L., Huo, J., Zhang, J., and Wang, Y. (2021, January 28–29). ECNN: One Online Deep Learning Model for Streaming Ocean Data Prediction. Proceedings of the ACM International Conference on Intelligent Computing and Its Emerging Applications, Jinan, China.10.1145/3491396.3506519 ↗
52. Explainable Online Deep Neural Network Selection Using Adaptive Saliency Maps for Time Series Forecasting10.1007/978-3-030-86486-6_25 ↗
53. Tian, X., Ng, W.W.Y., and Xu, H. (2023). Deep Incremental Hashing for Semantic Image Retrieval with Concept Drift. IEEE Trans. Big Data, 1–13.10.1109/TBDATA.2022.3233457 ↗
54. Evolving Spiking Neural Networks for online learning over drifting data streams10.1016/j.neunet.2018.07.014 ↗
55. Recommendation system based on deep learning methods: A systematic review and new directions10.1007/s10462-019-09744-1 ↗
56. A tutorial survey of architectures, algorithms, and applications for deep learning
57. Bank, D., Koenigstein, N., and Giryes, R. (2021). Autoencoders. arXiv.
58. Yoon, S., Lee, Y., Lee, J.-G., and Lee, B.S. (2022, January 14–18). Adaptive Model Pooling for Online Deep Anomaly Detection from a Complex Evolving Data Stream. Proceedings of the 28th ACM SIGKDD Conference on Knowledge Discovery and Data Mining, Washington, DC, USA.10.1145/3534678.3539348 ↗
59. Unsupervised statistical concept drift detection for behaviour abnormality detection10.1007/s10489-022-03611-3 ↗
60. DEVDAN: Deep evolving denoising autoencoder10.1016/j.neucom.2019.07.106 ↗
61. Bhatia, S., Jain, A., Srivastava, S., Kawaguchi, K., and Hooi, B. (2022, January 25–29). MemStream: Memory-Based Streaming Anomaly Detection. Proceedings of the ACM Web Conference 2022, Lyon, France.10.1145/3485447.3512221 ↗
62. Generative adversarial networks10.1145/3422622 ↗
63. Guan, H., Wang, Y., Ma, X., and Li, Y. (2019, January 20–24). DCIGAN: A Distributed Class-Incremental Learning Method Based on Generative Adversarial Networks. Proceedings of the IEEE Intl Conf on Parallel & Distributed Processing with Applications, Big Data & Cloud Computing, Sustainable Computing & Communications, Social Computing & Networking (ISPA/BDCloud/SocialCom/SustainCom), Rio de Janeiro, Brazil.10.1109/ISPA-BDCloud-SustainCom-SocialCom48970.2019.00115 ↗
64. Guzy, F., Wozniak, M., and Krawczyk, B. (2021, January 7–10). Evaluating and Explaining Generative Adversarial Networks for Continual Learning under Concept Drift. Proceedings of the International Conference on Data Mining Workshops (ICDMW), Auckland, New Zealand.10.1109/ICDMW53433.2021.00044 ↗
65. An overview on Restricted Boltzmann Machines10.1016/j.neucom.2017.09.065 ↗
66. Korycki, L., and Krawczyk, B. (2021, January 19–22). Concept Drift Detection from Multi-Class Imbalanced Data Streams. Proceedings of the IEEE 37th International Conference on Data Engineering (ICDE), Chania, Greece.10.1109/ICDE51399.2021.00097 ↗
67. Data Stream Adaptive Partitioning of Sliding Window Based on Gaussian Restricted Boltzmann Machine
68. Miljkovic, D. (2017, January 22–26). Brief review of self-organizing maps. Proceedings of the 40th International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO), Opatija, Croatia.10.23919/MIPRO.2017.7973581 ↗
69. Cerri, R., Junior, J.D.C., Faria, E.R., and Gama, J. (2021, January 22–26). A new self-organizing map based algorithm for multi-label stream classification. Proceedings of the 36th Annual ACM Symposium on Applied Computing, Virtual Event Republic of Korea.10.1145/3412841.3441922 ↗
70. SOINN+, a Self-Organizing Incremental Neural Network for Unsupervised Learning from Noisy Data Streams10.1016/j.eswa.2019.113069 ↗
71. Zheng, W., Zhao, P., Chen, G., Zhou, H., and Tian, Y. (2022). A Hybrid Spiking Neurons Embedded LSTM Network for Multivariate Time Series Learning under Concept-drift Environment. IEEE Trans. Knowl. Data Eng., 1–14.10.1109/TKDE.2022.3178176 ↗
72. A new predictive method supporting streaming data with hybrid recurring concept drifts in process industry10.1016/j.cie.2021.107625 ↗
73. Wang, L., Chen, S., Chen, F., He, Q., and Liu, J. (2023). B-Detection: Runtime Reliability Anomaly Detection for MEC Services with Boosting LSTM Autoencoder. IEEE Trans. Mob. Comput., 1–14.10.1109/TMC.2023.3262233 ↗
74. Yen, S., Moh, M., and Moh, T.-S. (2019, January 16–19). CausalConvLSTM: Semi-Supervised Log Anomaly Detection Through Sequence Modeling. Proceedings of the 18th IEEE International Conference on Machine Learning And Applications (ICMLA), Boca Raton, FL, USA.10.1109/ICMLA.2019.00217 ↗
75. Perera, P.P.B. (2021). Anomaly Detection on Single Variate Time Series with Concept drifts. [Ph.D. Thesis, University of Colombo School of Computing].
76. Enhancing incremental deep learning for FCCU end-point quality prediction10.1016/j.ins.2020.04.013 ↗
77. Recurrent Adaptive Classifier Ensemble for Handling Recurring Concept Drifts
78. Convergence of Photovoltaic Power Forecasting and Deep Learning: State-of-Art Review10.1109/ACCESS.2021.3117004 ↗
79. Human-level control through deep reinforcement learning10.1038/nature14236 ↗
80. Taiyuan University of Technology. Review on the research and practice of deep learning and reinforcement learning in smart grids10.17775/CSEEJPES.2018.00520 ↗
81. Tan, C., Sun, F., Kong, T., Zhang, W., Yang, C., and Liu, C. (2018, January 4–7). A Survey on Deep Transfer Learning. Proceedings of the 27th International Conference on Artificial Neural Networks, Rhodes, Greece.10.1007/978-3-030-01424-7_27 ↗
82. Kauschke, S., Lehmann, D.H., and Furnkranz, J. (2019, January 14–19). Patching Deep Neural Networks for Nonstationary Environments. Proceedings of the International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary.10.1109/IJCNN.2019.8852222 ↗
83. Disabato, S., and Roveri, M. (2019, January 14–19). Learning Convolutional Neural Networks in presence of Concept Drift. Proceedings of the International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary.10.1109/IJCNN.2019.8851731 ↗
84. Pratama, M., de Carvalho, M., Xie, R., Lughofer, E., and Lu, J. (2019, January 3–7). ATL: Autonomous Knowledge Transfer from Many Streaming Processes. Proceedings of the 28th ACM International Conference on Information and Knowledge Management, Beijing, China.
85. Xu, L., Ding, X., Peng, H., Zhao, D., and Li, X. (2023). ADTCD: An Adaptive Anomaly Detection Approach Towards Concept-Drift in IoT. IEEE Internet Things J., 1–13.10.1109/JIOT.2023.3265964 ↗
86. Yang, T., Tang, H., Bai, C., Liu, J., Hao, J., Meng, Z., Liu, P., and Wang, Z. (2022). Exploration in Deep Reinforcement Learning: A Comprehensive Survey. arXiv.
87. Deep graph convolutional reinforcement learning for financial portfolio management—DeepPocket10.1016/j.eswa.2021.115127 ↗
88. Zhang, Q., Wang, Z., Long, C., Huang, C., Yiu, S.M., Liu, Y., Cong, G., and Shi, J. (2022). Online Anomalous Subtrajectory Detection on Road Networks with Deep Reinforcement Learning. arXiv.
89. Saadallah, A., and Morik, K. (2021, January 6–9). Online Ensemble Aggregation using Deep Reinforcement Learning for Time Series Forecasting. Proceedings of the IEEE 8th International Conference on Data Science and Advanced Analytics (DSAA), Porto, Portugal.10.1109/DSAA53316.2021.9564132 ↗
90. FedHAR: Semi-Supervised Online Learning for Personalized Federated Human Activity Recognition10.1109/TMC.2021.3136853 ↗
91. Meta-cognitive recurrent kernel online sequential extreme learning machine with kernel adaptive filter for concept drift handling10.1016/j.engappai.2019.103327 ↗
92. da Silva, C.A.S., and Krohling, R.A. (2019, January 14–19). Semi-Supervised Online Elastic Extreme Learning Machine with Forgetting Parameter to deal with concept drift in data streams. Proceedings of the International Joint Conference on Neural Networks (IJCNN), Budapest, Hungary.10.1109/IJCNN.2019.8852361 ↗
93. A Neural Network-Based On-device Learning Anomaly Detector for Edge Devices
94. Asuncion, A., and Newman, D. (2007). UCI Machine Learning Repository, University of California.
95. Harries, M., and Wales, N.S. (1999). Splice-2 Comparative Evaluation: Electricity Pricing, Research Gate.
96. Incremental Learning of Concept Drift in Nonstationary Environments10.1109/TNN.2011.2160459 ↗
97. Tracking recurring contexts using ensemble classifiers: An application to email filtering10.1007/s10115-009-0206-2 ↗
98. Lopez-Paz, D., and Ranzato, M.A. (2022). Gradient Episodic Memory for Continual Learning. arXiv.
99. Street, W.N., and Kim, Y. (2001, January 26–29). A streaming ensemble algorithm (SEA) for large-scale classification. Proceedings of the seventh ACM SIGKDD international conference on Knowledge discovery and data mining, San Francisco, CA, USA.10.1145/502512.502568 ↗
100. Learning with Drift Detection