A Continual Learning Process to Detect Both Previously Learned and Newly Emerging Attack
Source abstract
Abstract
With the recent intensification of geopolitical tensions, cyber-attacks have become increasingly sophisticated and dynamic. Traditional machine learning-based anomaly detection techniques, which rely on pre-trained data, often suffer from performance degradation when exposed to novel attack types not seen during training. To address this limitation, this study proposes a continual learning-based anomaly detection framework capable of incrementally incorporating new attack patterns without forgetting previously learned information. The proposed method consists of three key stages: first, preprocessing and data augmentation are applied to construct high-quality, balanced datasets; second, a base anomaly detection model is trained; and third, new attack data are incrementally integrated to continuously update and evaluate the model. To enhance adaptability and efficiency, the framework incorporates Memory-LGBM, a lightweight architecture that combines a prototype-based memory module with a gradient-free LGBM classifier. The model maintains class-wise latent representations instead of raw samples, enabling compact, memory-efficient learning. Experimental results on the CICIDS 2017 dataset demonstrate that the proposed approach outperforms existing continual learning methods in accuracy, adaptability, and resistance to forgetting, making it a practical and scalable solution for real-world anomaly detection scenarios that demand rapid adaptation, strong knowledge retention, and low computational overhead.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Network Security and Intrusion Detection · Anomaly Detection Techniques and Applications · Advanced Malware Detection Techniques
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Computer Engineering, Sejong University, Seoul 05006, Republic of Korea
Department of Convergence Engineering for Intelligent Drones, Sejong University, Seoul 05006, Republic of Korea
Cyber Warfare Research Institute, Sejong University, Seoul 05006, Republic of Korea
Agency for Defense Development, Seoul 05771, Republic of Korea
Funding
Korea Creative Content Agency
References (65)
Show source-provided references
1. The internet of things promises new benefits and risks: A systematic analysis of adoption dynamics of iot products10.1109/MSEC.2018.2888780 ↗
2. Papernot, N., McDaniel, P., Sinha, A., and Wellman, M.P. (2018, January 24–26). SoK: Security and Privacy in Machine Learning. Proceedings of the 2018 IEEE European Symposium on Security and Privacy (EuroS&P), London, UK.10.1109/EuroSP.2018.00035 ↗
3. Pa Pa, Y.M., Tanizaki, S., Kou, T., Van Eeten, M., Yoshioka, K., and Matsumoto, T. (2023, January 7–8). An Attacker’s Dream? Exploring the Capabilities of ChatGPT for Developing Malware. Proceedings of the 16th Cyber Security Experimentation and Test Workshop, Marina del Rey, CA, USA.10.1145/3607505.3607513 ↗
4. Grinsztajn, L., Oyallon, E., and Varoquaux, G. (December, January 28). Why do tree-based models still outperform deep learning on typical tabular data?. Proceedings of the 35th Conference on Neural Information Processing Systems (NeurIPS 2022), New Orleans, LA, USA.
5. Guyon, I., Luxburg, U.V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R. (2017). Continual Learning with Deep Generative Replay. Proceedings of the NeurIPS, Curran Associates, Inc.
6. Overcoming Catastrophic Forgetting in Neural Networks10.1073/pnas.1611835114 ↗
7. Gong, D., Liu, L., Le, V., Saha, B., Mansour, M.R., Venkatesh, S., and van den Hengel, A. (November, January 27). Memorizing Normality to Detect Anomaly: Memory-augmented Deep Autoencoder for Unsupervised Anomaly Detection. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.10.1109/ICCV.2019.00179 ↗
8. An intelligent approach to credit card fraud detection using an optimized light gradient boosting machine10.1109/ACCESS.2020.2971354 ↗
9. Performance evaluations of AI-based obfuscated and encrypted malicious script detection with feature optimization10.4218/etrij.2024-0255 ↗
10. Kontogiannis, K., Khomh, F., Chatzigeorgiou, A., Fokaefs, M., and Zhou, M. (2020, January 18–21). Detecting Code Clones with Graph Neural Network and Flow-Augmented Abstract Syntax Tree. Proceedings of the 27th IEEE International Conference on Software Analysis, Evolution and Reengineering, SANER 2020, London, ON, Canada.
11. Kondrak, G. (2005). N-gram similarity and distance. International Symposium on String Processing and Information Retrieval, Springer.10.1007/11575832_13 ↗
12. Deep fuzzy hashing network for efficient image retrieval10.1109/TFUZZ.2020.2984991 ↗
13. Panwar, S.S., Raiwani, Y., and Panwar, L.S. (2022, January 10–11). An Intrusion Detection Model for CICIDS-2017 Dataset Using Machine Learning Algorithms. Proceedings of the 2022 International Conference on Advances in Computing, Communication and Materials (ICACCM), Dehradun, India.10.1109/ICACCM56405.2022.10009400 ↗
14. Gene Selection using Information Gain and Improved Simplified Swarm Optimization10.1016/j.neucom.2016.08.089 ↗
15. Sharafaldin, I., Habibi Lashkari, A., and Ghorbani, A.A. (2018, January 22–24). A detailed analysis of the cicids2017 data set. Proceedings of the Information Systems Security and Privacy: 4th International Conference, ICISSP 2018, Funchal-Madeira, Portugal. Revised Selected Papers 4.10.1007/978-3-030-25109-3_9 ↗
16. Random Forest10.17849/insm-47-01-31-39.1 ↗
17. Ben-Gal, I. (2008). Bayesian Networks. Encyclopedia of Statistics in Quality and Reliability, John Wiley & Sons.10.1002/9780470061572.eqr089 ↗
18. Random trees and applications
19. Rish, I. (2025, September 04). An Empirical Study of the Naive Bayes Classifier. Available online: https://faculty.cc.gatech.edu/~isbell/reading/papers/Rish.pdf.
20. Benchmarking of machine learning for anomaly based intrusion detection systems in the CICIDS2017 dataset10.1109/ACCESS.2021.3056614 ↗
21. Wu, Y., and He, K. (2018). Group Normalization. arXiv.10.1007/978-3-030-01261-8_1 ↗
22. Data standardization
23. Guo, G., Wang, H., Bell, D., Bi, Y., and Greer, K. (2003, January 3). KNN model-based approach in classification. Proceedings of the On the Move to Meaningful Internet Systems 2003: CoopIS, DOA, and ODBASE: OTM Confederated International Conferences, CoopIS, DOA, and ODBASE 2003, Catania, Italy.10.1007/978-3-540-39964-3_62 ↗
24. Decision tree methods: Applications for classification and prediction
25. Network anomaly detection and performance evaluation of Convolutional Neural Networks on UNSW-NB15 dataset10.1016/j.procs.2024.04.211 ↗
26. Comparison of Min-Max normalization and Z-Score Normalization in the K-nearest neighbor (kNN) Algorithm to Test the Accuracy of Types of Breast Cancer
27. Moustafa, N., and Slay, J. (2015, January 10–12). UNSW-NB15: A comprehensive data set for network intrusion detection systems (UNSW-NB15 network data set). Proceedings of the 2015 Military Communications and Information Systems Conference (MilCIS), Canberra, ACT, Australia.10.1109/MilCIS.2015.7348942 ↗
28. BAT: Deep learning methods on network intrusion detection using NSL-KDD dataset10.1109/ACCESS.2020.2972627 ↗
29. O’Shea, K., and Nash, R. (2015). An introduction to convolutional neural networks. arXiv.
30. More, S., Idrissi, M., Mahmoud, H., and Asyhari, A.T. (2024). Enhanced Intrusion Detection Systems Performance with UNSW-NB15 Data Analysis. Algorithms, 17.10.3390/a17020064 ↗
31. Logistic regression10.1161/CIRCULATIONAHA.106.682658 ↗
32. Wang, H., and Hu, D. (2005, January 13–15). Comparison of SVM and LS-SVM for regression. Proceedings of the 2005 International Conference on Neural Network and Brain, Beijing, China.
33. Altulaihan, E., Almaiah, M.A., and Aljughaiman, A. (2024). Anomaly Detection IDS for Detecting DoS Attacks in IoT Networks Based on Machine Learning Algorithms. Sensors, 24.10.3390/s24020713 ↗
34. Hendricks, R., and Khasawneh, M. (2021). Cluster analysis of categorical variables of parkinson’s disease patients. Brain Sci., 11.10.3390/brainsci11101290 ↗
35. (2023, February 17). Home. Available online: https://sites.google.com/view/iot-network-intrusion-dataset/home.
36. A Comprehensive Survey of Continual Learning: Theory, Method and Application10.1109/TPAMI.2024.3367329 ↗
37. Van de Ven, G.M., and Tolias, A.S. (2019). Three scenarios for continual learning. arXiv.
38. Liang, Y.S., and Li, W.J. (2024, January 16–22). Inflora: Interference-free low-rank adaptation for continual learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.02231 ↗
39. Yu, J., Zhuge, Y., Zhang, L., Hu, P., Wang, D., Lu, H., and He, Y. (2024, January 16–22). Boosting continual learning of vision-language models via mixture-of-experts adapters. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.02191 ↗
40. Gao, Z., Cen, J., and Chang, X. (2024, January 16–22). Consistent prompting for rehearsal-free continual learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.02689 ↗
41. Marczak, D., Twardowski, B., Trzciński, T., and Cygert, S. (2024). Magmax: Leveraging model merging for seamless continual learning. European Conference on Computer Vision, Springer Nature.10.1007/978-3-031-73013-9_22 ↗
42. Mixture of experts meets prompt-based continual learning
43. Guyon, I., and Elisseeff, A. (2006). An introduction to feature extraction. Feature Extraction: Foundations and Applications, Springer.10.1007/978-3-540-35488-8 ↗
44. Dingo optimizer: A nature-inspired metaheuristic approach for engineering problems10.1155/2021/2571863 ↗
45. Yarram, S. (2025, January 21–22). An Optimized Deep Learning Approach for Intrusion Detection: AE-DBN Hybrid Model with Dingo Feature Selection on CSE-CIC-IDS2018. Proceedings of the 2025 International Conference on Computing for Sustainability and Intelligent Future (COMP-SIF), Bangalore, India.10.1109/COMP-SIF65618.2025.10969957 ↗
46. Q-learning based vegetation evolution for numerical optimization and wireless sensor network coverage optimization10.1016/j.aej.2023.12.028 ↗
47. Class Imbalance Problem in Data Mining Review
48. Data imbalance in classification: Experimental evaluation10.1016/j.ins.2019.11.004 ↗
49. Thanh-Tung, H., and Tran, T. (2018). On Catastrophic Forgetting and Mode Collapse in Generative Adversarial Networks. arXiv.
50. Srivastava, A., Valkov, L., Russell, C., Gutmann, M.U., and Sutton, C. (2017, January 4–9). VEEGAN: Reducing Mode Collapse in GANs Using Implicit Variational Learning. Proceedings of the Advances in Neural Information Processing Systems, Long Beach, CA, USA.
51. Bang, D., and Shim, H. (2021, January 11–17). Mggan: Solving mode collapse using manifold-guided training. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCVW54120.2021.00266 ↗
52. SMOTE: Synthetic minority over-sampling technique10.1613/jair.953 ↗
53. Wang, S., Dai, Y., Shen, J., and Xuan, J. (2021). Research on expansion and classification of imbalanced data based on SMOTE algorithm. Sci. Rep., 11.10.1038/s41598-021-03430-5 ↗
54. He, H., Bai, Y., Garcia, E.A., and Li, S. (2008, January 1–8). ADASYN: Adaptive Synthetic Sampling Approach for Imbalanced Learning. Proceedings of the IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), Hong Kong.
55. Imani, M., Ghaderpour, Z., Joudaki, M., and Beikmohammadi, A. (2024, January 24–25). The Impact of SMOTE and ADASYN on Random Forest and Advanced Gradient Boosting Techniques in Telecom Customer Churn Prediction. Proceedings of the 2024 10th International Conference on Web Research (ICWR), IEEE, Tehran, Iran.10.1109/ICWR61162.2024.10533320 ↗
56. Denoising autoencoders for overgeneralization in neural networks10.1109/TPAMI.2019.2909876 ↗
57. Combining contextual neural networks for time series classification10.1016/j.neucom.2019.10.113 ↗
58. TSMAE: A Novel Anomaly Detection Approach for Internet of Things Time Series Data Using Memory-Augmented Autoencoder10.1109/TNSE.2022.3163144 ↗
59. Memory-augmented skip-connected autoencoder for unsupervised anomaly detection of rocket engines with multi-source fusion10.1016/j.isatra.2022.07.014 ↗
60. Gao, Q., Zhao, C., Sun, Y., Xi, T., Zhang, G., Ghanem, B., and Zhang, J. (2023, January 2–3). A unified continual learning framework with general parameter-efficient tuning. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.01055 ↗
61. Chaudhry, A., Rohrbach, M., Elhoseiny, M., Ajanthan, T., Dokania, P.K., Torr, P.H.S., and Ranzato, M. (2019). On Tiny Episodic Memories in Continual Learning. arXiv.
62. Buzzega, P., Boschini, M., Porrello, A., Abati, D., and Calderara, S. (2020, January 6–12). Dark Experience for General Continual Learning: A Strong, Simple Baseline. Proceedings of the Neural Information Processing Systems (NeurIPS), Online.
63. Lopez-Paz, D., and Ranzato, M. (2017). Gradient episodic memory for continual learning. Advances in Neural Information Processing Systems 30 (NIPS 2017), NeurIPS (Neural Information Processing System).
64. Chaudhry, A., Dokania, P.K., Ajanthan, T., and Torr, P.H. (2018, January 23–28). Riemannian walk for incremental learning: Understanding forgetting and intransigence. Proceedings of the European Conference on Computer Vision (ECCV), Glasgow, UK.10.1007/978-3-030-01252-6_33 ↗
65. Riemer, M., Cases, I., Ajemian, R., Liu, M., Rish, I., Tu, Y., and Tesauro, G. (2018). Learning to Learn without Forgetting by Maximizing Transfer and Minimizing Interference. arXiv.