Dual-Stream Time-Series Transformer-Based Encrypted Traffic Data Augmentation Framework
Source abstract
Abstract
We propose a Transformer-based data augmentation framework with a time-series dual-stream architecture to address performance degradation in encrypted network traffic classification caused by class imbalance between attack and benign traffic. The proposed framework independently processes the complete flow’s sequential packet information and statistical characteristics by extracting and normalizing a local channel (comprising packet size, inter-arrival time, and direction) and a set of six global flow-level statistical features. These are used to generate a fixed-length multivariate sequence and an auxiliary vector. The sequence and vector are then fed into an encoder-only Transformer that integrates learnable positional embeddings with a FiLM + context token-based injection mechanism, enabling complementary representation of sequential patterns and global statistical distributions. Large-scale experiments demonstrate that the proposed method reduces reconstruction RMSE and additional feature restoration MSE by over 50%, while improving accuracy, F1-Score, and AUC by 5–7%p compared to classification on the original imbalanced datasets. Furthermore, the augmentation process achieves practical levels of processing time and memory overhead. These results show that the proposed approach effectively mitigates class imbalance in encrypted traffic classification and offers a promising pathway to achieving more robust model generalization in real-world deployment scenarios.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Internet Traffic Analysis and Secure E-voting · Network Security and Intrusion Detection · Anomaly Detection Techniques and Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Cryptographic and Information Security Laboratory, Seoul National University of Science and Technology, Seoul 01811, Republic of Korea
Funding
Seoul National University of Science and Technology
References (44)
Show source-provided references
1. Langley, A., Riddoch, A., Wilk, A., Vicente, A., Krasic, C., Zhang, D., Yang, F., Kouranov, F., Swett, I., and Iyengar, J. (2017, January 21–25). The quic transport protocol: Design and internet-scale deployment. Proceedings of the Conference of the ACM Special Interest Group on Data Communication, Los Angeles, CA, USA.10.1145/3098822.3098842 ↗
2. A survey on encrypted network traffic analysis applications, techniques, and countermeasures10.1145/3457904 ↗
3. A survey of techniques for internet traffic classification using machine learning10.1109/SURV.2008.080406 ↗
4. Moore, A.W., and Zuev, D. (2005, January 14–18). Internet traffic classification using bayesian analysis techniques. Proceedings of the 2005 ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems, Virtual Event.10.1145/1064212.1064220 ↗
5. Deep packet: A novel approach for encrypted traffic classification using deep learning10.1007/s00500-019-04030-2 ↗
6. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017). Attention is all you need. Adv. Neural Inf. Process. Syst., 30.
7. SMOTE: Synthetic minority over-sampling technique10.1613/jair.953 ↗
8. Wang, P., Li, S., Ye, F., Wang, Z., and Zhang, M. (2020, January 7–11). PacketCGAN: Exploratory study of class imbalance for encrypted traffic classification using CGAN. Proceedings of the ICC 2020—2020 IEEE International Conference on Communications (ICC), Dublin, Ireland.10.1109/ICC40277.2020.9148946 ↗
9. Toward generating a new intrusion detection dataset and intrusion traffic characterization
10. Towards the development of realistic botnet dataset in the internet of things for network forensic analytics: Bot-iot dataset10.1016/j.future.2019.05.041 ↗
11. Learning from imbalanced data10.1109/TKDE.2008.239 ↗
12. Han, H., Wang, W.Y., and Mao, B.H. (2005, January 23–26). Borderline-SMOTE: A new over-sampling method in imbalanced data sets learning. Proceedings of the International Conference on Intelligent Computing, Hefei, China.10.1007/11538059_91 ↗
13. He, H., Bai, Y., Garcia, E.A., and Li, S. (2008, January 1–8). ADASYN: Adaptive synthetic sampling approach for imbalanced learning. Proceedings of the 2008 IEEE International Joint Conference on Neural Networks (IEEE World Congress on Computational Intelligence), Hong Kong, China.
14. Yoon, J., Jarrett, D., and Van der Schaar, M. (2019). Time-series generative adversarial networks. Adv. Neural Inf. Process. Syst., 32.
15. Yu, L., Zhang, W., Wang, J., and Yu, Y. (2017, January 4–9). Seqgan: Sequence generative adversarial nets with policy gradient. Proceedings of the AAAI Conference on Artificial Intelligence, Francisco, CA, USA.10.1609/aaai.v31i1.10804 ↗
16. Donahue, C., McAuley, J., and Puckette, M. (2018). Adversarial audio synthesis. arXiv.
17. Kingma, D.P., and Welling, M. (2013). Auto-encoding variational bayes. arXiv.
18. Larsen, A.B.L., Sønderby, S.K., Larochelle, H., and Winther, O. (2016, January 20–22). Autoencoding beyond pixels using a learned similarity metric. Proceedings of the International Conference on Machine Learning, PMLR, New York, NY, USA.
19. NetDiffus: Network traffic generation by diffusion models through time-series imaging10.1016/j.comnet.2024.110616 ↗
20. A balanced supervised contrastive learning-based method for encrypted network traffic classification10.1016/j.cose.2024.104023 ↗
21. A New Encrypted Traffic Identification Model Based on VAE-LSTM-DRN
22. Shaw, P., Uszkoreit, J., and Vaswani, A. (2018). Self-attention with relative position representations. arXiv.10.18653/v1/N18-2074 ↗
23. Ba, J.L., Kiros, J.R., and Hinton, G.E. (2016). Layer normalization. arXiv.
24. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
25. Dropout: A simple way to prevent neural networks from overfitting
26. Wiegreffe, S., and Pinter, Y. (2019). Attention is not not explanation. arXiv.10.18653/v1/D19-1002 ↗
27. Sparse is enough in scaling transformers
28. Zhou, H., Zhang, S., Peng, J., Zhang, S., Li, J., Xiong, H., and Zhang, W. (2021, January 2–9). Informer: Beyond efficient transformer for long sequence time-series forecasting. Proceedings of the AAAI Conference on Artificial Intelligence, Virtually.10.1609/aaai.v35i12.17325 ↗
29. Temporal fusion transformers for interpretable multi-horizon time series forecasting10.1016/j.ijforecast.2021.03.012 ↗
30. CoTNeT: Contextual transformer network for encrypted traffic classification10.1016/j.eij.2024.100475 ↗
31. NetST: Network Encrypted Traffic Classification Based on Swin Transformer
32. Liu, Z., Xie, Y., Luo, Y., Wang, Y., and Ji, X. (2025). TransECA-Net: A Transformer-Based Model for Encrypted Traffic Classification. Appl. Sci., 15.10.3390/app15062977 ↗
33. Claise, B., Trammell, B., and Aitken, P. (2013). Specification of the IP Flow Information Export (IPFIX) Protocol for the Exchange of Flow Information, Technical Report; Internet Engineering Task Force (IETF).10.17487/rfc7015 ↗
34. Baldini, G. (2020, January 3). Analysis of encrypted traffic with time-based features and time frequency analysis. Proceedings of the 2020 Global Internet of Things Summit (GIoTS), Dublin, Ireland.10.1109/GIOTS49054.2020.9119528 ↗
35. FlowPic: A generic representation for encrypted traffic classification and applications identification10.1109/TNSM.2021.3071441 ↗
36. Self-similarity in world wide web traffic: Evidence and possible causes10.1109/90.650143 ↗
37. Resampling strategies for imbalanced time series forecasting10.1007/s41060-017-0044-3 ↗
38. A comparison of normalization methods for high density oligonucleotide array data based on variance and bias10.1093/bioinformatics/19.2.185 ↗
39. Operating characteristics of the rank-based inverse normal transformation for quantitative trait analysis in genome-wide association studies10.1111/biom.13214 ↗
40. Leakage in data mining: Formulation, detection, and avoidance10.1145/2382577.2382579 ↗
41. Deep learning for time series classification: A review10.1007/s10618-019-00619-1 ↗
42. Correlation and Symmetrical Uncertainty-Based Feature Selection for Multivariate Time Series Classification
43. A kernel two-sample test
44. Reducing the dimensionality of data with neural networks10.1126/science.1127647 ↗