CoDC: Unified Diffusion and Classification for Enhanced Class-Incremental Learning
Source abstract
Abstract
In class-incremental learning (CIL), a model must learn new classes while retaining previous knowledge without storing all historical data. Generative replay mitigates catastrophic forgetting by synthesizing old class samples, but conventional pipelines usually train separate generative and classification models and can be degraded by generated images of poor quality. This paper proposes the Co-Diffusion Classifier (CoDC), a unified framework based on diffusion that performs image generation and classification in a single network. CoDC attaches a classification branch to the UNet encoder and introduces an exponential noise filtering loss according to diffusion timesteps so that cleaner samples contribute more strongly to representation learning. A base task classification pre-training stage followed by collaborative training with selective parameter freezing reduces conflicts between noise prediction and semantic feature extraction. For rehearsal-free replay, generated samples are selected using confidence and feature consistency filters. Experiments on CIFAR-100, FaceScrub, and Flowers-102 show that CoDC maintains strong incremental accuracy without storing real old class exemplars. Additional comparisons that account for protocol differences with recent exemplar-free and pre-trained model methods clarify the setting in which CoDC is most directly comparable.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Domain Adaptation and Few-Shot Learning · Machine Learning and ELM · Face recognition and analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Communication and Information Engineering, Shanghai University, Shanghai 200444, China
References (43)
Show source-provided references
1. A Survey on Ensemble Learning for Data Stream Classification10.1145/3054925 ↗
2. Open challenges for data stream mining research10.1145/2674026.2674028 ↗
3. A continual learning survey: Defying forgetting in classification tasks
4. Survey and performance evaluation of class-incremental learning
5. Class-incremental learning: Survey and performance evaluation on image classification10.1109/TPAMI.2022.3213473 ↗
6. A comprehensive survey of continual learning: Theory, method and application10.1109/TPAMI.2024.3367329 ↗
7. Three types of incremental learning10.1038/s42256-022-00568-3 ↗
8. McCloskey, M., and Cohen, N.J. (1989). Catastrophic interference in connectionist networks: The sequential learning problem. Psychology of Learning and Motivation, Academic Press.10.1016/S0079-7421(08)60536-8 ↗
9. Continual lifelong learning with neural networks: A review10.1016/j.neunet.2019.01.012 ↗
10. Overcoming catastrophic forgetting in neural networks10.1073/pnas.1611835114 ↗
11. Learning without forgetting10.1109/TPAMI.2017.2773081 ↗
12. Replay in deep learning: Current approaches and missing biological elements
13. Generative negative replay for continual learning10.1016/j.neunet.2023.03.006 ↗
14. Hinton, G., Vinyals, O., and Dean, J. (2015). Distilling the knowledge in a neural network. arXiv.
15. Rebuffi, S.-A., Kolesnikov, A., Sperl, G., and Lampert, C.H. (2017, January 21–26). iCaRL: Incremental classifier and representation learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.587 ↗
16. Rios, A., and Itti, L. (2019, January 10–16). Closed-loop memory GAN for continual learning. Proceedings of the 28th International Joint Conference on Artificial Intelligence (IJCAI), Macao, China.10.24963/ijcai.2019/462 ↗
17. Brain-inspired replay for continual learning with artificial neural networks10.1038/s41467-020-17866-2 ↗
18. Meng, Z., Zhang, J., Yang, C., Zhan, Z., Zhao, P., and Wang, Y. (October, January 29). Diffclass: Diffusion-based class incremental learning. Proceedings of the European Conference on Computer Vision (ECCV), Milan, Italy.
19. Jodelet, Q., Liu, X., Phua, Y.J., and Murata, T. (2023, January 2–3). Class-incremental learning using diffusion model for distillation and replay. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Paris, France.10.1109/ICCVW60793.2023.00367 ↗
20. Yan, S., Xie, J., and He, X. (2021, January 19–25). DER: Dynamically expandable representation for class incremental learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Virtual.10.1109/CVPR46437.2021.00303 ↗
21. Petit, G., Popescu, A., Schindler, H., Picard, D., and Delezoide, B. (2023, January 3–7). FeTrIL: Feature translation for exemplar-free class-incremental learning. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA.10.1109/WACV56688.2023.00390 ↗
22. Rypeść, G., Cygert, S., Khan, V., Trzciński, T., Zieliński, B., and Twardowski, B. (2024, January 7–11). Divide and not forget: Ensemble of selectively trained experts in Continual Learning. Proceedings of the International Conference on Learning Representations (ICLR), Vienna, Austria.
23. He, R., Fang, D., Xu, Y., Cui, Y., Li, M., Chen, C., Zeng, Z., and Zhuang, H. (2025, January 13–19). Semantic shift estimation via dual-projection and classifier reconstruction for exemplar-free class-incremental learning. Proceedings of the 42nd International Conference on Machine Learning (ICML), PMLR, Vancouver, BC, Canada.
24. Abbasnejad, E., Gong, D., McDonnell, M.D., Parvaneh, A., and Hengel, A.V.D. (2023, January 10–16). RanPAC: Random projections and pre-trained models for continual learning. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), New Orleans, LA, USA.10.52202/075280-0526 ↗
25. Zhou, D.-W., Zhang, Y., Ye, H.-J., Zhan, D.-C., and Liu, Z. (2024, January 16–22). Expandable subspace ensemble for pre-trained model-based class-incremental learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR52733.2024.02223 ↗
26. Wang, Y., Zhou, D.W., and Ye, H.J. (2025, January 19–23). Integrating task-specific and universal adapters for pre-trained model-based class-incremental learning. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Honolulu, HI, USA.10.1109/ICCV51701.2025.00083 ↗
27. Qiu, H., Zhang, M., Qiao, Z., Guan, W., Zhang, M., and Nie, L. (2026, January 27–28). SplitLoRA: Balancing stability and plasticity in continual learning through gradient space splitting. Proceedings of the International Conference on Learning Representations (ICLR), Rio de Janeiro, Brazil.
28. Ho, J., Jain, A., and Abbeel, P. (2020, January 6–12). Denoising diffusion probabilistic models. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Virtual.
29. Diffusion models in vision: A survey10.1109/TPAMI.2023.3261988 ↗
30. Diffusion models: A comprehensive survey of methods and applications10.1145/3554729 ↗
31. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing and Computer-Assisted Intervention (MICCAI), Munich, Germany.10.1007/978-3-319-24574-4_28 ↗
32. Song, J., Meng, C., and Ermon, S. (2020). Denoising diffusion implicit models. arXiv.
33. Rombach, R., Blattmann, A., Lorenz, D., Esser, P., and Ommer, B. (2022, January 18–24). High-resolution image synthesis with latent diffusion models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.01042 ↗
34. Schneider, F. (2023). Archisound: Audio generation with diffusion. arXiv.
35. Poole, B., Jain, A., Barron, J.T., and Mildenhall, B. (2022). Dreamfusion: Text-to-3d using 2d diffusion. arXiv.
36. A softmax-free loss function based on predefined optimal-distribution of latent features for deep learning classifier10.1109/TCSVT.2022.3212426 ↗
37. Krizhevsky, A., and Hinton, G. (2009). Learning Multiple Layers of Features from Tiny Images, University of Toronto. Technical Report.
38. Ng, H.W., and Winkler, S. (2014, January 27–30). A data-driven approach to cleaning large face datasets. Proceedings of the 2014 IEEE International Conference on Image Processing (ICIP), Paris, France.10.1109/ICIP.2014.7025068 ↗
39. Nilsback, M.E., and Zisserman, A. (2008, January 16–19). Automated flowers classification over a large number of classes. Proceedings of the Sixth Indian Conference on Computer Vision, Graphics and Image Processing (ICVGIP), Bhubaneswar, India.10.1109/ICVGIP.2008.47 ↗
40. Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., and Hochreiter, S. (2017, January 4–9). GANs trained by a two time-scale update rule converge to a local nash equilibrium. Proceedings of the Advances in Neural Information Processing Systems (NeurIPS), Long Beach, CA, USA.
41. Wang, F.-Y., Zhou, D.-W., Ye, H.-J., and Zhan, D.-C. (2022, January 23–27). Foster: Feature boosting and compression for class-incremental learning. Proceedings of the European Conference on Computer Vision (ECCV), Tel Aviv, Israel.10.1007/978-3-031-19806-9_23 ↗
42. Zhou, D.W., Wang, Q.W., Ye, H.J., and Zhan, D.C. (2023, January 1–5). A model or 603 exemplars: Towards memory-efficient class-incremental learning. Proceedings of the International Conference on Learning Representations (ICLR), Virtually.
43. Zhu, K., Zhai, W., Cao, Y., Luo, J., and Zha, Z.-J. (2022, January 18–24). Self-sustaining representation expansion for non-exemplar class-incremental learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA.10.1109/CVPR52688.2022.00908 ↗