D-Know: Disentangled Domain Knowledge-Aided Learning for Open-Domain Continual Object Detection
Source abstract
Abstract
Continual learning for open-vocabulary object detection aims to enable pretrained vision–language detectors to adapt to diverse specialized domains while preserving their zero-shot generalization capabilities. However, existing methods primarily focus on mitigating catastrophic forgetting, often neglecting the substantial domain shifts commonly encountered in real-world applications. To address this critical oversight, we pioneer Open-Domain Continual Object Detection (OD-COD), a new paradigm that requires detectors to continually adapt across domains with significant stylistic gaps. We propose Disentangled Domain Knowledge-Aided Learning (D-Know) to tackle this challenge. This framework explicitly disentangles domain-general priors from category-specific adaptation, managing them dynamically in a scalable domain knowledge base. Specifically, D-Know first learns domain priors in a self-supervised manner and then leverages these priors to facilitate category-specific adaptation within each domain. To rigorously evaluate this task, we construct OD-CODB, the first dedicated benchmark spanning six domains with substantial visual variations. Extensive experiments demonstrate that D-Know achieves superior performance, surpassing current state-of-the-art methods by an average of 4.2% mAP under open-domain continual settings while maintaining strong zero-shot generalization. Furthermore, experiments under the few-shot setting confirm D-Know’s superior data efficiency.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Domain Adaptation and Few-Shot Learning · Multimodal Machine Learning Applications · Advanced Neural Network Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
School of Computer Science and Technology, Xi’an Jiaotong University, Xi’an 710049, China
Shaanxi Province Key Laboratory of Big Data Knowledge Engineering, Xi’an Jiaotong University, Xi’an 710049, China
School of Continuing Education, Xi’an Jiaotong University, Xi’an 710049, China
MIGU Video Co., Ltd., Shanghai 201206, China
Funding
National Science and Technology Major Project · NSFC · State Key Laboratory of Communication Content Cognition · Project of China Knowledge Centre for Engineering Science and Technology
References (35)
Show source-provided references
1. Attention is all you need
2. Carion, N., Massa, F., Synnaeve, G., Usunier, N., Kirillov, A., and Zagoruyko, S. (2020). End-to-end object detection with transformers. European Conference on Computer Vision, Springer.10.1007/978-3-030-58452-8_13 ↗
3. Zhu, X., Su, W., Lu, L., Li, B., Wang, X., and Dai, J. (2020). Deformable detr: Deformable transformers for end-to-end object detection. arXiv.
4. Meng, D., Chen, X., Fan, Z., Zeng, G., Li, H., Yuan, Y., Sun, L., and Wang, J. (2021, January 11–17). Conditional detr for fast training convergence. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00363 ↗
5. Liu, S., Li, F., Zhang, H., Yang, X., Qi, X., Su, H., Zhu, J., and Zhang, L. (2022, January 25–29). DAB-DETR: Dynamic Anchor Boxes Are Better Queries for DETR. Proceedings of the International Conference on Learning Representations, Virtual Event.
6. Zareian, A., Rosa, K.D., Hu, D.H., and Chang, S.F. (2021, January 20–25). Open-Vocabulary Object Detection Using Captions. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA.10.1109/CVPR46437.2021.01416 ↗
7. Li, L.H., Zhang, P., Zhang, H., Yang, J., Li, C., Zhong, Y., Wang, L., Yuan, L., Zhang, L., and Hwang, J.N. (2022, January 18–24). Grounded language-image pre-training. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01069 ↗
8. GLIPv2: Unifying Localization and Vision-Language Understanding
9. Zero-shot generalizable incremental learning for vision-language object detection10.52202/079017-4342 ↗
10. Dong, B., Huang, Z., Yang, G., Zhang, L., and Zuo, W. (2024). MR-GDINO: Efficient open-world continual object detection. arXiv.
11. Cappellino, C., Mancusi, G., Mosconi, M., Porrello, A., Calderara, S., and Cucchiara, R. (2025). DitHub: A Modular Framework for Incremental Open-Vocabulary Object Detection. arXiv.
12. Poss, C., Ibragimov, O., Indreswaran, A., Gutsche, N., Irrenhauser, T., Prueglmeier, M., and Goehring, D. (2018, January 17–20). Application of open Source Deep Neural Networks for Object Detection in Industrial Environments. Proceedings of the 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA), Orlando, FL, USA.10.1109/ICMLA.2018.00041 ↗
13. Şafak Kılıç (2025). HybridVisionNet: An advanced hybrid deep learning framework for automated multi-class ocular disease diagnosis using fundus imaging. Ain Shams Eng. J., 16, 103594.10.1016/j.asej.2025.103594 ↗
14. Inoue, N., Furuta, R., Yamasaki, T., and Aizawa, K. (2018, January 18–23). Cross-Domain Weakly-Supervised Object Detection Through Progressive Domain Adaptation. Proceedings of the 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00525 ↗
15. Detection and tracking meet drones challenge10.1109/TPAMI.2021.3119563 ↗
16. A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Future10.1109/TPAMI.2024.3413013 ↗
17. Jeong, J., Park, G., Yoo, J., Jung, H., and Kim, H. (2024, January 20–27). Proxydet: Synthesizing proxy novel classes via classwise mixup for open-vocabulary object detection. Proceedings of the AAAI Conference on Artificial Intelligence, Vancouver, BC, Canada.10.1609/aaai.v38i3.28022 ↗
18. Radford, A., Kim, J.W., Hallacy, C., Ramesh, A., Goh, G., Agarwal, S., Sastry, G., Askell, A., Mishkin, P., and Clark, J. (2021, January 18–24). Learning transferable visual models from natural language supervision. Proceedings of the International Conference on Machine Learning. PmLR, Virtual Event.
19. Gu, X., Lin, T.Y., Kuo, W., and Cui, Y. (2021, January 4). Open-vocabulary Object Detection via Vision and Language Knowledge Distillation. Proceedings of the International Conference on Learning Representations, Vienna, Austria.
20. Wu, S., Zhang, W., Jin, S., Liu, W., and Loy, C.C. (2023, January 18–22). Aligning bag of regions for open-vocabulary object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.01464 ↗
21. Minderer, M., Gritsenko, A., Stone, A., Neumann, M., Weissenborn, D., Dosovitskiy, A., Mahendran, A., Arnab, A., Dehghani, M., and Shen, Z. (2022, January 23–27). Simple open-vocabulary object detection. Proceedings of the European Conference on Computer Vision, Tel Aviv, Israel.10.1007/978-3-031-20080-9_42 ↗
22. Kuo, W., Cui, Y., Gu, X., Piergiovanni, A.J., and Angelova, A. (2023, January 1–5). Open-Vocabulary Object Detection upon Frozen Vision and Language Models. Proceedings of the International Conference on Learning Representations, Kigali, Rwanda.
23. Continual Object Detection: A review of definitions, strategies, and challenges10.1016/j.neunet.2023.01.041 ↗
24. Learning without forgetting10.1109/TPAMI.2017.2773081 ↗
25. Rebuffi, S.A., Kolesnikov, A., Sperl, G., and Lampert, C.H. (2017, January 21–26). icarl: Incremental classifier and representation learning. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.587 ↗
26. Acharya, M., Hayes, T.L., and Kanan, C. (2020). Rodeo: Replay for online object detection. arXiv.10.5244/C.34.128 ↗
27. Li, W., Wu, Q., Xu, L., and Shang, C. (2018, January 7–10). Incremental learning of single-stage detectors with mining memory neurons. Proceedings of the 2018 IEEE 4th International Conference on Computer and Communications (ICCC), Chengdu, China.10.1109/CompComm.2018.8780739 ↗
28. Zhang, N., Sun, Z., Zhang, K., and Xiao, L. (2021, January 14–16). Incremental learning of object detection with output merging of compact expert detectors. Proceedings of the 2021 4th International Conference on Intelligent Autonomous Systems (ICoIAS), Wuhan, China.10.1109/ICoIAS53694.2021.00008 ↗
29. Guan, L., Wu, Y., Zhao, J., and Ye, C. (2018, January 26–30). Learn to detect objects incrementally. Proceedings of the 2018 IEEE Intelligent Vehicles Symposium (IV), Suzhou, China.10.1109/IVS.2018.8500673 ↗
30. RD-IOD: Two-Level Residual-Distillation-Based Triple-Network for Incremental Object Detection
31. Liu, S., Zeng, Z., Ren, T., Li, F., Zhang, H., Yang, J., Jiang, Q., Li, C., Yang, J., and Su, H. (October, January 29). Grounding dino: Marrying dino with grounded pre-training for open-set object detection. Proceedings of the European Conference on Computer Vision, Milan, Italy.
32. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11–17). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00986 ↗
33. Aich, A. (2021). Elastic weight consolidation (EWC): Nuts and bolts. arXiv.
34. Shao, S., Li, Z., Zhang, T., Peng, C., Yu, G., Zhang, X., Li, J., and Sun, J. (November, January 27). Objects365: A Large-Scale, High-Quality Dataset for Object Detection. Proceedings of the 2019 IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.10.1109/ICCV.2019.00852 ↗
35. Selvaraju, R.R., Cogswell, M., Das, A., Vedantam, R., Parikh, D., and Batra, D. (2017, January 22–29). Grad-CAM: Visual Explanations From Deep Networks via Gradient-Based Localization. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.74 ↗