Rarity-Aware Stratified Active Learning for Class-Imbalanced Industrial Object Detection
Source abstract
Abstract
Object detection systems deployed in industrial environments are often constrained by limited annotation budgets, severe class imbalance, and heterogeneous visual conditions. Active learning (AL) aims to reduce labeling costs by selecting informative samples; however, existing strategies struggle to simultaneously ensure robust performance, rare-class coverage, and stability under realistic industrial constraints. In this work, we propose a rarity-aware, stratified AL framework for industrial object detection that explicitly aligns sample selection with class imbalance and annotation efficiency. The method relies on a composite image-level score that jointly captures model uncertainty, informativeness, and complementary diversity cues, while adaptively emphasizing rare classes. Crucially, a stratified querying mechanism is introduced to explicitly regulate class-wise sample allocation during selection, playing a key role in improving performance stability and rare-class coverage under severe imbalance, without sacrificing global informativeness. The proposed approach operates purely at the data-selection level, making it detector-agnostic and directly applicable to modern object detection pipelines. Experiments conducted on two real-world industrial datasets involving lobster and snow crab parts, using YOLOv10 and YOLOv12, demonstrate improved training stability and annotation efficiency across balanced, imbalanced, and noisy settings over multiple active learning cycles up to 15% labeled data. Complementary comparisons with fully supervised training further show that using only 45–65% of the labeled data is sufficient to retain more than 97% of full-supervision mAP@50 and over 90% of mAP@50:95.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Machine Learning and Algorithms · Machine Learning and Data Classification
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Laboratoire de Recherche en Interaction Humain-Système (LARIHS), Université de Moncton, 218 Boul. J.-D. Gauthier, Shippagan, NB E8S 1P6, Canada
Secteur des Sciences, Université de Moncton, 218 Boul. J.-D. Gauthier, Shippagan, NB E8S 1P6, Canada
Funding
Research New Brunswick (Research NB), Canada
References (61)
Show source-provided references
1. Deep learning methods for object detection in smart manufacturing: A survey10.1016/j.jmsy.2022.06.011 ↗
2. Xu, J., Kovatsch, M., Mattern, D., Mazza, F., Harasic, M., Paschke, A., and Lucia, S. (2022). A Review on AI for Smart Manufacturing: Deep Learning Challenges and Solutions. Appl. Sci., 12.10.3390/app12168239 ↗
3. Deep learning for industrial image: Challenges, methods for enriching the sample space and restricting the hypothesis space, and possible issue10.1080/0951192X.2021.1901319 ↗
4. Human-centric artificial intelligence architecture for industry 5.0 applications10.1080/00207543.2022.2138611 ↗
5. A survey of deep active learning
6. Designing Synthetic Active Learning for model refinement in manufacturing parts detection10.1016/j.jmsy.2025.11.023 ↗
7. Active Learning and Novel Model Calibration Measurements for Automated Visual Inspection in Manufacturing
8. Zajec, P., Rožanec, J.M., Trajkova, E., Novalija, I., Kenda, K., Fortuna, B., and Mladenić, D. (2021). Help Me Learn! Architecture and Strategies to Combine Recommendations and Active Learning in Manufacturing. Information, 12.10.20944/preprints202110.0090.v1 ↗
9. Lv, X., Duan, F., Jiang, J.J., Fu, X., and Gan, L. (2020). Deep Active Learning for Surface Defect Detection. Sensors, 20.10.3390/s20061650 ↗
10. Explainable AI for trustworthy intelligent process monitoring10.1016/j.cie.2025.111407 ↗
11. Khan, N., Ahmad, K., Al Tamimi, A., Alani, M.M., Bermak, A., and Khalil, I. (2025). Explainable AI-Based Intrusion Detection Systems for Industry 5.0 and Adversarial XAI: A Systematic Review. Information, 16.10.3390/info16121036 ↗
12. Explainable AI for Industry 5.0: Vision, Architecture, and Potential Directions10.1109/OJIA.2024.3399057 ↗
13. Agostinho, C., Dikopoulou, Z., Lavasa, E., Perakis, K., Pitsios, S., Branco, R., Reji, S., Hetterich, J., Biliri, E., and Lampathaki, F. (2023). Explainability as the key ingredient for AI adoption in Industry 5.0 settings. Front. Artif. Intell., 6.10.3389/frai.2023.1264372 ↗
14. Bengar, J.Z., van de Weijer, J., Lopez Fuentes, L., and Raducanu, B. (2022). Class-Balanced Active Learning for Image Classification. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA, 3–8 January 2022, IEEE.10.1109/WACV51458.2022.00376 ↗
15. Aggarwal, U., Popescu, A., and Hudelot, C. (2020, January 1–5). Active Learning for Imbalanced Datasets. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Snowmass, CO, USA.10.1109/WACV45572.2020.9093475 ↗
16. Bai, H., Mou, S., Likhomanenko, T., Cinbis, R.G., Tuzel, O., Huang, P., Shan, J., Shi, J., and Cao, M. (2023). VISION Datasets: A Benchmark for Vision-based Industrial Inspection. arXiv.
17. Differential feature awareness network within antagonistic learning for infrared-visible object detection10.1109/TCSVT.2023.3289142 ↗
18. Active learning for industrial applications10.1080/08982112.2024.2402376 ↗
19. Zhao, Y., Yang, Y., and Chen, S. (2023, January 11–14). An Active Semi-Supervised Learning for Object Detection. Proceedings of the 2023 International Conference on Culture-Oriented Science and Technology (CoST), Xi’an, China.10.1109/CoST60524.2023.00059 ↗
20. Vedaldi, A., Bischof, H., Brox, T., and Frahm, J.M. (2020). Consistency-Based Semi-supervised Active Learning: Towards Minimizing Labeling Cost. Proceedings of the Computer Vision—ECCV 2020, Springer.
21. Chen, S., Yang, Y., and Hua, Y. (2023). Semi-Supervised Active Learning for Object Detection. Electronics, 12.10.3390/electronics12020375 ↗
22. Mi, P., Lin, J., Zhou, Y., Shen, Y., Luo, G., Sun, X., Cao, L., Fu, R., Xu, Q., and Ji, R. (2022). Active teacher for semi-supervised object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA, 18–24 June 2022, IEEE.10.1109/CVPR52688.2022.01408 ↗
23. Yang, C., Huang, L., and Crowley, E.J. (2024). Plug and play active learning for object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA, 16–22 June 2024, IEEE.10.1109/CVPR52733.2024.01684 ↗
24. Unlabeled data selection for active learning in image classification10.1038/s41598-023-50598-z ↗
25. Garcia, D., Carias, J., Adão, T., Jesus, R., Cunha, A., and Magalhães, L.G. (2023). Ten years of active learning techniques and object detection: A systematic review. Appl. Sci., 13.10.3390/app131910667 ↗
26. Yoo, D., and Kweon, I.S. (2019). Learning loss for active learning. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA, 15–20 June 2019, IEEE.10.1109/CVPR.2019.00018 ↗
27. Roy, S., Unmesh, A., and Namboodiri, V.P. (2018, January 3–6). Deep active learning for object detection. Proceedings of the 29th British Machine Vision Conference (BMVC), Newcastle, UK.
28. Li, X., and Guo, Y. (2013, January 23–28). Adaptive active learning for image classification. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Portland, OR, USA.10.1109/CVPR.2013.116 ↗
29. Feng, D., Wei, X., Rosenbaum, L., Maki, A., and Dietmayer, K. (2019). Deep active learning for efficient training of a lidar 3d object detector. Proceedings of the 2019 IEEE Intelligent Vehicles Symposium (IV), Paris, France, 9–12 June 2019, IEEE.10.1109/IVS.2019.8814236 ↗
30. Gal, Y., Islam, R., and Ghahramani, Z. (2017, January 6–11). Deep bayesian active learning with image data. Proceedings of the International Conference on Machine Learning (ICML). PMLR, Sydney, Australia.
31. Houlsby, N., Huszár, F., Ghahramani, Z., and Lengyel, M. (2011). Bayesian active learning for classification and preference learning. arXiv.
32. Choi, J., Elezi, I., Lee, H.J., Farabet, C., and Álvarez, J.M. (2021). Active Learning for Deep Object Detection via Probabilistic Modeling. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, BC, Canada, 11–17 October 2021, IEEE.10.1109/ICCV48922.2021.01010 ↗
33. Wu, J., Chen, J., and Huang, D. (2022). Entropy-Based Active Learning for Object Detection with Progressive Diversity Constraint. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA, 19–20 June 2022, IEEE.10.1109/CVPR52688.2022.00918 ↗
34. Wang, Y., Ilic, V., Li, J., Kisačanin, B., and Pavlovic, V. (2023). ALWOD: Active learning for weakly-supervised object detection. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Paris, France, 2–6 October 2023, IEEE.10.1109/ICCV51070.2023.00594 ↗
35. Yu, W., Zhu, S., Yang, T., and Chen, C. (2022). Consistency-based active learning for object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA, 19–20 June 2022, IEEE.10.1109/CVPRW56347.2022.00440 ↗
36. Golestaneh, S.A., and Kitani, K.M. (2020, January 7–11). Importance of self-consistency in active learning for semantic segmentation. Proceedings of the British Machine Vision Conference (BMVC), Manchester, UK.10.5244/C.34.3 ↗
37. Shen, Y., Song, Y., Li, H., Kamali, S., Wang, B., and Kuo, C.C.J. (2019). K-covers for active learning in image classification. Proceedings of the 2019 IEEE International Conference on Multimedia and Expo Workshops (ICMEW), Shanghai, China, 8–12 July 2019, IEEE.10.1109/ICMEW.2019.00-72 ↗
38. Sener, O., and Savarese, S. (May, January 30). Active learning for convolutional neural networks: A core-set approach. Proceedings of the International Conference on Learning Representations (ICLR), Vancouver, BC, Canada.
39. Agarwal, S., Arora, H., Anand, S., and Arora, C. (2020). Contextual diversity for active learning. Proceedings of the European Conference on Computer Vision (ECCV), Springer.10.1007/978-3-030-58517-4_9 ↗
40. Sinha, S., Ebrahimi, S., and Darrell, T. (2019). Variational adversarial active learning. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea, 27 October–2 November 2019, IEEE.10.1109/ICCV.2019.00607 ↗
41. Active learning for deep visual tracking10.1109/TNNLS.2023.3266837 ↗
42. Yin, C., Qian, B., Cao, S., Li, X., Wei, J., Zheng, Q., and Davidson, I. (2017). Deep similarity-based batch mode active learning with exploration-exploitation. Proceedings of the 2017 IEEE International Conference on Data Mining (ICDM), IEEE.10.1109/ICDM.2017.67 ↗
43. Hekimoglu, A., Schmidt, M., and Marcos-Ramiro, A. (2024). Active learning with task consistency and diversity in multi-task networks. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA, 3–8 January 2024, IEEE.10.1109/WACV57701.2024.00249 ↗
44. Active learning by querying informative and representative examples10.1109/TPAMI.2014.2307881 ↗
45. Ash, J.T., Zhang, C., Krishnamurthy, A., Langford, J., and Agarwal, A. (May, January 26). Deep batch active learning by diverse, uncertain gradient lower bounds. Proceedings of the International Conference on Learning Representations (ICLR), Addis Ababa, Ethiopia.
46. Zhdanov, F. (2019). Diverse mini-batch active learning. arXiv.
47. Employing Feature Mixture for Active Learning of Object Detection10.1016/j.neucom.2024.127883 ↗
48. Lyu, M., Zhou, J., Chen, H., Huang, Y., Yu, D., Li, Y., Guo, Y., Guo, Y., Xiang, L., and Ding, G. (2023). Box-level active detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada, 17–24 June 2023, IEEE.10.1109/CVPR52729.2023.02276 ↗
49. Xu, Y., Wang, W., and Chen, C. (2023). DeLR: Decoupled Localization and Recognition for Annotation-Efficient Object Detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada, 17–24 June 2023, IEEE.
50. Uncertainty and diversity-based active learning for UAV tracking10.1016/j.neucom.2025.130265 ↗
51. Yamani, A., Alyami, A., Luqman, H., Ghanem, B., and Giancola, S. (2024). Active Learning for Single-Stage Object Detection in UAV Images. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), Waikoloa, HI, USA, 3–8 January 2024, IEEE.10.1109/WACV57701.2024.00187 ↗
52. Bridging the gap: Active learning for efficient domain adaptation in object detection10.1016/j.eswa.2024.124403 ↗
53. Wang, J., and Zhao, N. (2025, January 11–15). Uncertainty Meets Diversity: A Comprehensive Active Learning Framework for Indoor 3D Object Detection. Proceedings of the Computer Vision and Pattern Recognition Conference, Nashville, TN, USA.10.1109/CVPR52734.2025.01893 ↗
54. Chelouati, N. (2024). Identification et Détection du Homard Américain dans les Secteurs de la Pêche et de la Transformation Basées sur les Systèmes de Vision. [Ph.D. Thesis, Faculté d’Ingénierie, Département de Génie électrique, Université de Moncton].
55. Surette, T. (2025, July 21). Snow Crab Measurement Project Dataset. Available online: https://github.com/TobieSurette/snow-crab-measurement-project/tree/main/studies.
56. LLM-driven agent for speech-enabled control of industrial robots: A case study in snow-crab quality inspection10.1016/j.rineng.2025.106660 ↗
57. (2024, March 15). YOLOv10 GitHub Repository. Available online: https://github.com/THU-MIG/yolov10.
58. Sun, S. (2025, May 15). YOLOv12 GitHub Repository. Available online: https://github.com/sunsmarterjie/yolov12.
59. Yolov10: Real-time end-to-end object detection
60. Tian, Y., Ye, Q., and Doermann, D. (2025). Yolov12: Attention-centric real-time object detectors. arXiv.
61. Recent advances in deep learning for object detection10.1016/j.neucom.2020.01.085 ↗