MAK-BRNet: Multi-Scale Adaptive Kernel and Boundary Refinement Network for Remote Sensing Object Detection
Source abstract
Abstract
Oriented object detection in remote sensing images rapidly evolves as a pivotal technique, driving transformative advancements across geospatial analytics, intelligent transportation systems, and urban infrastructure planning. However, the inherent characteristics of remote sensing objects, including complex background interference, multi-scale variations, and high-density distribution, pose critical challenges to balance detection accuracy and computational efficiency. This paper presents an anchor-free framework that eliminates the intrinsic constraints of anchor-based detectors, specifically the positive–negative sample imbalance and the computationally expensive non-maximum suppression (NMS) process. By effectively integrating adaptive kernel module with boundary refinement network, we achieved lightweight and efficient detection. Our method adaptively generates convolutional kernels tailored for multi-scale objects to extract discriminative features, while utilizing a boundary refinement network to precisely capture oriented bounding boxes. Experiments were carried out on the widely recognized HRSC2016 and DOTA datasets for the oriented bounding box (OBB) task. The proposed approach achieves 90.13% mAP (VOC07 metric) on HRSC2016 with 61.60 M parameters and 158.84 GFLOPS. For the DOTA benchmark, we attain 75.84% mAP with 45.96 M parameters and 131.39 GFLOPs. Our work highlights a lightweight yet powerful architecture that effectively balances accuracy and efficiency, making it particularly suitable for resource-constrained edge platforms.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Remote-Sensing Image Classification · Automated Road and Building Extraction
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
National Innovation Institute of Defense Technology, Academy of Military Sciences, Beijing 100071, China
Funding
National Natural Science Foundation of China
References (49)
Show source-provided references
1. DecoupleNet: A Lightweight Backbone Network With Efficient Feature Decoupling for Remote Sensing Visual Tasks10.1109/TGRS.2024.3465496 ↗
2. Mtp: Advancing remote sensing foundation model via multi-task pretraining10.1109/JSTARS.2024.3408154 ↗
3. Hou, L., Lu, K., Xue, J., and Li, Y. (March, January 22). Shape-adaptive selection and measurement for oriented object detection. Proceedings of the AAAI Conference on Artificial Intelligence, Online.
4. Yang, Z., Liu, S., Hu, H., Wang, L., and Lin, S. (November, January 27). Reppoints: Point set representation for object detection. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
5. Zhao, Z., Xue, Q., He, Y., Bai, Y., Wei, X., and Gong, Y. (October, January 29). Projecting points to axes: Oriented object detection via point-axis representation. Proceedings of the European Conference on Computer Vision, Milan, Italy.
6. Law, H., and Deng, J. (2018, January 8–14). Cornernet: Detecting objects as paired keypoints. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01264-9_45 ↗
7. Zhou, X., Zhuo, J., and Krahenbuhl, P. (2019, January 15–20). Bottom-up object detection by grouping extreme and center points. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00094 ↗
8. Duan, K., Bai, S., Xie, L., Qi, H., Huang, Q., and Tian, Q. (November, January 27). Centernet: Keypoint triplets for object detection. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea.
9. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
10. ASSD: Attentive single shot multibox detector10.1016/j.cviu.2019.102827 ↗
11. Xie, X., Cheng, G., Wang, J., Yao, X., and Han, J. (2021, January 10–17). Oriented R-CNN for object detection. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00350 ↗
12. Ding, J., Xue, N., Long, Y., Xia, G.S., and Lu, Q. (2019, January 15–20). Learning RoI transformer for oriented object detection in aerial images. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.00296 ↗
13. Ao2-detr: Arbitrary-oriented object detection transformer10.1109/TCSVT.2022.3222906 ↗
14. Gliding vertex on the horizontal bounding box for multi-oriented object detection10.1109/TPAMI.2020.2974745 ↗
15. Hou, L., Lu, K., Yang, X., Li, Y., and Xue, J. (2023). G-rep: Gaussian representation for arbitrary-oriented object detection. Remote Sens., 15.10.3390/rs15030757 ↗
16. Rotation-aware and multi-scale convolutional neural network for object detection in remote sensing images10.1016/j.isprsjprs.2020.01.025 ↗
17. Ming, Q., Zhou, Z., Miao, L., Zhang, H., and Li, L. (2021, January 2–9). Dynamic anchor learning for arbitrary-oriented object detection. Proceedings of the AAAI Conference on Artificial Intelligence, Virtually.10.1609/aaai.v35i3.16336 ↗
18. Low-rank adaption on transformer-based oriented object detector for satellite onboard processing of remote sensing images10.1109/TGRS.2024.3524578 ↗
19. ARS-DETR: Aspect ratio-sensitive detection transformer for aerial oriented object detection10.1109/TGRS.2024.3364713 ↗
20. Learning rotation-invariant convolutional neural networks for object detection in VHR optical remote sensing images10.1109/TGRS.2016.2601622 ↗
21. A survey on object detection in optical remote sensing images10.1016/j.isprsjprs.2016.03.014 ↗
22. Multi-scale object detection in remote sensing imagery with convolutional neural networks10.1016/j.isprsjprs.2018.04.003 ↗
23. Li, Y., Mao, H., Liu, R., Pei, X., Jiao, L., and Shang, R. (2021). A lightweight keypoint-based oriented object detection of remote sensing images. Remote Sens., 13.10.3390/rs13132459 ↗
24. He, X., Ma, S., He, L., Ru, L., and Wang, C. (2021). Learning rotated inscribed ellipse for oriented object detection in remote sensing images. Remote Sens., 13.10.3390/rs13183622 ↗
25. Yi, J., Wu, P., Liu, B., Huang, Q., Qu, H., and Metaxas, D. (2021, January 5–9). Oriented object detection in aerial images with box boundary-aware vectors. Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision, Virtual.10.1109/WACV48630.2021.00220 ↗
26. Song, F., Ma, R., Lei, T., and Peng, Z. (2023). RAIH-Det: An end-to-end rotated aircraft and aircraft head detector based on ConvNeXt and cyclical focal loss in optical remote sensing images. Remote Sens., 15.10.3390/rs15092364 ↗
27. ASSK-Net: Automatic Spatial Selection Kernel Network for Faster Oriented Object Detection10.1007/s12524-025-02185-0 ↗
28. Liu, Z., Mao, H., Wu, C.Y., Feichtenhofer, C., Darrell, T., and Xie, S. (18, January 18–24). A convnet for the 2020s. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.
29. Ding, X., Zhang, X., Han, J., and Ding, G. (2022, January 18–24). Scaling up your kernels to 31x31: Revisiting large kernel design in cnns. Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.01166 ↗
30. Liu, S., Chen, T., Chen, X., Chen, X., Xiao, Q., Wu, B., Kärkkäinen, T., Pechenizkiy, M., Mocanu, D., and Wang, Z. (2022). More convnets in the 2020s: Scaling up kernels beyond 51x51 using sparsity. arXiv.
31. SED-YOLO based multi-scale attention for small object detection in remote sensing10.1038/s41598-025-87199-x ↗
32. Conv2former: A simple transformer-style convnet for visual recognition10.1109/TPAMI.2024.3401450 ↗
33. Learning point-guided localization for detection in remote sensing images10.1109/JSTARS.2020.3036685 ↗
34. Small-Object Detection in Remote Sensing Images with Super Resolution Perception10.1109/JSTARS.2024.3452707 ↗
35. Real-time scene text detection with differentiable binarization and adaptive scale fusion10.1109/TPAMI.2022.3155612 ↗
36. Object detection in optical remote sensing images: A survey and a new benchmark10.1016/j.isprsjprs.2019.11.023 ↗
37. Zhuang, S., Wang, P., Jiang, B., Wang, G., and Wang, C. (2019). A single shot framework with multi-scale feature fusion for geospatial object detection. Remote Sens., 11.10.3390/rs11050594 ↗
38. Zhu, H., Chen, X., Dai, W., Fu, K., Ye, Q., and Jiao, J. (2015, January 27–30). Orientation robust object detection in aerial images using deep convolutional neural network. Proceedings of the 2015 IEEE International Conference on Image Processing (ICIP), Quebec, QC, Canada.10.1109/ICIP.2015.7351502 ↗
39. Xia, G.S., Bai, X., Ding, J., Zhu, Z., Belongie, S., Luo, J., Datcu, M., Pelillo, M., and Zhang, L. (2018, January 18–23). DOTA: A large-scale dataset for object detection in aerial images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00418 ↗
40. A high resolution optical satellite image dataset for ship recognition and some new baselines10.5220/0006120603240331 ↗
41. Yang, X., Sun, H., Fu, K., Yang, J., Sun, X., Yan, M., and Guo, Z. (2018). Automatic ship detection in remote sensing images from google earth of complex scenes based on multiscale rotation dense feature pyramid networks. Remote Sens., 10.10.3390/rs10010132 ↗
42. Jiang, Y., Zhu, X., Wang, X., Yang, S., Li, W., Wang, H., Fu, P., and Luo, Z. (2017). R2CNN: Rotational region CNN for orientation robust scene text detection. arXiv.10.1109/ICPR.2018.8545598 ↗
43. Position detection and direction prediction for arbitrary-oriented ships via multitask rotation region convolutional neural network10.1109/ACCESS.2018.2869884 ↗
44. Azimi, S.M., Vig, E., Bahmanyar, R., Körner, M., and Reinartz, P. (2018). Towards multi-class object detection in unconstrained remote sensing imagery. Proceedings of the Asian Conference on Computer Vision, Springer.10.1007/978-3-030-20893-6_10 ↗
45. EMO2-DETR: Efficient-matching oriented object detection with transformers10.1109/TGRS.2023.3300154 ↗
46. Toward arbitrary-oriented ship detection with rotated region proposal and discrimination networks10.1109/LGRS.2018.2856921 ↗
47. Liao, M., Zhu, Z., Shi, B., Xia, G.s., and Bai, X. (2018, January 18–23). Rotation-sensitive regression for oriented scene text detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00619 ↗
48. Align deep features for oriented object detection
49. Yu, Y., and Da, F. (2023, January 17–24). Phase-shifting coder: Predicting accurate orientation in oriented object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.01283 ↗