journal article·2025-05-08Open access

Rotation-Invariant Feature Enhancement with Dual-Aspect Loss for Arbitrary-Oriented Object Detection in Remote Sensing

Zhao Hu, Xiangfu Meng, Xinsong Liu, Zhuxiang Sun

Applied Sciences· Volume 15· Issue 10

Abstract

Object detection in remote sensing imagery plays a pivotal role in various applications, including aerial surveillance and urban planning. Despite its significance, the task remains challenging due to cluttered backgrounds, the arbitrary orientations of objects, and substantial scale variations across targets. To address these issues, we proposed RFE-FCOS, a novel framework that synergizes rotation-invariant feature extraction with adaptive multi-scale fusion. Specifically, we introduce a rotation-invariant learning (RIL) module, which employs adaptive rotation transformations to enhance shallow feature representations, thereby effectively mitigating interference from complex backgrounds and boosting geometric robustness. Furthermore, a rotation feature fusion (RFF) module propagates these rotation-aware features across hierarchical levels through an attention-guided fusion strategy, resulting in richer, more discriminative representations at multiple scales. Finally, we propose a novel dual-aspect RIoU loss (DARIoU) that simultaneously optimizes horizontal and angular regression tasks, facilitating stable training and the precise alignment of arbitrarily oriented bounding boxes. Evaluated on the DIOR-R and HRSC2016 benchmarks, our method demonstrates robust detection capabilities for arbitrarily oriented objects, achieving competitive performance in both accuracy and efficiency. This work provides a versatile solution for advancing object detection in real-world remote sensing scenarios.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Image and Video Retrieval Techniques · Remote-Sensing Image Classification · Advanced Neural Network Applications

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Electronic and Information Engineering, Liaoning Technical University, Huludao 125105, China

Funding

Fundamental Research Project of the Liaoning Provincial Department of Education

References (43)

Show source-provided references
1. A review and comparative study on probabilistic object detection in autonomous driving10.1109/TITS.2021.3096854 ↗
2. A survey on deep learning in medical image analysis10.1016/j.media.2017.07.005 ↗
3. Convolutional neural networks for object detection in aerial imagery for disaster response and recovery10.1016/j.aei.2019.101009 ↗
4. Deep-learning-based information mining from ocean remote-sensing imagery10.1093/nsr/nwaa047 ↗
5. Pavel, M.I., Tan, S.Y., and Abdullah, A. (2022). Vision-based autonomous vehicle systems based on deep learning: A systematic literature review. Appl. Sci., 12.10.3390/app12146831 ↗
6. Cerrillo-Cuenca, E., and Bueno-Ramírez, P. (2025). Predictive Archaeological Risk Assessment at Reservoirs with Multitemporal LiDAR and Machine Learning (XGBoost): The Case of Valdecañas Reservoir (Spain). Remote Sens., 17.10.3390/rs17071306 ↗
7. Durlević, U., Srejić, T., Valjarević, A., Aleksova, B., Deđanski, V., Vujović, F., and Lukić, T. (2025). GIS-Based Spatial Modeling of Soil Erosion and Wildfire Susceptibility Using VIIRS and Sentinel-2 Data: A Case Study of Šar Mountains National Park, Serbia. Forests, 16.10.3390/f16030484 ↗
8. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
9. He, K., Gkioxari, G., Dollár, P., and Girshick, R. (2017, January 22–29). Mask r-cnn. Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV), Venice, Italy. Available online: https://openaccess.thecvf.com/content_iccv_2017/html/He_Mask_R-CNN_ICCV_2017_paper.html.10.1109/ICCV.2017.322 ↗
10. Cai, Z., and Vasconcelos, N. (2018, January 18–22). Cascade r-cnn: Delving into high quality object detection. Proceedings of the Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), Salt Lake City, UT, USA. Available online: https://openaccess.thecvf.com/content_cvpr_2018/html/Cai_Cascade_R-CNN_Delving_CVPR_2018_paper.html.10.1109/CVPR.2018.00644 ↗
11. Redmon, J., Divvala, S., Girshick, R., and Farhadi, A. (2016, January 27–30). You only look once: Unified, real-time object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA. Available online: https://www.cv-foundation.org/openaccess/content_cvpr_2016/html/Redmon_You_Only_Look_CVPR_2016_paper.html.10.1109/CVPR.2016.91 ↗
12. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 11–14). Ssd: Single shot multibox detector. Proceedings of the European Conference on Computer Vision, Amsterdam, The Netherlands. Available online: https://link.springer.com/chapter/10.1007/978-3-319-46448-0_2.10.1007/978-3-319-46448-0_2 ↗
13. Tian, Z., Shen, C., Chen, H., and He, T. (November, January 27). Fcos: Fully convolutional one-stage object detection. Proceedings of the IEEE International Conference on Computer Vision, Seoul, Republic of Korea. Available online: https://openaccess.thecvf.com/content_ICCV_2019/html/Tian_FCOS_Fully_Convolutional_One-Stage_Object_Detection_ICCV_2019_paper.html.10.1109/ICCV.2019.00972 ↗
14. Object detection in optical remote sensing images: A survey and a new benchmark10.1016/j.isprsjprs.2019.11.023 ↗
15. Ship rotated bounding box space for ship extraction from high-resolution optical satellite images with complex backgrounds10.1109/LGRS.2016.2565705 ↗
16. Law, H., and Deng, J. (2018, January 8–14). Cornernet: Detecting objects as paired keypoints. Proceedings of the European Conference on Computer Vision, Munich, Germany. Available online: https://openaccess.thecvf.com/content_ECCV_2018/html/Hei_Law_CornerNet_Detecting_Objects_ECCV_2018_paper.html.10.1007/978-3-030-01264-9_45 ↗
17. Duan, K., Bai, S., Xie, L., Qi, H., Huang, Q., and Tian, Q. (November, January 27). Centernet: Keypoint triplets for object detection. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea. Available online: https://openaccess.thecvf.com/content_ICCV_2019/html/Duan_CenterNet_Keypoint_Triplets_for_Object_Detection_ICCV_2019_paper.html.10.1109/ICCV.2019.00667 ↗
18. Zhou, X., Zhuo, J., and Krahenbuhl, P. (November, January 27). Bottom-up object detection by grouping extreme and center points. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea. Available online: https://openaccess.thecvf.com/content_CVPR_2019/html/Zhou_Bottom-Up_Object_Detection_by_Grouping_Extreme_and_Center_Points_CVPR_2019_paper.html.10.1109/CVPR.2019.00094 ↗
19. Yang, Z., Liu, S., Hu, H., Wang, L., and Lin, S. (November, January 27). Reppoints: Point set representation for object detection. Proceedings of the IEEE/CVF International Conference on Computer Vision, Seoul, Republic of Korea. Available online: https://openaccess.thecvf.com/content_ICCV_2019/html/Yang_RepPoints_Point_Set_Representation_for_Object_Detection_ICCV_2019_paper.html.10.1109/ICCV.2019.00975 ↗
20. Dong, Z., Li, G., Liao, Y., Wang, F., Ren, P., and Qian, C. (2020, January 13–19). Centripetalnet: Pursuing high-quality keypoint pairs for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA. Available online: https://openaccess.thecvf.com/content_CVPR_2020/html/Dong_CentripetalNet_Pursuing_High-Quality_Keypoint_Pairs_for_Object_Detection_CVPR_2020_paper.html.10.1109/CVPR42600.2020.01053 ↗
21. Duan, K., Xie, L., Qi, H., Bai, S., Huang, Q., and Tian, Q. (2020, January 23–28). Corner proposal network for anchor-free, two-stage object detection. Proceedings of the European Conference on Computer Vision, Glasgow, UK. Available online: https://link.springer.com/chapter/10.1007/978-3-030-58580-8_24.10.1007/978-3-030-58580-8_24 ↗
22. Guo, C., Ma, Q., and Zhang, L. (2008, January 23–28). Spatio-temporal saliency detection using phase spectrum of quaternion fourier transform. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Anchorage, Alaska. Available online: https://ieeexplore.ieee.org/abstract/document/4587715.
23. Hypercomplex Fourier transforms of color images10.1109/TIP.2006.884955 ↗
24. Lowe, D.G. (1999, January 14–16). Object recognition from local scale-invariant features. Proceedings of the IEEE International Conference on Information Visualization, London, UK. Available online: https://link.springer.com/article/10.1023/B:VISI.0000029664.99615.94.
25. Nabati, R., and Qi, H. (2019, January 22–25). Rrpn: Radar region proposal network for object detection in autonomous vehicles. Proceedings of the IEEE International Conference on Image Processing, Taipei, Taiwan. Available online: https://ieeexplore.ieee.org/abstract/document/8803392.10.1109/ICIP.2019.8803392 ↗
26. Ding, J., Xue, N., Long, Y., Xia, G.S., and Lu, Q. (2019, January 15–20). Learning RoI transformer for oriented object detection in aerial images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA. Available online: https://openaccess.thecvf.com/content_CVPR_2019/html/Ding_Learning_RoI_Transformer_for_Oriented_Object_Detection_in_Aerial_Images_CVPR_2019_paper.html.10.1109/CVPR.2019.00296 ↗
27. Han, J., Ding, J., Xue, N., and Xia, G.S. (2021, January 20–25). Redet: A rotation-equivariant detector for aerial object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Nashville, TN, USA. Available online: https://openaccess.thecvf.com/content/CVPR2021/papers/Han_ReDet_A_Rotation-Equivariant_Detector_for_Aerial_Object_Detection_CVPR_2021_paper.pdf.10.1109/CVPR46437.2021.00281 ↗
28. Cohen, T., and Welling, M. (2016, January 20–22). Group equivariant convolutional networks. Proceedings of the International Conference on Machine Learning PMLR, New York, NY, USA. Available online: https://proceedings.mlr.press/v48/cohenc16.html.
29. Girshick, R. (2015, January 7–13). Fast r-cnn. Proceedings of the IEEE International Conference on Computer Vision, Santiago, Chile. Available online: https://openaccess.thecvf.com/content_iccv_2015/html/Girshick_Fast_R-CNN_ICCV_2015_paper.html.10.1109/ICCV.2015.169 ↗
30. Yu, J., Jiang, Y., Wang, Z., Cao, Z., and Huang, T. (2016, January 15–19). Unitbox: An advanced object detection network. Proceedings of the ACM MM, Amsterdam, The Netherlands.10.1145/2964284.2967274 ↗
31. Zheng, Z., Wang, P., Liu, W., Li, J., Ye, R., and Ren, D. (2020, January 9–11). Distance-IoU loss: Faster and better learning for bounding box regression. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA. Available online: https://ojs.aaai.org/index.php/AAAI/article/view/6999.
32. Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., and Savarese, S. (2019, January 16–20). Generalized intersection over union: A metric and a loss for bounding box regression. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA. Available online: https://openaccess.thecvf.com/content_CVPR_2019/html/Rezatofighi_Generalized_Intersection_Over_Union_A_Metric_and_a_Loss_for_CVPR_2019_paper.html.10.1109/CVPR.2019.00075 ↗
33. Enhancing geometric factors in model learning and inference for object detection and instance segmentation10.1109/TCYB.2021.3095305 ↗
34. Raisi, Z., Naiel, M.A., Younes, G., Wardell, S., and Zelek, J.S. (2021, January 20–25). Transformer-based text detection in the wild. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, online. Available online: https://openaccess.thecvf.com/content/CVPR2021W/VOCVALC/html/Raisi_Transformer-Based_Text_Detection_in_the_Wild_CVPRW_2021_paper.html.10.1109/CVPRW53098.2021.00353 ↗
35. Zhou, Y., Yang, X., Zhang, G., Wang, J., Liu, Y., Hou, L., Jiang, X., Liu, X., Yan, J., and Lyu, C. (2022, January 10–14). Mmrotate: A rotated object detection benchmark using pytorch. Proceedings of the ACM MM, Lisboa, Portugal. Available online: https://dl.acm.org/doi/abs/10.1145/3503161.3548541.10.1145/3503161.3548541 ↗
36. Lin, T.Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2017, January 22–29). Focal loss for dense object detection. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy. Available online: https://openaccess.thecvf.com/content_iccv_2017/html/Lin_Focal_Loss_for_ICCV_2017_paper.html.10.1109/ICCV.2017.324 ↗
37. Gliding vertex on the horizontal bounding box for multi-oriented object detection10.1109/TPAMI.2020.2974745 ↗
38. Optimization for arbitrary-oriented object detection via representation invariance loss10.1109/LGRS.2021.3115110 ↗
39. CFC-Net: A critical feature capturing network for arbitrary-oriented object detection in remote-sensing images10.1109/TGRS.2021.3095186 ↗
40. Qian, W., Yang, X., Peng, S., Yan, J., and Guo, Y. (2021, January 11–15). Learning modulated loss for rotated object detection. Proceedings of the AAAI Conference on Artificial Intelligence, online. Available online: https://ojs.aaai.org/index.php/AAAI/article/view/16347.
41. Yang, X., and Yan, J. (2020, January 23–28). Arbitrary-oriented object detection with circular smooth label. Proceedings of the European Conference on Computer Vision, Glasgow, UK. Available online: https://link.springer.com/chapter/10.1007/978-3-030-58598-3_40.10.1007/978-3-030-58598-3_40 ↗
42. Yang, X., Yan, J., Feng, Z., and He, T. (2021, January 11–15). R3det: Refined single-stage detector with feature refinement for rotating object. Proceedings of the AAAI Conference on Artificial Intelligence, online. Available online: https://ojs.aaai.org/index.php/AAAI/article/view/16426.10.1609/aaai.v35i4.16426 ↗
43. Learning high-precision bounding box for rotated object detection via kullback-leibler divergence