journal article·2025-05-07Open access

Lightweight Transformer with Adaptive Rotational Convolutions for Aerial Object Detection

Sabina Umirzakova, Shakhnoza Muksimova, Abrayeva Mahliyo Olimjon Qizi, Young Im Cho

Applied Sciences· Volume 15· Issue 9

Abstract

Oriented object detection in aerial imagery presents unique challenges due to the arbitrary orientations, diverse scales, and limited availability of labeled data. In response to these issues, we propose RASST—a lightweight Rotationally Aware Semi-Supervised Transformer framework designed to achieve high-precision detection under fully and semi-supervised conditions. RASST integrates a hybrid Vision Transformer architecture augmented with rotationally aware patch embeddings, adaptive rotational convolutions, and a multi-scale feature fusion (MSFF) module that employs cross-scale attention to enhance detection across object sizes. To address the scarcity of labeled data, we introduce a novel Pseudo-Label Guided Learning (PGL) framework, which refines pseudo-labels through Rotation-Aware Adaptive Weighting (RAW) and Global Consistency (GC) losses, thereby improving generalization and robustness against noisy supervision. Despite its lightweight design, RASST achieves superior performance on the DOTA-v1.5 benchmark, outperforming existing state-of-the-art methods in supervised and semi-supervised settings. The proposed framework demonstrates high scalability, precise orientation sensitivity, and effective utilization of unlabeled data, establishing a new benchmark for efficient oriented object detection in remote sensing imagery.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Infrared Target Detection Methodologies · Advanced Measurement and Detection Methods · Astronomical Observations and Instrumentation

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Engineering, Gachon University, Sujeong-gu, Seongnam-si 461-701, Republic of Korea

Department of “Information Systems and Technologies”, Tashkent State University of Economics, Tashkent 100066, Uzbekistan

References (26)

Show source-provided references
1. Understanding urban landuse from the above and ground perspectives: A deep learning, multimodal solution10.1016/j.rse.2019.04.014 ↗
2. What is the relationship between land use and surface water quality? A review and prospects from remote sensing perspective10.1007/s11356-022-21348-x ↗
3. Convolutional neural networks for object detection in aerial imagery for disaster response and recovery10.1016/j.aei.2019.101009 ↗
4. Matthew, U.O., Kazaure, J.S., Onyebuchi, A., Daniel, O.O., Muhammed, I.H., and Okafor, N.U. (2021, January 23–25). Artificial intelligence autonomous unmanned aerial vehicle (UAV) system for remote sensing in security surveillance. Proceedings of the 2020 2nd International Conference on Cyberspac (Cyber Nigeria), Abuja, Nigeria.10.1109/CYBERNIGERIA51635.2021.9428862 ↗
5. R3det: Refined single-stage detector with feature refinement for rotating object
6. Umirzakova, S., Muksimova, S., Mardieva, S., Sultanov Baxtiyarovich, M., and Cho, Y.-I. (2024). MIRA-CAP: Memory-Integrated Retrieval-Augmented Captioning for State-of-the-Art Image and Video Captioning. Sensors, 24.10.3390/s24248013 ↗
7. Oriented objects as pairs of middle lines10.1016/j.isprsjprs.2020.09.022 ↗
8. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017). Attention is all you need. Advances in Neural Information Processing Systems, MIT Press.
9. Muksimova, S., Umirzakova, S., Sultanov, M., and Cho, Y.I. (2025). Cross-Modal Transformer-Based Streaming Dense Video Captioning with Neural ODE Temporal Localization. Sensors, 25.10.3390/s25030707 ↗
10. MixMatch: A holistic approach to semi-supervised learning
11. Xie, Q., Luong, M.-T., Hovy, E., and Le, Q.V. (2020, January 13–19). Self-training with noisy student improves imagenet classification. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA.10.1109/CVPR42600.2020.01070 ↗
12. Yu, L., Zhou, Y., Li, X., Hu, S., and Jing, D. (2024). A rotating object detector with convolutional dynamic adaptive matching. Appl. Sci., 14.10.3390/app14020633 ↗
13. Sohn, K., Berthelot, D., Carlini, N., Zhang, Z., Zhang, H., Raffel, C.A., Cubuk, E.D., Kurakin, A., and Li, C.L. (2020). FixMatch: Simplifying semi-supervised learning with consistency and confidence. arXiv.
14. Learning Rotation-Invariant Convolutional Neural Networks for Object Detection in VHR Optical Remote Sensing Images10.1109/TGRS.2016.2601622 ↗
15. Convolutional Neural Network Based Automatic Object Detection on Aerial Images10.1109/LGRS.2016.2542358 ↗
16. Li, C., Luo, B., Hong, H., Su, X., Wang, Y., Liu, J., Wang, C., Zhang, J., and Wei, L. (2020). Object Detection Based on Global-Local Saliency Constraint in Aerial Images. Remote Sens., 12.10.3390/rs12091435 ↗
17. Xu, H., Liu, X., Xu, H., Ma, Y., Zhu, Z., Yan, C., and Dai, F. (2024, January 16–22). Rethinking boundary discontinuity problem for oriented object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR52733.2024.01648 ↗
18. Pu, Y., Wang, Y., Xia, Z., Han, Y., Wang, Y., Gan, W., Wang, Z., Song, S., and Huang, G. (2023, January 1–6). Adaptive rotated convolution for rotated object detection. Proceedings of the IEEE/CVF International Conference on Computer Vision, Paris, France.10.1109/ICCV51070.2023.00606 ↗
19. Hua, W., Liang, D., Li, J., Liu, X., Zou, Z., Ye, X., and Bai, X. (2023, January 17–24). Sood: Towards semi-supervised oriented object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.01493 ↗
20. Yu, Y., and Da, F. (2023, January 17–24). Phase-shifting coder: Predicting accurate orientation in oriented object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.01283 ↗
21. Efficient inductive vision transformer for oriented object detection in remote sensing imagery
22. Task interleaving and orientation estimation for high-precision oriented object detection in aerial images10.1016/j.isprsjprs.2023.01.001 ↗
23. Lin, T.-Y., Dollár, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature pyramid networks for object detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
24. Xia, G.S., Bai, X., and Ding, J. (2018, January 18–23). Dota: A large-scale dataset for object detection in aerial images. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake, UT, USA.10.1109/CVPR.2018.00418 ↗
25. Yu, J., Jiang, Y., Wang, Z., Cao, Z., and Huang, T. (2016, January 15–19). UnitBox: An advanced object detection network. Proceedings of the 24th ACM international conference on Multimedia, Amsterdam, The Netherlands.10.1145/2964284.2967274 ↗
26. Ruder, S. (2016). An overview of gradient descent optimization algorithms. arXiv.