journal article·2025-04-17Open access

A Progressive Semantic-Aware Fusion Network for Remote Sensing Object Detection

Lerong Li, Jiayang Wang, Yue Liao, Wenbin Qian

Applied Sciences· Volume 15· Issue 8

Abstract

Object detection in remote sensing images has gained prominence alongside advancements in sensor technology and earth observation systems. Although current detection frameworks demonstrate remarkable achievements in natural imagery analysis, their performance degrades when applied to remote imaging scenarios due to two inherent limitations: (1) complex background interference, which causes object features to be easily obscured by noise, leading to reduced detection accuracy; (2) the variation in object scales leads to a decrease in the model’s generalization ability. To address these issues, we propose a progressive semantic-aware fusion network (ProSAF-Net). First, we design a shallow detail aggregation module (SDAM), which adaptively integrates features across different channels and scales in the early Neck stage through dynamically adjusted fusion weights, fully exploiting shallow detail information to refine object edge and texture representation. Second, to effectively integrate shallow detail information and high-level semantic abstractions, we propose a deep semantic fusion module (DSFM), which employs a progressive feature fusion mechanism to incrementally integrate deep semantic information, strengthening the global representation of objects while effectively complementing the rich shallow details extracted by SDAM, enhancing the model’s capability in distinguishing objects and refining spatial localization. Furthermore, we develop a spatial context-aware module (SCAM) to fully exploit both global and local contextual information, effectively distinguishing foreground from background and suppressing interference, thus improving detection robustness. Finally, we propose auxiliary dynamic loss (ADL), which adaptively adjusts loss weights based on object scales and utilizes supplementary anchor priors to expedite parameter convergence during coordinate regression, thereby improving the model’s positioning accuracy for targets. Extensive experiments on the RSOD, DIOR, and NWPU VHR-10 datasets demonstrate that our method outperforms other state-of-the-art methods.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Remote-Sensing Image Classification · Advanced Image Fusion Techniques · Automated Road and Building Extraction

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

School of Software, Jiangxi Agricultural University, Nanchang 330045, China

Funding

Science and Technology Project of the Jiangxi Provincial Department of Education · Jiangxi Provincial Department of Science and Technology

References (65)

Show source-provided references
1. Remote sensing object detection meets deep learning: A metareview of challenges and advances10.1109/MGRS.2023.3312347 ↗
2. How the variety of satellite remote sensing data over volcanoes can assist hazard monitoring efforts: The 2011 eruption of Nabro volcano10.1016/j.rse.2019.111426 ↗
3. Weakly supervised low-rank representation for hyperspectral anomaly detection10.1109/TCYB.2021.3065070 ↗
4. A joint convolutional neural networks and context transfer for street scenes labeling10.1109/TITS.2017.2726546 ↗
5. Tian, Z., Shen, C., Chen, H., and He, T. (November, January 27). FCOS: Fully Convolutional One-Stage Object Detection. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.
6. Law, H., and Deng, J. (2018, January 8–14). CornerNet: Detecting Objects as Paired Keypoints. Proceedings of the European Conference on Computer Vision (ECCV), Munich, Germany.10.1007/978-3-030-01264-9_45 ↗
7. Duan, K., Bai, S., Xie, L., Qi, H., Huang, Q., and Tian, Q. (November, January 27). Centernet: Keypoint Triplets for Object Detection. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Seoul, Republic of Korea.
8. GCWNet: A global context-weaving network for object detection in remote sensing images10.1109/TGRS.2022.3205052 ↗
9. Self-attention guidance and multiscale feature fusion-based UAV image object detection
10. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
11. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016, January 11–14). SSD: Single Shot Multibox Detector. Proceedings of the European Conference on Computer Vision (ECCV), Amsterdam, The Netherlands.10.1007/978-3-319-46448-0_2 ↗
12. Redmon, J., and Farhadi, A. (2018). Yolov3: An incremental improvement. arXiv.
13. Lin, T.Y., Goyal, P., Girshick, R., He, K., and Dollár, P. (2017, January 22–29). Focal Loss for Dense Object Detection. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.324 ↗
14. Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2023, January 18–23). YOLOv7: Trainable Bag-of-Freebies Sets New State-of-the-Art for Real-Time Object Detectors. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Vancouver, BC, Canada.10.1109/CVPR52729.2023.00721 ↗
15. Ruan, H., Qian, W., Zheng, Z., and Peng, Y. (2023). A Decoupled Semantic–Detail Learning Network for Remote Sensing Object Detection in Complex Backgrounds. Electronics, 12.10.3390/electronics12143201 ↗
16. ABNet: Adaptive balanced network for multiscale object detection in remote sensing imagery
17. Global to local: A scale-aware network for remote sensing object detection10.1109/TGRS.2023.3294241 ↗
18. Multiscale deformable attention and multilevel features aggregation for remote sensing object detection10.1109/LGRS.2022.3178479 ↗
19. Adaptively attentional feature fusion oriented to multiscale object detection in remote sensing images
20. SFSANet: Multiscale Object Detection in Remote Sensing Image Based on Semantic Fusion and Scale Adaptability
21. FSoD-Net: Full-scale object detection from optical remote sensing imagery
22. Lin, T.Y., Dollár, P., Girshick, R., He, K., Hariharan, B., and Belongie, S. (2017, January 21–26). Feature Pyramid Networks for Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Honolulu, HI, USA.10.1109/CVPR.2017.106 ↗
23. Liu, S., Qi, L., Qin, H., Shi, J., and Jia, J. (2018, January 18–22). Path Aggregation Network for Instance Segmentation. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00913 ↗
24. CE-FPN: Enhancing channel information for object detection10.1007/s11042-022-11940-1 ↗
25. Gated ladder-shaped feature pyramid network for object detection in optical remote sensing images
26. GLF-Net: A target detection method based on global and local multiscale feature fusion of remote sensing aircraft images10.1109/LGRS.2022.3144284 ↗
27. Mffsodnet: Multi-scale feature fusion small object detection network for uav aerial images
28. AFANet: A Multi-Backbone Compatible Feature Fusion Framework for Effective Remote Sensing Object Detection10.1109/LGRS.2024.3462089 ↗
29. CAD-Net: A context-aware detection network for objects in remote sensing imagery10.1109/TGRS.2019.2930982 ↗
30. Few-shot object detection via context-aware aggregation for remote sensing images
31. Zhang, Z., Gong, P., Sun, H., Wu, P., and Yang, X. (2023, January 4–10). Dynamic local and global context exploration for small object detection. Proceedings of the ICASSP 2023–2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Rhodes Island, Greece.10.1109/ICASSP49357.2023.10095314 ↗
32. Dense tiny object detection: A scene context guided approach and a unified benchmark
33. Ultralytics ultralytics/yolov5: v7.0—YOLOv5 SOTA Realtime Instance Segmentation.
34. Tian, Y., Ye, Q., and Doermann, D. (2025). Yolov12: Attention-centric real-time object detectors. arXiv.
35. Gu, A., and Dao, T. (2023). Mamba: Linear-time sequence modeling with selective state spaces. arXiv.
36. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, I., and Polosukhin, Ł. (2017). Attention is all you need. Adv. Neural Inf. Process. Syst., 30.
37. Vmamba: Visual state space model
38. Yu, J., Jiang, Y., Wang, Z., Cao, Z., and Huang, T. (2016, January 15–19). UnitBox: An Advanced Object Detection Network. Proceedings of the 24th ACM International Conference on Multimedia (ACM MM), Amsterdam, The Netherlands.10.1145/2964284.2967274 ↗
39. Rezatofighi, H., Tsoi, N., Gwak, J., Sadeghian, A., Reid, I., and Savarese, S. (2019, January 16–20). Generalized Intersection over Union: A Metric and a Loss for Bounding Box Regression. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00075 ↗
40. Zheng, Z., Wang, P., Liu, W., Li, J., Ye, R., and Ren, D. (2020, January 7–12). Distance-IoU loss: Faster and better learning for bounding box regression. Proceedings of the AAAI Conference on Artificial Intelligence, New York, NY, USA.10.1609/aaai.v34i07.6999 ↗
41. Enhancing geometric factors in model learning and inference for object detection and instance segmentation10.1109/TCYB.2021.3095305 ↗
42. Zhang, H., Xu, C., and Zhang, S. (2023). Inner-iou: More effective intersection over union loss with auxiliary bounding box. arXiv.
43. Yang, J., Liu, S., Wu, J., Su, X., Hai, N., and Huang, X. (2024). Pinwheel-shaped Convolution and Scale-based Dynamic Loss for Infrared Small Target Detection. arXiv.10.1609/aaai.v39i9.32996 ↗
44. Zhang, W., Cong, M., and Wang, L. (2003, January 14–17). Algorithms for optical weak small targets detection and tracking. Proceedings of the International Conference on Neural Networks and Signal Processing, Nanjing, China.
45. Accurate object localization in remote sensing images based on convolutional neural networks10.1109/TGRS.2016.2645610 ↗
46. Learning rotation-invariant convolutional neural networks for object detection in VHR optical remote sensing images10.1109/TGRS.2016.2601622 ↗
47. Object detection in optical remote sensing images: A survey and a new benchmark10.1016/j.isprsjprs.2019.11.023 ↗
48. Bodla, N., Singh, B., Chellappa, R., and Davis, L.S. (2017, January 22–29). Soft-NMS: Improving Object Detection with One Line of Code. Proceedings of the IEEE International Conference on Computer Vision (ICCV), Venice, Italy.10.1109/ICCV.2017.593 ↗
49. Cai, Z., and Vasconcelos, N. (2018, January 18–22). Cascade R-CNN: Delving into High Quality Object Detection. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Salt Lake City, UT, USA.10.1109/CVPR.2018.00644 ↗
50. KLDet: Detecting tiny objects in remote sensing images via kullback-leibler divergence
51. An anchor-free network with density map and attention mechanism for multiscale object detection in aerial images10.1109/LGRS.2022.3207178 ↗
52. Significant feature elimination and sample assessment for remote sensing small objects’ detection
53. TBNet: A texture and boundary-aware network for small weak object detection in remote-sensing imagery10.1016/j.patcog.2024.110976 ↗
54. FMSSD: Feature-merged single-shot detection for multiscale objects in large-scale remote sensing imagery10.1109/TGRS.2019.2954328 ↗
55. A relation-augmented embedded graph attention network for remote sensing object detection
56. CANet: Centerness-aware network for object detection in remote sensing images
57. Sun, Y., Liu, W., Gao, Y., Hou, X., and Bi, F. (2022). A dense feature pyramid network for remote sensing object detection. Appl. Sci., 12.10.3390/app12104997 ↗
58. ASSD: Feature aligned single-shot detection for multiscale objects in aerial imagery
59. Huang, W., Li, G., Chen, Q., Ju, M., and Qu, J. (2021). CF2PN: A cross-scale feature fusion pyramid network based remote sensing target detection. Remote Sens., 13.10.3390/rs13050847 ↗
60. Cross-scale feature fusion for object detection in optical remote sensing images10.1109/LGRS.2020.2975541 ↗
61. MSA R-CNN: A comprehensive approach to remote sensing object detection and scene understanding10.1016/j.eswa.2023.122788 ↗
62. A task-balanced multiscale adaptive fusion network for object detection in remote sensing images10.1109/TGRS.2023.3294241 ↗
63. SRAF-Net: A scene-relevant anchor-free object detection network in remote sensing images
64. Multiscale semantic fusion-guided fractal convolutional object detection network for optical remote sensing imagery
65. Cof-net: A progressive coarse-to-fine framework for object detection in remote-sensing imagery