ISAR Image Quality Assessment Based on Visual Attention Model
Source abstract
Abstract
The quality of ISAR (Inverse Synthetic Aperture Radar) images has a significant impact on the detection and recognition of targets. Therefore, ISAR image quality assessment is a fundamental prerequisite and primary link in the utilization of ISAR images. Previous ISAR image quality assessment methods typically extract hand-crafted features or use simple multi-layer networks to extract local features. Hand-crafted features and local features from networks usually lack the global information of ISAR images. Furthermore, most deep neural networks obtain feature representations by abridging the prediction quality score and the ground truth, neglecting to explore the strong correlations between features and quality scores in the stage of feature extraction. This study proposes a Gramin Transformer to explore the similarity and diversity of features extracted from different images, thus obtaining features containing quality-related information. The Gramin matrix of features is computed to obtain the score token through the self-attention layer. It prompts the network to learn more discriminative features, which are closely associated with quality scores. Despite the Transformer architecture’s ability to extract global information, the Channel Attention Block (CAB) can capture complementary information from different channels in an image, aggregating and mining information from these channels to provide a more comprehensive evaluation of ISAR images. ISAR images are formed from target scattering points with a background containing substantial silent noise, and the Inter-Region Attention Block (IRAB) is utilized to extract local scattering point features, which decide the clarity of target. In addition, extensive experiments are conducted on the ISAR image dataset (including space stations, ships, aircraft, etc.). The evaluation results of our method on the dataset are significantly superior to those of traditional feature extraction methods and existing image quality assessment methods.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Image Fusion Techniques · Photoacoustic and Ultrasonic Imaging · Infrared Target Detection Methodologies
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
East China Research Institute of Electronic Engineering, Hefei 230088, China
References (22)
Show source-provided references
1. Classification of ISAR Images Using Variable Cross-Range Resolutions10.1109/TAES.2018.2814211 ↗
2. Moving Target Analysis in ISAR Image Sequences with a Multiframe Marked Point Process Model10.1109/TGRS.2013.2258927 ↗
3. Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment10.1109/TIP.2017.2760518 ↗
4. Image Quality Improvement in Kidney Stone Detection on Computed Tomography Images
5. Seven challenges in image quality assessment: Past present and future research
6. Research on ISAR image quality evaluation
7. A Quantitative Evaluation Approach for ISAR Image Performance
8. Li, J., Tian, B., Li, S., Wang, Y., He, T., and Xu, S. (2023, January 8–10). Inverse Synthetic Aperture Radar Image Quality Assessment Based on BP Neural Network. Proceedings of the 2023 8th International Conference on Signal and Image Processing (ICSIP), Wuxi, China.10.1109/ICSIP57908.2023.10270971 ↗
9. Jasinski, T., Rosenberg, L., and Antipov, I. (2023, January 6–10). Automated ISAR Image Quality Assessment. Proceedings of the 2023 IEEE International Radar Conference (RADAR), Sydney, Australia.10.1109/RADAR54928.2023.10371011 ↗
10. Image quality assessment using contrastive learning10.1109/TIP.2022.3181496 ↗
11. Zhao, K., Yuan, K., Sun, M., Li, M., and Wen, X. (2023, January 17–24). Quality-aware pre-trained models for blind image quality assessment. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.02136 ↗
12. Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., and Gelly, S. (2020). An image is worth 16 × 16 words: Transformers for image recognition at scale. arXiv.
13. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, Ł., and Polosukhin, I. (2017). Attention is all you need. Adv. Neural Inf. Process. Syst., 30.
14. Cao, M., Fan, Y., Zhang, Y., Wang, J., and Yang, Y. (2022). Vdtr: Video deblurring with transformer. arXiv.
15. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 11–17). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00986 ↗
16. Ke, J., Wang, Q., Wang, Y., Milanfar, P., and Yang, F. (2021, January 11–17). Musiq: Multi-scale image quality transformer. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, BC, Canada.10.1109/ICCV48922.2021.00510 ↗
17. Tong, J., Yang, Q., Shen, L., Li, B., and Chu, S. (2023, January 26–28). ISAR image evaluation method based on visual perception supervised learning. Proceedings of the SPIE 12803, Fifth International Conference on Artificial Intelligence and Computer Science (AICS 2023), Wuhan, China.10.1117/12.3009516 ↗
18. Zhang, J. (2023). ISAR Image Quality Grade Evaluation of Space Targets Based on Fusion Feature. Proceedings of the World Conference on Intelligent and 3-D Technologies (WCI3DT 2022) Methods, Algorithms and Applications, Springer Nature.10.1007/978-981-19-7184-6_5 ↗
19. No-reference image quality assessment in the spatial domain10.1109/TIP.2012.2214050 ↗
20. Making a “completely blind” image quality analyzer10.1109/LSP.2012.2227726 ↗
21. Liu, S., and Deng, W. (2015, January 3–6). Very deep convolutional neural network based image classification using small training sample size. Proceedings of the 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR), Kuala Lumpur, Malaysia.10.1109/ACPR.2015.7486599 ↗
22. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep Residual Learning for Image Recognition. Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗