CDBA-GAN: A Conditional Dual-Branch Attention Generative Adversarial Network for Robust Sonar Image Generation
Source abstract
Abstract
The acquisition of real-world sonar data necessitates substantial investments of manpower, material resources, and financial capital, rendering it challenging to obtain sufficient authentic samples for sonar-related research tasks. Consequently, sonar image simulation technology has become increasingly vital in the field of sonar data analysis. Traditional sonar simulation methods predominantly focus on low-level physical modeling, which often suffers from limited image controllability and diminished fidelity in multi-category and multi-background scenarios. To address these limitations, this paper proposes a Conditional Dual-Branch Attention Generative Adversarial Network (CDBA-GAN). The framework comprises three key innovations: The conditional information fusion module, dual-branch attention feature fusion mechanism, and cross-layer feature reuse. By integrating encoded conditional information with the original input data of the generative adversarial network, the fusion module enables precise control over the generation of sonar images under specific conditions. A hierarchical attention mechanism is implemented, sequentially performing channel-level and pixel-level attention operations. This establishes distinct weight matrices at both granularities, thereby enhancing the correlation between corresponding elements. The dual-branch attention features are fused via a skip-connection architecture, facilitating efficient feature reuse across network layers. The experimental results demonstrate that the proposed CDBA-GAN generates condition-specific sonar images with a significantly lower Fréchet inception distance (FID) compared to existing methods. Notably, the framework exhibits robust imaging performance under noisy interference and outperforms state-of-the-art models (e.g., DCGAN, WGAN, SAGAN) in fidelity across four categorical conditions, as quantified by FID metrics.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Image Processing Techniques · Generative Adversarial Networks and Image Synthesis · Advanced Vision and Imaging
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Computer Science and Technology, Hangzhou Dianzi University, Hangzhou 310018, China
Funding
Stable Supporting Fund of Acoustic Science and Technology Laboratory · National Natural Science Foundation of China
References (33)
Show source-provided references
1. Simulation and analysis of synthetic sidescan sonar images10.1049/ip-rsn:19971311 ↗
2. Gueriot, D., Sintes, C., and Garello, R. (2007, January 18–21). Sonar data simulation based on tube tracing. Proceedings of the Oceans 2007-Europe, Aberdeen, UK.10.1109/OCEANSE.2007.4302474 ↗
3. A Sample Augmentation Method for Side-Scan Sonar Full-Class Images That Can Be Used for Detection and Segmentation
4. Seg2Sonar: A Full-Class Sample Synthesis Method Applied to Underwater Sonar Image Target Detection, Recognition, and Segmentation Tasks
5. Generative Adversarial Networks
6. Generative adversarial networks for noise reduction in low-dose CT10.1109/TMI.2017.2708987 ↗
7. Dai, W., Dong, N., Wang, Z., Liang, X., Zhang, H., and Xing, E.P. (2018). Scan: Structure correcting adversarial network for organ segmentation in chest X-rays. Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support, Springer.10.1007/978-3-030-00889-5_30 ↗
8. Li, Z., Wang, Y., and Yu, J. (2017). Reconstruction of thin-slice medical images using generative adversarial network. Machine Learning in Medical Imaging, Springer.10.1007/978-3-319-67389-9_38 ↗
9. Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21–26). Image-to-image translation with conditional adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.632 ↗
10. Ledig, C., Theis, L., Huszár, F., Caballero, J., Cunningham, A., and Acosta, A. (2017, January 21–26). Photo-realistic single image super-resolution using a generative adversarial network. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.19 ↗
11. Deep neural networks for learning classification features and generative models from synthetic aperture sonar big data
12. Jegorova, M., Karjalainen, A.I., Vazquez, J., and Hospedales, T. (August, January 31). Full-Scale Continuous Synthetic Sonar Data Generation with Markov Conditional Generative Adversarial Networks. Proceedings of the 2020 IEEE International Conference on Robotics and Automation (ICRA), Paris, France.10.1109/ICRA40945.2020.9197353 ↗
13. Hussain, A., Hussain, T., Ullah, W., Khan, S.U., Kim, M.J., and Muhammad, K. (2024). Big Data Analysis for Industrial Activity Recognition Using Attention-Inspired Sequential Temporal Convolution Network. IEEE Trans. Big Data.10.1109/TBDATA.2024.3489414 ↗
14. Contextual visual and motion salient fusion framework for action recognition in dark environments10.1016/j.knosys.2024.112480 ↗
15. Radford, A., Metz, L., and Chintala, S. (2015). Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv.
16. Arjovsky, M., Chintala, S., and Bottou, L. (2017, January 6–11). Wasserstein generative adversarial networks. Proceedings of the International Conference on Machine Learning, Sydney, Australia. PMLR.
17. Gulrajani, I., Ahmed, F., Arjovsky, M., Dumoulin, V., and Courville, A. (2017). Improved training of wasserstein gans. arXiv.
18. Ao, D., Dumitru, C.O., Schwarz, G., and Datcu, M. (2018). Dialectical GAN for SAR image translation: From Sentinel-1 to TerraSAR-X. Remote. Sens., 10.10.20944/preprints201807.0340.v1 ↗
19. Sonar Image Generation by MFA-CycleGAN for Boosting Underwater Object Detection of AUVs10.1109/JOE.2024.3350746 ↗
20. Mirza, M., and Osindero, S. (2014). Conditional generative adversarial nets. arXiv.
21. Reed, S., Akata, Z., Yan, X., Logeswaran, L., Schiele, B., and Lee, H. (2016, January 20–22). Generative adversarial text to image synthesis. Proceedings of the International Conference on Machine Learning, New York, NY, USA. PMLR.
22. Perarnau, G., Van De Weijer, J., Raducanu, B., and Álvarez, J.M. (2016). Invertible conditional gans for image editing. arXiv.
23. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A.N., Kaiser, L., and Polosukhin, I. (2017). Attention is all you need. arXiv.
24. Wang, X., Girshick, R., Gupta, A., and He, K. (2018, January 18–23). Non-local neural networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00813 ↗
25. Zhang, H., Goodfellow, I., Metaxas, D., and Odena, A. (2019, January 9–15). Self-attention generative adversarial networks. Proceedings of the 36th International Conference on Machine Learning, Long Beach, CA, USA.
26. Hu, J., Shen, L., and Sun, G. (2018, January 18–23). Squeeze-and-excitation networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00745 ↗
27. Hu, J., Shen, L., Albanie, S., Sun, G., and Vedaldi, A. (2018). Gather-excite: Exploiting feature context in convolutional neural networks. arXiv.
28. Li, L., Li, Y., Wang, H., Yue, C., Gao, P., Wang, Y., and Feng, X. (2024). Side-Scan Sonar Image Generation Under Zero and Few Samples for Underwater Target Detection. Remote. Sens., 16.10.3390/rs16224134 ↗
29. Zhang, F., Hou, X., Wang, Z., Cheng, C., and Tan, T. (2024). Side-Scan Sonar Image Generator Based on Diffusion Models for Autonomous Underwater Vehicles. J. Mar. Sci. Eng., 12.10.3390/jmse12081457 ↗
30. DBSAGAN: Dual Branch Split Attention Generative Adversarial Network for Super-Resolution Reconstruction in Remote Sensing Images10.1109/LGRS.2023.3266325 ↗
31. Huang, W., Zhao, Z., Su, L., and Ju, M. (2022). Dual-Branch Attention-Assisted CNN for Hyperspectral Image Classification. Remote Sens., 14.10.3390/rs14236158 ↗
32. Salimans, T., Goodfellow, I., Zaremba, W., Cheung, V., Radford, A., and Chen, X. (2016). Improved techniques for training gans. arXiv.
33. The Fréchet distance between multivariate normal distributions10.1016/0047-259X(82)90077-X ↗