Improving StyleGAN-ADA with efficient channel attention and multidimensional enhancement heuristic for solder joint defect detection
Source abstract
Abstract
Generative Adversarial Networks have excelled in generating high-quality images but face challenges when trained on limited datasets due to the discriminator’s tendency to overfit, which compromises the generator’s performance. To address this issue, we propose StyleGAN2-ADAEH, an improved algorithm based on StyleGAN2-ADA. Our method incorporates an attention mechanism into the generator, enhancing its ability to focus on critical input features and improving image realism and detail. In addition, we introduce two heuristic data augmentation strategies in the discriminator, fostering a balanced and competitive dynamic between the generator and discriminator, thereby preventing mode collapse and overfitting. To validate our approach, we developed a new dataset, PCBA-SJD, comprising 2575 images across four types of solder joint defects, and conducted experiments on the PCBA-SJD, FFHQ256-2k, and AFHQ-CAT/WILD datasets. Our method consistently outperforms the latest techniques, achieving a reduced FID score of 15.3 and a KID value of 3.8 on PCBA-SJD, reflecting an improvement of 18.62%. These results demonstrate that our approach improves image synthesis quality under limited data conditions while enhancing training stability.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Advanced Neural Network Applications · Industrial Vision Systems and Defect Detection · Generative Adversarial Networks and Image Synthesis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Robotics Research Center, College of Electrical Engineering and Automation, Shandong University of Science and Technology , Qingdao 266590,
Funding
National Natural Science Foundation of China · Natural Science Foundation of Shandong Province · Natural Science Foundation of Shandong Province for Innovation and Development Joint Funds
References (38)
Show source-provided references
1. Towards principled methods for training generative adversarial networks
2. Z. Zhao , Z.Zhang, T.Chen, S.Singh, and H.Zhang, “Image augmentations for GAN training,” arXiv:2006.02595 (2020).
3. A style-based generator architecture for generative adversarial networks
4. Analyzing and improving the image quality of StyleGAN
5. Alias-free generative adversarial networks10.5555/3540261.3540327 ↗
6. 1
7. StyleGAN-V: A continuous video generator with the price, image quality and perks of StyleGAN2
8. StyleGAN-fusion: Diffusion guided domain adaptation of image generators
9. Denoising diffusion probabilistic models10.5555/3495724.3496298 ↗
10. Improved denoising diffusion probabilistic models
11. A survey on image data augmentation for deep learning10.1186/s40537-019-0197-0 ↗
12. Spectral normalization for generative adversarial networks
13. FMRGAN: Feature mapping reconstruction GAN for rolling bearings fault diagnosis under limited data condition10.1109/jsen.2024.3415713 ↗
14. Training generative adversarial networks with limited data10.5555/3495724.3496739 ↗
15. Regularizing generative adversarial networks under limited data
16. On data augmentation for GAN training10.1109/tip.2021.3049346 ↗
17. ECA-Net: Efficient channel attention for deep convolutional neural networks
18. GANs trained by a two time-scale update rule converge to a local nash equilibrium10.5555/3295222.3295408 ↗
19. Demystifying MMD GANs
20. StarGAN v2: Diverse image synthesis for multiple domains
21. Generative adversarial nets10.5555/2969033.2969125 ↗
22. Unsupervised representation learning with deep convolutional generative adversarial networks
23. Improved training of wasserstein GANs10.5555/3295222.3295327 ↗
24. Progressive growing of GANs for improved quality, stability, and variation
25. Large scale GAN training for high fidelity natural image synthesis
26. SketchCleanGAN: A generative network to enhance and correct query sketches for improving 3D CAD model retrieval systems10.1016/j.cag.2024.104000 ↗
27. Efficient image generation with contour wavelet diffusion10.1016/j.cag.2024.104087 ↗
28. Which training methods for GANs do actually converge?
29. Few-shot image generation with elastic weight consolidation10.5555/3495724.3497056 ↗
30. A lightweight steel surface defect detection network based on YOLOv910.1063/5.0273824 ↗
31. IFCD: Inverted feature extraction for enhancing curling stone detection10.1063/5.0252198 ↗
32. Deceive D: Adaptive pseudo augmentation for GAN training with limited data10.5555/3540261.3541918 ↗
33. Improving GANs with a dynamic discriminator10.5555/3600270.3601368 ↗
34. Multi-channel attention selection GANs for guided image-to-image translation10.1109/TPAMI.2022.3212915 ↗
35. GIU-GANs: Global information utilization for generative adversarial networks10.1016/j.neunet.2022.05.014 ↗
36. Channel attention GAN trained with enhanced dataset for single-image shadow removal10.1109/access.2022.3147063 ↗
37. Diffusion-GAN: Training GANs with diffusion
38. Ensembling off-the-shelf models for GAN training