journal article·2025-06-17Open access

GAN-Based Super-Resolution in Linear R-SAM Imaging for Enhanced Non-Destructive Semiconductor Measurement

Thi Thu Ha Vu, Tan Hung Vo, Trong Nhan Nguyen, Jaeyeop Choi, Le Hai Tran, Vu Hoang Minh Doan, Van Bang Nguyen, Wonjo Lee, Sudip Mondal, Junghwan Oh

Applied Sciences· Volume 15· Issue 12

Abstract

The precise identification and non-destructive measurement of structural features and defects in semiconductor wafers are essential for ensuring process integrity and sustaining high yield in advanced manufacturing environments. Unlike conventional measurement techniques, scanning acoustic microscopy (SAM) is an advanced method that provides detailed visualizations of both surface and internal wafer structures. However, in practical industrial applications, the scanning time and image quality of SAM significantly impact its overall performance and utility. Prolonged scanning durations can lead to production bottlenecks, while suboptimal image quality can compromise the accuracy of defect detection. To address these challenges, this study proposes LinearTGAN, an improved generative adversarial network (GAN)-based model specifically designed to improve the resolution of linear acoustic wafer images acquired by the breakthrough rotary scanning acoustic microscopy (R-SAM) system. Empirical evaluations demonstrate that the proposed model significantly outperforms conventional GAN-based approaches, achieving a Peak Signal-to-Noise Ratio (PSNR) of 29.479 dB, a Structural Similarity Index Measure (SSIM) of 0.874, a Learned Perceptual Image Patch Similarity (LPIPS) of 0.095, and a Fréchet Inception Distance (FID) of 0.445. To assess the measurement aspect of LinearTGAN, a lightweight defect segmentation module was integrated and tested on annotated wafer datasets. The super-resolved images produced by LinearTGAN significantly enhanced segmentation accuracy and improved the sensitivity of microcrack detection. Furthermore, the deployment of LinearTGAN within the R-SAM system yielded a 92% improvement in scanning performance for 12-inch wafers while simultaneously enhancing image fidelity. The integration of super-resolution techniques into R-SAM significantly advances the precision, robustness, and efficiency of non-destructive measurements, highlighting their potential to have a transformative impact in semiconductor metrology and quality assurance.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Integrated Circuits and Semiconductor Failure Analysis · CCD and CMOS Imaging Sensors · Advanced Optical Sensing Technologies

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Industry 4.0 Convergence Bionics Engineering, Pukyong National University, Busan 48513, Republic of Korea

Smart Gym-Based Translational Research Center for Active Senior’s Healthcare, Pukyong National University, Busan 48513, Republic of Korea

Digital Healthcare Research Center, Pukyong National University, Busan 48513, Republic of Korea

Department of Biomedical Engineering, Pukyong National University, Busan 48513, Republic of Korea

Ohlabs Corp., Busan 48513, Republic of Korea

Funding

National Research Foundation of Korea (NRF) · Pukyong National University Industry–University Cooperation Foundation’s 2024 Post-Doc support project

References (49)

Show source-provided references
1. The Silicon Age: Trends in Semiconductor Devices Industry10.25103/jestr.151.14 ↗
2. Lechien, T., Dehaerne, E., Dey, B., Blanco, V., Halder, S., De Gendt, S., and Meert, W. (2023). Automated semiconductor defect inspection in scanning electron microscope images: A systematic review. arXiv.
3. Scanning acoustic microscopy10.1016/0041-624X(93)90070-G ↗
4. Development of fast scanning module with a novel bubble solution applied to scanning acoustic microscopy system for industrial nondestructive inspection10.1016/j.eswa.2023.120273 ↗
5. Development of high-speed scanning acoustic microscopy system: Simplified design and stabilization
6. Generative adversarial networks10.1145/3422622 ↗
7. Qu, J., Blau, P., Shih, A., McSpadden, S., Pharr, G., and Jang, J. (2004, January 10–12). Scanning acoustic microscopy for non-destructive evaluation of subsurface characteristics. Proceedings of the 6th International Conference on Frontiers of Design and Manufacturing (SM Wu Symposium on Manufacturing Sciences), Xi’an, China.
8. The acoustic micro integrated detection technique for silicon wafer processing10.4028/www.scientific.net/AMR.497.151 ↗
9. Ramanathan, S., Semmens, J., and Kessler, L. (June, January 30). High-frequency acoustic microscopy studies of buried interfaces in silicon. Proceedings of the 56th Electronic Components and Technology Conference, San Diego, CA, USA.
10. (2025, April 14). Ohlabs Corp., Busan, Republic of Korea. [Online]. Available online: https://www.youtube.com/watch?v=SglCbQLm6C4.
11. III Super-resolution by data inversion10.1016/S0079-6638(08)70314-7 ↗
12. Synthetic aperture focusing technique signal processing10.1016/0308-9126(86)90107-0 ↗
13. Nonlinear structural modification and nonlinear coupling10.1016/j.ymssp.2014.01.016 ↗
14. Ağalday, M.F., and Çınar, A. (2025). Improvement of a subpixel convolutional neural network for a super-resolution image. Appl. Sci., 15.10.3390/app15052459 ↗
15. Jing, T., Liu, C., and Chen, Y. (2025). A lightweight single-image super-resolution method based on the parallel connection of convolution and Swin Transformer blocks. Appl. Sci., 15.10.3390/app15041806 ↗
16. Waseem, I., Habib, M., Rehman, E., Bibi, R., Yousaf, R.M., Aslam, M., Jilani, S.F., and Younis, M.W. (2024). Enhanced learning enriched features mechanism using deep convolutional neural network for image denoising and super-resolution. Appl. Sci., 14.10.3390/app14146281 ↗
17. High-resolution imaging in acoustic microscopy using deep learning10.1088/2632-2153/ad1c30 ↗
18. Sharma, A., Somani, A., Banerjee, P., Melandsø, F., and Habib, A. (2024, January 17–21). HDL-SAM: A Hybrid Deep Learning Framework for High-Resolution Imaging in Scanning Acoustic Microscopy. Proceedings of the Synthetic Data for Computer Vision Workshop@ CVPR 2024, Seattle, WA, USA.
19. Enhancement of acoustic microscopy lateral resolution: A comparison between deep learning and two deconvolution methods10.1109/TUFFC.2019.2940003 ↗
20. GAN-based satellite imaging: A survey on techniques and applications10.1109/ACCESS.2022.3221123 ↗
21. Somani, A., Banerjee, P., Rastogi, M., Habib, A., Agarwal, K., and Prasad, D. (2023, January 18–22). Image inpainting with hypergraphs for resolution improvement in scanning acoustic microscopy. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPRW59228.2023.00313 ↗
22. Image inpainting in acoustic microscopy10.1063/5.0139034 ↗
23. Small sample classification based on data enhancement and its application in flip chip defection10.1016/j.microrel.2022.114887 ↗
24. Wang, X., Xie, L., Dong, C., and Shan, Y. (2021, January 10–17). Real-esrgan: Training real-world blind super-resolution with pure synthetic data. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCVW54120.2021.00217 ↗
25. Fast anisotropic gauss filtering10.1109/TIP.2003.812429 ↗
26. Zhang, K., Zuo, W., and Zhang, L. (2018, January 18–22). Learning a single convolutional super-resolution network for multiple degradations. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00344 ↗
27. An unbiased risk estimator for image denoising in the presence of mixed Poisson–Gaussian noise10.1109/TIP.2014.2300821 ↗
28. Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., and Guo, B. (2021, January 10–17). Swin transformer: Hierarchical vision transformer using shifted windows. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00986 ↗
29. SSIR: Spatial shuffle multi-head self-attention for single image super-resolution10.1016/j.patcog.2023.110195 ↗
30. Kruse, R., Mostaghim, S., Borgelt, C., Braune, C., and Steinbrecher, M. (2022). Multi-layer perceptrons. Comput. Intell. Methodol. Introd., 53–124.10.1007/978-3-030-42227-1_5 ↗
31. Ronneberger, O., Fischer, P., and Brox, T. (2015, January 5–9). U-net: Convolutional networks for biomedical image segmentation. Proceedings of the Medical Image Computing And Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany. Proceedings, Part III 18.
32. Automatic multiorgan segmentation in thorax CT images using U-net-GAN10.1002/mp.13458 ↗
33. Joint segment-level and pixel-wise losses for deep learning based retinal vessel segmentation10.1109/TBME.2018.2828137 ↗
34. Johnson, J., Alahi, A., and Fei-Fei, L. (2016, January 11–14). Perceptual losses for real-time style transfer and super-resolution. Proceedings of the Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands. Proceedings, Part II 14.10.1007/978-3-319-46475-6_43 ↗
35. Hore, A., and Ziou, D. (2010, January 23–26). Image quality metrics: PSNR vs. SSIM. Proceedings of the 2010 20th International Conference on Pattern Recognition, Istanbul, Turkey.10.1109/ICPR.2010.579 ↗
36. Benecki, P., Kostrzewa, D., and Kawulok, M. (2023, January 16–21). Perceptual Loss for Training Multi-Image Super-Resolution. Proceedings of the IGARSS 2023-2023 IEEE International Geoscience and Remote Sensing Symposium, Pasadena, CA, USA.10.1109/IGARSS52108.2023.10282654 ↗
37. Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., and Hochreiter, S. (2017). Gans trained by a two time-scale update rule converge to a local nash equilibrium. Adv. Neural Inf. Process. Syst., 30.
38. Botchkarev, A. (2018). Performance metrics (error measures) in machine learning regression, forecasting and prognostics: Properties and typology. arXiv.
39. Chen, H., Widodo, A., Wisnujati, A., Rahaman, M., Lin, J., Chen, L., and Weng, C. (2022). AlexNet convolutional neural network for disease detection and classification of tomato leaf. Electronics, 11.10.3390/electronics11060951 ↗
40. Koonce, B., and Koonce, B. (2021). Vgg network. Convolutional Neural Networks with Swift for Tensorflow: Image Recognition and Dataset Categorization, Springer.10.1007/978-1-4842-6168-2 ↗
41. Image interpolation techniques in digital image processing: An overview
42. Li, Y., Agustsson, E., Gu, S., Timofte, R., and Van Gool, L. (2018, January 8–14). Carn: Convolutional anchored regression network for fast and accurate single image super-resolution. Proceedings of the European Conference on Computer Vision (ECCV) Workshops, Munich, Germany.10.1007/978-3-030-11021-5_11 ↗
43. Zhang, K., Liang, J., Van Gool, L., and Timofte, R. (2021, January 10–17). Designing a practical degradation model for deep blind image super-resolution. Proceedings of the IEEE/CVF International Conference on Computer Vision, Montreal, QC, Canada.10.1109/ICCV48922.2021.00475 ↗
44. Transformer-based multistage enhancement for remote sensing image super-resolution
45. Dai, T., Cai, J., Zhang, Y., Xia, S., and Zhang, L. (2019, January 15–20). Second-order attention network for single image super-resolution. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Long Beach, CA, USA.10.1109/CVPR.2019.01132 ↗
46. Yang, Z., Yang, D., Dyer, C., He, X., Smola, A., and Hovy, E. (2016, January 12–17). Hierarchical attention networks for document classification. Proceedings of the 2016 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, San Diego, CA, USA.10.18653/v1/N16-1174 ↗
47. Cross-scale internal graph neural network for image super-resolution
48. Jocher, G., Chaurasia, A., and Qiu, J. (2025, March 05). YOLO by Ultralytics. (2023, 1). Available online: https://github.com/ultralytics/ultralytics.
49. Reis, D., Kupec, J., Hong, J., and Daoudi, A. (2023). Real-time flying object detection with YOLOv8. arXiv.