journal article·2025-06Open access

Deep learning based optical image super-resolution via generative diffusion models for layerwise in-situ LPBF monitoring

Francis Ogoke, Sumesh Kalambettu Suresh, Jesse Adamczyk, Dan Bolintineanu, Anthony Garland, Michael Heiden, Amir Barati Farimani

Abstract

The stochastic formation of defects during Laser Powder Bed Fusion (L-PBF) negatively impacts its adoption for high-precision use cases. Optical monitoring techniques can be used to identify defects based on layer-wise imaging, but these methods are difficult to scale to high resolutions due to cost and memory constraints. Therefore, we implement generative deep learning models to link low-cost, low-resolution images of the build plate to detailed high-resolution optical images of the build plate, enabling cost-efficient process monitoring. To do so, a conditional latent probabilistic diffusion model is trained to produce realistic high-resolution images of the build plate from low-resolution webcam images, recovering the distribution of small-scale features and surface roughness. We first evaluate the performance of the model by analyzing the reconstruction quality of the generated images using peak-signal-to-noise-ratio (PSNR), structural similarity index measure (SSIM) and wavelet covariance metrics that describe the preservation of high-frequency information. Additionally, we design a framework based upon the Segment Anything foundation model to recreate the 3D morphology of the printed part and analyze the surface roughness of the reconstructed samples. Finally, we explore the zero-shot generalization capabilities of the implemented framework to other part geometries by creating synthetic low-resolution data.
Source: openalex_inverted_index · Quality: baseline

Research context

OpenAlex topics: Advanced Image Processing Techniques · Image and Signal Denoising Methods · Advanced X-ray Imaging Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

References (58)

Show source-provided references
1. A review on functionally graded materials and structures via additive manufacturing: from multi-scale design to versatile functional properties10.1002/admt.201900981 ↗
2. Additive manufacturing for mass customization
3. Additive manufacturing review: early past to current practice10.1115/1.4048193 ↗
4. Review of mechanical properties of Ti-6Al-4V made by laser-based additive manufacturing using powder feedstock10.1007/s11837-015-1759-z ↗
5. Additive manufacturing: scientific and technological challenges, market uptake and opportunities10.1016/j.mattod.2017.07.001 ↗
6. Additive manufacturing of metallic components–process, structure and properties10.1016/j.pmatsci.2017.10.001 ↗
7. Density analysis of direct metal laser re-melted 316L stainless steel cubic primitives10.1023/B:JMSC.0000013875.62536.fa ↗
8. Selective laser melting additive manufacturing of Inconel 718 superalloy parts: Densification, microstructure and properties10.1016/j.jallcom.2013.09.171 ↗
9. Damage evolution and failure mechanisms in additively manufactured stainless steel10.1016/j.msea.2015.10.073 ↗
10. Effect of process control and powder quality on Inconel 718 produced using electron beam melting
11. Reducing lack of fusion during selective laser melting of CoCrMo alloy: Effect of laser power on geometrical features of tracks
12. Keyhole formation by laser drilling in laser powder bed fusion of Ti6Al4V biomedical alloy: Mesoscopic computational fluid dynamics simulation versus mathematical modelling using empirical validation10.3390/nano11123284 ↗
13. Keyhole threshold and morphology in laser melting revealed by ultrahigh-speed X-ray imaging10.1126/science.aav4687 ↗
14. Foster · 2015
15. The influence of a ceramic recoater blade on 3D printing using direct metal laser sintering
16. A study on elimination of failures resulting from layering and internal stresses in powder bed fusion (PBF) additive manufacturing10.1080/10426914.2019.1655151 ↗
17. Spatially resolved acoustic spectroscopy for selective laser melting10.1016/j.jmatprotec.2016.05.005 ↗
18. Selective laser melting of Ti6Al4V alloy for biomedical applications: Temperature monitoring and microstructural evolution10.1016/j.jallcom.2013.08.183 ↗
19. Quality control of laser-and powder bed-based additive manufacturing (AM) technologies10.1016/j.phpro.2010.08.089 ↗
20. High-resolution melt pool thermal imaging for metals additive manufacturing using the two-color method with a color camera
21. Pak · 2024
22. Flaw detection in powder bed fusion using optical imaging
23. In situ 3D monitoring of geometric signatures in the powder-bed-fusion additive manufacturing process via vision sensing methods10.3390/s18041180 ↗
24. In-situ defect detection in laser powder bed fusion by using thermography and optical tomography—Comparison to computed tomography
25. Automated layerwise detection of geometrical distortions in laser powder bed fusion
26. High resolution imaging for inspection of laser beam melting systems
27. Thermal history and high-speed optical imaging of overhang structures during laser powder bed fusion: A computational and experimental analysis
28. Layer-wise anomaly detection and classification for powder bed additive manufacturing processes: A machine-agnostic algorithm for real-time pixel-wise semantic segmentation
29. Characterization of in-situ measurements based on layerwise imaging in laser powder bed fusion
30. Process mapping and in-process monitoring of porosity in laser powder bed fusion using layerwise optical imaging10.1115/1.4040615 ↗
31. Application of supervised machine learning for defect detection during metallic powder bed fusion additive manufacturing using high resolution imaging
32. Toward in-situ flaw detection in laser powder bed fusion additive manufacturing through layerwise imagery and machine learning10.1016/j.jmsy.2021.01.008 ↗
33. In-situ visual monitoring for multi-scale defects detection in laser powder bed fusion
34. Srdiff: Single image super-resolution with diffusion probabilistic models10.1016/j.neucom.2022.01.029 ↗
35. X. Wang, K. Yu, S. Wu, J. Gu, Y. Liu, C. Dong, Y. Qiao, C. Change Loy, Esrgan: Enhanced super-resolution generative adversarial networks, in: Proceedings of the European Conference on Computer Vision (ECCV) Workshops, 2018.10.1007/978-3-030-11021-5_5 ↗
36. Deep learning for single image super-resolution: A brief review10.1109/TMM.2019.2919431 ↗
37. Y. Zhang, Y. Tian, Y. Kong, B. Zhong, Y. Fu, Residual dense network for image super-resolution, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 2472–2481.10.1109/CVPR.2018.00262 ↗
38. J. Kim, J.K. Lee, K.M. Lee, Accurate image super-resolution using very deep convolutional networks, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2016, pp. 1646–1654.10.1109/CVPR.2016.182 ↗
39. Learning a deep convolutional network for image super-resolution
40. Generative adversarial nets
41. Pores for thought: generative adversarial networks for stochastic reconstruction of 3D multi-phase electrode microstructures with periodic boundaries10.1038/s41524-020-0340-7 ↗
42. Deep-learned generators of porosity distributions produced during metal additive manufacturing
43. ESRGAN+: Further improving enhanced super-resolution generative adversarial network
44. S. Gao, X. Liu, B. Zeng, S. Xu, Y. Li, X. Luo, J. Liu, X. Zhen, B. Zhang, Implicit diffusion models for continuous super-resolution, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 10021–10030.10.1109/CVPR52729.2023.00966 ↗
45. Catastrophic forgetting and mode collapse in GANs
46. K. Liu, W. Tang, F. Zhou, G. Qiu, Spectral regularization for combating mode collapse in gans, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, 2019, pp. 6382–6390.10.1109/ICCV.2019.00648 ↗
47. Veegan: Reducing mode collapse in gans using implicit variational learning
48. Denoising diffusion probabilistic models
49. Inexpensive high fidelity melt pool models in additive manufacturing using generative deep diffusion10.1016/j.matdes.2024.113181 ↗
50. Song · 2020
51. R. Rombach, A. Blattmann, D. Lorenz, P. Esser, B. Ommer, High-Resolution Image Synthesis With Latent Diffusion Models, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, CVPR, 2022, pp. 10684–10695.10.1109/CVPR52688.2022.01042 ↗
52. U-net: Convolutional networks for biomedical image segmentation
53. A. Kirillov, E. Mintun, N. Ravi, H. Mao, C. Rolland, L. Gustafson, T. Xiao, S. Whitehead, A.C. Berg, W.-Y. Lo, et al., Segment anything, in: Proceedings of the IEEE/CVF International Conference on Computer Vision, 2023, pp. 4015–4026.10.1109/ICCV51070.2023.00371 ↗
54. Image quality assessment: from error visibility to structural similarity10.1109/TIP.2003.819861 ↗
55. Maximum entropy models from phase harmonic covariances10.1016/j.acha.2021.01.003 ↗
56. Reading and understanding continuous wavelet transforms
57. P. Esser, R. Rombach, B. Ommer, Taming transformers for high-resolution image synthesis, in: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2021, pp. 12873–12883.10.1109/CVPR46437.2021.01268 ↗
58. C. Ledig, L. Theis, F. Huszár, J. Caballero, A. Cunningham, A. Acosta, A. Aitken, A. Tejani, J. Totz, Z. Wang, et al., Photo-realistic single image super-resolution using a generative adversarial network, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 4681–4690.10.1109/CVPR.2017.19 ↗