Benchmarking Conditional GANs in Industrial Marble Texture Synthesis via a Dual-Evaluation Framework
Source abstract
Abstract
Deploying conditional Generative Adversarial Networks (cGANs) for industrial texture synthesis faces two barriers: the prohibitive cost of manual data annotation and the uncertain alignment between automated evaluation metrics and human perception. This study addresses both challenges for marble texture synthesis using 289 high-resolution industrial scans. We adapt an unsupervised segmentation pipeline combining Simple Linear Iterative Clustering (SLIC) superpixels, Gaussian Mixture Models (GMMs), and graph cut optimization to extract vein structures without manual annotation. Four cGAN architectures—baseline cGAN, Pix2Pix, BicycleGAN, and GauGAN—are benchmarked using a dual-evaluation protocol contrasting ten automated metrics with structured human-centered assessment. The results reveal a significant metric–perception discrepancy. Pix2Pix achieved the best Fréchet Inception Distance (FID = 85.3) yet received the lowest human ratings due to periodic texture artifacts. GauGAN produced textures statistically indistinguishable from real marble, achieving a Visual Turing Pass Rate (VTPR) of 0.533 and a Mean Opinion Score on Marble Authenticity (MOS-MA) of 2.89, despite an inferior FID (87.3). These findings make three contributions: an annotation-free segmentation pipeline, empirical evidence that automated metrics alone are insufficient for architecture selection, and a dual-evaluation framework that establishes human-in-the-loop assessment as essential for quality-critical industrial deployment.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Generative Adversarial Networks and Image Synthesis · Machine Learning in Materials Science · Advanced Neural Network Applications
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
CERENA, Instituto Superior Técnico, Universidade de Lisboa, 1049-001 Lisbon, Portugal
Instituto Superior Técnico, Universidade de Lisboa, 1049-001 Lisbon, Portugal
LAETA, IDMEC, Instituto Superior Técnico, Universidade de Lisboa, 1049-001 Lisbon, Portugal
Funding
Sustainable Stone by Portugal project
References (70)
Show source-provided references
1. Technology Enablers for the Implementation of Industry 4.0 to Traditional Manufacturing Sectors: A Review10.1016/j.compind.2020.103390 ↗
2. Industrial Design Digital Technology10.1016/j.protcy.2015.07.007 ↗
3. Xian, W., Sangkloy, P., Agrawal, V., Raj, A., Lu, J., Fang, C., Yu, F., and Hays, J. (2018, January 18–23). TextureGAN: Controlling Deep Image Synthesis with Texture Patches. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00882 ↗
4. Weinberger, P., Gall, A., Heim, A., Yosifov, M., Kastner, J., Schwarz, L., Fröhler, B., Bodenhofer, U., and Sascha, S. (Res. Sq., 2024). Unsupervised Segmentation of Industrial X-Ray Computed Tomography Data with the Segment Anything Model, Res. Sq., preprint.10.21203/rs.3.rs-3900291/v1 ↗
5. Mirza, M., and Osindero, S. (2014). Conditional Generative Adversarial Nets. arXiv.
6. Park, T., Liu, M.-Y., Wang, T.-C., and Zhu, J.-Y. (2019, January 15–20). Semantic Image Synthesis with Spatially-Adaptive Normalization. Proceedings of the 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Long Beach, CA, USA.10.1109/CVPR.2019.00244 ↗
7. Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017). Image-to-Image Translation with Conditional Adversarial Networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2017), Honolulu, HI, USA, 21–26 July 2017, IEEE.10.1109/CVPR.2017.632 ↗
8. Era, I.Z., Ahmed, I., Liu, Z., and Das, S. (2024). An Unsupervised Approach towards Promptable Defect Segmentation in Laser-Based Additive Manufacturing by Segment Anything. arXiv.10.1038/s44334-025-00021-4 ↗
9. Heusel, M., Ramsauer, H., Unterthiner, T., Nessler, B., and Hochreiter, S. (2017). GANs Trained by a Two Time-Scale Update Rule Converge to a Local Nash Equilibrium. Proceedings of the 31st International Conference on Neural Information Processing Systems NIPS’17, Long Beach, CA, USA, 4–9 December 2017, ACM Digital Library.
10. Lee, D., Sugiyama, M., Luxburg, U., Guyon, I., and Garnett, R. (2016). Improved Techniques for Training GANs. Proceedings of the Advances in Neural Information Processing Systems 29 (NIPS 2016), NIPS Foundation.
11. A Neural Algorithm of Artistic Style10.1167/16.12.326 ↗
12. Zhou, S., Gordon, M.L., Krishna, R., Narcomey, A., Fei-Fei, L., and Bernstein, M.S. (2019). HYPE: A Benchmark for Human EYe Perceptual Evaluation of Generative Models. Proceedings of the 33rd International Conference on Neural Information Processing Systems, Curran Associates Inc.
13. Exposing Flaws of Generative Model Evaluation Metrics and Their Unfair Treatment of Diffusion Models
14. Pros and Cons of GAN Evaluation Measures: New Developments10.1016/j.cviu.2021.103329 ↗
15. Liu, L., Duan, H., Hu, Q., Yang, L., Cai, C., Ye, T., Liu, H., Zhang, X., and Zhai, G. (2025). F-Bench: Rethinking Human Preference Evaluation Metrics for Benchmarking Face Generation, Customization, and Restoration. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Honolulu, HI, USA, 19–23 Ocotober 2025, IEEE.
16. Perlin, K. (2002). Improving Noise. Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques, San Antonio, TX, USA, 23–26 July 2002, Association for Computing Machinery.10.1145/566570.566636 ↗
17. An Image Synthesizer
18. Generating Textures on Arbitrary Surfaces Using Reaction-Diffusion10.1145/127719.122749 ↗
19. Worley, S. (1996). A Cellular Texture Basis Function. SIGGRAPH ’96: Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniq, Association for Computing Machinery.10.1145/237170.237267 ↗
20. Efros, A.A., and Leung, T.K. (1999, January 20–27). Texture Synthesis by Non-Parametric Sampling. Proceedings of the IEEE International Conference on Computer Vision, Corfu, Greece.10.1109/ICCV.1999.790383 ↗
21. Efros, A.A., and Freeman, W.T. (2001). Image Quilting for Texture Synthesis and Transfer. Proceedings of the SIGGRAPH ’01: Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, ACM Digital Library.10.1145/383259.383296 ↗
22. Graphcut Textures: Image and Video Synthesis Using Graph Cuts10.1145/882262.882264 ↗
23. Texture Synthesis and Nonparametric Resampling of Random Fields10.1214/009053606000000588 ↗
24. Exemplar-Based Texture Synthesis: The Efros-Leung Algorithm10.5201/ipol.2013.59 ↗
25. A Style-Based Generator Architecture for Generative Adversarial Networks10.1109/TPAMI.2020.2970919 ↗
26. Rombach, R., Blattmann, A., Lorenz, D., Esser, P., and Ommer, B. (2022). High-Resolution Image Synthesis with Latent Diffusion Models. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), IEEE.10.1109/CVPR52688.2022.01042 ↗
27. Goodfellow, I.J., Pouget-Abadie, J., Mirza, M., Xu, B., Warde-Farley, D., Ozair, S., Courville, A., and Bengio, Y. (2014). Generative Adversarial Networks. arXiv.
28. Texture Synthesis Using Convolutional Neural Networks
29. Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017). Unpaired Image-to-Image Translation Using Cycle-Consistent Adversarial Networks. Proceedings of the IEEE International Conference on Computer Vision, Institute of Electrical and Electronics Engineers Inc.10.1109/ICCV.2017.244 ↗
30. Efficient Semantic Image Synthesis via Class-Adaptive Normalization
31. Zhang, L., Rao, A., and Agrawala, M. (2023). Adding Conditional Control to Text-to-Image Diffusion Models. Proceedings of the IEEE International Conference on Computer Vision, Institute of Electrical and Electronics Engineers Inc.10.1109/ICCV51070.2023.00355 ↗
32. Cao, P., Zhou, F., Yang, L., Huang, T., and Song, Q. (2025). Image Is All You Need to Empower Large-Scale Diffusion Models for In-Domain Generation. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2025, IEEE.10.1109/CVPR52734.2025.01711 ↗
33. Borovec, J. (2013, January 16). Fully Automatic Segmentation of Stained Histological Cuts. Proceedings of the Poster 2013: 17th International Student Conference on Electrical Engineering, Prague, Czech Republic.
34. Supervised and Unsupervised Segmentation Using Superpixels, Model Estimation, and Graph Cut10.1117/1.JEI.26.6.061610 ↗
35. Andreini, P., Ciano, G., Bonechi, S., Graziani, C., Lachi, V., Mecocci, A., Sodi, A., Scarselli, F., and Bianchini, M. (2022). A Two-Stage GAN for High-Resolution Retinal Image Generation and Segmentation. Electronics, 11.10.3390/electronics11010060 ↗
36. SLIC Superpixels Compared to State-of-the-Art Superpixel Methods10.1109/TPAMI.2012.120 ↗
37. Giraud, R., and Clément, M. (2024). Superpixel Segmentation: A Long-Lasting Ill-Posed Problem. arXiv.
38. Ferrari, V., and Hebert, M. (2018). Superpixel Sampling Networks. Proceedings of the European Conference on Computer Vision—ECCV 2018, Munich, Germany, 8–14 November 2018, ACM Digital Library.10.1007/978-3-030-01216-8 ↗
39. Unsupervised Superpixel-Based Segmentation of Histopathological Images with Consensus Clustering10.1007/978-3-319-60964-5_67 ↗
40. Interactive Graph Cuts for Optimal Boundary & Region Segmentation Of Objects in N-D Images
41. Normalized Cuts and Image Segmentation10.1109/34.868688 ↗
42. A Data Generation Method with Dual Discriminators and Regularization for Surface Defect Detection under Limited Data10.1016/j.compind.2023.103963 ↗
43. Deep CNN-Based Visual Defect Detection: Survey of Current Literature10.1016/j.compind.2023.103911 ↗
44. A Survey of Defect Detection Applications Based on Generative Adversarial Networks10.1109/ACCESS.2022.3217227 ↗
45. Integrating Aesthetic and Emotional Preferences in Social Robot Design: An Affective Design Approach with Kansei Engineering and Deep Convolutional Generative Adversarial Network10.1016/j.ergon.2021.103128 ↗
46. Deep Learning Based System for Garment Visual Degradation Prediction for Longevity10.1016/j.compind.2022.103779 ↗
47. A Wasserstein Generative Digital Twin Model in Health Monitoring of Rotating Machines10.1016/j.compind.2022.103807 ↗
48. Developing a Data-Driven Technology Roadmapping Method Using Generative Adversarial Network (GAN)10.1016/j.compind.2022.103835 ↗
49. Johnson, J., Alahi, A., and Li, F.-F. (2016). Perceptual Losses for Real-Time Style Transfer and Super-Resolution. European Conference on Computer Vision, Springer.10.1007/978-3-319-46475-6_43 ↗
50. Research on Image Generation and Style Transfer Algorithm Based on Deep Learning10.4236/ojapps.2019.98053 ↗
51. Bernardi, M. (2023). Generating Realistic Marble Textures Using Generative Adversarial Networks. [Bachelor’s Thesis, Università degli Studi di Padova].
52. MaterialGAN: Reflectance Capture Using a Generative SVBRDF Model10.1145/3414685.3417779 ↗
53. An Adaptive Fused Domain-Cycling Variational Generative Adversarial Network for Machine Fault Diagnosis under Data Scarcity10.1016/j.inffus.2025.103616 ↗
54. A Dynamic Collaborative Adversarial Domain Adaptation Network for Unsupervised Rotating Machinery Fault Diagnosis10.1016/j.ress.2024.110662 ↗
55. Yan, J., Cheng, Y., Zhang, F., Li, M., Zhou, N., Jin, B., Wang, H., Yang, H., and Zhang, W. (Struct. Health Monit., 2025). Research on Multimodal Techniques for Arc Detection in Railway Systems with Limited Data, Struct. Health Monit., online first.10.1177/14759217251336797 ↗
56. Deconvolution and Checkerboard Artifacts10.23915/distill.00003 ↗
57. (2008). Subjective Video Quality Assessment Methods for Multimedia Applications (Standard No. ITU-T P.910).
58. (2020). Methodologies for the Subjective Assessment of the Quality of Television Images (Standard No. ITU-R BT.500-14).
59. Wang, Z., Simoncelli, E.P., and Bovik, A.C. (2003, January 9–12). Multi-Scale Structural Similarity for Image Quality Assessment. Proceedings of the 37th IEEE Asilomar Conference on Signals, Systems and Computers, Pacific Grove, CA, USA.
60. State-of-the-Art in the Architecture, Methods and Applications of StyleGAN10.1111/cgf.14503 ↗
61. Two Modifications of Weight Calculation of the Non-Local Means Denoising Method10.4236/eng.2013.510B107 ↗
62. 3D Texture Mapping for Rapid Manufacturing10.1080/16864360.2007.10738509 ↗
63. Kirillov, A., Mintun, E., Ravi, N., Mao, H., Rolland, C., Gustafson, L., Xiao, T., Whitehead, S., Berg, A.C., and Lo, W.-Y. (2023). Segment Anything. Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Paris, France, 2–3 October 2023, IEEE.10.1109/ICCV51070.2023.00371 ↗
64. Oquab, M., Darcet, T., Moutakanni, T., Vo, H., Szafraniec, M., Khalidov, V., Fernandez, P., Haziza, D., Massa, F., and El-Nouby, A. (2024). DINOv2: Learning Robust Visual Features without Supervision. Trans. Mach. Learn. Res., 1–31. Available online: https://openreview.net/forum?id=a68SUt6zFt.
65. Caron, M., Bojanowski, P., Joulin, A., and Douze, M. (2019). Deep Clustering for Unsupervised Learning of Visual Features. Proceedings of the European Conference on Computer Vision (ECCV), Florence, Italy, 7–13 October 2012, ACM Digital Library.
66. Tabassum, A., and Ziabari, A. (2024). Adapting Segment Anything Model (SAM) to Experimental Datasets via Fine-Tuning on GAN-Based Simulation: A Case Study in Additive Manufacturing. arXiv.
67. Zhu, J.-Y., Zhang, R., Pathak, D., Darrell, T., Efros, A.A., Wang, O., and Shechtman, E. (2017). Toward Multimodal Image-to-Image Translation. arXiv.
68. Saad, M.M., Rehmani, M.H., and O’Reilly, R. (2024). Early Stopping Criteria for Training Generative Adversarial Networks in Biomedical Imaging. Proceedings of the IEEE Irish Signals and Systems Conference (ISSC 2024), Belfast, UK, 13–14 June 2024, IEEE.10.1109/ISSC61953.2024.10603268 ↗
69. Haghighat, M., and Razian, M.A. (2014). Fast-FMI: Non-Reference Image Fusion Metric. Proceedings of the 8th IEEE International Conference on Application of Information and Communication Technologies, AICT 2014—Conference Proceedings, Astana, Kazakhstan, 15–17 October 2014, Institute of Electrical and Electronics Engineers Inc.10.1109/ICAICT.2014.7036000 ↗
70. Fabre-Thorpe, M. (2011). The Characteristics and Limits of Rapid Visual Categorization. Front. Psychol., 2.10.3389/fpsyg.2011.00243 ↗