journal article·2025-11-28Open access

A Synthetic Image Generation Pipeline for Vision-Based AI in Industrial Applications

Nishanth Nandakumar, Jörg Eberhardt

Applied Sciences· Volume 15· Issue 23

Abstract

The collection and annotation of large-scale image datasets remains a significant challenge in training vision-based AI models, especially in domains such as industrial automation. In industrial settings, this limitation is especially critical for quality inspection tasks within Flexible Manufacturing Systems and Batch-Size-of-One production, where high variability in components restricts the availability of relevant datasets. This study presents a pipeline for generating photorealistic synthetic images to support automated visual inspection. Rendered images derived from geometric models of manufactured parts are enhanced using a Cycle-Consistent Adversarial Network (CycleGAN), which transfers pixel-level features from real camera images. The pipeline is applied in two scenarios: (1) domain transfer between similar objects for data augmentation, and (2) domain transfer between dissimilar objects to synthesize images before physical production. The generated images are evaluated using mean Average Precision (mAP) and the Turing test, respectively. The pipeline is further validated in two industrial setups: object detection for a pick-and-place task using a Niryo robot, and anomaly detection in products manufactured by a FESTO machine. The successful implementation of the pipeline demonstrates its potential to generate effective training data for vision-based AI in industrial applications and highlights the importance of enhancing domain quality in industrial synthetic data workflows.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Advanced Neural Network Applications · Generative Adversarial Networks and Image Synthesis · Industrial Vision Systems and Defect Detection

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Institute for Photonic Systems, Ravensburg-Weingarten University of Applied Sciences, 88250 Weingarten, Germany

Funding

Carl Zeiss Stiftung

References (34)

Show source-provided references
1. A review of artificial intelligence applications in manufacturing operations10.1002/amp2.10159 ↗
2. Automated surface defect detection framework using machine vision and convolutional neural networks10.1007/s10845-021-01878-w ↗
3. Sundaram, S., and Zeid, A. (2023). Artificial intelligence-based smart quality inspection for manufacturing. Micromachines, 14.10.3390/mi14030570 ↗
4. A review: Data pre-processing and data augmentation techniques10.1016/j.gltp.2022.04.020 ↗
5. A comprehensive survey on transfer learning10.1109/JPROC.2020.3004555 ↗
6. Generalizing from a few examples: A survey on few-shot learning
7. Ten deep learning techniques to address small data problems with remote sensing
8. A domain adaptation YOLOv5 model for industrial defect inspection10.1016/j.measurement.2023.112725 ↗
9. Flexible manufacturing system
10. Achieving batch-size-of-one production model in robot flexible assembly cells10.1007/s00170-023-11246-y ↗
11. Boikov, A., Payor, V., Savelev, R., and Kolesnikov, A. (2021). Synthetic data generation for steel defect detection and classification using deep learning. Symmetry, 13.10.3390/sym13071176 ↗
12. Nakumar, N., and Eberhardt, J. (2023, January 8–10). Overview of Synthetic Data Generation for Computer Vision in Industry. Proceedings of the 2023 8th International Conference on Mechanical Engineering and Robotics Research (ICMERR), Krakow, Poland.
13. Singh, M., Srivastava, R., Fuenmayor, E., Kuts, V., Qiao, Y., Murray, N., and Devine, D. (2022). Applications of digital twin across industries: A review. Appl. Sci., 12.10.3390/app12115727 ↗
14. Procedural synthetic training data generation for AI-based defect detection in industrial surface inspection10.1016/j.procir.2022.05.115 ↗
15. Singh, K., Navaratnam, T., Holmer, J., Schaub-Meyer, S., and Roth, S. (2024, January 16–22). Is synthetic data all we need? benchmarking the robustness of models trained with synthetic images. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPRW63382.2024.00257 ↗
16. Zhu, J.Y., Park, T., Isola, P., and Efros, A.A. (2017, January 22–29). Unpaired image-to-image translation using cycle-consistent adversarial networks. Proceedings of the IEEE International Conference on Computer Vision, Venice, Italy.10.1109/ICCV.2017.244 ↗
17. Isola, P., Zhu, J.Y., Zhou, T., and Efros, A.A. (2017, January 21–26). Image-to-image translation with conditional adversarial networks. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Honolulu, HI, USA.10.1109/CVPR.2017.632 ↗
18. Image quality assessment through FSIM, SSIM, MSE and PSNR—A comparative study10.4236/jcc.2019.73002 ↗
19. Wang, C.Y., Bochkovskiy, A., and Liao, H.Y.M. (2023, January 17–24). YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Vancouver, BC, Canada.10.1109/CVPR52729.2023.00721 ↗
20. Tan, M., Pang, R., and Le, Q.V. (2020, January 13–19). Efficientdet: Scalable and efficient object detection. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Seattle, WA, USA.10.1109/CVPR42600.2020.01079 ↗
21. Faster R-CNN: Towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
22. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.Y., and Berg, A.C. (2016). Ssd: Single shot multibox detector. European Conference on Computer Vision, Springer International Publishing.10.1007/978-3-319-46448-0_2 ↗
23. Nandakumar, N. (2025, September 14). nishanthnandakumar/Synthetic-Data-Generation-Pipeline. Available online: https://github.com/nishanthnandakumar/Synthetic-data-Generation-Pipeline-.
24. YOLO algorithm with hybrid attention feature pyramid network for solder joint defect detection10.1109/TCPMT.2024.3409773 ↗
25. Dehaerne, E., Dey, B., Halder, S., and De Gendt, S. (March, January 26). Optimizing YOLOv7 for semiconductor defect detection. Proceedings of the Metrology, Inspection, and Process Control XXXVII, San Jose, CA, USA.
26. Turing, A.M. (2007). Computing machinery and intelligence. Parsing the Turing Test: Philosophical and Methodological Issues in the Quest for the Thinking Computer, Springer.10.1007/978-1-4020-6710-5_3 ↗
27. (2024, November 28). Ned2—Educational Desktop Robotic Arm. Available online: https://niryo.com/product/educational-desktop-robotic-arm/.
28. Tzutalin, D. (2022, November 25). HumanSignal LabelImg. Available online: https://github.com/HumanSignal/labelImg.
29. Yu, H., Chen, C., Du, X., Li, Y., Rashwan, A., Hou, L., Jin, P., Yang, F., Liu, F., and Kim, J. (2024, July 05). Tensor Flow Model Garden, Available online: https://github.com/tensorflow/models.
30. Deng, H., and Li, X. (2022, January 18–24). Anomaly detection via reverse distillation from one-class embedding. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, New Orleans, LA, USA.10.1109/CVPR52688.2022.00951 ↗
31. Akcay, S., Ameln, D., Vaidya, A., Lakshmanan, B., Ahuja, N., and Genc, U. (2022, January 16–19). Anomalib: A deep learning library for anomaly detection. Proceedings of the 2022 IEEE International Conference on Image Processing (ICIP), Bordeaux, France.10.1109/ICIP46576.2022.9897283 ↗
32. He, Y., Chen, L., Yuan, Y.J., Chen, S.Y., and Gao, L. (2024). Multi-level patch transformer for style transfer with single reference image. International Conference on Computational Visual Media, Springer Nature.10.1007/978-981-97-2092-7_11 ↗
33. Nguyen, A., Yosinski, J., and Clune, J. (2019). Understanding neural networks via feature visualization: A survey. Explainable AI: Interpreting, Explaining and Visualizing Deep Learning, Springer International Publishing.10.1007/978-3-030-28954-6_4 ↗
34. On the black-box explainability of object detection models for safe and trustworthy industrial applications10.1016/j.rineng.2024.103498 ↗