StyleGAN3-driven instance-aware dynamic fusion augmentation with lightweight YOLO-MD for defect detection on microstructured surfaces
Source abstract
Abstract
Microstructured surfaces are critical in modern manufacturing, yet online defect detection still faces challenges such as limited samples, redundant networks, data imbalance, and complex backgrounds. To address this, this study proposes a StyleGAN3-based Instance-Aware Dynamic Fusion Augmentation (SIDFA) method and a lightweight YOLO-MD model. SIDFA can extract defect features from small, multidimensionally imbalanced datasets and adaptively fuse them into real image backgrounds. YOLO-MD reduces model complexity through L1 regularization and structured pruning, while knowledge distillation is employed to maintain detection performance. On the self-built Microstructure Injection-molded Defect Dataset (MIDD), YOLO-MD (SIDFA) achieves an mAP@0.5 of 82.541% with only 1.813 M parameters. Compared with YOLO26n (SIDFA) trained on the same augmented dataset, YOLO-MD (SIDFA) slightly improves detection accuracy while reducing the number of parameters by 23.66% and increasing the frame rate (FPS) by 11.58%. Compared with the non-augmented YOLO26n, mAP@0.5 is improved by 10.882%. Under the same conditions, YOLO-MD (SIDFA) achieves a better balance between detection accuracy and model complexity than mainstream models such as YOLOv8s (79.265%, 11.127 M) and YOLOv10n (79.162%, 2.266 M). These results indicate that the proposed method has potential for real-time industrial deployment and automated quality inspection of microstructured surfaces. The MIDD dataset are publicly available at: https://github.com/EZ4JJ/MIDD-YOLO-MD .
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Advanced Sensor and Energy Harvesting Materials · Machine Learning in Materials Science · Ultrasonics and Acoustic Wave Propagation
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (61)
Show source-provided references
1. In situ 3D nanoprinting of free-form coupling elements for hybrid photonic integration10.1038/s41566-018-0133-4 ↗
2. Two-photon direct laser writing of ultracompact multi-lens objectives10.1038/nphoton.2016.121 ↗
3. Adding chemically selective subtraction to multi-material 3D additive manufacturing10.1038/s41467-018-05234-0 ↗
4. A fast and low-power microelectromechanical system-based non-volatile memory device10.1038/ncomms1227 ↗
5. A flexoelectric microelectromechanical system on silicon10.1038/nnano.2015.260 ↗
6. Electrostrictive microelectromechanical fibres and textiles10.1038/s41467-017-01558-5 ↗
7. Simple fabrication of highly sensitive capacitive pressure sensors using a porous dielectric layer with cone-shaped patterns10.1016/j.matdes.2020.109203 ↗
8. Fabrication of square-centimeter plasmonic nanoantenna arrays by femtosecond direct laser writing lithography: effects of collective excitations on SEIRA enhancement10.1021/acsphotonics.5b00141 ↗
9. Versatile direct laser writing lithography technique for surface enhanced infrared spectroscopy sensors10.1021/acssensors.6b00469 ↗
10. A micro/nano-biomimetic coating on titanium orchestrates osteo/angio-genesis and osteoimmunomodulation for advanced osseointegration10.1016/j.biomaterials.2021.121162 ↗
11. Drug delivery and cytocompatibility of ciprofloxacin loaded gelatin nanofibers-coated Mg alloy10.1016/j.matlet.2017.07.072 ↗
12. Tailoring micro/nano-fibers for biomedical applications
13. A cost-effective process chain for thermoplastic microneedle manufacture combining laser micro-machining and micro-injection moulding10.1016/j.cirpj.2021.01.015 ↗
14. In-process monitoring of electrohydrodynamic inkjet printing using machine vision
15. Three-dimensional characterisation of deformation-induced damage in dual phase steel using deep learning10.1016/j.matdes.2023.112108 ↗
16. A systematic review of deep learning for silicon wafer defect recognition10.1109/ACCESS.2021.3106171 ↗
17. Autonomous nanorobots with powerful thrust under dry solid-contact conditions by photothermal shock10.1038/s41467-023-43433-6 ↗
18. Autonomous vision-guided two-arm collaborative microassembly using learned manipulation model10.1109/LRA.2024.3355635 ↗
19. R. Sapkota, R.H. Cheppally, A. Sharda, M. Karkee, YOLO26: Key architectural enhancements and performance benchmarking for real-time object detection, (2025) 1–15. arXiv:2509.25164. https://doi.org/10.48550/arXiv.2509.25164.
20. Distinctive image features from scale-invariant keypoints10.1023/B:VISI.0000029664.99615.94 ↗
21. Histograms of oriented gradients for human detection
22. Wafer map defect pattern classification and image retrieval using convolutional neural network10.1109/TSM.2018.2795466 ↗
23. A novel method based on deep convolutional neural networks for wafer semiconductor surface defect inspection10.1109/TIM.2020.3007292 ↗
24. A light-weighted CNN model for wafer structural defect detection10.1109/ACCESS.2020.2970461 ↗
25. Deformable convolutional networks for efficient mixed-type wafer defect pattern recognition10.1109/TSM.2020.3020985 ↗
26. Convolutional neural network for wafer surface defect classification and the detection of unknown defect class10.1109/TSM.2019.2902657 ↗
27. You only look once: unified, real-time object detection
28. J. Redmon, A. Farhadi, YOLOv3: An Incremental Improvement, (2018). http://arxiv.org/abs/1804.02767.
29. YOLO9000: Better, faster, stronger
30. A. Bochkovskiy, C.-Y. Wang, H.-Y.M. Liao, YOLOv4: Optimal Speed and Accuracy of Object Detection, (2020). http://arxiv.org/abs/2004.10934.
31. Liu · 2016 · 21
32. Rich feature hierarchies for accurate object detection and semantic segmentation
33. Real-time damage detection in dams using remotely operated vehicle equipped with sonar and you only look once network10.1016/j.aei.2025.103957 ↗
34. Improved YOLOv8-GD deep learning model for defect detection in electroluminescence images of solar photovoltaic modules10.1016/j.engappai.2024.107866 ↗
35. Revisiting unreasonable effectiveness of data in deep learning era
36. TAS2-net: triple-attention semantic segmentation network for small surface defect detection
37. Surface defect detection of strip steel based on GT-CutMix augmentation algorithm and improved DSSD model10.1088/1361-6501/ad5b7c ↗
38. An imbalanced small sample slab defect recognition method based on image generation10.1016/j.jmapro.2024.03.028 ↗
39. Research on rapid detection of cross-scale defects in surface based on deep learning10.1016/j.jmapro.2023.12.033 ↗
40. Path aggregation network for instance segmentation
41. Fast R-CNN
42. Overfeat: Integrated recognition, localization and detection using convolutional networks
43. Alias-free generative adversarial networks
44. Automatic detection and characterization of porosities in cross-section images of metal parts produced by binder jetting using machine learning and image augmentation10.1007/s10845-023-02100-9 ↗
45. Multispectral satellite image generation using StyleGAN310.1109/JSTARS.2024.3356618 ↗
46. GANs trained by a two time-scale update rule converge to a local nash equilibrium
47. Learning both weights and connections for efficient neural networks
48. Learning efficient CNN through network slimming
49. A noise robust method based on completed local binary patterns for hot-rolled steel strip surface defects10.1016/j.apsusc.2013.09.002 ↗
50. Unsupervised representation learning with deep convolutional generative adversarial networks
51. A. Jolicoeur-Martineau, The relativistic discriminator: a key element missing from standard GAN, arXiv:1807.00734, 2018.
52. Improved training of wasserstein GANs
53. Visualizing data using t-SNE
54. The unreasonable effectiveness of deep features as a perceptual metric
55. D. Picard, Torch.manual_seed(3407) is all you need: On the influence of random seeds in deep learning architectures for computer vision, (2023) 1–9. http://arxiv.org/abs/2109.08203.
56. Faster R-CNN: towards real-time object detection with region proposal networks10.1109/TPAMI.2016.2577031 ↗
57. G. Jocher, Ultralytics YOLOv5, Version 7.0, (2020). https://github.com/ultralytics/yolov5. https://doi.org/10.5281/zenodo.3908559.
58. G. Jocher, A. Chaurasia, J. Qiu, Ultralytics YOLO, Version 8.0.0, (2023). https://github.com/ultralytics/ultralytics.
59. DETRs beat YOLOs on Real-time object detection
60. A. Wang, H. Chen, L. Liu, K. Chen, Z. Lin, J. Han, G. Ding, YOLOv10 : Real-time end-to-end object detection, (2024) 1–28.10.52202/079017-3429 ↗
61. Searching for MobileNetV3