Steel Surface Defect Detection Using Learnable Memory Vision Transformer
Source abstract
Abstract
This study investigates the application of Learnable Memory Vision Transformers (LMViT) for detecting metal surface flaws, comparing their performance with traditional CNNs, specifically ResNet18 and ResNet50, as well as othe... | Find, read and cite all the research you need on Tech Science Press
Source: openalex_inverted_index · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Image and Object Detection Techniques · Surface Roughness and Optical Measurements
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
References (41)
Show source-provided references
1. D. Bahdanau, K. Cho, and Y. Bengio, “Neural machine translation by jointly learning to align and translate,” 2015, arXiv:1409.0473.
2. A. Parikh, O. Tackstrom, D. Das, and J. Uszkoreit, “A decomposable attention model for natural language inference,” 2016, arXiv:1606.01933.10.18653/v1/D16-1244 ↗
3. Attention is all you need
4. J. Devlin, M. W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of deep bidirectional transformers for language understanding,” 2019, arXiv:1810.04805.
5. T. B. Brown et al., “Language models are few-shot learners,” 2020, arXiv:2005.14165.
6. Generative pretraining from pixels
7. A. Dosovitskiy et al., “An image is worth 16x16 words: Transformers for image recognition at scale,” 2020, arXiv:2010.11929.
8. M. Sandler, A. Zhmoginov, M. Vladymyrov, and A. Jackson, “Fine-tuning image transformers using learnable memory,” 2024, arXiv:2203.15243.
9. Contrastive self-supervised representation learning framework for metal surface defect detection10.1186/s40537-023-00827-z ↗
10. Surface defect detection methods for industrial products: A review
11. Advances in the surface defect machining (SDM) of hard steels10.1016/j.jmapro.2016.05.007 ↗
12. Recent advances in surface defect inspection of industrial products using deep learning techniques10.1007/s00170-021-06592-8 ↗
13. Research progress of visual inspection technology of steel products-a review10.3390/app8112195 ↗
14. Automated visual defect detection for flat steel surface: A survey10.1109/TIM.2019.2963555 ↗
15. A review on industrial surface defect detection based on deep learning technology
16. CNN-based hot-rolled steel strip surface defects classification: A comparative study between different pre-trained CNN models10.1007/s00170-024-13341-0 ↗
17. Steel plate surface defect detection based on dataset enhancement and lightweight convolution neural network
18. Review of deep learning: Concepts, CNN architectures, challenges, applications, future directions10.1186/s40537-021-00444-8 ↗
19. A comprehensive survey of convolutions in deep learning: Applications, challenges, and future trends10.1109/ACCESS.2024.3376441 ↗
20. A survey on convolutional neural networks and their performance limitations in image recognition tasks10.1155/2024/2797320 ↗
21. A survey on vision transformer10.1109/TPAMI.2022.3152247 ↗
22. CAT-EDNet: Cross-attention transformer-based encoder-decoder network for salient defect detection of strip steel surface
23. ETDNet: Efficient transformer-based detection network for surface defect detection
24. Defect transformer: An efficient hybrid transformer architecture for surface defect detection10.1016/j.measurement.2023.112614 ↗
25. Swin-MFINet: Swin transformer based multi-feature integration network for detection of pixel-level surface defects10.1016/j.eswa.2022.118269 ↗
26. Surface defect detection and classification of steel using an efficient swin transformer10.1016/j.aei.2023.102061 ↗
27. An improved vision transformer-based method for classifying surface defects in hot-rolled strip steel
28. Improved YOLOv5 based on the mobilevit backbone for the detection of steel surface defects
29. An improved yolox model for detecting strip surface defects10.1002/srin.202200505 ↗
30. Explainable artificial intelligence (XAI): Concepts, taxonomies, opportunities and challenges toward responsible AI10.1016/j.inffus.2019.12.012 ↗
31. Explainable artificial intelligence: A comprehensive review
32. Conceptualizing understanding in explainable artificial intelligence (XAI): An abilities-based approach10.1007/s10676-024-09769-3 ↗
33. Explainable artificial intelligence for automatic defect detection in additively manufactured parts using CT scan analysis
34. XAI-IDS: Toward proposing an explainable artificial intelligence framework for enhancing network intrusion detection systems10.3390/app14104170 ↗
35. Detection of manufacturing defects in steel using deep learning with explainable artificial intelligence10.1109/ACCESS.2024.3430113 ↗
36. An end-to-end steel strip surface defects recognition system based on convolutional neural networks10.1002/srin.201600068 ↗
37. Visualizing data using t-CNE
38. Principal components analysis (PCA)10.1016/0098-3004(93)90090-R ↗
39. How to use t-CNE effectively10.23915/distill.00002 ↗
40. Data visualization by nonlinear dimensionality reduction
41. Visualizing high-dimensional data: Advances in the past decade10.1109/TVCG.2016.2640960 ↗