journal article·2021-10-19Open access

A Deep Convolutional Neural Network-Based Multi-Class Image Classification for Automatic Wafer Map Failure Recognition in Semiconductor Manufacturing

Huilin Zheng, Syed Waseem Abbas Sherazi, Sang Hyeok Son, Jong Yun Lee

Applied Sciences· Volume 11· Issue 20

Abstract

Wafer maps provide engineers with important information about the root causes of failures during the semiconductor manufacturing process. Through the efficient recognition of the wafer map failure pattern type, the semiconductor manufacturing process and its product performance can be improved, as well as reducing the product cost. Therefore, this paper proposes an accurate model for the automatic recognition of wafer map failure types using a deep learning-based convolutional neural network (DCNN). For this experiment, we use WM811K, which is an open-source real-time wafer map dataset containing wafer map images of nine failure classes. Our research contents can be briefly summarized as follows. First, we use random sampling to extract 500 images from each class of the original image dataset. Then we propose a deep convolutional neural network model to generate a multi-class classification model. Lastly, we evaluate the performance of the proposed prediction model and compare it with three other popular machine learning-based models—logistic regression, random forest, and gradient boosted decision trees—and several well-known deep learning models—VGGNet, ResNet, and EfficientNet. Consequently, the comprehensive analysis showed that the performance of the proposed DCNN model outperformed those of other popular machine learning and deep learning-based prediction models.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Industrial Vision Systems and Defect Detection · Integrated Circuits and Semiconductor Failure Analysis · Advancements in Photolithography Techniques

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Computer Science, Chungbuk National University, Cheongju 28644, Korea

Funding

Korea Institute for Advancement of Technology · National Research Foundation of Korea · Ministry of Science and ICT, South Korea

References (51)

Show source-provided references
1. Defect pattern recognition on wafers using convolutional neural networks10.1002/qre.2627 ↗
2. Detection of spatial defect patterns generated in semiconductor fabrication processes10.1109/TSM.2011.2154870 ↗
3. Wafer map failure pattern recognition and similarity ranking for large-scale data sets
4. Decision tree ensemble-based wafer map failure pattern recognition based on radon transform-based features10.1109/TSM.2018.2806931 ↗
5. A novel DBSCAN-based defect pattern detection and classification framework for wafer bin map10.1109/TSM.2019.2916835 ↗
6. Drozda-Freeman, A., McIntyre, M., Retersdorf, M., Wooten, C., Song, X., and Hesse, A. (2007, January 11–12). The application and use of an automated spatial pattern recognition (SPR) system in the identification and solving of yield issues in semiconductor manufacturing. Proceedings of the 2007 IEEE/SEMI Advanced Semiconductor Manufacturing Conference, Stresa, Italy.10.1109/ASMC.2007.375121 ↗
7. Fault detection using the k-nearest neighbor rule for semiconductor manufacturing processes10.1109/TSM.2007.907607 ↗
8. A voting ensemble classifier for wafer map defect patterns identification in semiconductor manufacturing10.1109/TSM.2019.2904306 ↗
9. A deep convolutional neural network for wafer defect identification on an imbalanced dataset in semiconductor manufacturing processes10.1109/TSM.2020.2994357 ↗
10. Hybrid data mining approach for pattern extraction from wafer bin map to improve yield in semiconductor manufacturing10.1016/j.ijpe.2006.05.015 ↗
11. Multi-step ART1 algorithm for recognition of defect patterns on semiconductor wafers10.1080/00207543.2011.574502 ↗
12. Deep convolutional neural networks for image classification: A comprehensive review10.1162/neco_a_00990 ↗
13. Li, Z., Liu, F., Yang, W., Peng, S., and Zhou, J. (2021). A survey of convolutional neural networks: Analysis, applications, and prospects. IEEE Trans. Neural Netw. Learn. Syst., 1–21.
14. Ullah, I., Manzo, M., Shah, M., and Madden, M. (2019). Graph Convolutional Networks: Analysis, improvements and results. arXiv.
15. Fault diagnosis in microelectronics attachment via deep learning analysis of 3-D laser scans10.1109/TIE.2019.2931220 ↗
16. A deep learning framework for simulation and defect prediction applied in microelectronics10.1016/j.simpat.2019.102063 ↗
17. Wafer map defect pattern classification and image retrieval using convolutional neural network10.1109/TSM.2018.2795466 ↗
18. Unsupervised Pre-Training of Imbalanced Data for Identification of Wafer Map Defect Patterns10.1109/ACCESS.2021.3068378 ↗
19. Logistic regression in the medical literature: Standards for use and reporting, with particular attention to one medical domain10.1016/S0895-4356(01)00372-9 ↗
20. Random forests10.1023/A:1010933404324 ↗
21. Greedy boosting approximation: A gradient boosting machine10.1214/aos/1013203451 ↗
22. Simonyan, K., and Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. arXiv.
23. He, K., Zhang, X., Ren, S., and Sun, J. (2016, January 27–30). Deep residual learning for image recognition. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA.10.1109/CVPR.2016.90 ↗
24. Tan, M., and Le, Q. (2019, January 9–15). Efficientnet: Rethinking model scaling for convolutional neural networks. Proceedings of the 36th International Conference on Machine Learning, Long Beach, CA, USA. PMLR 97.
25. Mirlab.org (2021, October 06). MIR Corpora. Available online: http://mirlab.org/dataSet/public/.
26. He, Q.P., and Wang, J. (2008, January 11–13). Principal component based k-nearest-neighbor rule for semiconductor process fault detection. Proceedings of the 2008 American Control Conference, Seattle, WA, USA.10.1109/ACC.2008.4586721 ↗
27. Wafer defect pattern recognition by multi-class support vector machines by using a novel defect cluster index10.1016/j.eswa.2009.01.003 ↗
28. Using wafer map features to better predict die-level failures in final test10.1109/TSM.2015.2443864 ↗
29. Machine learning-based novelty detection for faulty wafer detection in semiconductor manufacturing10.1016/j.eswa.2011.09.088 ↗
30. Jizat, J.A.M., Majeed, A.P.A., Nasir, A.F.A., Taha, Z., and Yuen, E. (2021). Evaluation of the machine learning classifier in wafer defects classification. ICT Express, 1–5.10.1016/j.icte.2021.04.007 ↗
31. Convolutional neural network for wafer surface defect classification and the detection of unknown defect class10.1109/TSM.2019.2902657 ↗
32. Kim, J., Kim, H., Park, J., Mo, K., and Kang, P. (2019). Bin2Vec: A better wafer bin map coloring scheme for comprehensible visualization and effective bad wafer classification. Appl. Sci., 9.10.3390/app9030597 ↗
33. Anomaly detection and segmentation for wafer defect patterns using deep convolutional encoder–decoder neural network architectures in semiconductor manufacturing10.1109/TSM.2019.2897690 ↗
34. Alawieh, M.B., Boning, D., and Pan, D.Z. (2020, January 20–24). Wafer map defect patterns classification using deep selective learning. Proceedings of the 2020 57th ACM/IEEE Design Automation Conference (DAC), San Francisco, CA, USA.10.1109/DAC18072.2020.9218580 ↗
35. Backpropagation applied to handwritten zip code recognition10.1162/neco.1989.1.4.541 ↗
36. 1D convolutional neural network for the discrimination of aristolochic acids and their analogues based on near-infrared spectroscopy10.1039/C9AY01531K ↗
37. Nair, V., and Hinton, G.E. (2010, January 21–24). Rectified linear units improve restricted boltzmann machines. Proceedings of the 27th International Conference on International Conference on Machine Learning, Haifa, Israel.
38. Activation functions in neural networks
39. He, K., Zhang, X., Ren, S., and Sun, J. (2015, January 7–13). Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. Proceedings of the IEEE international conference on computer vision, Santiago, Chile.10.1109/ICCV.2015.123 ↗
40. A weight initialization method for improving training speed in feedforward neural network10.1016/S0925-2312(99)00127-7 ↗
41. Fast image reconstruction with L2--regularization10.1002/jmri.24365 ↗
42. Albawi, S., Mohammed, T.A., and Al-Zawi, S. (2017, January 21–23). Understanding of a convolutional neural network. Proceedings of the 2017 International Conference on Engineering and Technology (ICET), Antalya, Turkey.10.1109/ICEngTechnol.2017.8308186 ↗
43. Dropout: A simple way to prevent neural networks from overfitting
44. Kingma, D.P., and Ba, J. (2014). Adam: A method for stochastic optimization. arXiv.
45. Abadi, M., Agarwal, A., Barham, P., Brevdo, E., Chen, Z., Citro, C., Corrado, G.S., Davis, A., Dean, J., and Devin, M. (2016). Tensorflow: Large-scale machine learning on heterogeneous distributed systems. arXiv.
46. Keras.io (2021, October 06). Keras Documentation. Available online: https://keras.io/.
47. Scikit-learn: Machine learning in Python
48. Jupyter.org (2021, October 06). Project Jupyter. Available online: http://jupyter.org/.
49. Van Rossum, G., and Drake, F.L. (2009). Python 3 Reference Manual, CreateSpace.
50. Fuzzy similarity measures for detection and classification of defects in CFRP10.1109/TUFFC.2013.2776 ↗
51. Bardamova, M., Konev, A., Hodashinsky, I., and Shelupanov, A. (2018). A fuzzy classifier with feature selection based on the gravitational search algorithm. Symmetry, 10.10.3390/sym10110609 ↗