Pruning Quantized Unsupervised Meta-Learning DegradingNet Solution for Industrial Equipment and Semiconductor Process Anomaly Detection and Prediction
Source abstract
Abstract
Machine- and deep-learning methods are used for industrial applications in prognostics and health management (PHM) for semiconductor processing and equipment anomaly detection to achieve proactive equipment maintenance and prevent process interruptions or equipment downtime. This study proposes a Pruning Quantized Unsupervised Meta-learning DegradingNet Solution (PQUM-DNS) for the fast training and retraining of new equipment or processes with limited data for anomaly detection and the prediction of various equipment and process conditions. This study utilizes real data from a factory chiller host motor, the Paderborn current and vibration open dataset, and the SECOM semiconductor open dataset to conduct experimental simulations, calculate the average value, and obtain the results. Compared to conventional deep autoencoders, PQUM-DNS reduces the average data volume required for rapid training and retraining by about 75% with similar AUC. The average RMSE of the predictive degradation degree is 0.037 for Holt–Winters, and the model size is reduced by about 60% through pruning and quantization which can be realized by edge devices, such as Raspberry Pi. This makes the proposed PQUM-DNS very suitable for intelligent equipment management and maintenance in industrial applications.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: Industrial Vision Systems and Defect Detection · Fault Detection and Control Systems · Advanced Statistical Process Monitoring
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
College of Electrical and Computer Engineering, National Yang Ming Chiao Tung University, Hsinchu City 300, Taiwan
Advance Tech Co., Taipei City 114, Taiwan
Department of Electronics Engineering, National Yang Ming Chiao Tung University, Hsinchu City 300, Taiwan
References (40)
Show source-provided references
1. Tung, F., and Mori, G. (2018, January 18–22). Clip-q: Deep network compression learning by in-parallel pruning-quantization. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00821 ↗
2. Optimal brain compression: A framework for accurate post-training quantization and pruning
3. Opq: Compressing deep neural networks with one-shot pruning-quantization
4. Meta-learning in neural networks: A survey
5. Givnan, S., Chalmers, C., Fergus, P., Ortega-Martorell, S., and Whalley, T. (2022). Anomaly detection using autoencoder reconstruction upon industrial motors. Sensors, 22.10.3390/s22093166 ↗
6. The use of the area under the ROC curve in the evaluation of machine learning algorithms10.1016/S0031-3203(96)00142-2 ↗
7. Forecasting seasonals and trends by exponentially weighted moving averages10.1016/j.ijforecast.2003.09.015 ↗
8. A feature-level degradation measurement method for composite health index construction and trend prediction modeling10.1016/j.measurement.2022.112324 ↗
9. Joint modeling of degradation and failure time data10.1016/j.jspi.2008.05.027 ↗
10. Bellavista, P., Della Penna, R., Foschini, L., and Scotece, D. (2020, January 7–11). Machine learning for predictive diagnostics at the edge: An IIoT practical example. Proceedings of the ICC 2020–2020 IEEE International Conference on Communications (ICC), Dublin, Ireland.10.1109/ICC40277.2020.9148684 ↗
11. A comprehensive survey on design and application of autoencoder in deep learning10.1016/j.asoc.2023.110176 ↗
12. Automated surface defect detection framework using machine vision and convolutional neural networks10.1007/s10845-021-01878-w ↗
13. Industrial anomaly detection with multiscale autoencoder and deep feature extractor-based neural network10.1049/ipr2.12752 ↗
14. Pradeep, D., Vardhan, B.V., Raiak, S., Muniraj, I., Elumalai, K., and Chinnadurai, S. (2023, January 19–20). Optimal Predictive Maintenance Technique for Manufacturing Semiconductors using Machine Learning. Proceedings of the 2023 3rd International Conference on Intelligent Communication and Computational Techniques (ICCT), Jaipur, India.10.1109/ICCT56969.2023.10075658 ↗
15. Machine learning-based techniques for fault diagnosis in the semiconductor manufacturing process: A comparative study10.1007/s11227-022-04730-x ↗
16. A new deep auto-encoder method with fusing discriminant information for bearing fault diagnosis10.1016/j.ymssp.2020.107233 ↗
17. Abbasi, S., Famouri, M., Shafiee, M.J., and Wong, A. (2021). OutlierNets: Highly compact deep autoencoder network architectures for on-device acoustic anomaly detection. Sensors, 21.10.3390/s21144805 ↗
18. Yazici, M.T., Basurra, S., and Gaber, M.M. (2018). Edge machine learning: Enabling smart internet of things applications. Big Data Cogn. Comput., 2.10.3390/bdcc2030026 ↗
19. Yu, Y.-C., Chuang, S.-W., Shuai, H.-H., and Lee, C.-Y. (2022, January 1–3). Fast Adaption for Multi Motor Anomaly Detection via Meta Learning and deep unsupervised learning. Proceedings of the 2022 IEEE 31st International Symposium on Industrial Electronics (ISIE), Anchorage, AK, USA.10.1109/ISIE51582.2022.9831559 ↗
20. Advantech (2023, June 01). WISE-2410—LoRaWAN Wireless Vibration Sensor—Advantech. Available online: https://www.advantech.com/en/products/b7e2306f-d561-4ca9-b0e3-33f7057e185f/wise-2410/mod_25018dc7-355c-40b4-bf9b-c93f6c73f1a0.
21. Advantech (2023, June 01). WebAccess_MCM_DS(07.18.17)—Advantech Support—Advantech. Available online: https://www.advantech.com/en/support/details/datasheet?id=b5660e1c-d223-40ed-86bd-bdab7be541d7.
22. Design of Smart Device for Induction Motor Condition Monitoring10.1088/1742-6596/1845/1/012035 ↗
23. Lessmeier, C., Kimotho, J.K., Zimmer, D., and Sextro, W. (2016, January 5–8). Condition monitoring of bearing damage in electromechanical drive systems by using motor current signals of electric motors: A benchmark data set for data-driven classification. Proceedings of the European Conference of the PHM Society, Bilbao, Spain.10.36001/phme.2016.v3i1.1577 ↗
24. Fault analysis and diagnosis system for induction motors10.1016/j.compeleceng.2016.01.028 ↗
25. Salem, M., Taheri, S., and Yuan, J.S. (2018). An experimental evaluation of fault diagnosis from imbalanced and incomplete data for smart semiconductor manufacturing. Big Data Cogn. Comput., 2.10.3390/bdcc2040030 ↗
26. The random subspace method for constructing decision forests10.1109/34.709601 ↗
27. Ho, T.K. (1995, January 14–16). Random decision forests. Proceedings of the 3rd International Conference on Document Analysis and Recognition, Montreal, QC, Canada.
28. Dua, D., and Graff, C. (2019). UCI Machine Learning Repository, University of California, School of Information and Computer Science. Available online: https://archive.ics.uci.edu/ml/datasets.php.
29. Using AUC and accuracy in evaluating learning algorithms10.1109/TKDE.2005.50 ↗
30. (2024, February 12). Type I Error and Type II Error. Available online: https://explorable.com/type-i-error.
31. ICML (2023, June 01). ICML 2019 Meta-Learning Tutorial. Available online: https://sites.google.com/view/icml19metalearning.
32. Finn, C., Abbeel, P., and Levine, S. (2017, January 6–11). Model-agnostic meta-learning for fast adaptation of deep networks. Proceedings of the International Conference on Machine Learning, Sydney, Australia.
33. Exponential smoothing: The state of the art10.1002/for.3980040103 ↗
34. Forecasting using simple exponential smoothing method
35. Experimental designs for autoregressive models applied to industrial maintenance10.1016/j.ress.2014.09.003 ↗
36. Zhao, Z., and Liu, F. (2004, January 2–6). Industrial monitoring based on moving average PCA and neural network. Proceedings of the 30th Annual Conference of IEEE Industrial Electronics Society, IECON 2004, Busan, Republic of Korea.
37. Box, G.E., Jenkins, G.M., Reinsel, G.C., and Ljung, G.M. (2015). Time Sries Analysis: Forecasting and Control, John Wiley & Sons.
38. Combining seasonal time series ARIMA method and neural networks with genetic algorithms for predicting the production value of the mechanical industry in Taiwan10.1007/s00521-008-0216-0 ↗
39. Han, S., Pool, J., Tran, J., and Dally, W. (2015). Learning both weights and connections for efficient neural network. Adv. Neural Inf. Process. Syst., 28.
40. Jacob, B., Kligys, S., Chen, B., Zhu, M., Tang, M., Howard, A., Adam, H., and Kalenichenko, D. (2018, January 18–22). Quantization and training of neural networks for efficient integer-arithmetic-only inference. Proceedings of the IEEE Conference on Computer Cision and Pattern Recognition, Salt Lake City, UT, USA.10.1109/CVPR.2018.00286 ↗