journal article·2023-02-07Open access

Phase I Analysis of Nonlinear Profiles Using Anomaly Detection Techniques

Chuen-Sheng Cheng, Pei-Wen Chen, Yu-Tang Wu

Applied Sciences· Volume 13· Issue 4

Abstract

In various industries, the process or product quality is evaluated by a functional relationship between a dependent variable y and one or a few input variables x, expressed as y=fx. This relationship is called a profile in the literature. Recently, profile monitoring has received a lot of research attention. In this study, we formulated profile monitoring as an anomaly-detection problem and proposed an outlier-detection procedure for phase I nonlinear profile analysis. The developed procedure consists of three key processes. First, we obtained smoothed nonlinear profiles using the spline smoothing method. Second, we proposed a method for estimating the proportion of outliers in the dataset. A distance-based decision function was developed to identify potential outliers and provide a rough estimate of the contamination rate. Finally, PCA was used as a dimensionality reduction method. An outlier-detection algorithm was then employed to identify outlying profiles based on the estimated contamination rate. The algorithms considered in this study included Local Outlier Factor (LOF), Elliptic Envelope (EE), and Isolation Forest (IF). The proposed procedure was evaluated using a nonlinear profile that has been studied by various researchers. We compared various competing methods based on commonly used metrics such as type I error, type II error, and F2 score. Based on the evaluation metrics, our experimental results indicate that the performance of the proposed method is better than other existing methods. When considering the smallest and hardest-to-detect variation, the LOF algorithm, with the contamination rate determined by the method proposed in this study, achieved type I errors, type II errors, and F2 scores of 0.049, 0.001, and 0.951, respectively, while the performance metrics of the current best method were 0.081, 0.015, and 0.899, respectively.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Anomaly Detection Techniques and Applications · Advanced Statistical Process Monitoring · Fault Detection and Control Systems

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Department of Industrial Engineering and Management, Yuan Ze University, No. 135, Yuan-Tung Road, Chung-Li District, Taoyuan City 32003, Taiwan

Funding

National Science and Technology Council, Taiwan

References (57)

Show source-provided references
1. Statistical process monitoring of nonlinear profiles using wavelets10.1080/00224065.2009.11917773 ↗
2. Nonlinear profile monitoring for oven-temperature data10.1080/00224065.2016.11918153 ↗
3. Using control charts to monitor process and product quality profiles10.1080/00224065.2004.11980276 ↗
4. An overview on recent profile monitoring papers (2008–2018) based on conceptual classification scheme10.1016/j.cie.2018.10.008 ↗
5. Statistical quality control applied to ion chromatography calibrations10.1016/S0021-9673(98)00094-6 ↗
6. On-line monitoring when the process yields a linear profile10.1080/00224065.2000.11980027 ↗
7. On the monitoring of linear profiles10.1080/00224065.2003.11980225 ↗
8. A change point method for linear profile data10.1002/qre.788 ↗
9. Statistical monitoring of nonlinear product and process quality profiles10.1002/qre.858 ↗
10. Equipment fault detection using spatial signatures10.1109/3476.650961 ↗
11. Test of significance based on wavelet thresholding and Neyman’s truncation10.1080/01621459.1996.10476936 ↗
12. Automatic feature extraction of waveform signals for in-process diagnostic performance improvement10.1023/A:1011248925750 ↗
13. Wavelet-based SPC procedure for complicated functional data10.1080/00207540500222647 ↗
14. Controversies and contradictions in statistical process control10.1080/00224065.2000.11980013 ↗
15. Phase I analysis for monitoring nonlinear profiles in manufacturing processes10.1080/00224065.2006.11918610 ↗
16. A survey of outlier detection methodologies10.1023/B:AIRE.0000045502.10941.a9 ↗
17. Comparison of outliers and novelty detection to identify ionospheric TEC irregularities during geomagnetic storm and substorm10.1088/1742-6596/739/1/012015 ↗
18. Miljković, D. (2010, January 29). Review of novelty detection methods. Proceedings of the 33rd International Convention MIPRO, Opatija, Croatia.
19. Chalapathy, R., and Chawla, S. (2019). Deep learning for anomaly detection: A survey. arXiv.10.1145/3394486.3406704 ↗
20. Deep learning for anomaly detection: A review10.1145/3439950 ↗
21. A unifying review of deep and shallow anomaly detection10.1109/JPROC.2021.3052449 ↗
22. A comprehensive survey of anomaly detection techniques for high dimensional big data10.1186/s40537-020-00320-x ↗
23. Ebadi, M., Chenouri, S., and Steiner, S.H. (2021). Phase I analysis of high-dimensional multivariate processes in the presence of outliers. arXiv.
24. A review on outlier/anomaly detection in time series data
25. Anomaly detection: A survey10.1145/1541880.1541882 ↗
26. A review of novelty detection10.1016/j.sigpro.2013.12.026 ↗
27. Al-amri, R., Murugesan, R.K., Man, M., Abdulateef, A.F., Al-Sharafi, M.A., and Alkahtani, A.A. (2021). A review of machine learning and deep learning techniques for anomaly detection in IoT data. Appl. Sci., 11.10.3390/app11125320 ↗
28. Deep learning for anomaly detection in time-series data: Review, analysis, and guidelines10.1109/ACCESS.2021.3107975 ↗
29. McLachlan, G., and Peel, D. (2000). Finite Mixture Models, John Wiley & Sons, Ltd.10.1002/0471721182 ↗
30. Effect of Phase I estimation on Phase II control chart performance with profile data10.1002/qre.1727 ↗
31. Cluster-based profile analysis in phase I10.1080/00224065.2015.11918103 ↗
32. Robust cluster-based method for monitoring generalized linear profiles in phase I
33. Phase I non-linear profiles monitoring using a modified Hausdorff distance algorithm and clustering analysis10.1108/IJQRM-01-2020-0001 ↗
34. Unsupervised deep multitask anomaly detection with robust alarm strategy for online evaluation of bearing early fault occurrence10.1109/TIM.2022.3200092 ↗
35. RADIS: A real-time anomaly detection intelligent system for fault diagnosis of marine machinery10.1016/j.eswa.2022.117634 ↗
36. From anomaly detection to novel fault discrimination for wind turbine gearboxes with a sparse isolation encoding forest10.1109/TIM.2022.3187737 ↗
37. Ramp loss one-class support vector machine; a robust and effective approach to anomaly detection problems10.1016/j.neucom.2018.05.027 ↗
38. Ensembles of one class support vector machines10.1007/978-3-642-02326-2_19 ↗
39. Supervised outlier detection for classification and regression10.1016/j.neucom.2022.02.047 ↗
40. Roig, M., Catalan, M., and Gastón, B. (2019, January 2–4). Ensembled outlier detection using multi-variable correlation in WSN through unsupervised learning techniques. Proceedings of the 4th International Conference on Internet of Things, Big Data and Security (IoTBDS), Heraklion, Crete, Greece.10.5220/0007657400380048 ↗
41. Cheng, Z., Zou, C., and Dong, J. (2019, January 24–27). Outlier detection using isolation forest and local outlier factor. Proceedings of the International Conference on Research in Adaptive and Convergent Systems, Chongqing, China.10.1145/3338840.3355641 ↗
42. Dentamaro, V., Convertini, V.N., Galantucci, S., Giglio, P., Palmisano, T., and Pirlo, G. (2021, January 7–9). Ensemble consensus: An unsupervised algorithm for anomaly detection in network security data. Proceedings of the Italian Conference on Cybersecurity (ITASEC), Virtual.
43. Estimating the Support of a High-Dimensional Distribution10.1162/089976601750264965 ↗
44. Support vector data description10.1023/B:MACH.0000008084.60811.49 ↗
45. Ruff, L., Vandermeulen, R.A., Görnitz, N., Deecke, L., Siddiqui, S.A., Binder, A., Müller, E., and Kloft, M. (2018, January 10–15). Deep One-Class Classification. Proceedings of the 35th International Conference on Machine Learning, Stockholm, Sweden.
46. Breunig, M.M., Kriegel, H.P., Ng, R.T., and Sander, J. (2000, January 15–18). LOF: Identifying density-based local outliers. Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data, Dallas, TX, USA.10.1145/342009.335388 ↗
47. Scikit-learn: Machine Learning in Python
48. Xu, Z., Kakde, D., and Chaudhuri, A. (2019, January 9–12). Automatic hyperparameter tuning method for local outlier factor. Proceedings of the 2019 IEEE International Conference on Big Data, Los Angeles, CA, USA.10.1109/BigData47090.2019.9006151 ↗
49. Least median of squares regression10.1080/01621459.1984.10477105 ↗
50. A fast algorithm for the minimum covariance determinant estimator10.1080/00401706.1999.10485670 ↗
51. SciPy 1.0: Fundamental algorithms for scientific computing in Python10.1038/s41592-019-0686-2 ↗
52. High-dimensional process monitoring and fault isolation via variable selection10.1080/00224065.2009.11917780 ↗
53. Multivariate statistical process control using LASSO10.1198/jasa.2009.tm08128 ↗
54. Detecting outliers in complex profiles using a χ2 control chart method10.1080/07408170802323000 ↗
55. Outlier detection in general profiles using penalized regression method10.1080/0740817X.2012.762486 ↗
56. Taha, A.A., and Hanbury, A. (2015). Metrics for evaluating 3D medical image segmentation: Analysis, selection, and tool. BMC Med. Imaging, 15.10.1186/s12880-015-0068-x ↗
57. Classification assessment methods10.1016/j.aci.2018.08.003 ↗