journal article·2025-10-20Open access

Comparison of Machine Learning Models in Nonlinear and Stochastic Signal Classification

Elzbieta Olejarczyk, Carlo Massaroni

Applied Sciences· Volume 15· Issue 20

Abstract

This study aims to compare different classifiers in the context of distinguishing two classes of signals: nonlinear electrocardiography (ECG) signals and stochastic artifacts occurring in ECG signals. The ECG signals from a single-lead wearable Movesense device were analyzed with a set of eight features: variance (VAR), three fractal dimension measures (Higuchi fractal dimension (HFD), Katz fractal dimension (KFD), and Detrended Fluctuation Analysis (DFA)), and four entropy measures (approximate entropy (ApEn), sample entropy (SampEn), and multiscale entropy (MSE) for scales 1 and 2). The minimum-redundancy maximum-relevance algorithm was applied for evaluation of feature importance. A broad spectrum of machine learning models was considered for classification. The proposed approach allowed for comparison of classifier features, as well as providing a broader insight into the characteristics of the signals themselves. The most important features for classification were VAR, DFA, ApEn, and HFD. The best performance among 34 classifiers was obtained using an optimized RUSBoosted Trees ensemble classifier (sensitivity, specificity, and positive and negative predictive values were 99.8, 73.7%, 99.8, and 74.3, respectively). The accuracy of the Movesense device was very high (99.6%). Moreover, the multifractality of ECG during sleep was observed in the relationship between SampEn (or ApEn) and MSE.
Source: crossref · Quality: baseline

Research context

OpenAlex topics: Fault Detection and Control Systems · Neural Networks and Applications · Control Systems and Identification

SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.

Affiliations

Nalecz Institute of Biocybernetics and Biomedical Engineering, Polish Academy of Sciences, 02-109 Warsaw, Poland

Faculty of Electrical Engineering, Automatics, Computer Science, and Biomedical Engineering, AGH University of Krakow, 30-059 Krakow, Poland

Departmental Faculty of Engineering, Università Campus Bio-Medico di Roma, 00128 Rome, Italy

Fondazione Policlinico Universitario Campus Bio-Medico di Roma, 00128 Rome, Italy

Funding

European Health and Digital Executive Agency

References (42)

Show source-provided references
1. Clifford, G.D., Azuaje, F., and McSharry, P.E. (2006). Advanced Methods for ECG Analysis, Artech House.
2. Review of noise removal techniques in ECG signals10.1049/iet-spr.2020.0104 ↗
3. Van der Bijl, K., Elgendi, M., and Menon, C. (2022). Automatic ECG Quality Assessment Techniques: A Systematic Review. Diagnostics, 12.10.3390/diagnostics12112578 ↗
4. Nonlinear filtering in ECG Signal Enhancement
5. A Novel ECG Denoising Scheme Using the Ensemble Kalman Filter
6. Robust heartbeat detection using multimodal recordings and ECG quality assessment with signal amplitudes dispersion10.1016/j.cmpb.2018.06.009 ↗
7. Zhao, Z., and Zhang, Y. (2018). SQI Quality Evaluation Mechanism of Single-Lead ECG Signal Based on Simple Heuristic Fusion and Fuzzy Comprehensive Evaluation. Front. Physiol., 9.10.3389/fphys.2018.00727 ↗
8. The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis10.1098/rspa.1998.0193 ↗
9. A study of the characteristics of white noise using the empirical mode decomposition method10.1098/rspa.2003.1221 ↗
10. Arrhythmia ECG noise reduction by ensemble empirical mode decomposition10.3390/s100606063 ↗
11. Xu, X., Liang, Y., He, P., and Yang, J. (2019). Adaptive Motion Artifact Reduction Based on Empirical Wavelet Transform and Wavelet Thresholding for the Non-Contact ECG Monitoring Systems. Sensors, 19.10.3390/s19132916 ↗
12. Empirical Wavelet Transform Based ECG Signal Filtering Method
13. Sharanya, S., and Arjunan, P.D. (2023). Fractal Dimension Techniques for Analysis of Cardiac Autonomic Neuropathy. Biomed. Eng. Appl. Basis Commun., 35.10.4015/S1016237223500035 ↗
14. Wang, G., Yao, D., Gu, Z., Peng, Y., Tong, S., and Liu, C. (2023, January 18–21). Fast Sample Entropy Atrial Fibrillation Analysis Towards Wearable Device. Proceedings of the 12th Asian-Pacific Conference on Medical and Biological Engineering. APCMBE 2023, Suzhou, China. IFMBE Proceedings.
15. Olejarczyk, E., Raus-Jarzabek, E., and Massaroni, C. (2024, January 29–31). Automatic identification of movement and muscle artifacts in ECG based on statistical and nonlinear measures. Proceedings of the 2024 IEEE International Workshop on Metrology for Industry 4.0 & IoT, Florence, Italy.10.1109/MetroInd4.0IoT61288.2024.10584239 ↗
16. Alghieth, M. (2025). DeepECG-Net: A hybrid transformer-based deep learning model for real-time ECG anomaly detection. Sci. Rep., 15.10.1038/s41598-025-07781-1 ↗
17. A Low-Cost Implementation of Sample Entropy in Wearable Embedded Systems: An Example of Online Analysis for Sleep EEG
18. Gomolka, R.S., Kampusch, S., Kaniusas, E., Thurk, F., Szeles, J.C., and Klonowski, W. (2018). Higuchi Fractal Dimension of Heart Rate Variability During Percutaneous Auricular Vagus Nerve Stimulation in Healthy and Diabetic Subjects. Front. Physiol., 9.10.3389/fphys.2018.01162 ↗
19. Sample Entropy in Electrocardiogram During Atrial Fibrillation10.33160/yam.2018.03.007 ↗
20. Zhao, L., Liu, C., Wei, S., Shen, Q., Zhou, F., and Li, J. (2018). A New Entropy-Based Atrial Fibrillation Detection Method for Scanning Wearable ECG Recordings. Entropy, 20.10.3390/e20120904 ↗
21. Sample Entropy Analysis of heart rate variability in RR interval detection10.21923/jesd.745275 ↗
22. Abdelrazik, A., Eldesouky, M., Antoun, I., Lau, E.Y.M., Koya, A., Vali, Z., Suleman, S.A., Donaldson, J., and Ng, G.A. (2025). Wearable Devices for Arrhythmia Detection: Advancements and Clinical Implications. Sensors, 25.10.3390/s25092848 ↗
23. Ribeiro, P., Sa, J., Paiva, D., and Rodrigues, P.M. (2024). Cardiovascular Diseases Diagnosis Using an ECG Multi-Band Non-Linear Machine Learning Framework Analysis. Bioengineering, 11.10.3390/bioengineering11010058 ↗
24. Noitz, M., Mortl, C., Bock, C., Mahringer, C., Bodenhofer, U., Dunser, M.W., and Meier, J. (2024). Detection of Subtle ECG Changes Despite Superimposed Artifacts by Different Machine Learning Algorithms. Algorithms, 17.10.3390/a17080360 ↗
25. Comparing the Performance of Random Forest, SVM and Their Variants for ECG Quality Assessment Combined with Nonlinear Features10.1007/s40846-018-0411-0 ↗
26. Comparison of Machine Learning Algorithms for the Quality Assessment of Wearable ECG Signals Via Lenovo H3 Devices10.1007/s40846-020-00588-7 ↗
27. An Optimal Methodology for Early Prediction of Sudden Cardiac Death Using Advanced Heart Rate Variability Features of ECG Signal10.1007/s13369-023-08457-6 ↗
28. An open-source software for non-invasive heart rate variability assessment10.1111/2041-210X.13393 ↗
29. El-Yaagoubi, M., Goya-Esteban, R., Jabrane, Y., Munoz-Romero, S., Garcia-Alberola, A., and Rojo-Alvarez, J.L. (2019). On the Robustness of Multiscale Indices for Long-Term Monitoring in Cardiac Signals. Entropy, 21.10.3390/e21060594 ↗
30. The sensitivity of 38 heart rate variability measures to the addition of artifact in human and artificial 24-hr cardiac recordings10.1111/anec.12483 ↗
31. Heart rate variability during exercise: A comparison of artefact correction methods10.1519/JSC.0000000000001800 ↗
32. Ernst, G. (2017). Hidden Signals-The History and Methods of Heart Rate Variability. Front. Public Health, 5.10.3389/fpubh.2017.00265 ↗
33. Massaroni, C., Olejarczyk, E., Lo Presti, D., Schena, E., Nusca, A., Ussia, G.P., and Silvestri, S. (2024, January 29–31). Indirect Respiratory Monitoring via Single-Lead Wearable ECG: Influence of Motion Artifacts and Devices on Respiratory Rate Estimations. Proceedings of the 2024 IEEE International Workshop on Metrology for Industry 4.0 & IoT, Florence, Italy.10.1109/MetroInd4.0IoT61288.2024.10584200 ↗
34. Approach to an irregular time series on the basis of the fractal theory10.1016/0167-2789(88)90081-4 ↗
35. Fractals and the analysis of waveforms10.1016/0010-4825(88)90041-8 ↗
36. Fractal mechanisms and heart rate dynamics: Long-range correlations and their breakdown with disease10.1016/S0022-0736(95)80017-4 ↗
37. Approximate entropy as a measure of system complexity10.1073/pnas.88.6.2297 ↗
38. Physiological time-series analysis using approximate entropy and sample entropy10.1152/ajpheart.2000.278.6.H2039 ↗
39. Multiscale entropy analysis of complex physiologic time series10.1103/PhysRevLett.89.068102 ↗
40. Minimum redundancy feature selection from microarray gene expression data10.1142/S0219720005001004 ↗
41. Chen, X., Zheng, S., Peng, L., Zhong, Q., and He, L. (2023). A novel method based on shifted rank-1 reconstruction for removing EMG artifacts in ECG signals. Biomed. Signal Process. Control, 85.10.1016/j.bspc.2023.104967 ↗
42. Multiscale entropy analysis of biological signals10.1103/PhysRevE.71.021906 ↗