Towards Reliable ECG Analysis: Addressing Validation Gaps in the Electrocardiographic R-Peak Detection
Source abstract
Abstract
Electrocardiographic (ECG) R-peak detection is essential for every sensor-based cardiovascular health monitoring system. To validate R-peak detectors, comparing the predicted results with reference annotations is crucial. This comparison is typically performed using tools provided by the waveform database (WFDB) or custom methods. However, many studies fail to provide detailed information on the validation process. The literature also highlights inconsistencies in reporting window size, a crucial parameter used to compare predictions with expert annotations to distinguish false peaks from the true R-peak. Additionally, there is also a need for uniformity in reporting the total number of beats for individual or collective records of the widely used MIT-BIH arrhythmia database. Thus, we aim to review validation methods of various R-peak detection methodologies before their implementation in real time. This review discusses the impact of non-beat annotations when using a custom validation method, allowable window tolerance, the effects of window size deviations, and implications of varying numbers of beats and skipping segments on ECG testing, providing a comprehensive guide for researchers. Addressing these validation gaps is critical as they can significantly affect validatory outcomes. Finally, the conclusion section proposes a structured concept as a future approach, a guide to integrate WFDB R-peak validation tools for testing any QRS annotated ECG database. Overall, this review underscores the importance of complete transparency in reporting testing procedures, which prevents misleading assessments of R-peak detection algorithms and enables fair methodological comparison.
Source: crossref · Quality: baseline
Research context
OpenAlex topics: ECG Monitoring and Analysis
SciVX discovery tags are terminology-based. OpenAlex topics are source-provided classifications.
Affiliations
Department of Electronic Engineering, Gachon University, Seongnam 13120, Republic of Korea
Department of Semiconductor Engineering, Gachon University, Seongnam 13120, Republic of Korea
Funding
Gachon University
References (95)
Show source-provided references
1. Prevalence and prevention of cardiovascular disease and diabetes mellitus10.1016/j.phrs.2016.09.040 ↗
2. Early Diagnosis of Cardiovascular Diseases in the Era of Artificial Intelligence: An In-Depth Review
3. Pereira, T.M., Conceição, R.C., Sencadas, V., and Sebastião, R. (2023). Biometric recognition: A systematic review on electrocardiogram data acquisition methods. Sensors, 23.10.3390/s23031507 ↗
4. The impact of the MIT-BIH Arrhythmia Database10.1109/51.932724 ↗
5. Laguna, P., Mark, R.G., Goldberg, A., and Moody, G.B. (1997, January 7–10). A database for evaluation of algorithms for measurement of QT and other waveform intervals in the ECG. Proceedings of the Computers in Cardiology 1997, Lund, Sweden.
6. PTB-XL, a large publicly available electrocardiography dataset10.1038/s41597-020-0495-6 ↗
7. PhysioBank, PhysioToolkit, and PhysioNet: Components of a new research resource for complex physiologic signals10.1161/01.CIR.101.23.e215 ↗
8. A noise stress test for arrhythmia detectors
9. The European ST-T database: Standard for evaluating systems for the analysis of ST-T changes in ambulatory electrocardiography10.1093/oxfordjournals.eurheartj.a060332 ↗
10. Abrupt changes in fibrillatory wave characteristics at the termination of paroxysmal atrial fibrillation in humans10.1093/europace/eum096 ↗
11. Alfaras, M., Soriano, M.C., and Ortín, S. (2019). A fast machine learning model for ECG-based heartbeat classification and arrhythmia detection. Front. Phys., 7.10.3389/fphy.2019.00103 ↗
12. Three-heartbeat multilead ECG recognition method for arrhythmia classification10.1109/ACCESS.2022.3169893 ↗
13. Gacek, A., and Pedrycz, W. (2011). ECG Signal Processing, Classification and Interpretation: A Comprehensive Framework of Computational Intelligence, Springer. [2011th ed.].10.1007/978-0-85729-868-3 ↗
14. A robust QRS detection and accurate R-peak identification algorithm for wearable ECG sensors10.1007/s11432-020-3150-2 ↗
15. Exploratory data analysis based efficient QRS-complex detection technique with minimal computational load10.1007/s13246-020-00906-y ↗
16. Novel method to efficiently create an mHealth app: Implementation of a real-time electrocardiogram R peak detector10.2196/mhealth.8429 ↗
17. Methodological shortcomings of wrist-worn heart rate monitors validations10.2196/10108 ↗
18. An IOT framework for detecting cardiac arrhythmias in real-time using deep learning resnet model10.1016/j.measen.2023.100866 ↗
19. A novel method for the detection of R-peaks in ECG based on K-Nearest Neighbors and Particle Swarm Optimization10.1186/s13634-017-0519-3 ↗
20. Ansari, Y., Mourad, O., Qaraqe, K., and Serpedin, E. (2023). Deep learning for ECG Arrhythmia detection and classification: An overview of progress for period 2017–2023. Front. Physiol., 14.10.3389/fphys.2023.1246746 ↗
21. Duan, J., Wang, Q., Zhang, B., Liu, C., Li, C., and Wang, L. (2022). Accurate detection of atrial fibrillation events with RR intervals from ECG signals. PLoS ONE, 17.10.1371/journal.pone.0271596 ↗
22. Discrimination of ventricular tachycardia and localization of its exit site using surface electrocardiography
23. Physionet (2023, June 25). BXB—ANSI/AAMI-Standard Beat-by-Beat Annotation Comparator. Available online: www.physionet.org/physiotools/wag/bxb-1.htm.
24. Mahmoodabadi, S., Ahmadian, A., and Abolhasani, M. (2005, January 7–9). ECG feature extraction using Daubechies wavelets. Proceedings of the Fifth IASTED International Conference on Visualization, Imaging and Image Processing, Benidorm, Spain.
25. Mahmoodabadi, S., Ahmadian, A., Abolhasani, M., Eslami, M., and Bidgoli, J. (2006, January 17–18). ECG feature extraction based on multiresolution wavelet transform. Proceedings of the 2005 IEEE Engineering in Medicine and Biology 27th Annual Conference, Shanghai, China.10.1109/IEMBS.2005.1615314 ↗
26. (2012). Particular Requirements for the Basic Safety and Essential Performance of Ambulatory Electrocardiographic Systems (Standard No. ANSI/AAMI/IEC 60601–2-47). International Standard.
27. Marsili, I.A., Biasiolli, L., Masè, M., Adami, A., Andrighetti, A.O., Ravelli, F., and Nollo, G. (2020). Implementation and validation of real-time algorithms for atrial fibrillation detection on a wearable ECG device. Comput. Biol. Med., 116.10.1016/j.compbiomed.2019.103540 ↗
28. Doyen, M., Ge, D., Beuchée, A., Carrault, G., and Hernández, A.I. (2019). Robust, real-time generic detector based on a multi-feature probabilistic method. PLoS ONE, 14.10.1371/journal.pone.0223785 ↗
29. Optimal data fusion for the improvement of QRS complex detection in multi-channel ECG recordings10.1007/s11517-019-01990-3 ↗
30. Bachi, L., Billeci, L., and Varanini, M. (2021). QRS Detection Based on Medical Knowledge and Cascades of Moving Average Filters. Appl. Sci., 11.10.3390/app11156995 ↗
31. An R-peak detection method based on peaks of Shannon energy envelope10.1016/j.bspc.2013.01.001 ↗
32. An Adaptive And Time-Efficient ECG R-peak Detection Algorithm10.1155/2017/5980541 ↗
33. A lightweight QRS detector for single lead ECG signals using a max-min difference algorithm10.1016/j.cmpb.2017.02.028 ↗
34. An Efficient R-peak Detection Using Riesz Fractional-Order Digital Differentiator10.1007/s00034-019-01238-3 ↗
35. R-peak detection based chaos analysis of ECG signal10.1007/s10470-019-01556-1 ↗
36. R Peak Detection Method Using Wavelet Transform and Modified Shannon Energy Envelope10.1155/2017/4901017 ↗
37. A novel method for detecting R-peaks in electrocardiogram (ECG) signal10.1016/j.bspc.2011.03.004 ↗
38. A Novel Approach to ECG R-peak Detection in Electrocardiogram (ECG) Signal10.1007/s13369-018-3557-8 ↗
39. An improved method for R-peak detection by using Shannon energy envelope10.1007/s12046-016-0485-8 ↗
40. ECG beat detection using filter banks10.1109/10.740882 ↗
41. A real-time QRS detection algorithm10.1109/TBME.1985.325532 ↗
42. Varghese, V.J., and Manikandan, M.S. (2023, January 7–9). Fast R-peak detection from compressed ECG sensing measurements without reconstruction for energy-constrained cardiac health monitoring. Proceedings of the 2023 5th International Conference on Bio-engineering for Smart Technologies (BioSMART), Paris, France.
43. QRS complexes detection for ECG signal: The Difference Operation Method10.1016/j.cmpb.2008.04.006 ↗
44. An Automatic R and T Peak Detection Method Based on the Combination of Hierarchical Clustering and Discrete Wavelet transform10.1109/JBHI.2020.2973982 ↗
45. A Real-Time QRS Detection System with PR/RT Interval and ST Segment Measurements for Wearable ECG Sensors Using Parallel Delta Modulators10.1109/TBCAS.2018.2823275 ↗
46. A Level-Crossing Based QRS-Detection Algorithm for Wearable ECG Sensors10.1109/JBHI.2013.2274809 ↗
47. Elgendi, M., Mohamed, A., and Ward, R. (2017). Efficient ECG Compression and QRS Detection for E-Health Applications. Sci. Rep., 7.10.1038/s41598-017-00540-x ↗
48. Elgendi, M., Eskofier, B., Dokos, S., and Abbott, D. (2014). Revisiting QRS detection methodologies for portable, wearable, battery-operated, and wireless ECG systems. PLoS ONE, 9.10.1371/journal.pone.0084018 ↗
49. An Open-Source Toolbox for Analysing and Processing Physionet Databases in MATLAB and Octave10.5334/jors.bi ↗
50. Mondelo, V., Lado, M.J., Mendez, A.J., Vila, X.A., and Rodriguez-Linares, L. (2018, January 13–16). An evaluation tool for wave delineation in ECG processing: Wxw. Proceedings of the 2018 13th Iberian Conference on Information Systems and Technologies (CISTI), Caceres, Spain.10.23919/CISTI.2018.8399420 ↗
51. Abdullah Al, Z.M., Thapa, K., and Yang, S.-H. (2021). Improving R Peak Detection in ECG Signal using Dynamic Mode Selected Energy and Adaptive Window Sizing Algorithm with Decision Tree Algorithm. Sensors, 21.10.3390/s21196682 ↗
52. A Novel Method of QRS Detection Using Time and Amplitude Thresholds with Statistical False Peak Elimination10.1109/ACCESS.2021.3067179 ↗
53. Rahul, J., Sora, M., and Sharma, L.D. (2021). Dynamic thresholding based efficient QRS complex detection with low computational overhead. Biomed. Signal Process. Control, 67.10.1016/j.bspc.2021.102519 ↗
54. Automatic Real-Time Embedded QRS Complex Detection for a Novel Patch-Type Electrocardiogram Recorder10.1109/JTEHM.2015.2421901 ↗
55. Detection of abnormal heart conditions based on characteristics of ECG signals10.1016/j.measurement.2018.05.033 ↗
56. Denoising and R-Peak Detection of Electrocardiogram Signal Based on EMD and Improved Approximate Envelope10.1007/s00034-013-9691-3 ↗
57. Fast QRS Detection and ECG Compression Based on Signal Structural Analysis10.1109/JBHI.2018.2792404 ↗
58. An efficient new method for the detection of QRS in electrocardiogram10.1016/j.compeleceng.2013.11.004 ↗
59. Delineation of ECG characteristic features using multiresolution wavelet analysis method10.1016/j.measurement.2011.10.025 ↗
60. Empirical mode decomposition based ECG enhancement and QRS detection10.1016/j.compbiomed.2011.10.012 ↗
61. ECG Enhancement and QRS Detection Based on Sparse Derivatives10.1016/j.bspc.2013.06.005 ↗
62. Novel Real-Time Low-Complexity QRS Complex Detector Based on Adaptive Thresholding10.1109/JSEN.2015.2450773 ↗
63. An Accurate QRS Complex and P Wave Detection in ECG Signals Using Complete Ensemble Empirical Mode Decomposition with Adaptive Noise Approach10.1109/ACCESS.2019.2939943 ↗
64. Extraction of QRS fiducial points from the ECG using adaptive mathematical morphology10.1016/j.dsp.2016.06.010 ↗
65. Robust arrhythmia classification based on QRS detection and a compact 1D-CNN for wearable ECG devices10.1109/JBHI.2022.3207456 ↗
66. An efficient and robust digital fractional order differentiator based ECG pre-processor design for QRS detection10.1109/TBCAS.2019.2916676 ↗
67. Quantitative investigation of QRS detection rules using the MIT/BIH arrhythmia database10.1109/TBME.1986.325695 ↗
68. QRS detection based on multiscale mathematical morphology for wearable ECG devices in body area networks10.1109/TBCAS.2009.2020093 ↗
69. QRS detection using S-Transform and Shannon energy10.1016/j.cmpb.2014.04.008 ↗
70. Automatic detection of P, QRS and T patterns in 12 leads ECG signal based on CWT10.1016/j.bspc.2015.10.011 ↗
71. New standards for ECG equipment10.1016/j.jelectrocard.2019.07.013 ↗
72. (2012). Testing and Reporting Performance Results of Cardiac Rhythm and ST Segment Measurement Algorithms (Standard No. EC57-2012).
73. Physionet (2023, June 23). WRANN—Write a WFDB Annotation File. Available online: https://physionet.org/physiotools/wag/wrann-1.htm.
74. Moody, G.B. (2022). WFDB Applications Guide, Massachusetts Instittue of Technology. [10th ed.].
75. Physionet (2023, June 22). Comparing Annotation Files. Available online: https://www.physionet.org/physiotools/wag/evnode10.htm.
76. Physionet (2023, June 22). RXR—ANSI/AAMI-Standard Run-by-Run Annotation Comparator. Available online: https://physionet.org/physiotools/wag/rxr-1.htm.
77. Physionet (2023, June 24). MXM—ANSI/AAMI-Standard Measurement-by-Measurement Annotation Comparator. Available online: https://physionet.org/physiotools/wag/mxm-1.htm.
78. Physionet (2023, June 25). EPIC—ANSI/AAMI-Standard Episode-by-Episode Annotation Comparator. Available online: https://archive.physionet.org/physiotools/old/dbag/epic-1.htm.
79. Bernat, M., and Piotrowski, Z. (2015, January 25–27). Software tool for the analysis of components characteristic for ECG signal. Proceedings of the 2015 22nd International Conference Mixed Design of Integrated Circuits & Systems (MIXDES), Torun, Poland.10.1109/MIXDES.2015.7208490 ↗
80. Moody, G.B. (2022). WFDB Programmer’s Guide, Massachusetts Instittue of Technology. [10th ed.].
81. Zong, W., Heldt, T., Moody, G., and Mark, R. (2003, January 21–24). An open-source algorithm to detect onset of arterial blood pressure pulses. Proceedings of the Computers in Cardiology, Thessaloniki, Greece.10.1109/CIC.2003.1291140 ↗
82. Zanoli, S., Ansaloni, G., Teijeiro, T., and Atienza, D. (2023). Event-based sampled ECG morphology reconstruction through self-similarity. Comput. Methods Programs Biomed., 240.10.1016/j.cmpb.2023.107712 ↗
83. A Novel Technique for Fetal Heart Rate Estimation Based on Ensemble Learning10.5539/mas.v13n10p137 ↗
84. AlDuwaile, D.A., and Islam, M.S. (2021). Using convolutional neural network and a single heartbeat for ECG biometric recognition. Entropy, 23.10.3390/e23060733 ↗
85. Physionet (2023, June 23). SUMSTATS—Derive Aggregate Statistics from bxb, rxr, etc., Line-Format Output. Available online: https://archive.physionet.org/physiotools/wag/sumsta-1.htm.
86. McConnella, M., Schwerina, B., Soa, S., and Richardsb, B. (2020). RR-APET-Heart rate variability analysis software. Comput. Methods Programs Biomed., 185.10.1016/j.cmpb.2019.105127 ↗
87. Moody, G., Moody, B., and Silva, I. (2014, January 7–10). Robust detection of heart beats in multimodal data: The physionet/computing in cardiology challenge 2014. Proceedings of the Computing in Cardiology 2014, Cambridge, MA, USA.
88. A universal, high-performance ECG signal processing engine to reduce clinical burden10.1111/anec.12993 ↗
89. Real–Time ECG Algorithms for Ambulatory Patient Monitoring
90. QRS detection based on wavelet coefficients10.1016/j.cmpb.2011.12.004 ↗
91. Chen, A., Zhang, Y., Zhang, M., Liu, W., Chang, S., Wang, H., He, J., and Huang, Q. (2020). A real time QRS detection algorithm based on ET and PD controlled threshold strategy. Sensors, 20.10.3390/s20144003 ↗
92. Development and evaluation of multilead wavelet-based ECG delineation algorithms for embedded wireless sensor nodes10.1109/TITB.2011.2163943 ↗
93. Accurate QRS complex detection in 12-lead ECG signals using multi-lead fusion10.1016/j.measurement.2023.113776 ↗
94. Verification and comparison of MIT-BIH arrhythmia database based on number of beats
95. Physionet (2023, June 20). BXB Varargout Function. Available online: https://archive.physionet.org/physiotools/matlab/wfdb-app-matlab/html/bxb.html.