Impact of ECG Dataset Diversity on Generalization of CNN Model for Detecting QRS Complex

IEEE Access 2019  ยท  Ahsan Habib, Chandan Karmakar, John Yearwood ยท

Detection of QRS complexes in electrocardiogram (ECG) signal is crucial for automated cardiac diagnosis. Automated QRS detection has been a research topic for over three decades and several of the traditional QRS detection methods show acceptable detection accuracy, however, the applicability of these methods beyond their study-specific databases was not explored. The non-stationary nature of ECG and signal variance of intra and inter-patient recordings impose significant challenges on single QRS detectors to achieve reasonable performance. In real life, a promising QRS detector may be expected to achieve acceptable accuracy over diverse ECG recordings and, thus, investigation of the model's generalization capability is crucial. This paper investigates the generalization capability of convolutional neural network (CNN) based-models from intra (subject wise leave-one-out and five-fold cross validation) and inter-database (training with single and multiple databases) points-of-view over three publicly available ECG databases, namely MIT-BIH Arrhythmia, INCART, and QT. Leave-one-out test accuracy reports 99.22%, 97.13%, and 96.25% for these databases accordingly and inter-database tests report more than 90% accuracy with the single exception of INCART. The performance variation reveals the fact that a CNN model's generalization capability does not increase simply by adding more training samples, rather the inclusion of samples from a diverse range of subjects is necessary for reasonable QRS detection accuracy.

PDF Abstract

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Uses Extra
Training Data
Benchmark
QRS Complex Detection INCART CNN (LOSO, Intra-Db) Accuracy 97.85% # 1
QRS Complex Detection INCART CNN (MIT-BIH) Accuracy 91.65% # 2
QRS Complex Detection INCART CNN (MIT-BIH + QT) Accuracy 90.54% # 3
QRS Complex Detection INCART CNN (QT) Accuracy 86.3% # 4
QRS Complex Detection MIT-BIH AR CNN (QT) Accuracy 96.6% # 5
F1-score - # 1
QRS Complex Detection MIT-BIH AR CNN (INCART) Accuracy 97.49% # 4
F1-score - # 1
QRS Complex Detection MIT-BIH AR CNN (INCART + QT) Accuracy 97.5% # 3
F1-score - # 1
QRS Complex Detection MIT-BIH AR CNN (LOSO, Intra-Db) Accuracy 99.60% # 1
F1-score - # 1
QRS Complex Detection QT CNN (MIT-BIH) Accuracy 96.6% # 2
QRS Complex Detection QT CNN (MIT-BIH+INCART) Accuracy 94.48% # 3
QRS Complex Detection QT CNN (LOSO, Intra-Db) Accuracy 97.42% # 1
QRS Complex Detection QT CNN (INCART) Accuracy 94.39% # 4

Methods


No methods listed for this paper. Add relevant methods here