Subsampling Bias and The Best-Discrepancy Systematic Cross Validation

no code implementations • 4 Jul 2019 • Liang Guo, Jianya Liu, Ruodan Lu

Experiments with 156 benchmark datasets and three classifiers (logistic regression, decision tree and naive bayes) show that in general, our cross-validation procedure can extrude subsampling bias in the MCCV by lowering the EPE around 7. 18% and the variances around 26. 73%.

BIG-bench Machine Learning