no code implementations • 28 Oct 2023 • Shibal Ibrahim, Kayhan Behdin, Rahul Mazumder
Skinny Trees lead to superior feature selection than many existing toolkits e. g., in terms of AUC performance for $25\%$ feature budget, Skinny Trees outperforms LightGBM by $10. 2\%$ (up to $37. 7\%$), and Random Forests by $3\%$ (up to $12. 5\%$).
1 code implementation • 5 Jun 2023 • Shibal Ibrahim, Wenyu Chen, Hussein Hazimeh, Natalia Ponomareva, Zhe Zhao, Rahul Mazumder
To deal with this challenge, we propose a novel, permutation-based local search method that can complement first-order methods in training any sparse gate, e. g., Hash routing, Top-k, DSelect-k, and COMET.
no code implementations • 19 May 2022 • Shibal Ibrahim, Hussein Hazimeh, Rahul Mazumder
We therefore propose a novel tensor-based formulation of differentiable trees that allows for efficient vectorization on GPUs.
no code implementations • 13 Oct 2021 • Shibal Ibrahim, Natalia Ponomareva, Rahul Mazumder
In this paper, we show that the statistical problems with covariance estimation drive the poor performance of H-score -- a common baseline for newer metrics -- and propose shrinkage-based estimator.
1 code implementation • 24 Aug 2021 • Shibal Ibrahim, Peter Radchenko, Emanuel Ben-David, Rahul Mazumder
We discuss and interpret findings from our model on the US Census Planning Database.