Search Results for author: Shibal Ibrahim

Found 5 papers, 2 papers with code

End-to-end Feature Selection Approach for Learning Skinny Trees

no code implementations28 Oct 2023 Shibal Ibrahim, Kayhan Behdin, Rahul Mazumder

Skinny Trees lead to superior feature selection than many existing toolkits e. g., in terms of AUC performance for $25\%$ feature budget, Skinny Trees outperforms LightGBM by $10. 2\%$ (up to $37. 7\%$), and Random Forests by $3\%$ (up to $12. 5\%$).

Ensemble Learning Feature Compression +2

COMET: Learning Cardinality Constrained Mixture of Experts with Trees and Local Search

1 code implementation5 Jun 2023 Shibal Ibrahim, Wenyu Chen, Hussein Hazimeh, Natalia Ponomareva, Zhe Zhao, Rahul Mazumder

To deal with this challenge, we propose a novel, permutation-based local search method that can complement first-order methods in training any sparse gate, e. g., Hash routing, Top-k, DSelect-k, and COMET.

Language Modelling Recommendation Systems

Flexible Modeling and Multitask Learning using Differentiable Tree Ensembles

no code implementations19 May 2022 Shibal Ibrahim, Hussein Hazimeh, Rahul Mazumder

We therefore propose a novel tensor-based formulation of differentiable trees that allows for efficient vectorization on GPUs.

Multi-Task Learning

Newer is not always better: Rethinking transferability metrics, their peculiarities, stability and performance

no code implementations13 Oct 2021 Shibal Ibrahim, Natalia Ponomareva, Rahul Mazumder

In this paper, we show that the statistical problems with covariance estimation drive the poor performance of H-score -- a common baseline for newer metrics -- and propose shrinkage-based estimator.

Dimensionality Reduction Domain Adaptation

Cannot find the paper you are looking for? You can Submit a new open access paper.