no code implementations • 15 Oct 2023 • Haoxian Chen, Henry Lam
Its key idea is to use a surrogate model to approximate the objective and, importantly, quantify the associated uncertainty that allows a sequential search of query points that balance exploitation-exploration.
1 code implementation • ICLR 2022 • Krzysztof Choromanski, Haoxian Chen, Han Lin, Yuanzhe Ma, Arijit Sehanobish, Deepali Jain, Michael S Ryoo, Jake Varley, Andy Zeng, Valerii Likhosherstov, Dmitry Kalashnikov, Vikas Sindhwani, Adrian Weller
We propose a new class of random feature methods for linearizing softmax and Gaussian kernels called hybrid random features (HRFs) that automatically adapt the quality of kernel estimation to provide most accurate approximation in the defined regions of interest.
1 code implementation • 16 Jul 2021 • Krzysztof Choromanski, Han Lin, Haoxian Chen, Tianyi Zhang, Arijit Sehanobish, Valerii Likhosherstov, Jack Parker-Holder, Tamas Sarlos, Adrian Weller, Thomas Weingarten
In this paper we provide, to the best of our knowledge, the first comprehensive approach for incorporating various masking mechanisms into Transformers architectures in a scalable way.
no code implementations • 27 May 2021 • Yuanlu Bai, Tucker Balch, Haoxian Chen, Danial Dervovic, Henry Lam, Svitlana Vyetrenko
Stochastic simulation aims to compute output performance for complex models that lack analytical tractability.
no code implementations • 26 Feb 2021 • Haoxian Chen, Ziyi Huang, Henry Lam, Huajie Qian, Haofeng Zhang
We study the generation of prediction intervals in regression for uncertainty quantification.
no code implementations • 22 Feb 2021 • Behnaz Arzani, Kevin Hsieh, Haoxian Chen
Automated machine learning (AutoML) systems aim to enable training machine learning (ML) models for non-ML experts.
no code implementations • NeurIPS 2020 • Han Lin, Haoxian Chen, Tianyi Zhang, Clement Laroche, Krzysztof Choromanski
Orthogonal Monte Carlo (OMC) is a very effective sampling algorithm imposing structural geometric conditions (orthogonality) on samples for variance reduction.