Search Results for author: Alycia Lee

Found 3 papers, 0 papers with code

Beyond Scale: the Diversity Coefficient as a Data Quality Metric Demonstrates LLMs are Pre-trained on Formally Diverse Data

no code implementations24 Jun 2023 Alycia Lee, Brando Miranda, Sudharsan Sundar, Sanmi Koyejo

Current trends to pre-train capable Large Language Models (LLMs) mostly focus on scaling of model and dataset size.

Batched Stochastic Bayesian Optimization via Combinatorial Constraints Design

no code implementations17 Apr 2019 Kevin K. Yang, Yuxin Chen, Alycia Lee, Yisong Yue

Importantly, we show that our objective function can be efficiently decomposed as a difference of submodular functions (DS), which allows us to employ DS optimization tools to greedily identify sets of constraints that increase the likelihood of finding items with high utility.

Bayesian Optimization Experimental Design

Cannot find the paper you are looking for? You can Submit a new open access paper.