Search Results for author: Liyi Zhang

Found 3 papers, 2 papers with code

Deep de Finetti: Recovering Topic Distributions from Large Language Models

no code implementations21 Dec 2023 Liyi Zhang, R. Thomas McCoy, Theodore R. Sumers, Jian-Qiao Zhu, Thomas L. Griffiths

Large language models (LLMs) can produce long, coherent passages of text, suggesting that LLMs, although trained on next-word prediction, must represent the latent structure that characterizes a document.

Bayesian Inference

Transport Score Climbing: Variational Inference Using Forward KL and Adaptive Neural Transport

1 code implementation3 Feb 2022 Liyi Zhang, David M. Blei, Christian A. Naesseth

Variational inference often minimizes the "reverse" Kullbeck-Leibler (KL) KL(q||p) from the approximate distribution q to the posterior p. Recent work studies the "forward" KL KL(p||q), which unlike reverse KL does not lead to variational approximations that underestimate uncertainty.

Variational Inference

Variational Combinatorial Sequential Monte Carlo Methods for Bayesian Phylogenetic Inference

1 code implementation31 May 2021 Antonio Khalil Moretti, Liyi Zhang, Christian A. Naesseth, Hadiah Venner, David Blei, Itsik Pe'er

Bayesian phylogenetic inference is often conducted via local or sequential search over topologies and branch lengths using algorithms such as random-walk Markov chain Monte Carlo (MCMC) or Combinatorial Sequential Monte Carlo (CSMC).

Cannot find the paper you are looking for? You can Submit a new open access paper.