Syntactic and Semantic Control of Large Language Models via Sequential Monte Carlo

no code implementations • 17 Apr 2025 • João Loula, Benjamin LeBrun, Li Du, Ben Lipkin, Clemente Pasti, Gabriel Grand, Tianyu Liu, Yahya Emara, Marjorie Freedman, Jason Eisner, Ryan Cotterell, Vikash Mansinghka, Alexander K. Lew, Tim Vieira, Timothy J. O'Donnell

A wide range of LM applications require generating text that conforms to syntactic or semantic constraints.

Code Generation Probabilistic Programming +1