Syntactic and Semantic Control of Large Language Models via Sequential Monte Carlo

no code implementations • 17 Apr 2025 • João Loula, Benjamin LeBrun, Li Du, Ben Lipkin, Clemente Pasti, Gabriel Grand, Tianyu Liu, Yahya Emara, Marjorie Freedman, Jason Eisner, Ryan Cotterell, Vikash Mansinghka, Alexander K. Lew, Tim Vieira, Timothy J. O'Donnell

A wide range of LM applications require generating text that conforms to syntactic or semantic constraints.

Code Generation Probabilistic Programming +1

Models Can and Should Embrace the Communicative Nature of Human-Generated Math

no code implementations • 25 Sep 2024 • Sasha Boguraev, Ben Lipkin, Leonie Weissweiler, Kyle Mahowald

Math is constructed by people for people: just as natural language corpora reflect not just propositions but the communicative goals of language users, the math data that models are trained on reflects not just idealized mathematical entities but rich communicative intentions.

Math