no code implementations • 18 Jan 2024 • Saibo Geng, Berkay Döner, Chris Wendler, Martin Josifoski, Robert West
This paper introduces sketch-guided constrained decoding (SGCD), a novel approach to constrained decoding for blackbox LLMs, which operates without access to the logits of the blackbox LLM.