Search Results for author: Luca Beurer-Kellner

Found 6 papers, 2 papers with code

Guiding LLMs The Right Way: Fast, Non-Invasive Constrained Generation

no code implementations7 Feb 2024 Luca Beurer-Kellner, Marc Fischer, Martin Vechev

To ensure that text generated by large language models (LLMs) is in an expected format, constrained decoding proposes to enforce strict formal language constraints during generation.

Controlled Text Generation via Language Model Arithmetic

1 code implementation24 Nov 2023 Jasper Dekoninck, Marc Fischer, Luca Beurer-Kellner, Martin Vechev

In addition, the framework allows for more precise control of generated text than direct prompting and prior controlled text generation (CTG) techniques.

Language Modelling Text Generation

Prompt Sketching for Large Language Models

no code implementations8 Nov 2023 Luca Beurer-Kellner, Mark Niklas Müller, Marc Fischer, Martin Vechev

This way, sketching grants users more control over the generation process, e. g., by providing a reasoning framework via intermediate instructions, leading to better overall results.

Arithmetic Reasoning Benchmarking +2

Prompting Is Programming: A Query Language for Large Language Models

no code implementations12 Dec 2022 Luca Beurer-Kellner, Marc Fischer, Martin Vechev

We show that LMQL can capture a wide range of state-of-the-art prompting methods in an intuitive way, especially facilitating interactive flows that are challenging to implement with existing high-level APIs.

Code Generation Language Modelling +1

On Distribution Shift in Learning-based Bug Detectors

1 code implementation21 Apr 2022 Jingxuan He, Luca Beurer-Kellner, Martin Vechev

To address this key challenge, we propose to train a bug detector in two phases, first on a synthetic bug distribution to adapt the model to the bug detection domain, and then on a real bug distribution to drive the model towards the real distribution.

Contrastive Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.