1 code implementation • 29 Dec 2024 • Ranim Khojah, Francisco Gomes de Oliveira Neto, Mazen Mohamad, Philipp Leitner
In this study, we introduce CodePromptEval, a dataset of 7072 prompts designed to evaluate five prompt techniques (few-shot, persona, chain-of-thought, function signature, list of packages) and their effect on the correctness, similarity, and quality of complete functions generated by three LLMs (GPT-4o, Llama3, and Mistral).
no code implementations • 21 May 2024 • Ranim Khojah, Francisco Gomes de Oliveira Neto, Philipp Leitner
We compile existing conversation attributes with humans and NLU-based chatbots and adapt them to the context of software development.
no code implementations • 23 Apr 2024 • Ranim Khojah, Mazen Mohamad, Philipp Leitner, Francisco Gomes de Oliveira Neto
Large Language Models (LLMs) are frequently discussed in academia and the general public as support tools for virtually any use case that relies on the production of text, including software engineering.
no code implementations • 26 Oct 2021 • Afonso Fontes, Gregory Gay, Francisco Gomes de Oliveira Neto, Robert Feldt
To illustrate how AI can support unit testing, this chapter introduces the concept of search-based unit test generation.