Automating Human Tutor-Style Programming Feedback: Leveraging GPT-4 Tutor Model for Hint Generation and GPT-3.5 Student Model for Hint Validation

2 code implementations • 5 Oct 2023 • Tung Phung, Victor-Alexandru Pădurean, Anjali Singh, Christopher Brooks, José Cambronero, Sumit Gulwani, Adish Singla, Gustavo Soares

We investigate the role of generative AI models in providing human tutor-style programming hints to help students resolve errors in their buggy programs.

Generative AI for Programming Education: Benchmarking ChatGPT, GPT-4, and Human Tutors

no code implementations • 29 Jun 2023 • Tung Phung, Victor-Alexandru Pădurean, José Cambronero, Sumit Gulwani, Tobias Kohn, Rupak Majumdar, Adish Singla, Gustavo Soares

In our work, we systematically evaluate two models, ChatGPT (based on GPT-3. 5) and GPT-4, and compare their performance with human tutors for a variety of scenarios.

Benchmarking

Generating High-Precision Feedback for Programming Syntax Errors using Large Language Models

1 code implementation • 24 Jan 2023 • Tung Phung, José Cambronero, Sumit Gulwani, Tobias Kohn, Rupak Majumdar, Adish Singla, Gustavo Soares

We investigate using LLMs to generate feedback for fixing syntax errors in Python programs, a key scenario in introductory programming.