Search Results for author: Shivang Gupta

Found 4 papers, 0 papers with code

How Can I Get It Right? Using GPT to Rephrase Incorrect Trainee Responses

no code implementations2 May 2024 Jionghao Lin, Zifei Han, Danielle R. Thomas, Ashish Gurung, Shivang Gupta, Vincent Aleven, Kenneth R. Koedinger

Our findings indicate that: 1) using a few-shot approach, the GPT-4 model effectively identifies correct/incorrect trainees' responses from three training lessons with an average F1 score of 0. 84 and an AUC score of 0. 85; and 2) using the few-shot approach, the GPT-4 model adeptly rephrases incorrect trainees' responses into desired responses, achieving performance comparable to that of human experts.

Improving Assessment of Tutoring Practices using Retrieval-Augmented Generation

no code implementations4 Feb 2024 Zifei, Han, Jionghao Lin, Ashish Gurung, Danielle R. Thomas, Eason Chen, Conrad Borchers, Shivang Gupta, Kenneth R. Koedinger

The results indicate that the RAG prompt demonstrated more accurate performance (assessed by the level of hallucination and correctness in the generated assessment texts) and lower financial costs than the other strategies evaluated.

Hallucination Math +1

Using Large Language Models to Assess Tutors' Performance in Reacting to Students Making Math Errors

no code implementations6 Jan 2024 Sanjit Kakarla, Danielle Thomas, Jionghao Lin, Shivang Gupta, Kenneth R. Koedinger

By analyzing 50 real-life tutoring dialogues, we find both GPT-3. 5-Turbo and GPT-4 demonstrate proficiency in assessing the criteria related to reacting to students making errors.

Math

Using Large Language Models to Provide Explanatory Feedback to Human Tutors

no code implementations27 Jun 2023 Jionghao Lin, Danielle R. Thomas, Feifei Han, Shivang Gupta, Wei Tan, Ngoc Dang Nguyen, Kenneth R. Koedinger

Research demonstrates learners engaging in the process of producing explanations to support their reasoning, can have a positive impact on learning.

Binary Classification Data Augmentation +4

Cannot find the paper you are looking for? You can Submit a new open access paper.