Search Results for author:
Found 6 papers, 2 papers with code
COAST: Enhancing the Code Debugging Ability of LLMs through Communicative Agent Based Data Synthesis
In this paper, we introduce DEBUGEVAL, a comprehensive benchmark for evaluating the debugging abilities of LLMs by emulating the multi-stage human debugging process.
Interpretable Knowledge Tracing via Response Influence-based Counterfactual Reasoning
Knowledge tracing (KT) plays a crucial role in computer-aided education and intelligent tutoring systems, aiming to assess students' knowledge proficiency by predicting their future performance on new questions based on their past response records.
A Probabilistic Generative Model for Tracking Multi-Knowledge Concept Mastery Probability
To better model students' exercise responses, we proposed a logarithmic linear model with three interactive strategies, which models students' exercise responses by considering the relationship among students' knowledge status, knowledge concept, and problems.
AIBench Training: Balanced Industry-Standard AI Training Benchmarking
We use real-world benchmarks to cover the factors space that impacts the learning dynamics to the most considerable extent.
AIBench: An Agile Domain-specific Benchmarking Methodology and an AI Benchmark Suite
An end-to-end benchmark is a distillation of the essential attributes of an industry-scale application.
AIBench: An Industry Standard Internet Service AI Benchmark Suite
On the basis of the AIBench framework, abstracting the real-world data sets and workloads from one of the top e-commerce providers, we design and implement the first end-to-end Internet service AI benchmark, which contains the primary modules in the critical paths of an industry scale application and is scalable to deploy on different cluster scales.
