Search Results for author:
Found 7 papers, 4 papers with code
Etalon: Holistic Performance Evaluation Framework for LLM Inference Systems
However, these metrics fail to fully capture the nuances of LLM inference, leading to an incomplete assessment of user-facing performance crucial for real-time applications such as chat and translation.
Class-Level Code Generation from Natural Language Using Iterative, Tool-Enhanced Reasoning over Repository
To address this gap, we introduce RepoClassBench, a comprehensive benchmark designed to rigorously evaluate LLMs in generating complex, class-level code within real-world repositories.
Towards Effective Paraphrasing for Information Disguise
Information Disguise (ID), a part of computational ethics in Natural Language Processing (NLP), is concerned with best practices of textual paraphrasing to prevent the non-consensual use of authors' posts on the Internet.
AI-TA: Towards an Intelligent Question-Answer Teaching Assistant using Open-Source LLMs
Responding to the thousands of student questions on online QA platforms each semester has a considerable human cost, particularly in computing courses with rapidly growing enrollments.
CST5: Data Augmentation for Code-Switched Semantic Parsing
To aid further research in this area, we are also releasing (a) Hinglish-TOP, the largest human annotated code-switched semantic parsing dataset to date, containing 10k human annotated Hindi-English (Hinglish) code-switched utterances, and (b) Over 170K CST5 generated code-switched utterances from the TOPv2 dataset.
Learning to Automate Follow-up Question Generation using Process Knowledge for Depression Triage on Reddit Posts
We demonstrate the challenge of using existing datasets to train a DLM for generating FQs that adhere to clinical process knowledge.
Diagnosing Data from ICTs to Provide Focused Assistance in Agricultural Adoptions
Our classifier achieves accuracies ranging from 79% to 90% across the five states, demonstrating its potential for assisting future ethnographic investigations.
