Search Results for author: Vamshi Krishna Bonagiri

Found 4 papers, 2 papers with code

COBIAS: Contextual Reliability in Bias Assessment

1 code implementation22 Feb 2024 Priyanshul Govil, Vamshi Krishna Bonagiri, Manas Gaur, Ponnurangam Kumaraguru, Sanorita Dey

Our contribution is twofold: (i) we create a dataset of 2287 stereotyped statements augmented with points for adding context; (ii) we develop the Context-Oriented Bias Indicator and Assessment Score (COBIAS) to assess statements' contextual reliability in measuring bias.

SaGE: Evaluating Moral Consistency in Large Language Models

1 code implementation21 Feb 2024 Vamshi Krishna Bonagiri, Sreeram Vennam, Priyanshul Govil, Ponnurangam Kumaraguru, Manas Gaur

To this extent, we construct the Moral Consistency Corpus (MCC), containing 50K moral questions, responses to them by LLMs, and the RoTs that these models followed.

Decision Making Moral Scenarios

Measuring Moral Inconsistencies in Large Language Models

no code implementations26 Jan 2024 Vamshi Krishna Bonagiri, Sreeram Vennam, Manas Gaur, Ponnurangam Kumaraguru

To address this issue, we propose a novel information-theoretic measure called Semantic Graph Entropy (SGE) to measure the consistency of an LLM in moral scenarios.

Decision Making Language Modelling +2

Cannot find the paper you are looking for? You can Submit a new open access paper.