no code implementations • 5 Mar 2024 • Son The Nguyen, Niranjan Uma Naresh, Theja Tulabandhula
This paper addresses the challenges of aligning large language models (LLMs) with human values via preference learning (PL), with a focus on the issues of incomplete and corrupted data in preference datasets.
no code implementations • 22 Oct 2022 • Niranjan Uma Naresh, Ziyan Jiang, Ankit, Sungjin Lee, Jie Hao, Xing Fan, Chenlei Guo
Conversational understanding is an integral part of modern intelligent devices.
no code implementations • 29 Jan 2022 • Minjia Zhang, Niranjan Uma Naresh, Yuxiong He
In recent years, large pre-trained Transformer-based language models have led to dramatic improvements in many natural language understanding tasks.
no code implementations • 29 Sep 2021 • Minjia Zhang, Niranjan Uma Naresh, Yuxiong He
To address this challenge, we propose ScaLA, a scalable and robust method for large-batch optimization of transformer networks via adversarial perturbation.