no code implementations • 31 Aug 2024 • Hossein Khalili, Seongbin Park, Vincent Li, Brandan Bright, Ali Payani, Ramana Rao Kompella, Nader Sehatbakhsh
Our results show that LightPure can outperform existing methods by up to 10x in terms of latency while achieving higher accuracy and robustness for various attack scenarios.
no code implementations • 27 Jul 2024 • Yifan Yang, Ali Payani, Parinaz Naghizadeh
Personalized Federated Learning (FL) algorithms collaboratively train customized models for each client, enhancing the accuracy of the learned models on the client's local data (e. g., by clustering similar clients, or by fine-tuning models locally).
1 code implementation • 19 Jun 2024 • Yuan Yang, Siheng Xiong, Ali Payani, Ehsan Shareghi, Faramarz Fekri
To investigate this, we introduce the task of reasoning in the wild, where an LLM is tasked to solve a reasoning problem of unknown type by identifying the subproblems and their corresponding formalisms, and writing a program to solve each subproblem, guided by a tactic.
1 code implementation • 30 May 2024 • Yuchi Liu, Jaskirat Singh, Gaowen Liu, Ali Payani, Liang Zheng
Specifically, we include a hierarchy of LLMs, first constructing a prompt with precise instructions and accurate wording in a hierarchical manner, and then using this prompt to generate the final answer to the user query.
no code implementations • 29 May 2024 • Qin Yang, Meisam Mohammad, Han Wang, Ali Payani, Ashish Kundu, Kai Shu, Yan Yan, Yuan Hong
To address such limitations, we propose a novel Language Model-based Optimal Differential Privacy (LMO-DP) mechanism, which takes the first step to enable the tight composition of accurately fine-tuning (large) language models with a sub-optimal DP mechanism, even in strong privacy regimes (e. g., $0. 1\leq \epsilon<3$).
no code implementations • 28 May 2024 • Renzhi Wu, Pramod Chunduri, Dristi J Shah, Ashmitha Julius Aravind, Ali Payani, Xu Chu, Joy Arulraj, Kexin Rong
In this paper, we will present SketchQL, a video database management system (VDBMS) for retrieving video moments with a sketch-based query interface.
no code implementations • 17 Apr 2024 • Zihao Li, Yucheng Shi, Zirui Liu, Fan Yang, Ali Payani, Ninghao Liu, Mengnan Du
Besides, the experiments show that there is a strong correlation between the LLM's performance in different languages and the proportion of those languages in its pre-training corpus.
no code implementations • 14 Apr 2024 • Yifan Yang, Ali Payani, Parinaz Naghizadeh
We then use this CDF error bound to provide a bound on the generalization error guarantees of a classifier trained on such non-IID data.
1 code implementation • 6 Apr 2024 • Bin Lei, Yi Zhang, Shan Zuo, Ali Payani, Caiwen Ding
Firstly, their effectiveness in tackling complex mathematical problems is somewhat constrained.
Ranked #1 on Math Word Problem Solving on MATH
no code implementations • 26 Mar 2024 • Gustav A. Baumgart, Jaemin Shin, Ali Payani, Myungjin Lee, Ramana Rao Kompella
(3) However, algorithms such as FedDyn and SCAFFOLD are more prone to catastrophic failures without the support of additional techniques such as gradient clipping.
1 code implementation • 18 Mar 2024 • Siddharth Joshi, Arnav Jain, Ali Payani, Baharan Mirzasoleiman
We show that subsets that closely preserve the cross-covariance of the images and captions of the full data provably achieve a superior generalization performance.
no code implementations • 6 Mar 2024 • Hao Xue, Tianye Tang, Ali Payani, Flora D. Salim
Specifically, the framework includes a prompt generation stage based on the information entropy of prompts and a prompt refinement stage to integrate mechanisms such as the chain of thought.
1 code implementation • 16 Feb 2024 • Ziru Chen, Michael White, Raymond Mooney, Ali Payani, Yu Su, Huan Sun
In this paper, we examine how large language models (LLMs) solve multi-step problems under a language agent framework with three components: a generator, a discriminator, and a planning method.
1 code implementation • 12 Jan 2024 • Siheng Xiong, Ali Payani, Ramana Kompella, Faramarz Fekri
Instead of reasoning over the original context, we adopt a latent representation, temporal graph (TG) that enhances the learning of TR.
1 code implementation • 25 Dec 2023 • Siheng Xiong, Yuan Yang, Ali Payani, James C Kerce, Faramarz Fekri
We first convert TKGs into a temporal event knowledge graph (TEKG) which has a more explicit representation of time in term of nodes of the graph.
no code implementations • 16 Nov 2023 • Josh Andle, Ali Payani, Salimeh Yasaei-Sekeh
Through this lens we demonstrate how task complexity and similarity influence the optimal weight sharing decisions, giving insights into the relationships between tasks and helping inform decision making in similar CL methods.
no code implementations • 15 Nov 2023 • Yueqing Liang, Lu Cheng, Ali Payani, Kai Shu
This work investigates the potential of undermining both fairness and detection performance in abusive language detection.
1 code implementation • 24 May 2023 • Yuan Yang, Siheng Xiong, Ali Payani, Ehsan Shareghi, Faramarz Fekri
Translating natural language sentences to first-order logic (NL-FOL translation) is a longstanding challenge in the NLP and formal logic literature.
no code implementations • 23 May 2023 • Yihao Xue, Ali Payani, Yu Yang, Baharan Mirzasoleiman
Pretrained machine learning models need to be adapted to distribution shifts when deployed in new target environments.
1 code implementation • 22 May 2023 • Ziru Chen, Shijie Chen, Michael White, Raymond Mooney, Ali Payani, Jayanth Srinivasa, Yu Su, Huan Sun
Thus, we propose a novel representation for SQL queries and their edits that adheres more closely to the pre-training corpora of language models of code.
no code implementations • 17 May 2023 • Ganghua Wang, Ali Payani, Myungjin Lee, Ramana Kompella
While many mitigation strategies have been proposed in centralized learning, many of these methods are not directly applicable in federated learning, where data is privately stored on multiple clients.
no code implementations • 18 Jul 2022 • Canyu Chen, Yueqing Liang, Xiongxiao Xu, Shangyu Xie, Ashish Kundu, Ali Payani, Yuan Hong, Kai Shu
Thus, it is essential to ensure fairness in machine learning models.
1 code implementation • 9 Jun 2022 • Yuan Yang, Siheng Xiong, Ali Payani, James C Kerce, Faramarz Fekri
Inductive logic reasoning is a fundamental task in graph analysis, which aims to generalize patterns from data.
no code implementations • 8 Nov 2021 • Muralikrishnna G. Sethuraman, Ali Payani, Faramarz Fekri, J. Clayton Kerce
To achieve this, we take a symbolic reasoning based approach using the framework of formal logic.
no code implementations • 23 Mar 2020 • Ali Payani, Faramarz Fekri
Most importantly, it allows for incorporating expert knowledge into the learning, and hence leading to much faster learning and better generalization compared to the standard deep reinforcement learning.
1 code implementation • 8 Jun 2019 • Ali Payani, Faramarz Fekri
In particular, we show that our proposed method outperforms the state of the art ILP solvers in classification tasks for Mutagenesis, Cora and IMDB datasets.
no code implementations • 2 Apr 2019 • Ali Payani, Faramarz Fekri
In particular, we propose a new framework for learning the inductive logic programming (ILP) problems by exploiting the explicit representational power of NLN.