1 code implementation • 31 Oct 2024 • Keivan Rezaei, Khyathi Chandu, Soheil Feizi, Yejin Choi, Faeze Brahman, Abhilasha Ravichander
Large language models trained on web-scale corpora can memorize undesirable datapoints such as incorrect facts, copyrighted content or sensitive data.
1 code implementation • 12 Jun 2024 • Arman Zarei, Keivan Rezaei, Samyadeep Basu, Mehrdad Saberi, Mazda Moayeri, Priyatham Kattakinda, Soheil Feizi
We also show that re-weighting the erroneous attention contributions in CLIP can also lead to improved compositional performances, however these improvements are often less significant than those achieved by solely learning a linear projection head, highlighting erroneous attentions to be only a minor error source.
no code implementations • 12 Jun 2024 • Mohammadtaghi Hajiaghayi, Sébastien Lahaie, Keivan Rezaei, Suho Shin
In the field of computational advertising, the integration of ads into the outputs of large language models (LLMs) presents an opportunity to support these services without compromising content integrity.
1 code implementation • 2 May 2024 • Samyadeep Basu, Keivan Rezaei, Priyatham Kattakinda, Ryan Rossi, Cherry Zhao, Vlad Morariu, Varun Manjunatha, Soheil Feizi
To address this issue, we introduce the concept of Mechanistic Localization in text-to-image models, where knowledge about various visual attributes (e. g., "style", "objects", "facts") can be mechanistically localized to a small fraction of layers in the UNet, thus facilitating efficient model editing.
no code implementations • 11 Nov 2023 • Soheil Feizi, Mohammadtaghi Hajiaghayi, Keivan Rezaei, Suho Shin
This paper explores the potential for leveraging Large Language Models (LLM) in the realm of online advertising systems.
no code implementations • 7 Oct 2023 • Mohammadtaghi Hajiaghayi, Mohammad Mahdavi, Keivan Rezaei, Suho Shin
To mitigate this behavior, the principal announces an eligible set which screens out a certain set of solutions.
no code implementations • 29 Sep 2023 • Keivan Rezaei, Mehrdad Saberi, Mazda Moayeri, Soheil Feizi
To improve on these shortcomings, we propose a novel approach that prioritizes interpretability in this problem: we start by obtaining human-understandable concepts (tags) of images in the dataset and then analyze the model's behavior based on the presence or absence of combinations of these tags.
1 code implementation • 29 Sep 2023 • Mehrdad Saberi, Vinu Sankar Sadasivan, Keivan Rezaei, Aounon Kumar, Atoosa Chegini, Wenxiao Wang, Soheil Feizi
Moreover, we show that watermarking methods are vulnerable to spoofing attacks where the attacker aims to have real images identified as watermarked ones, damaging the reputation of the developers.
1 code implementation • 10 May 2023 • Mazda Moayeri, Keivan Rezaei, Maziar Sanjabi, Soheil Feizi
We observe that the mapping between an image's representation in one model to its representation in another can be learned surprisingly well with just a linear layer, even across diverse models.
2 code implementations • 5 Feb 2023 • Keivan Rezaei, Kiarash Banihashem, Atoosa Chegini, Soheil Feizi
Based on this approach, we propose DPA+ROE and FA+ROE defense methods based on Deep Partition Aggregation (DPA) and Finite Aggregation (FA) approaches from prior work.