Search Results for author:
Found 14 papers, 12 papers with code
Cross the Gap: Exposing the Intra-modal Misalignment in CLIP via Modality Inversion
In this paper, we show that the common practice of individually exploiting the text or image encoders of these powerful multi-modal models is highly suboptimal for intra-modal tasks like image-to-image retrieval.
Improving Zero-shot Generalization of Learned Prompts via Unsupervised Knowledge Distillation
Our approach, which we call Knowledge Distillation Prompt Learning (KDPL), can be integrated into existing prompt learning techniques and eliminates the need for labeled examples during adaptation.
iSEARLE: Improving Textual Inversion for Zero-Shot Composed Image Retrieval
Given a query consisting of a reference image and a relative caption, Composed Image Retrieval (CIR) aims to retrieve target images visually similar to the reference one while incorporating the changes specified in the relative caption.
Multimodal-Conditioned Latent Diffusion Models for Fashion Image Editing
Fashion illustration is a crucial medium for designers to convey their creative vision and transform design concepts into tangible representations that showcase the interplay between clothing and the human body.
Mapping Memes to Words for Multimodal Hateful Meme Classification
Multimodal image-text memes are prevalent on the internet, serving as a unique form of communication that combines visual and textual elements to convey humor, ideas, or emotions.
Ranked #3 on
Hateful Meme Classification
on HarMeme
Exploiting CLIP-based Multi-modal Approach for Artwork Classification and Retrieval
Given the recent advances in multimodal image pretraining where visual models trained with semantically dense textual supervision tend to have better generalization capabilities than those trained using categorical attributes or through unsupervised techniques, in this work we investigate how recent CLIP model can be applied in several tasks in artwork domain.
OpenFashionCLIP: Vision-and-Language Contrastive Learning with Open-Source Fashion Data
The inexorable growth of online shopping and e-commerce demands scalable and robust machine learning-based solutions to accommodate customer requirements.
Composed Image Retrieval using Contrastive Learning and Task-oriented CLIP-based Features
Given a query composed of a reference image and a relative caption, the Composed Image Retrieval goal is to retrieve images visually similar to the reference one that integrates the modifications expressed by the caption.
Ranked #9 on
Image Retrieval
on Fashion IQ
ECO: Ensembling Context Optimization for Vision-Language Models
Among these, the CLIP model has shown remarkable capabilities for zero-shot transfer by matching an image and a custom textual prompt in its latent space.
LaDI-VTON: Latent Diffusion Textual-Inversion Enhanced Virtual Try-On
In this context, image-based virtual try-on, which consists in generating a novel image of a target model wearing a given in-shop garment, has yet to capitalize on the potential of these powerful generative solutions.
Multimodal Garment Designer: Human-Centric Latent Diffusion Models for Fashion Image Editing
Given the lack of existing datasets suitable for the task, we also extend two existing fashion datasets, namely Dress Code and VITON-HD, with multimodal annotations collected in a semi-automatic manner.
Zero-Shot Composed Image Retrieval with Textual Inversion
Composed Image Retrieval (CIR) aims to retrieve a target image based on a query composed of a reference image and a relative caption that describes the difference between the two images.
Conditioned and Composed Image Retrieval Combining and Partially Fine-Tuning CLIP-Based Features
The proposed method is based on an initial training stage where a simple combination of visual and textual features is used, to fine-tune the CLIP text encoder.
Ranked #3 on
Image Retrieval
on LaSCo
Composed Image Retrieval (CoIR)
Content-Based Image Retrieval
+2
Effective Conditioned and Composed Image Retrieval Combining CLIP-Based Features
the visual content of the query image.
Ranked #15 on
Image Retrieval
on CIRR
