Search Results for author:
Found 9 papers, 2 papers with code
Enhancing End-to-End Multi-Task Dialogue Systems: A Study on Intrinsic Motivation Reinforcement Learning Algorithms for Improved Training and Adaptability
This policy is trained by reinforcement learning algorithms by taking advantage of an environment in which an agent receives feedback in the form of a reward signal.
Text-to-Sticker: Style Tailoring Latent Diffusion Models for Human Expression
Evaluation results show our method improves visual quality by 14%, prompt alignment by 16. 2% and scene diversity by 15. 3%, compared to prompt engineering the base Emu model for stickers generation.
EgoVLPv2: Egocentric Video-Language Pre-training with Fusion in the Backbone
Video-language pre-training (VLP) has become increasingly important due to its ability to generalize to various vision and language tasks.
End-to-End Neural Network Compression via $\frac{\ell_1}{\ell_2}$ Regularized Latency Surrogates
Our algorithm is versatile and can be used with many popular compression methods including pruning, low-rank factorization, and quantization.
DIME-FM: DIstilling Multimodal and Efficient Foundation Models
We transfer the knowledge from the pre-trained CLIP-ViTL/14 model to a ViT-B/32 model, with only 40M public images and 28. 4M unpaired public sentences.
DIME-FM : DIstilling Multimodal and Efficient Foundation Models
In this paper, we introduce a new distillation mechanism (DIME-FM) that allows us to transfer the knowledge contained in large VLFMs to smaller, customized foundation models using a relatively small amount of inexpensive, unpaired images and sentences.
Tell Your Story: Task-Oriented Dialogs for Interactive Content Creation
We collect a new dataset C3 (Conversational Content Creation), comprising 10k dialogs conditioned on media montages simulated from a large media collection.
Fighting FIRe with FIRE: Assessing the Validity of Text-to-Video Retrieval Benchmarks
Searching troves of videos with textual descriptions is a core multimodal retrieval task.
VoLTA: Vision-Language Transformer with Weakly-Supervised Local-Feature Alignment
Extensive experiments on a wide range of vision- and vision-language downstream tasks demonstrate the effectiveness of VoLTA on fine-grained applications without compromising the coarse-grained downstream performance, often outperforming methods using significantly more caption and box annotations.
