Search Results for author:
Found 10 papers, 3 papers with code
TIP: Text-Driven Image Processing with Semantic and Restoration Instructions
Text-driven diffusion models have become increasingly popular for various image editing tasks, including inpainting, stylization, and object replacement.
VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretraining
Our results show that our pretrained aesthetic vision-language model outperforms prior works on image aesthetic captioning over the AVA-Captions dataset, and it has powerful zero-shot capability for aesthetic tasks such as zero-shot style classification and zero-shot IAA, surpassing many supervised baselines.
Ranked #46 on
Video Quality Assessment
on MSU SR-QA Dataset
Weakly-Supervised Action Detection Guided by Audio Narration
We explored how to eliminate the expensive annotations in video detection data which provide refined boundaries.
Linguistic Structures as Weak Supervision for Visual Scene Graph Generation
Prior work in scene graph generation requires categorical supervision at the level of triplets - subjects and objects, and predicates that relate them, either with or without bounding box information.
SpotPatch: Parameter-Efficient Transfer Learning for Mobile Object Detection
In this paper we address the question: can task-specific detectors be trained and represented as a shared set of weights, plus a very small set of additional weights for each task?
Cap2Det: Learning to Amplify Weak Caption Supervision for Object Detection
Learning to localize and name object instances is a fundamental problem in vision, but state-of-the-art approaches rely on expensive bounding box supervision.
Learning to discover and localize visual objects with open vocabulary
To alleviate the cost of obtaining accurate bounding boxes for training today's state-of-the-art object detection models, recent weakly supervised detection work has proposed techniques to learn from image-level labels.
Story Understanding in Video Advertisements
We dedicate our study to understand the dynamic structure of video ads automatically.
ADVISE: Symbolism and External Knowledge for Decoding Advertisements
In order to convey the most content in their limited space, advertisements embed references to outside knowledge via symbolism.
Automatic Understanding of Image and Video Advertisements
There is more to images than their objective physical content: for example, advertisements are created to persuade a viewer to take a certain action.
