Search Results for author:
Found 14 papers, 5 papers with code
Semi-Supervised Image Captioning by Adversarially Propagating Labeled Data
We present a novel data-efficient semi-supervised framework to improve the generalization of image captioning models.
Self-Supervised Real-time Video Stabilization
Videos are a popular media form, where online video streaming has recently gathered much popularity.
Single-Modal Entropy based Active Learning for Visual Question Answering
In this work, we address Active Learning in the multi-modal setting of Visual Question Answering (VQA).
ACP++: Action Co-occurrence Priors for Human-Object Interaction Detection
A common problem in the task of human-object interaction (HOI) detection is that numerous HOI classes have only a small number of labeled examples, resulting in training sets with a long-tailed distribution.
Ranked #41 on
Human-Object Interaction Detection
on HICO-DET
Dealing with Missing Modalities in the Visual Question Answer-Difference Prediction Task through Knowledge Distillation
In this work, we address the issues of missing modalities that have arisen from the Visual Question Answer-Difference prediction task and find a novel method to solve the task at hand.
Dense Relational Image Captioning via Multi-task Triple-Stream Networks
To this end, we propose the multi-task triple-stream network (MTTSNet) which consists of three recurrent units responsible for each POS which is trained by jointly predicting the correct captions and POS for each word.
Detecting Human-Object Interactions with Action Co-occurrence Priors
A common problem in human-object interaction (HOI) detection task is that numerous HOI classes have only a small number of labeled examples, resulting in training sets with a long-tailed distribution.
Image Captioning with Very Scarce Supervised Data: Adversarial Semi-Supervised Learning Approach
To this end, our proposed semi-supervised learning method assigns pseudo-labels to unpaired samples via Generative Adversarial Networks to learn the joint distribution of image and caption.
Deep Iterative Frame Interpolation for Full-frame Video Stabilization
We present a novel deep approach to video stabilization which can generate video frames without cropping and low distortion.
Dense Relational Captioning: Triple-Stream Networks for Relationship-Based Captioning
Our goal in this work is to train an image captioning model that generates more dense and informative captions.
Disjoint Multi-task Learning between Heterogeneous Human-centric Tasks
Human behavior understanding is arguably one of the most important mid-level components in artificial intelligence.
Contextually Customized Video Summaries via Natural Language
Despite the challenging baselines, our method still manages to show comparable or even exceeding performance.
Video-Story Composition via Plot Analysis
Inspired by plot analysis of written stories, our method generates a sequence of video clips ordered in such a way that it reflects plot dynamics and content coherency.
Human Attention Estimation for Natural Images: An Automatic Gaze Refinement Approach
Photo collections and its applications today attempt to reflect user interactions in various forms.
