Search Results for author:
Found 15 papers, 7 papers with code
KAFA: Rethinking Image Ad Understanding with Knowledge-Augmented Feature Adaptation of Vision-Language Models
Image ad understanding is a crucial task with wide real-world applications.
Chain-of-Thought Predictive Control
We study generalizable policy learning from demonstrations for complex low-level control tasks (e. g., contact-rich object manipulations).
MetaCLUE: Towards Comprehensive Visual Metaphors Research
Towards this goal, we introduce MetaCLUE, a set of vision tasks on visual metaphor.
Improving Policy Optimization with Generalist-Specialist Learning
Generalization in deep reinforcement learning over unseen environment variations usually requires policy learning over a large set of diverse training variations.
Learning to Act with Affordance-Aware Multimodal Neural SLAM
With the proposed Affordance-aware Multimodal Neural SLAM (AMSLAM) approach, we obtain more than 40% improvement over prior published work on the ALFRED benchmark and set a new state-of-the-art generalization performance at a success rate of 23. 48% on the test unseen scenes.
TRIG: Transformer-Based Text Recognizer with Initial Embedding Guidance
We propose a 1-D split to address the challenges of complexity and replace the CNN with the transformer encoder to reduce the need for a context modeling module.
LUMINOUS: Indoor Scene Generation for Embodied AI Challenges
However, current simulators for Embodied AI (EAI) challenges only provide simulated indoor scenes with a limited number of layouts.
IFR: Iterative Fusion Based Recognizer For Low Quality Scene Text Recognition
In this paper, we propose an Iterative Fusion based Recognizer (IFR) for low quality scene text recognition, taking advantage of refined text images input and robust feature representation.
ManiSkill: Generalizable Manipulation Skill Benchmark with Large-Scale Demonstrations
Here we propose SAPIEN Manipulation Skill Benchmark (ManiSkill) to benchmark manipulation skills over diverse objects in a full-physics simulator.
Tracking Based Semi-Automatic Annotation for Scene Text Videos
Moreover, a paired low-quality scene text video dataset named Text-RBL is proposed, consisting of raw videos, blurry videos, and low-resolution videos, labeled by the proposed convenient semi-automatic labeling strategy.
Semantically Robust Unpaired Image Translation for Data with Unmatched Semantics Statistics
Many applications of unpaired image-to-image translation require the input contents to be preserved semantically during translations.
Refactoring Policy for Compositional Generalizability using Self-Supervised Object Proposals
We study how to learn a policy with compositional generalizability.
One-pixel Signature: Characterizing CNN Models for Backdoor Detection
One-pixel signature is a general representation that can be used to characterize CNN models beyond backdoor detection.
Information-Theoretic Local Minima Characterization and Regularization
Recent advances in deep learning theory have evoked the study of generalizability across different local minima of deep neural networks (DNNs).
Controllable Top-down Feature Transformer
We study the intrinsic transformation of feature maps across convolutional network layers with explicit top-down control.
