Search Results for author:
Found 12 papers, 5 papers with code
Benchmarking the Robustness of Temporal Action Detection Models Against Temporal Corruptions
In this paper, we extensively analyze the robustness of seven leading TAD methods and obtain some interesting findings: 1) Existing methods are particularly vulnerable to temporal corruptions, and end-to-end methods are often more susceptible than those with a pre-trained feature extractor; 2) Vulnerability mainly comes from localization error rather than classification error; 3) When corruptions occur in the middle of an action instance, TAD models tend to yield the largest performance drop.
DCIR: Dynamic Consistency Intrinsic Reward for Multi-Agent Reinforcement Learning
In this paper, we propose a new approach that enables agents to learn whether their behaviors should be consistent with that of other agents by utilizing intrinsic rewards to learn the optimal policy for each agent.
Multi-agent Reinforcement Learning
reinforcement-learning
+2
$A^2$Nav: Action-Aware Zero-Shot Robot Navigation by Exploiting Vision-and-Language Ability of Foundation Models
We study the task of zero-shot vision-and-language navigation (ZS-VLN), a practical yet challenging problem in which an agent learns to navigate following a path described by language instructions without requiring any path-instruction annotation data.
Weakly-Supervised Multi-Granularity Map Learning for Vision-and-Language Navigation
To achieve accurate and efficient navigation, it is critical to build a map that accurately represents both spatial location and the semantic information of the environment objects.
Graph Convolutional Module for Temporal Action Localization in Videos
To this end, we propose a general graph convolutional module (GCM) that can be easily plugged into existing action localization methods, including two-stage and one-stage paradigms.
Ranked #2 on
Temporal Action Localization
on THUMOS’14
(mAP IOU@0.1 metric)
Modular Graph Attention Network for Complex Visual Relational Reasoning
Moreover, to capture the complex logic in a query, we construct a relational graph to represent the visual objects and their relationships, and propose a multi-step reasoning method to progressively understand the complex logic.
Ranked #2 on
Referring Expression Comprehension
on CLEVR-Ref+
RSPNet: Relative Speed Perception for Unsupervised Video Representation Learning
We study unsupervised video representation learning that seeks to learn both motion and appearance features from unlabeled video only, which can be reused for downstream tasks such as action recognition.
Ranked #11 on
Self-Supervised Action Recognition
on UCF101
Location-aware Graph Convolutional Networks for Video Question Answering
In this work, we propose to represent the contents in the video as a location-aware graph by incorporating the location information of an object into the graph construction.
Dense Regression Network for Video Grounding
The key idea of this paper is to use the distances between the frame within the ground truth and the starting (ending) frame as dense supervisions to improve the video grounding accuracy.
Natural Language Moment Retrieval
Natural Language Queries
+2
A Thorough Comparison Study on Adversarial Attacks and Defenses for Common Thorax Disease Classification in Chest X-rays
In this paper, we aim to review various adversarial attack and defense methods on chest X-rays.
Graph Convolutional Networks for Temporal Action Localization
Then we apply the GCNs over the graph to model the relations among different proposals and learn powerful representations for the action classification and localization.
Ranked #4 on
Temporal Action Localization
on THUMOS’14
(mAP IOU@0.1 metric)
Continual Reinforcement Learning with Diversity Exploration and Adversarial Self-Correction
We first develop an unsupervised diversity exploration method to learn task-specific skills using an unsupervised objective.
