Search Results for author:
Found 20 papers, 12 papers with code
Cost-Sensitive Learning for Long-Tailed Temporal Action Segmentation
In temporal action segmentation approaches, we identified a bi-level learning bias.
Context-Enhanced Memory-Refined Transformer for Online Action Detection
The past is encoded using short- and long-term memories to capture immediate and long-range dependencies, while anticipation compensates for missing future context.
Long-Tail Temporal Action Segmentation with Group-wise Temporal Logit Adjustment
However, state-of-the-art temporal action segmentation methods overlook the long tail and fail to recognize tail actions.
X-MIC: Cross-Modal Instance Conditioning for Egocentric Action Generalization
Lately, there has been growing interest in adapting vision-language models (VLMs) to image and third-person video classification due to their success in zero-shot recognition.
DiffH2O: Diffusion-Based Synthesis of Hand-Object Interactions from Textual Descriptions
For the textual guidance, we contribute comprehensive text descriptions to the GRAB dataset and show that they enable our method to have more fine-grained control over hand-object interactions.
On the Utility of 3D Hand Poses for Action Recognition
3D hand pose is an underexplored modality for action recognition.
Ranked #1 on
Action Recognition
on H2O (2 Hands and Objects)
Opening the Vocabulary of Egocentric Actions
Given a set of verbs and objects observed during training, the goal is to generalize the verbs to an open vocabulary of actions with seen and novel objects.
Ranked #1 on
Open Vocabulary Action Recognition
on Assembly101
(using extra training data)
Every Mistake Counts in Assembly
Our framework constructs a knowledge base with spatial and temporal beliefs based on observed mistakes.
AssemblyHands: Towards Egocentric Activity Understanding via 3D Hand Pose Estimation
To obtain high-quality 3D hand pose annotations for the egocentric images, we develop an efficient pipeline, where we use an initial set of manual annotations to train a model to automatically annotate a much larger dataset.
Temporal Action Segmentation: An Analysis of Modern Techniques
Temporal action segmentation (TAS) in videos aims at densely identifying video frames in minutes-long videos with multiple action classes.
Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activities
Assembly101 is a new procedural activity dataset featuring 4321 videos of people assembling and disassembling 101 "take-apart" toy vehicles.
Technical Report: Temporal Aggregate Representations
At what temporal scale should they be derived?
Ranked #5 on
Action Anticipation
on EPIC-KITCHENS-100 (test)
Transferring Knowledge from Text to Video: Zero-Shot Anticipation for Procedural Actions
Can we teach a robot to recognize and make predictions for activities that it has never seen before?
Transformed ROIs for Capturing Visual Transformations in Videos
Modeling the visual changes that an action brings to a scene is critical for video understanding.
Temporal Aggregate Representations for Long-Range Video Understanding
Future prediction, especially in long-range videos, requires reasoning from current and past observations.
Ranked #2 on
Action Anticipation
on Assembly101
Unsupervised learning of action classes with continuous temporal embedding
The task of temporally detecting and segmenting actions in untrimmed videos has seen an increased attention recently.
Ranked #3 on
Unsupervised Action Segmentation
on IKEA ASM
Learning Style Compatibility for Furniture
When judging style, a key question that often arises is whether or not a pair of objects are compatible with each other.
Zero-Shot Anticipation for Instructional Activities
How can we teach a robot to predict what will happen next for an activity it has never seen before?
Unsupervised Learning and Segmentation of Complex Activities from Video
This paper presents a new method for unsupervised segmentation of complex activities from video into multiple steps, or sub-activities, without any textual input.
DRAW: Deep networks for Recognizing styles of Artists Who illustrate children's books
The style was noticeable in other characters of the same illustrator in different books as well.
