Search Results for author:
Found 10 papers, 7 papers with code
Intention-driven Ego-to-Exo Video Generation
Finally, the inferred human movement and high-level action descriptions jointly guide the generation of exocentric motion and interaction content (i. e., corresponding optical flow and occlusion maps) in the backward process of the diffusion model, ultimately warping them into the corresponding exocentric video.
LEMON: Learning 3D Human-Object Interaction Relation from 2D Images
Which underexploit certain correlations between the interaction counterparts (human and object), and struggle to address the uncertainty in interactions.
Grounding 3D Object Affordance from 2D Interactions in Images
Comprehensive experiments on PIAD demonstrate the reliability of the proposed task and the superiority of our method.
Leverage Interactive Affinity for Affordance Learning
Perceiving potential "action possibilities" (i. e., affordance) regions of images and learning interactive functionalities of objects from human demonstration is a challenging task due to the diversity of human-object interactions.
Grounded Affordance from Exocentric View
Due to the diversity of interactive affordance, the uniqueness of different individuals leads to diverse interactions, which makes it difficult to establish an explicit link between object parts and affordance labels.
Learning Affordance Grounding from Exocentric Images
To empower an agent with such ability, this paper proposes a task of affordance grounding from exocentric view, i. e., given exocentric human-object interaction and egocentric object images, learning the affordance knowledge of the object and transferring it to the egocentric image using only the affordance label as supervision.
Phrase-Based Affordance Detection via Cyclic Bilateral Interaction
In this paper, we explore to perceive affordance from a vision-language perspective and consider the challenging phrase-based affordance detection problem, i. e., given a set of phrases describing the action purposes, all the object regions in a scene with the same affordance should be detected.
Learning Visual Affordance Grounding from Demonstration Videos
For the object branch, we introduce a semantic enhancement module (SEM) to make the network focus on different parts of the object according to the action classes and utilize a distillation loss to align the output features of the object branch with that of the video branch and transfer the knowledge in the video branch to the object branch.
Ranked #2 on
Video-to-image Affordance Grounding
on EPIC-Hotspot
One-Shot Object Affordance Detection in the Wild
To empower robots with this ability in unseen scenarios, we first study the challenging one-shot affordance detection problem in this paper, i. e., given a support image that depicts the action purpose, all objects in a scene with the common affordance should be detected.
One-Shot Affordance Detection
To empower robots with this ability in unseen scenarios, we consider the challenging one-shot affordance detection problem in this paper, i. e., given a support image that depicts the action purpose, all objects in a scene with the common affordance should be detected.
