Search Results for author:
Found 23 papers, 10 papers with code
Move Anything with Layered Scene Diffusion
Diffusion models generate images with an unprecedented level of quality, but how can we freely rearrange image layouts?
Hyper-VolTran: Fast and Generalizable One-Shot Image to 3D Object Structure via HyperNetworks
Solving image-to-3D from a single view is an ill-posed problem, and current neural reconstruction methods addressing it through diffusion models still rely on scene-specific optimization, constraining their generalization capability.
GenTron: Delving Deep into Diffusion Transformers for Image and Video Generation
In this study, we explore Transformer-based diffusion models for image and video generation.
FLATTEN: optical FLow-guided ATTENtion for consistent text-to-video editing
In this paper, for the first time, we introduce optical flow into the attention module in the diffusion model's U-Net to address the inconsistency issue for text-to-video editing.
Mindstorms in Natural Language-Based Societies of Mind
What should be the social structure of an NLSOM?
Boundary-Denoising for Video Activity Localization
To alleviate the boundary ambiguity, we propose to study the video activity localization problem from a denoising perspective.
Ranked #1 on
Video Grounding
on MAD
NewsNet: A Novel Dataset for Hierarchical Temporal Segmentation
Temporal video segmentation is the get-to-go automatic video analysis, which decomposes a long-form video into smaller components for the following-up understanding tasks.
Multi-Modal Few-Shot Temporal Action Detection
In this work, we introduce a new multi-modality few-shot (MMFS) TAD problem, which can be considered as a marriage of FS-TAD and ZS-TAD by leveraging few-shot support videos and new class names jointly.
Where is my Wallet? Modeling Object Proposal Sets for Egocentric Visual Query Localization
Our experiments show the proposed adaptations improve egocentric query detection, leading to a better visual query localization system in both 2D and 3D configurations.
Negative Frames Matter in Egocentric Visual Query 2D Localization
The repeated gradient computation of the same object lead to an inefficient training; (2) The false positive rate is high on background frames.
ETAD: Training Action Detection End to End on a Laptop
We propose to sequentially forward the snippet frame through the video encoder, and backward only a small necessary portion of gradients to update the encoder.
Contrastive Language-Action Pre-training for Temporal Localization
Long-form video understanding requires designing approaches that are able to temporally localize activities or language.
Contrastive Learning
Few Shot Temporal Action Localization
+3
SegTAD: Precise Temporal Action Detection via Semantic Segmentation
To address these issues and precisely model temporal action detection, we formulate the task of temporal action detection in a novel perspective of semantic segmentation.
Low-Fidelity Video Encoder Optimization for Temporal Action Localization
This results in a task discrepancy problem for the video encoder – trained for action classification, but used for TAL.
Ranked #9 on
Temporal Action Localization
on HACS
Ego4D: Around the World in 3,000 Hours of Egocentric Video
We introduce Ego4D, a massive-scale egocentric video dataset and benchmark suite.
Relation-aware Video Reading Comprehension for Temporal Language Grounding
Temporal language grounding in videos aims to localize the temporal span relevant to the given query sentence.
Low-Fidelity End-to-End Video Encoder Pre-training for Temporal Action Localization
This results in a task discrepancy problem for the video encoder -- trained for action classification, but used for TAL.
Boundary-sensitive Pre-training for Temporal Localization in Videos
However, most existing models developed for these tasks are pre-trained on general video action classification tasks.
Ranked #23 on
Temporal Action Localization
on ActivityNet-1.3
VLG-Net: Video-Language Graph Matching Network for Video Grounding
Grounding language queries in videos aims at identifying the time interval (or moment) semantically relevant to a language query.
Ranked #1 on
Natural Language Moment Retrieval
on DiDeMo
LC-NAS: Latency Constrained Neural Architecture Search for Point Cloud Networks
In this paper, we introduce a new NAS framework, dubbed LC-NAS, where we search for point cloud architectures that are constrained to a target latency.
Learning Heat Diffusion for Network Alignment
EDNA uses the diffusion signal as a proxy for computing node similarities between networks.
G-TAD: Sub-Graph Localization for Temporal Action Detection
In this work, we propose a graph convolutional network (GCN) model to adaptively incorporate multi-level semantic context into video features and cast temporal action detection as a sub-graph localization problem.
Ranked #5 on
Temporal Action Localization
on EPIC-KITCHENS-100
BAOD: Budget-Aware Object Detection
We adopt a hybrid supervised learning framework to train the object detector from both these types of annotation.
