Search Results for author:
Found 8 papers, 2 papers with code
Scaling 4D Representations
Scaling has not yet been convincingly demonstrated for pure self-supervised learning from video.
Perception Test 2024: Challenge Summary and a Novel Hour-Long VideoQA Benchmark
We summarise in this report the challenge tasks and results, and introduce in detail the novel hour-long video QA benchmark 1h-walk VQA.
Moving Off-the-Grid: Scene-Grounded Video Representations
By using a combination of cross-attention and positional embeddings we disentangle the representation structure and image structure.
BootsTAP: Bootstrapped Training for Tracking-Any-Point
To endow models with greater understanding of physics and motion, it is useful to enable them to perceive how solid surfaces move and deform in real scenes.
Ranked #1 on
Point Tracking
on TAP-Vid-RGB-Stacking
Perception Test 2023: A Summary of the First Challenge And Outcome
The First Perception Test challenge was held as a half-day workshop alongside the IEEE/CVF International Conference on Computer Vision (ICCV) 2023, with the goal of benchmarking state-of-the-art video models on the recently proposed Perception Test benchmark.
Learning from One Continuous Video Stream
We introduce a framework for online learning from a single continuous video stream -- the way people and animals learn, without mini-batches, data augmentation or shuffling.
Perception Test: A Diagnostic Benchmark for Multimodal Video Models
We propose a novel multimodal video benchmark - the Perception Test - to evaluate the perception and reasoning skills of pre-trained multimodal models (e. g. Flamingo, SeViLA, or GPT-4).
Ranked #1 on
Point Tracking
on Perception Test
