Search Results for author:
Found 15 papers, 9 papers with code
Humanoid Locomotion as Next Token Prediction
We cast real-world humanoid control as a next token prediction problem, akin to predicting the next word in language.
Reconstructing Hands in 3D with Transformers
The key to HaMeR's success lies in scaling up both the data used for training and the capacity of the deep network for hand reconstruction.
Ranked #2 on
3D Hand Pose Estimation
on HO-3D v2
Robot Learning with Sensorimotor Pre-training
We present a self-supervised sensorimotor pre-training approach for robotics.
Real-World Humanoid Locomotion with Reinforcement Learning
Humanoid robots that can autonomously operate in diverse environments have the potential to help address labour shortages in factories, assist elderly at homes, and colonize new planets.
Learning to Imitate Object Interactions from Internet Videos
In this paper we make two main contributions: (1) a novel reconstruction technique RHOV (Reconstructing Hands and Objects from Videos), which reconstructs 4D trajectories of both the hand and the object using 2D image cues and temporal smoothness constraints; (2) a system for imitating object interactions in a physics simulator with reinforcement learning.
Real-World Robot Learning with Masked Visual Pre-training
Finally, we train a 307M parameter vision transformer on a massive collection of 4. 5M images from the Internet and egocentric videos, and demonstrate clearly the benefits of scaling visual pre-training for robot learning.
Learning to Learn with Generative Models of Neural Network Checkpoints
We explore a data-driven approach for learning to optimize neural networks.
Masked Visual Pre-training for Motor Control
This paper shows that self-supervised visual pre-training from real-world images is effective for learning motor control tasks from pixels.
Ego4D: Around the World in 3,000 Hours of Egocentric Video
We introduce Ego4D, a massive-scale egocentric video dataset and benchmark suite.
Reconstructing Hand-Object Interactions in the Wild
In this work we explore reconstructing hand-object interactions in the wild.
State-Only Imitation Learning for Dexterous Manipulation
To tackle this setting, we train an inverse dynamics model and use it to predict actions for state-only demonstrations.
Designing Network Design Spaces
In this work, we present a new network design paradigm.
Ranked #1 on
Out-of-Distribution Generalization
on ImageNet-W
On Network Design Spaces for Visual Recognition
Compared to current methodologies of comparing point and curve estimates of model families, distribution estimates paint a more complete picture of the entire design landscape.
Attentive Single-Tasking of Multiple Tasks
In this work we address task interference in universal networks by considering that a network is trained on multiple tasks, but performs one task at a time, an approach we refer to as "single-tasking multiple tasks".
Data Distillation: Towards Omni-Supervised Learning
We investigate omni-supervised learning, a special regime of semi-supervised learning in which the learner exploits all available labeled data plus internet-scale sources of unlabeled data.
