no code implementations • 30 Sep 2024 • Qi Wu, Zipeng Fu, Xuxin Cheng, Xiaolong Wang, Chelsea Finn
We present a system for quadrupedal mobile manipulation in indoor environments.
no code implementations • 10 Jul 2024 • Hao-Tien Lewis Chiang, Zhuo Xu, Zipeng Fu, Mithun George Jacob, Tingnan Zhang, Tsang-Wei Edward Lee, Wenhao Yu, Connor Schenck, David Rendleman, Dhruv Shah, Fei Xia, Jasmine Hsu, Jonathan Hoech, Pete Florence, Sean Kirmani, Sumeet Singh, Vikas Sindhwani, Carolina Parada, Chelsea Finn, Peng Xu, Sergey Levine, Jie Tan
The high-level policy consists of a long-context VLM that takes the demonstration tour video and the multimodal user instruction as input to find the goal frame in the tour video.
no code implementations • 15 Jun 2024 • Zipeng Fu, Qingqing Zhao, Qi Wu, Gordon Wetzstein, Chelsea Finn
This policy transfers to the real world and allows humanoid robots to follow human body and hand motion in real time using only a RGB camera, i. e. shadowing.
no code implementations • 4 Jan 2024 • Zipeng Fu, Tony Z. Zhao, Chelsea Finn
We first present Mobile ALOHA, a low-cost and whole-body teleoperation system for data collection.
no code implementations • 2 Nov 2023 • Annie S. Chen, Govind Chada, Laura Smith, Archit Sharma, Zipeng Fu, Sergey Levine, Chelsea Finn
To succeed in the real world, robots must cope with situations that differ from those seen during training.
no code implementations • 11 Sep 2023 • Ziwen Zhuang, Zipeng Fu, Jianren Wang, Christopher Atkeson, Soeren Schwertfeger, Chelsea Finn, Hang Zhao
Parkour is a grand challenge for legged locomotion that requires robots to overcome various obstacles rapidly in complex environments.
no code implementations • 18 Oct 2022 • Zipeng Fu, Xuxin Cheng, Deepak Pathak
The standard hierarchical control pipeline for such legged manipulators is to decouple the controller into that of manipulation and locomotion.
no code implementations • CVPR 2022 • Zipeng Fu, Ashish Kumar, Ananye Agarwal, Haozhi Qi, Jitendra Malik, Deepak Pathak
A safety advisor module adds sensed unexpected obstacles to the occupancy map and environment-determined speed limits to the velocity command generator.
no code implementations • 25 Oct 2021 • Zipeng Fu, Ashish Kumar, Jitendra Malik, Deepak Pathak
We demonstrate that learning to minimize energy consumption plays a key role in the emergence of natural locomotion gaits at different speeds in real quadruped robots.
no code implementations • 30 Sep 2021 • Luyao Yuan, Zipeng Fu, Linqi Zhou, Kexin Yang, Song-Chun Zhu
Currently, in the study of multiagent systems, the intentions of agents are usually ignored.
1 code implementation • 8 Jul 2021 • Ashish Kumar, Zipeng Fu, Deepak Pathak, Jitendra Malik
Successful real-world deployment of legged robots would require them to adapt in real-time to unseen scenarios like changing terrains, changing payloads, wear and tear.
1 code implementation • 21 Jan 2020 • Luyao Yuan, Zipeng Fu, Jingyue Shen, Lu Xu, Junhong Shen, Song-Chun Zhu
Pragmatics studies how context can contribute to language meanings.