Search Results for author:
Found 9 papers, 1 papers with code
Vid2Robot: End-to-end Video-conditioned Policy Learning with Cross-Attention Transformers
Given a video demonstration of a manipulation task and current visual observations, Vid2Robot directly produces robot actions.
FlexCap: Generating Rich, Localized, and Flexible Captions in Images
The model, FlexCap, is trained to produce length-conditioned captions for input bounding boxes, and this allows control over the information density of its output, with descriptions ranging from concise object labels to detailed captions.
Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysis
Motivated by the impressive open-set performance and content generation capabilities of web-scale, large-capacity pre-trained models (i. e., foundation models) in research fields such as Natural Language Processing (NLP) and Computer Vision (CV), we devote this survey to exploring (i) how these existing foundation models from NLP and CV can be applied to the field of robotics, and also exploring (ii) what a robotics-specific foundation model would look like.
MAEA: Multimodal Attribution for Embodied AI
Understanding multimodal perception for embodied AI is an open question because such inputs may contain highly complementary as well as redundant information for the task.
HomeRobot: Open-Vocabulary Mobile Manipulation
HomeRobot (noun): An affordable compliant robot that navigates homes and manipulates a wide range of objects in order to complete everyday tasks.
Spatial-Language Attention Policies for Efficient Robot Learning
We see a 4x improvement over baseline in mobile manipulation setting.
Transformers are Adaptable Task Planners
Every home is different, and every person likes things done in their particular way.
Learning Embeddings that Capture Spatial Semantics for Indoor Navigation
We know that humans can search for an object like a book, or a plate in an unseen house, based on the spatial semantics of bigger objects detected.
Predicting Human Strategies in Simulated Search and Rescue Task
In our efforts to model the rescuer's mind, we begin with a simple simulated search and rescue task in Minecraft with human participants.
