Search Results for author:
Found 7 papers, 0 papers with code
UGIF: UI Grounded Instruction Following
We compare the performance of different LLMs including PaLM and GPT-3 and find that the end-to-end task completion rate is 48% for English UI but the performance drops to 32% for other languages.
Translating Natural Language Instructions to Computer Programs for Robot Manipulation
It is highly desirable for robots that work alongside humans to be able to understand instructions in natural language.
Spatial Reasoning from Natural Language Instructions for Robot Manipulation
Robots that can manipulate objects in unstructured environments and collaborate with humans can benefit immensely by understanding natural language.
One-Shot Object Localization Using Learnt Visual Cues via Siamese Networks
A robot that can operate in novel and unstructured environments must be capable of recognizing new, previously unseen, objects.
Multi-Instance Aware Localization for End-to-End Imitation Learning
Existing architectures for imitation learning using image-to-action policy networks perform poorly when presented with an input image containing multiple instances of the object of interest, especially when the number of expert demonstrations available for training are limited.
Stochastic Action Prediction for Imitation Learning
Imitation learning is a data-driven approach to acquiring skills that relies on expert demonstrations to learn a policy that maps observations to actions.
Teaching Robots Novel Objects by Pointing at Them
Robots that must operate in novel environments and collaborate with humans must be capable of acquiring new knowledge from human experts during operation.
