Search Results for author:
Found 6 papers, 2 papers with code
MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens
The effectiveness of Multimodal Large Language Models (MLLMs) demonstrates a profound capability in multimodal understanding.
R2H: Building Multimodal Navigation Helpers that Respond to Help Requests
Intelligent navigation-helper agents are critical as they can navigate users in unknown areas through environmental awareness and conversational ability, serving as potential accessibility tools for individuals with disabilities.
ESC: Exploration with Soft Commonsense Constraints for Zero-shot Object Navigation
Such object navigation tasks usually require large-scale training in visual environments with labeled objects, which generalizes poorly to novel objects in unknown environments.
JARVIS: A Neuro-Symbolic Commonsense Reasoning Framework for Conversational Embodied Agents
Building a conversational embodied agent to execute real-life tasks has been a long-standing yet quite challenging research goal, as it requires effective human-agent communication, multi-modal understanding, long-range sequential decision making, etc.
VLMbench: A Compositional Benchmark for Vision-and-Language Manipulation
We hope the new simulator and benchmark will facilitate future research on language-guided robotic manipulation.
Manipulation-Oriented Object Perception in Clutter through Affordance Coordinate Frames
In this work, we combine the notions of affordance and category-level pose, and introduce the Affordance Coordinate Frame (ACF).
