Search Results for author:
Found 5 papers, 3 papers with code
DELAN: Dual-Level Alignment for Vision-and-Language Navigation by Cross-Modal Contrastive Learning
For task completion, the agent needs to align and integrate various navigation modalities, including instruction, observation and navigation history.
Android in the Zoo: Chain-of-Action-Thought for GUI Agents
To address this, this work presents Chain-of-Action-Thought (dubbed CoAT), which takes the description of the previous actions, the current screen, and more importantly the action thinking of what actions should be performed and the outcomes led by the chosen action.
ReForm-Eval: Evaluating Large Vision Language Models via Unified Re-Formulation of Task-Oriented Benchmarks
Recent years have witnessed remarkable progress in the development of large vision-language models (LVLMs).
Breaking Down the Task: A Unit-Grained Hybrid Training Framework for Vision and Language Decision Making
Vision language decision making (VLDM) is a challenging multimodal task.
Curriculum Learning for Vision-and-Language Navigation
Vision-and-Language Navigation (VLN) is a task where an agent navigates in an embodied indoor environment under human instructions.
